2024-02-14T12:48:10.925 INFO:root:teuthology version: 0.0.1.dev258+g9e44c16 2024-02-14T12:48:10.925 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} --name vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/orig.config.yaml 2024-02-14T12:48:10.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T12:48:11.071 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595 branch: wip-vshankar-testing-20240206.051942 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} email: vshankar@redhat.com first_in_suite: false job_id: '7559595' kernel: client: sha1: distro flavor: default kdb: true sha1: 8d59ab0bd93c806231018a6729893bf309624262 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240206.051942 ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 install: ceph: flavor: default sha1: a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240206.051942 sha1: a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 962 sha1: a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 sleep_before_teardown: 0 subset: 960/1024 suite: fs suite_branch: wip-vshankar-testing-20240206.051942 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1OiEGnKLohZkUg9gPcrlx0X2idlZtkQ6t2atbDftVjZz2Xh3Fv2qi4gD0v3X1Sd2tD6J8Ht6dZCsmxSS1mNuY= smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIV/b+GCqPCSI/bvwUWvnbyHMeGEscQ9tEeRtn0JuUNHF72cho0WTr/yx3xmUJmgG3iLldTluHIDLj72+FZ6hvI= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8qlwUb18sMiRFQ0xcJYqMizXcmfZtGEgPg5j5hBW2eHLJFJFRhcsmrKUDkBbCK2RzIL58v5f23zDRiBTlPLB4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9e44c16382dfc4c612f7437cbb344c76223137cc timestamp: 2024-02-14_05:24:17 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-14T12:48:11.071 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/qa; will attempt to use it 2024-02-14T12:48:11.072 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/qa/tasks 2024-02-14T12:48:11.072 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-14T12:48:11.073 INFO:teuthology.task.internal:Checking packages... 2024-02-14T12:48:11.097 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0' 2024-02-14T12:48:11.097 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-14T12:48:11.097 INFO:teuthology.packaging:ref: None 2024-02-14T12:48:11.097 INFO:teuthology.packaging:tag: None 2024-02-14T12:48:11.097 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240206.051942 2024-02-14T12:48:11.097 INFO:teuthology.packaging:sha1: a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:48:11.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240206.051942 2024-02-14T12:48:11.243 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1280.ga6fe3fa3 2024-02-14T12:48:11.245 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-14T12:48:11.258 INFO:teuthology.task.internal:no buildpackages task found 2024-02-14T12:48:11.258 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-14T12:48:11.278 INFO:teuthology.task.internal:Saving configuration 2024-02-14T12:48:11.298 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-14T12:48:11.304 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-14T12:48:11.329 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-14 12:42:52.142736', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1OiEGnKLohZkUg9gPcrlx0X2idlZtkQ6t2atbDftVjZz2Xh3Fv2qi4gD0v3X1Sd2tD6J8Ht6dZCsmxSS1mNuY='} 2024-02-14T12:48:11.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-14 12:42:52.143990', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIV/b+GCqPCSI/bvwUWvnbyHMeGEscQ9tEeRtn0JuUNHF72cho0WTr/yx3xmUJmgG3iLldTluHIDLj72+FZ6hvI='} 2024-02-14T12:48:11.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-14 12:42:52.141229', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8qlwUb18sMiRFQ0xcJYqMizXcmfZtGEgPg5j5hBW2eHLJFJFRhcsmrKUDkBbCK2RzIL58v5f23zDRiBTlPLB4='} 2024-02-14T12:48:11.377 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-14T12:48:11.383 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-02-14T12:48:11.384 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-02-14T12:48:11.384 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-02-14T12:48:11.384 INFO:teuthology.run_tasks:Running task console_log... 2024-02-14T12:48:11.490 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5a5bcfa160>, signals=[15]) 2024-02-14T12:48:11.491 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-14T12:48:11.497 INFO:teuthology.task.internal:Opening connections... 2024-02-14T12:48:11.497 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T12:48:11.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:11.608 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-02-14T12:48:11.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:11.714 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-02-14T12:48:11.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:48:11.802 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-14T12:48:11.808 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-02-14T12:48:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-02-14T12:48:11.828 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:11.887 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-02-14T12:48:11.907 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-02-14T12:48:11.925 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-02-14T12:48:11.925 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-02-14T12:48:11.983 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-02-14T12:48:11.983 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-02-14T12:48:11.983 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-02-14T12:48:11.983 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:11.983 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-02-14T12:48:11.983 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:11.984 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:11.984 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-02-14T12:48:12.007 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-02-14T12:48:12.024 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-02-14T12:48:12.025 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-14T12:48:12.081 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-02-14T12:48:12.081 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-02-14T12:48:12.081 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T12:48:12.082 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T12:48:12.083 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-14T12:48:12.107 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-14T12:48:12.117 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-14T12:48:12.126 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-14T12:48:12.126 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-02-14T12:48:12.128 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-02-14T12:48:12.131 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-02-14T12:48:12.147 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-14T12:48:12.153 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-14T12:48:12.153 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-02-14T12:48:12.186 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-02-14T12:48:12.189 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-02-14T12:48:12.214 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-14T12:48:12.293 INFO:teuthology.run_tasks:Running task kernel... 2024-02-14T12:48:12.307 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8d59ab0bd93c806231018a6729893bf309624262'} 2024-02-14T12:48:12.307 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-02-14T12:48:12.307 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-02-14T12:48:12.308 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-14T12:48:12.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T12:48:12.325 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-02-14T12:48:12.383 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-361.el9.x86_64 2024-02-14T12:48:12.384 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-361.el9.x86_64 2024-02-14T12:48:12.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-02-14T12:48:15.021 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 6.8 MB/s | 6.7 MB 00:00 2024-02-14T12:48:16.787 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2024-02-14T12:48:29.409 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 667 kB/s | 8.0 MB 00:12 2024-02-14T12:48:32.876 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 19 MB 00:02 2024-02-14T12:48:40.742 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.1 MB 00:04 2024-02-14T12:48:43.334 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2024-02-14T12:48:47.252 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 20 MB 00:03 2024-02-14T12:48:52.268 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-14T12:48:54.642 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-14T12:48:54.642 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-14T12:48:54.731 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-02-14T12:48:54.740 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-02-14T12:48:54.740 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-419.el9 CentOS-BaseOS 6.0 M 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-419.el9 CentOS-BaseOS 21 M 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-419.el9 CentOS-BaseOS 39 M 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-419.el9 CentOS-BaseOS 33 M 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2024-02-14T12:48:54.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:48:54.742 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 99 M 2024-02-14T12:48:54.742 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 122 M 2024-02-14T12:48:54.742 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-02-14T12:48:55.519 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-419.el9.x86_64.rpm 7.7 MB/s | 6.0 MB 00:00 2024-02-14T12:48:56.486 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-419.el9.x86_64.rpm 12 MB/s | 21 MB 00:01 2024-02-14T12:48:57.486 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-core-5.14.0-419.el9.x86_6 17 MB/s | 33 MB 00:01 2024-02-14T12:48:57.836 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-5.14.0-419.el9.x86_64.rpm 13 MB/s | 39 MB 00:03 2024-02-14T12:48:57.839 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-02-14T12:48:57.840 INFO:teuthology.orchestra.run.smithi012.stdout:Total 32 MB/s | 99 MB 00:03 2024-02-14T12:48:57.840 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-02-14T12:48:58.321 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-02-14T12:48:58.322 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-02-14T12:48:59.366 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-02-14T12:48:59.366 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-02-14T12:49:01.911 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-02-14T12:49:02.598 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-419.el9.x86_64 1/4 2024-02-14T12:49:02.736 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-14T12:49:05.637 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-14T12:49:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-14T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-14T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-419.el9.x86_64 4/4 2024-02-14T12:49:16.075 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-14T12:49:46.739 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-419.el9.x86_64 4/4 2024-02-14T12:49:46.739 INFO:teuthology.orchestra.run.smithi012.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-14T12:49:46.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:49:46.812 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-419.el9.x86_64 4/4 2024-02-14T12:49:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-419.el9.x86_64 4/4 2024-02-14T12:49:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-419.el9.x86_64 1/4 2024-02-14T12:49:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-419.el9.x86_64 2/4 2024-02-14T12:49:47.232 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-419.el9.x86_64 3/4 2024-02-14T12:49:47.667 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-419.el9.x86_64 4/4 2024-02-14T12:49:47.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:49:47.667 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-02-14T12:49:47.667 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-419.el9.x86_64 2024-02-14T12:49:47.668 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-419.el9.x86_64 2024-02-14T12:49:47.668 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-419.el9.x86_64 2024-02-14T12:49:47.668 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-419.el9.x86_64 2024-02-14T12:49:47.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:49:47.668 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-02-14T12:49:48.199 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-02-14T12:49:48.338 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-14T12:49:48.338 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-14T12:49:48.338 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-419.el9.x86_64 2024-02-14T12:49:48.339 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-14T12:49:48.339 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-14T12:49:48.339 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-02-14T12:49:48.339 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-02-14T12:49:48.339 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-02-14T12:49:48.452 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-419.el9.x86_64 2024-02-14T12:49:48.452 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-419.el9.x86_64 2024-02-14T12:49:48.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-02-14T12:49:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-02-14T12:49:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-02-14T12:49:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-02-14T12:49:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 68.el9 2024-02-14T12:49:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-02-14T12:49:48.495 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8264254 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:49:48.496 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-14T12:49:48.497 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-14T12:49:48.497 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-14T12:49:48.497 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-02-14T12:49:48.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:49:48.497 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-02-14T12:49:48.498 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-14T12:49:48.498 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-419.el9.x86_64 2024-02-14T12:49:48.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-14T12:49:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-02-14T12:49:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-14T12:49:50.495 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-02-14T12:49:50.497 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-02-14T12:49:50.512 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.ONZ5iIEPsW 2024-02-14T12:49:50.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ONZ5iIEPsW 2024-02-14T12:49:50.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.ONZ5iIEPsW 2024-02-14T12:49:50.735 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.ONZ5iIEPsW is 6KB 2024-02-14T12:49:50.784 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.ONZ5iIEPsW 2024-02-14T12:49:50.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-02-14T12:49:50.868 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-14T12:49:50.868 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-14T12:49:50.868 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-14T12:49:50.868 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64.conf 2024-02-14T12:49:50.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-419.el9.x86_64 2024-02-14T12:49:51.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-02-14T12:50:21.021 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-14T12:50:21.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-14T12:50:21.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:50:39.548 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-14T12:50:48.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-14T12:50:48.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:51:06.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-02-14T12:51:18.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-14T12:51:18.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:51:19.330 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-02-14T12:51:19.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-14T12:51:19.974 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-419.el9.x86_64"... 2024-02-14T12:51:19.975 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-02-14T12:51:19.988 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-419.el9.x86_64 2024-02-14T12:51:19.988 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-419.el9.x86_64 vs 5.14.0-419.el9.x86_64 2024-02-14T12:51:19.988 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-14T12:51:19.989 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-14T12:51:20.992 DEBUG:teuthology.parallel:result is None 2024-02-14T12:51:20.992 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-14T12:51:21.000 INFO:teuthology.task.internal:Creating test directory... 2024-02-14T12:51:21.000 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-14T12:51:21.003 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-14T12:51:21.005 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-14T12:51:21.024 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-14T12:51:21.031 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-14T12:51:21.038 INFO:teuthology.task.internal:Creating archive directory... 2024-02-14T12:51:21.038 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-14T12:51:21.058 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-14T12:51:21.064 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-14T12:51:21.157 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-14T12:51:21.163 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-14T12:51:21.164 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-14T12:51:21.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T12:51:21.181 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-14T12:51:21.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T12:51:21.198 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-14T12:51:21.200 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-14T12:51:21.224 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-14T12:51:21.261 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-14T12:51:21.269 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-14T12:51:21.284 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-14T12:51:21.303 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-14T12:51:21.324 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-14T12:51:21.327 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-14T12:51:21.329 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-14T12:51:21.339 INFO:teuthology.task.internal:Configuring sudo... 2024-02-14T12:51:21.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-14T12:51:21.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-14T12:51:21.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-14T12:51:21.374 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-14T12:51:21.384 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-14T12:51:21.384 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-14T12:51:21.409 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-14T12:51:21.417 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-14T12:51:21.432 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-14T12:51:21.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-14T12:51:21.555 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-14T12:51:21.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-14T12:51:21.680 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:51:21.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-14T12:51:21.747 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-14T12:51:21.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-14T12:51:21.847 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-14T12:51:21.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-14T12:51:21.981 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T12:51:21.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-14T12:51:22.054 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-14T12:51:22.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-14T12:51:22.156 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-14T12:51:22.236 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-14T12:51:22.284 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T12:51:22.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-14T12:51:22.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-02-14T12:51:22.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-02-14T12:51:22.359 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-02-14T12:51:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-14T12:51:22.426 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-14T12:51:22.434 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-14T12:51:22.841 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-14T12:51:22.849 INFO:teuthology.task.internal:Starting timer... 2024-02-14T12:51:22.849 INFO:teuthology.run_tasks:Running task pcp... 2024-02-14T12:51:22.872 INFO:teuthology.run_tasks:Running task selinux... 2024-02-14T12:51:22.880 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-14T12:51:22.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-02-14T12:51:22.941 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-02-14T12:51:22.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2024-02-14T12:51:23.000 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2024-02-14T12:51:23.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-02-14T12:51:23.056 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-02-14T12:51:23.058 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-14T12:51:23.058 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-02-14T12:51:23.073 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-02-14T12:51:23.073 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2024-02-14T12:51:23.102 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2024-02-14T12:51:23.102 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-02-14T12:51:23.129 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-02-14T12:51:23.130 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi055.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi103.front.sepia.ceph.com': 'permissive'} 2024-02-14T12:51:23.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-14T12:51:23.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T12:51:23.158 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-14T12:51:23.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T12:51:23.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-14T12:51:23.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T12:51:23.219 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-14T12:51:23.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-02-14T12:51:23.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2024-02-14T12:51:23.338 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-02-14T12:51:23.372 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-14T12:51:23.386 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-14T12:51:23.393 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-14T12:51:23.549 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-14T12:51:23.571 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-14T12:51:23.573 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi055.front.sepia.ceph.com,smithi103.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-14T12:56:01.098 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com')] 2024-02-14T12:56:01.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-14T12:56:01.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:56:01.199 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-02-14T12:56:01.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-02-14T12:56:01.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-02-14T12:56:01.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:56:01.381 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-02-14T12:56:01.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-02-14T12:56:01.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-14T12:56:01.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T12:56:01.546 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-02-14T12:56:01.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-14T12:56:01.619 INFO:teuthology.run_tasks:Running task clock... 2024-02-14T12:56:01.629 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-14T12:56:01.629 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-14T12:56:01.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-14T12:56:01.632 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-14T12:56:01.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-14T12:56:01.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-14T12:56:01.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-14T12:56:01.665 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-14T12:56:01.669 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-14T12:56:01.683 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-14T12:56:01.690 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-14T12:56:01.690 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-14T12:56:01.707 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-14T12:56:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-02-14T12:56:01.726 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2024-02-14T12:56:01.728 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-02-14T12:56:01.737 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-02-14T12:56:01.743 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2024-02-14T12:56:01.745 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-14T12:56:01.750 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-02-14T12:56:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-14T12:56:01.763 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-14T12:56:01.767 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-14T12:56:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-14T12:56:01.783 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-14T12:56:01.812 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-02-14T12:56:01.815 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-14T12:56:01.815 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-02-14T12:56:01.816 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.816 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.816 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.816 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.827 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-02-14T12:56:01.830 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-14T12:56:01.830 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-02-14T12:56:01.830 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.830 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.830 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.830 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.831 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-02-14T12:56:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-14T12:56:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-02-14T12:56:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.834 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T12:56:01.835 INFO:teuthology.run_tasks:Running task install... 2024-02-14T12:56:01.843 DEBUG:teuthology.task.install:project ceph 2024-02-14T12:56:01.843 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0'}} 2024-02-14T12:56:01.843 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0'} 2024-02-14T12:56:01.843 INFO:teuthology.task.install:Using flavor: default 2024-02-14T12:56:01.851 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-14T12:56:01.851 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-14T12:56:01.851 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0', 'tag': None, 'wait_for_package': False} 2024-02-14T12:56:01.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:56:01.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0', 'tag': None, 'wait_for_package': False} 2024-02-14T12:56:01.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:56:01.855 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0', 'tag': None, 'wait_for_package': False} 2024-02-14T12:56:01.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:56:02.000 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/ 2024-02-14T12:56:02.000 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1280.ga6fe3fa3 2024-02-14T12:56:02.004 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/ 2024-02-14T12:56:02.004 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1280.ga6fe3fa3 2024-02-14T12:56:02.071 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/ 2024-02-14T12:56:02.071 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1280.ga6fe3fa3 2024-02-14T12:56:02.107 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-14T12:56:02.107 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:56:02.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-14T12:56:02.135 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-14T12:56:02.135 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-14T12:56:02.171 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-14T12:56:02.171 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T12:56:02.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-14T12:56:02.180 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-14T12:56:02.181 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T12:56:02.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-14T12:56:02.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-14T12:56:02.204 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-14T12:56:02.204 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-14T12:56:02.208 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-14T12:56:02.209 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-14T12:56:02.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-14T12:56:02.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-14T12:56:02.281 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-14T12:56:02.346 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-02-14T12:56:02.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-02-14T12:56:02.357 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-14T12:56:02.363 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-14T12:56:02.392 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2024-02-14T12:56:02.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2024-02-14T12:56:02.424 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-02-14T12:56:02.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-02-14T12:56:02.594 INFO:teuthology.orchestra.run.smithi012.stdout:74 files removed 2024-02-14T12:56:02.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-14T12:56:02.639 INFO:teuthology.orchestra.run.smithi055.stdout:74 files removed 2024-02-14T12:56:02.660 INFO:teuthology.orchestra.run.smithi103.stdout:74 files removed 2024-02-14T12:56:02.667 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-14T12:56:02.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-14T12:56:03.261 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 253 kB/s | 80 kB 00:00 2024-02-14T12:56:03.327 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 228 kB/s | 80 kB 00:00 2024-02-14T12:56:03.440 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 172 kB/s | 80 kB 00:00 2024-02-14T12:56:03.694 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-02-14T12:56:03.695 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-02-14T12:56:03.815 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 30 kB/s | 10 kB 00:00 2024-02-14T12:56:04.104 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-02-14T12:56:04.104 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-02-14T12:56:04.216 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-02-14T12:56:04.685 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-02-14T12:56:04.698 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-02-14T12:56:04.881 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 9.1 MB/s | 6.7 MB 00:00 2024-02-14T12:56:06.148 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-02-14T12:56:06.152 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-02-14T12:56:06.323 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2024-02-14T12:56:07.441 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-02-14T12:56:08.547 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.0 MB 00:02 2024-02-14T12:56:08.960 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.0 MB 00:02 2024-02-14T12:56:11.873 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 19 MB 00:02 2024-02-14T12:56:12.187 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 19 MB 00:02 2024-02-14T12:56:14.339 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 19 MB 00:05 2024-02-14T12:56:15.932 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-02-14T12:56:16.598 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.1 MB 00:00 2024-02-14T12:56:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2024-02-14T12:56:18.164 INFO:teuthology.orchestra.run.smithi055.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2024-02-14T12:56:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.1 MB 00:00 2024-02-14T12:56:18.945 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-14T12:56:19.675 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2024-02-14T12:56:20.265 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2024-02-14T12:56:21.661 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2024-02-14T12:56:23.785 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-02-14T12:56:24.706 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-02-14T12:56:26.357 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-14T12:56:26.358 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-14T12:56:26.373 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-14T12:56:26.374 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-14T12:56:26.375 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-14T12:56:26.377 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-14T12:56:26.379 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-14T12:56:26.381 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-14T12:56:26.383 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-14T12:56:26.464 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-02-14T12:56:26.487 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================================ 2024-02-14T12:56:26.487 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-02-14T12:56:26.487 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================================ 2024-02-14T12:56:26.487 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-02-14T12:56:26.487 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-14T12:56:26.487 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 6.6 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 5.1 M 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 886 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 145 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 1.5 M 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 138 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 1.8 M 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 7.4 M 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 52 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 9.7 M 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 47 M 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 263 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 748 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 217 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 27 k 2024-02-14T12:56:26.488 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 18 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 31 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 743 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 127 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 161 k 2024-02-14T12:56:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 321 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 297 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 99 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 85 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.1 M 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 171 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-14T12:56:26.490 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.4 M 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.1 M 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-14T12:56:26.491 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 20 M 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 28 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 2.1 M 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 247 k 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 4.7 M 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 17 M 2024-02-14T12:56:26.492 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 15 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 25 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 163 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-14T12:56:26.493 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 499 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 5.1 M 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-14T12:56:26.494 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 45 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 131 k 2024-02-14T12:56:26.495 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-14T12:56:26.496 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-14T12:56:26.497 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-14T12:56:26.498 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-14T12:56:26.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-14T12:56:26.500 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================================ 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout:Install 147 Packages 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 26 Packages 2024-02-14T12:56:26.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:56:26.502 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 222 M 2024-02-14T12:56:26.502 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-02-14T12:56:26.650 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-02-14T12:56:27.394 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-14T12:56:27.394 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-14T12:56:27.407 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-14T12:56:27.408 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-14T12:56:27.409 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-14T12:56:27.410 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-14T12:56:27.412 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-14T12:56:27.415 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-14T12:56:27.416 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-14T12:56:27.427 INFO:teuthology.orchestra.run.smithi103.stdout:(1/173): ceph-19.0.0-1280.ga6fe3fa3.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-02-14T12:56:27.501 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================================ 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================================ 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 6.6 k 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 5.1 M 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 886 k 2024-02-14T12:56:27.522 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 145 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 1.5 M 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 138 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 1.8 M 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 7.4 M 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 52 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 9.7 M 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 47 M 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 263 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 748 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 217 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 27 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 18 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-14T12:56:27.523 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 31 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 743 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 127 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 161 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 321 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 297 k 2024-02-14T12:56:27.524 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 99 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 85 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.1 M 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 171 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-14T12:56:27.525 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.4 M 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.1 M 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-14T12:56:27.526 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 20 M 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 28 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 2.1 M 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 247 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 4.7 M 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 17 M 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 15 k 2024-02-14T12:56:27.527 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 25 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 163 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-14T12:56:27.528 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 499 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 5.1 M 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-14T12:56:27.529 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 45 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 131 k 2024-02-14T12:56:27.530 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-14T12:56:27.531 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-14T12:56:27.532 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-14T12:56:27.533 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-14T12:56:27.534 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================================ 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout:Install 147 Packages 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 26 Packages 2024-02-14T12:56:27.535 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:56:27.536 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 222 M 2024-02-14T12:56:27.536 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2024-02-14T12:56:27.728 INFO:teuthology.orchestra.run.smithi103.stdout:(2/173): ceph-fuse-19.0.0-1280.ga6fe3fa3.el9.x8 2.9 MB/s | 886 kB 00:00 2024-02-14T12:56:27.820 INFO:teuthology.orchestra.run.smithi103.stdout:(3/173): ceph-base-19.0.0-1280.ga6fe3fa3.el9.x8 8.3 MB/s | 5.1 MB 00:00 2024-02-14T12:56:27.845 INFO:teuthology.orchestra.run.smithi103.stdout:(4/173): ceph-immutable-object-cache-19.0.0-128 1.2 MB/s | 145 kB 00:00 2024-02-14T12:56:28.003 INFO:teuthology.orchestra.run.smithi103.stdout:(5/173): ceph-mds-19.0.0-1280.ga6fe3fa3.el9.x86 12 MB/s | 2.1 MB 00:00 2024-02-14T12:56:28.154 INFO:teuthology.orchestra.run.smithi103.stdout:(6/173): ceph-mgr-19.0.0-1280.ga6fe3fa3.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-02-14T12:56:28.191 INFO:teuthology.orchestra.run.smithi055.stdout:(1/173): ceph-19.0.0-1280.ga6fe3fa3.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-02-14T12:56:28.387 INFO:teuthology.orchestra.run.smithi103.stdout:(7/173): ceph-mon-19.0.0-1280.ga6fe3fa3.el9.x86 12 MB/s | 4.7 MB 00:00 2024-02-14T12:56:28.900 INFO:teuthology.orchestra.run.smithi055.stdout:(2/173): ceph-fuse-19.0.0-1280.ga6fe3fa3.el9.x8 1.2 MB/s | 886 kB 00:00 2024-02-14T12:56:29.067 INFO:teuthology.orchestra.run.smithi055.stdout:(3/173): ceph-immutable-object-cache-19.0.0-128 871 kB/s | 145 kB 00:00 2024-02-14T12:56:29.359 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-14T12:56:29.360 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-14T12:56:29.375 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-14T12:56:29.376 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-14T12:56:29.377 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-14T12:56:29.378 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-14T12:56:29.381 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-14T12:56:29.384 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-14T12:56:29.385 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-14T12:56:29.421 INFO:teuthology.orchestra.run.smithi103.stdout:(8/173): ceph-radosgw-19.0.0-1280.ga6fe3fa3.el9 9.4 MB/s | 9.7 MB 00:01 2024-02-14T12:56:29.472 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-02-14T12:56:29.496 INFO:teuthology.orchestra.run.smithi103.stdout:(9/173): ceph-selinux-19.0.0-1280.ga6fe3fa3.el9 337 kB/s | 25 kB 00:00 2024-02-14T12:56:29.500 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================ 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================ 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 6.6 k 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 5.1 M 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 886 k 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 145 k 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 1.5 M 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 138 k 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 1.8 M 2024-02-14T12:56:29.501 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 7.4 M 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 52 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 9.7 M 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 47 M 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 263 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 748 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 217 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 27 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 18 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 31 k 2024-02-14T12:56:29.502 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 743 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 127 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 161 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 321 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 297 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 99 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 85 k 2024-02-14T12:56:29.503 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.1 M 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 171 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-14T12:56:29.504 INFO:teuthology.orchestra.run.smithi012.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.4 M 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 3.1 M 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-14T12:56:29.505 INFO:teuthology.orchestra.run.smithi012.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 20 M 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 28 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 2.1 M 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 247 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 4.7 M 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 17 M 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1280.ga6fe3fa3.el9 ceph-noarch 15 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 25 k 2024-02-14T12:56:29.506 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 163 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-14T12:56:29.507 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 499 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 5.1 M 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-14T12:56:29.508 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 45 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.0.0-1280.ga6fe3fa3.el9 ceph 131 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-14T12:56:29.509 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-14T12:56:29.510 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-14T12:56:29.511 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-14T12:56:29.512 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-14T12:56:29.513 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================================ 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:Install 147 Packages 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 26 Packages 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 222 M 2024-02-14T12:56:29.514 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-02-14T12:56:29.675 INFO:teuthology.orchestra.run.smithi055.stdout:(4/173): ceph-base-19.0.0-1280.ga6fe3fa3.el9.x8 3.0 MB/s | 5.1 MB 00:01 2024-02-14T12:56:29.967 INFO:teuthology.orchestra.run.smithi055.stdout:(5/173): ceph-mgr-19.0.0-1280.ga6fe3fa3.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-02-14T12:56:30.209 INFO:teuthology.orchestra.run.smithi055.stdout:(6/173): ceph-mds-19.0.0-1280.ga6fe3fa3.el9.x86 1.9 MB/s | 2.1 MB 00:01 2024-02-14T12:56:30.576 INFO:teuthology.orchestra.run.smithi012.stdout:(1/173): ceph-19.0.0-1280.ga6fe3fa3.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-02-14T12:56:30.659 INFO:teuthology.orchestra.run.smithi055.stdout:(7/173): ceph-mon-19.0.0-1280.ga6fe3fa3.el9.x86 6.8 MB/s | 4.7 MB 00:00 2024-02-14T12:56:30.671 INFO:teuthology.orchestra.run.smithi103.stdout:(10/173): ceph-common-19.0.0-1280.ga6fe3fa3.el9 5.7 MB/s | 20 MB 00:03 2024-02-14T12:56:30.847 INFO:teuthology.orchestra.run.smithi103.stdout:(11/173): ceph-osd-19.0.0-1280.ga6fe3fa3.el9.x8 6.2 MB/s | 17 MB 00:02 2024-02-14T12:56:30.872 INFO:teuthology.orchestra.run.smithi103.stdout:(12/173): cephfs-mirror-19.0.0-1280.ga6fe3fa3.e 1.1 MB/s | 217 kB 00:00 2024-02-14T12:56:30.947 INFO:teuthology.orchestra.run.smithi103.stdout:(13/173): cephfs-shell-19.0.0-1280.ga6fe3fa3.el 271 kB/s | 27 kB 00:00 2024-02-14T12:56:30.972 INFO:teuthology.orchestra.run.smithi103.stdout:(14/173): libcephfs-devel-19.0.0-1280.ga6fe3fa3 311 kB/s | 31 kB 00:00 2024-02-14T12:56:31.192 INFO:teuthology.orchestra.run.smithi012.stdout:(2/173): ceph-fuse-19.0.0-1280.ga6fe3fa3.el9.x8 1.4 MB/s | 886 kB 00:00 2024-02-14T12:56:31.306 INFO:teuthology.orchestra.run.smithi103.stdout:(15/173): libcephfs2-19.0.0-1280.ga6fe3fa3.el9. 2.0 MB/s | 743 kB 00:00 2024-02-14T12:56:31.326 INFO:teuthology.orchestra.run.smithi012.stdout:(3/173): ceph-immutable-object-cache-19.0.0-128 1.1 MB/s | 145 kB 00:00 2024-02-14T12:56:31.406 INFO:teuthology.orchestra.run.smithi103.stdout:(16/173): librados-devel-19.0.0-1280.ga6fe3fa3. 1.2 MB/s | 127 kB 00:00 2024-02-14T12:56:31.698 INFO:teuthology.orchestra.run.smithi103.stdout:(17/173): libradosstriper1-19.0.0-1280.ga6fe3fa 1.7 MB/s | 499 kB 00:00 2024-02-14T12:56:31.748 INFO:teuthology.orchestra.run.smithi103.stdout:(18/173): libcephsqlite-19.0.0-1280.ga6fe3fa3.e 210 kB/s | 163 kB 00:00 2024-02-14T12:56:31.826 INFO:teuthology.orchestra.run.smithi055.stdout:(8/173): ceph-radosgw-19.0.0-1280.ga6fe3fa3.el9 8.3 MB/s | 9.7 MB 00:01 2024-02-14T12:56:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:(19/173): python3-ceph-argparse-19.0.0-1280.ga6 492 kB/s | 45 kB 00:00 2024-02-14T12:56:31.918 INFO:teuthology.orchestra.run.smithi055.stdout:(9/173): ceph-selinux-19.0.0-1280.ga6fe3fa3.el9 275 kB/s | 25 kB 00:00 2024-02-14T12:56:31.949 INFO:teuthology.orchestra.run.smithi103.stdout:(20/173): python3-ceph-common-19.0.0-1280.ga6fe 1.2 MB/s | 131 kB 00:00 2024-02-14T12:56:32.118 INFO:teuthology.orchestra.run.smithi012.stdout:(4/173): ceph-base-19.0.0-1280.ga6fe3fa3.el9.x8 2.7 MB/s | 5.1 MB 00:01 2024-02-14T12:56:32.226 INFO:teuthology.orchestra.run.smithi012.stdout:(5/173): ceph-mds-19.0.0-1280.ga6fe3fa3.el9.x86 2.4 MB/s | 2.1 MB 00:00 2024-02-14T12:56:32.491 INFO:teuthology.orchestra.run.smithi103.stdout:(21/173): python3-cephfs-19.0.0-1280.ga6fe3fa3. 298 kB/s | 161 kB 00:00 2024-02-14T12:56:32.493 INFO:teuthology.orchestra.run.smithi012.stdout:(6/173): ceph-mgr-19.0.0-1280.ga6fe3fa3.el9.x86 4.0 MB/s | 1.5 MB 00:00 2024-02-14T12:56:32.825 INFO:teuthology.orchestra.run.smithi103.stdout:(22/173): python3-rados-19.0.0-1280.ga6fe3fa3.e 963 kB/s | 321 kB 00:00 2024-02-14T12:56:33.125 INFO:teuthology.orchestra.run.smithi103.stdout:(23/173): python3-rbd-19.0.0-1280.ga6fe3fa3.el9 992 kB/s | 297 kB 00:00 2024-02-14T12:56:33.242 INFO:teuthology.orchestra.run.smithi103.stdout:(24/173): python3-rgw-19.0.0-1280.ga6fe3fa3.el9 854 kB/s | 99 kB 00:00 2024-02-14T12:56:33.334 INFO:teuthology.orchestra.run.smithi103.stdout:(25/173): rbd-fuse-19.0.0-1280.ga6fe3fa3.el9.x8 932 kB/s | 85 kB 00:00 2024-02-14T12:56:33.418 INFO:teuthology.orchestra.run.smithi012.stdout:(7/173): ceph-common-19.0.0-1280.ga6fe3fa3.el9. 6.2 MB/s | 20 MB 00:03 2024-02-14T12:56:34.717 INFO:teuthology.orchestra.run.smithi103.stdout:(26/173): librgw2-19.0.0-1280.ga6fe3fa3.el9.x86 1.7 MB/s | 5.1 MB 00:03 2024-02-14T12:56:34.819 INFO:teuthology.orchestra.run.smithi012.stdout:(8/173): ceph-osd-19.0.0-1280.ga6fe3fa3.el9.x86 7.2 MB/s | 17 MB 00:02 2024-02-14T12:56:34.860 INFO:teuthology.orchestra.run.smithi103.stdout:(27/173): rbd-nbd-19.0.0-1280.ga6fe3fa3.el9.x86 1.2 MB/s | 171 kB 00:00 2024-02-14T12:56:34.926 INFO:teuthology.orchestra.run.smithi103.stdout:(28/173): ceph-grafana-dashboards-19.0.0-1280.g 428 kB/s | 28 kB 00:00 2024-02-14T12:56:34.927 INFO:teuthology.orchestra.run.smithi012.stdout:(9/173): ceph-radosgw-19.0.0-1280.ga6fe3fa3.el9 6.5 MB/s | 9.7 MB 00:01 2024-02-14T12:56:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:(10/173): ceph-selinux-19.0.0-1280.ga6fe3fa3.el 201 kB/s | 25 kB 00:00 2024-02-14T12:56:34.993 INFO:teuthology.orchestra.run.smithi103.stdout:(29/173): ceph-mgr-cephadm-19.0.0-1280.ga6fe3fa 2.0 MB/s | 138 kB 00:00 2024-02-14T12:56:35.036 INFO:teuthology.orchestra.run.smithi012.stdout:(11/173): cephfs-mirror-19.0.0-1280.ga6fe3fa3.e 2.3 MB/s | 217 kB 00:00 2024-02-14T12:56:35.128 INFO:teuthology.orchestra.run.smithi012.stdout:(12/173): ceph-mon-19.0.0-1280.ga6fe3fa3.el9.x8 1.6 MB/s | 4.7 MB 00:02 2024-02-14T12:56:35.153 INFO:teuthology.orchestra.run.smithi012.stdout:(13/173): cephfs-shell-19.0.0-1280.ga6fe3fa3.el 232 kB/s | 27 kB 00:00 2024-02-14T12:56:35.195 INFO:teuthology.orchestra.run.smithi012.stdout:(14/173): libcephfs-devel-19.0.0-1280.ga6fe3fa3 468 kB/s | 31 kB 00:00 2024-02-14T12:56:35.337 INFO:teuthology.orchestra.run.smithi012.stdout:(15/173): libcephfs2-19.0.0-1280.ga6fe3fa3.el9. 3.9 MB/s | 743 kB 00:00 2024-02-14T12:56:35.362 INFO:teuthology.orchestra.run.smithi012.stdout:(16/173): libcephsqlite-19.0.0-1280.ga6fe3fa3.e 976 kB/s | 163 kB 00:00 2024-02-14T12:56:35.421 INFO:teuthology.orchestra.run.smithi012.stdout:(17/173): librados-devel-19.0.0-1280.ga6fe3fa3. 1.5 MB/s | 127 kB 00:00 2024-02-14T12:56:35.427 INFO:teuthology.orchestra.run.smithi103.stdout:(30/173): rbd-mirror-19.0.0-1280.ga6fe3fa3.el9. 1.5 MB/s | 3.1 MB 00:02 2024-02-14T12:56:35.713 INFO:teuthology.orchestra.run.smithi012.stdout:(18/173): libradosstriper1-19.0.0-1280.ga6fe3fa 1.4 MB/s | 499 kB 00:00 2024-02-14T12:56:35.805 INFO:teuthology.orchestra.run.smithi012.stdout:(19/173): python3-ceph-argparse-19.0.0-1280.ga6 494 kB/s | 45 kB 00:00 2024-02-14T12:56:35.927 INFO:teuthology.orchestra.run.smithi103.stdout:(31/173): ceph-mgr-dashboard-19.0.0-1280.ga6fe3 1.9 MB/s | 1.8 MB 00:00 2024-02-14T12:56:35.972 INFO:teuthology.orchestra.run.smithi012.stdout:(20/173): python3-ceph-common-19.0.0-1280.ga6fe 788 kB/s | 131 kB 00:00 2024-02-14T12:56:36.119 INFO:teuthology.orchestra.run.smithi103.stdout:(32/173): ceph-mgr-modules-core-19.0.0-1280.ga6 1.3 MB/s | 247 kB 00:00 2024-02-14T12:56:36.130 INFO:teuthology.orchestra.run.smithi012.stdout:(21/173): librgw2-19.0.0-1280.ga6fe3fa3.el9.x86 7.2 MB/s | 5.1 MB 00:00 2024-02-14T12:56:36.155 INFO:teuthology.orchestra.run.smithi012.stdout:(22/173): python3-cephfs-19.0.0-1280.ga6fe3fa3. 879 kB/s | 161 kB 00:00 2024-02-14T12:56:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:(33/173): ceph-mgr-rook-19.0.0-1280.ga6fe3fa3.e 629 kB/s | 52 kB 00:00 2024-02-14T12:56:36.222 INFO:teuthology.orchestra.run.smithi012.stdout:(23/173): python3-rados-19.0.0-1280.ga6fe3fa3.e 3.4 MB/s | 321 kB 00:00 2024-02-14T12:56:36.303 INFO:teuthology.orchestra.run.smithi103.stdout:(34/173): ceph-prometheus-alerts-19.0.0-1280.ga 153 kB/s | 15 kB 00:00 2024-02-14T12:56:36.314 INFO:teuthology.orchestra.run.smithi012.stdout:(24/173): python3-rgw-19.0.0-1280.ga6fe3fa3.el9 1.1 MB/s | 99 kB 00:00 2024-02-14T12:56:36.348 INFO:teuthology.orchestra.run.smithi012.stdout:(25/173): python3-rbd-19.0.0-1280.ga6fe3fa3.el9 1.5 MB/s | 297 kB 00:00 2024-02-14T12:56:36.407 INFO:teuthology.orchestra.run.smithi012.stdout:(26/173): rbd-fuse-19.0.0-1280.ga6fe3fa3.el9.x8 928 kB/s | 85 kB 00:00 2024-02-14T12:56:36.470 INFO:teuthology.orchestra.run.smithi103.stdout:(35/173): ceph-volume-19.0.0-1280.ga6fe3fa3.el9 1.5 MB/s | 263 kB 00:00 2024-02-14T12:56:36.507 INFO:teuthology.orchestra.run.smithi012.stdout:(27/173): rbd-nbd-19.0.0-1280.ga6fe3fa3.el9.x86 1.7 MB/s | 171 kB 00:00 2024-02-14T12:56:36.607 INFO:teuthology.orchestra.run.smithi012.stdout:(28/173): ceph-grafana-dashboards-19.0.0-1280.g 284 kB/s | 28 kB 00:00 2024-02-14T12:56:36.708 INFO:teuthology.orchestra.run.smithi012.stdout:(29/173): ceph-mgr-cephadm-19.0.0-1280.ga6fe3fa 1.3 MB/s | 138 kB 00:00 2024-02-14T12:56:36.878 INFO:teuthology.orchestra.run.smithi103.stdout:(36/173): cephadm-19.0.0-1280.ga6fe3fa3.el9.noa 1.8 MB/s | 748 kB 00:00 2024-02-14T12:56:36.970 INFO:teuthology.orchestra.run.smithi103.stdout:(37/173): cephfs-top-19.0.0-1280.ga6fe3fa3.el9. 199 kB/s | 18 kB 00:00 2024-02-14T12:56:36.983 INFO:teuthology.orchestra.run.smithi012.stdout:(30/173): ceph-mgr-dashboard-19.0.0-1280.ga6fe3 6.4 MB/s | 1.8 MB 00:00 2024-02-14T12:56:37.104 INFO:teuthology.orchestra.run.smithi103.stdout:(38/173): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2024-02-14T12:56:37.162 INFO:teuthology.orchestra.run.smithi103.stdout:(39/173): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-02-14T12:56:37.196 INFO:teuthology.orchestra.run.smithi103.stdout:(40/173): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-02-14T12:56:37.229 INFO:teuthology.orchestra.run.smithi103.stdout:(41/173): elfutils-libelf-devel-0.190-2.el9.x86 613 kB/s | 20 kB 00:00 2024-02-14T12:56:37.280 INFO:teuthology.orchestra.run.smithi103.stdout:(42/173): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-02-14T12:56:37.314 INFO:teuthology.orchestra.run.smithi103.stdout:(43/173): flexiblas-3.0.4-8.el9.x86_64.rpm 953 kB/s | 32 kB 00:00 2024-02-14T12:56:37.397 INFO:teuthology.orchestra.run.smithi103.stdout:(44/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-02-14T12:56:37.431 INFO:teuthology.orchestra.run.smithi103.stdout:(45/173): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2024-02-14T12:56:37.464 INFO:teuthology.orchestra.run.smithi103.stdout:(46/173): libaio-devel-0.3.111-13.el9.x86_64.rp 302 kB/s | 10 kB 00:00 2024-02-14T12:56:37.498 INFO:teuthology.orchestra.run.smithi103.stdout:(47/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-02-14T12:56:37.532 INFO:teuthology.orchestra.run.smithi103.stdout:(48/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-14T12:56:37.574 INFO:teuthology.orchestra.run.smithi103.stdout:(49/173): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-02-14T12:56:37.616 INFO:teuthology.orchestra.run.smithi103.stdout:(50/173): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-02-14T12:56:37.649 INFO:teuthology.orchestra.run.smithi103.stdout:(51/173): libuuid-devel-2.37.4-18.el9.x86_64.rp 733 kB/s | 24 kB 00:00 2024-02-14T12:56:37.683 INFO:teuthology.orchestra.run.smithi103.stdout:(52/173): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-02-14T12:56:37.725 INFO:teuthology.orchestra.run.smithi103.stdout:(53/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-02-14T12:56:37.767 INFO:teuthology.orchestra.run.smithi103.stdout:(54/173): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-02-14T12:56:37.792 INFO:teuthology.orchestra.run.smithi103.stdout:(55/173): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2024-02-14T12:56:37.808 INFO:teuthology.orchestra.run.smithi012.stdout:(31/173): ceph-mgr-diskprediction-local-19.0.0- 9.0 MB/s | 7.4 MB 00:00 2024-02-14T12:56:37.918 INFO:teuthology.orchestra.run.smithi103.stdout:(56/173): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-02-14T12:56:37.975 INFO:teuthology.orchestra.run.smithi012.stdout:(32/173): ceph-mgr-modules-core-19.0.0-1280.ga6 1.5 MB/s | 247 kB 00:00 2024-02-14T12:56:38.035 INFO:teuthology.orchestra.run.smithi103.stdout:(57/173): openssl-devel-3.0.7-25.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-02-14T12:56:38.058 INFO:teuthology.orchestra.run.smithi012.stdout:(33/173): ceph-mgr-rook-19.0.0-1280.ga6fe3fa3.e 627 kB/s | 52 kB 00:00 2024-02-14T12:56:38.102 INFO:teuthology.orchestra.run.smithi103.stdout:(58/173): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2024-02-14T12:56:38.152 INFO:teuthology.orchestra.run.smithi103.stdout:(59/173): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2024-02-14T12:56:38.175 INFO:teuthology.orchestra.run.smithi012.stdout:(34/173): rbd-mirror-19.0.0-1280.ga6fe3fa3.el9. 1.7 MB/s | 3.1 MB 00:01 2024-02-14T12:56:38.185 INFO:teuthology.orchestra.run.smithi103.stdout:(60/173): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2024-02-14T12:56:38.201 INFO:teuthology.orchestra.run.smithi012.stdout:(35/173): ceph-prometheus-alerts-19.0.0-1280.ga 108 kB/s | 15 kB 00:00 2024-02-14T12:56:38.318 INFO:teuthology.orchestra.run.smithi012.stdout:(36/173): cephadm-19.0.0-1280.ga6fe3fa3.el9.noa 6.3 MB/s | 748 kB 00:00 2024-02-14T12:56:38.343 INFO:teuthology.orchestra.run.smithi012.stdout:(37/173): ceph-volume-19.0.0-1280.ga6fe3fa3.el9 1.5 MB/s | 263 kB 00:00 2024-02-14T12:56:38.344 INFO:teuthology.orchestra.run.smithi103.stdout:(61/173): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-02-14T12:56:38.393 INFO:teuthology.orchestra.run.smithi012.stdout:(38/173): cephfs-top-19.0.0-1280.ga6fe3fa3.el9. 242 kB/s | 18 kB 00:00 2024-02-14T12:56:38.394 INFO:teuthology.orchestra.run.smithi103.stdout:(62/173): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-02-14T12:56:38.485 INFO:teuthology.orchestra.run.smithi012.stdout:(39/173): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-02-14T12:56:38.517 INFO:teuthology.orchestra.run.smithi103.stdout:(63/173): python3-attrs-20.3.0-7.el9.noarch.rpm 633 kB/s | 78 kB 00:00 2024-02-14T12:56:38.527 INFO:teuthology.orchestra.run.smithi012.stdout:(40/173): bison-3.7.4-5.el9.x86_64.rpm 6.8 MB/s | 920 kB 00:00 2024-02-14T12:56:38.553 INFO:teuthology.orchestra.run.smithi012.stdout:(41/173): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-02-14T12:56:38.578 INFO:teuthology.orchestra.run.smithi012.stdout:(42/173): elfutils-libelf-devel-0.190-2.el9.x86 409 kB/s | 20 kB 00:00 2024-02-14T12:56:38.612 INFO:teuthology.orchestra.run.smithi012.stdout:(43/173): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-02-14T12:56:38.637 INFO:teuthology.orchestra.run.smithi012.stdout:(44/173): flexiblas-3.0.4-8.el9.x86_64.rpm 539 kB/s | 32 kB 00:00 2024-02-14T12:56:38.670 INFO:teuthology.orchestra.run.smithi103.stdout:(64/173): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 5.8 MB 00:00 2024-02-14T12:56:38.704 INFO:teuthology.orchestra.run.smithi103.stdout:(65/173): python3-jinja2-2.11.3-5.el9.noarch.rp 6.7 MB/s | 227 kB 00:00 2024-02-14T12:56:38.704 INFO:teuthology.orchestra.run.smithi012.stdout:(45/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-02-14T12:56:38.721 INFO:teuthology.orchestra.run.smithi012.stdout:(46/173): flexiblas-openblas-openmp-3.0.4-8.el9 215 kB/s | 17 kB 00:00 2024-02-14T12:56:38.738 INFO:teuthology.orchestra.run.smithi103.stdout:(66/173): python3-jsonpatch-1.21-16.el9.noarch. 733 kB/s | 24 kB 00:00 2024-02-14T12:56:38.738 INFO:teuthology.orchestra.run.smithi012.stdout:(47/173): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-02-14T12:56:38.763 INFO:teuthology.orchestra.run.smithi012.stdout:(48/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-02-14T12:56:38.771 INFO:teuthology.orchestra.run.smithi103.stdout:(67/173): python3-jsonpointer-2.0-4.el9.noarch. 544 kB/s | 18 kB 00:00 2024-02-14T12:56:38.780 INFO:teuthology.orchestra.run.smithi012.stdout:(49/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-02-14T12:56:38.804 INFO:teuthology.orchestra.run.smithi103.stdout:(68/173): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2024-02-14T12:56:38.814 INFO:teuthology.orchestra.run.smithi012.stdout:(50/173): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-02-14T12:56:38.838 INFO:teuthology.orchestra.run.smithi103.stdout:(69/173): python3-markupsafe-1.1.1-12.el9.x86_6 941 kB/s | 32 kB 00:00 2024-02-14T12:56:38.839 INFO:teuthology.orchestra.run.smithi012.stdout:(51/173): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2024-02-14T12:56:38.864 INFO:teuthology.orchestra.run.smithi012.stdout:(52/173): libuuid-devel-2.37.4-18.el9.x86_64.rp 495 kB/s | 24 kB 00:00 2024-02-14T12:56:38.890 INFO:teuthology.orchestra.run.smithi012.stdout:(53/173): libzstd-devel-1.5.1-2.el9.x86_64.rpm 922 kB/s | 46 kB 00:00 2024-02-14T12:56:38.923 INFO:teuthology.orchestra.run.smithi012.stdout:(54/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-02-14T12:56:38.949 INFO:teuthology.orchestra.run.smithi012.stdout:(55/173): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-02-14T12:56:38.960 INFO:teuthology.orchestra.run.smithi103.stdout:(70/173): python3-numpy-1.20.1-5.el9.x86_64.rpm 39 MB/s | 4.8 MB 00:00 2024-02-14T12:56:38.974 INFO:teuthology.orchestra.run.smithi012.stdout:(56/173): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-02-14T12:56:39.001 INFO:teuthology.orchestra.run.smithi103.stdout:(71/173): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-02-14T12:56:39.074 INFO:teuthology.orchestra.run.smithi012.stdout:(57/173): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-02-14T12:56:39.085 INFO:teuthology.orchestra.run.smithi103.stdout:(72/173): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 174 kB 00:00 2024-02-14T12:56:39.128 INFO:teuthology.orchestra.run.smithi103.stdout:(73/173): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-02-14T12:56:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:(58/173): openssl-devel-3.0.7-25.el9.x86_64.rpm 19 MB/s | 3.0 MB 00:00 2024-02-14T12:56:39.161 INFO:teuthology.orchestra.run.smithi103.stdout:(74/173): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-02-14T12:56:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:(59/173): postgresql-13.11-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-02-14T12:56:39.203 INFO:teuthology.orchestra.run.smithi103.stdout:(75/173): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-02-14T12:56:39.208 INFO:teuthology.orchestra.run.smithi012.stdout:(60/173): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-02-14T12:56:39.233 INFO:teuthology.orchestra.run.smithi012.stdout:(61/173): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-02-14T12:56:39.245 INFO:teuthology.orchestra.run.smithi103.stdout:(76/173): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2024-02-14T12:56:39.320 INFO:teuthology.orchestra.run.smithi103.stdout:(77/173): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-02-14T12:56:39.363 INFO:teuthology.orchestra.run.smithi103.stdout:(78/173): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-02-14T12:56:39.396 INFO:teuthology.orchestra.run.smithi103.stdout:(79/173): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-02-14T12:56:39.417 INFO:teuthology.orchestra.run.smithi012.stdout:(62/173): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2024-02-14T12:56:39.459 INFO:teuthology.orchestra.run.smithi012.stdout:(63/173): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-02-14T12:56:39.485 INFO:teuthology.orchestra.run.smithi012.stdout:(64/173): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-02-14T12:56:39.510 INFO:teuthology.orchestra.run.smithi055.stdout:(10/173): ceph-common-19.0.0-1280.ga6fe3fa3.el9 1.7 MB/s | 20 MB 00:11 2024-02-14T12:56:39.602 INFO:teuthology.orchestra.run.smithi055.stdout:(11/173): cephfs-mirror-19.0.0-1280.ga6fe3fa3.e 2.3 MB/s | 217 kB 00:00 2024-02-14T12:56:39.644 INFO:teuthology.orchestra.run.smithi055.stdout:(12/173): cephfs-shell-19.0.0-1280.ga6fe3fa3.el 654 kB/s | 27 kB 00:00 2024-02-14T12:56:39.677 INFO:teuthology.orchestra.run.smithi055.stdout:(13/173): libcephfs-devel-19.0.0-1280.ga6fe3fa3 937 kB/s | 31 kB 00:00 2024-02-14T12:56:39.693 INFO:teuthology.orchestra.run.smithi012.stdout:(65/173): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-02-14T12:56:39.718 INFO:teuthology.orchestra.run.smithi012.stdout:(66/173): python3-jinja2-2.11.3-5.el9.noarch.rp 972 kB/s | 227 kB 00:00 2024-02-14T12:56:39.735 INFO:teuthology.orchestra.run.smithi012.stdout:(67/173): python3-jsonpatch-1.21-16.el9.noarch. 592 kB/s | 24 kB 00:00 2024-02-14T12:56:39.752 INFO:teuthology.orchestra.run.smithi012.stdout:(68/173): python3-jsonpointer-2.0-4.el9.noarch. 538 kB/s | 18 kB 00:00 2024-02-14T12:56:39.786 INFO:teuthology.orchestra.run.smithi012.stdout:(69/173): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-14T12:56:39.812 INFO:teuthology.orchestra.run.smithi012.stdout:(70/173): python3-markupsafe-1.1.1-12.el9.x86_6 538 kB/s | 32 kB 00:00 2024-02-14T12:56:39.855 INFO:teuthology.orchestra.run.smithi103.stdout:(80/173): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-02-14T12:56:39.861 INFO:teuthology.orchestra.run.smithi055.stdout:(14/173): ceph-osd-19.0.0-1280.ga6fe3fa3.el9.x8 1.7 MB/s | 17 MB 00:09 2024-02-14T12:56:39.913 INFO:teuthology.orchestra.run.smithi103.stdout:(81/173): python3-toml-0.10.2-6.el9.noarch.rpm 665 kB/s | 39 kB 00:00 2024-02-14T12:56:39.947 INFO:teuthology.orchestra.run.smithi103.stdout:(82/173): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.2 MB/s | 41 kB 00:00 2024-02-14T12:56:39.953 INFO:teuthology.orchestra.run.smithi012.stdout:(71/173): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-02-14T12:56:39.961 INFO:teuthology.orchestra.run.smithi055.stdout:(15/173): libcephsqlite-19.0.0-1280.ga6fe3fa3.e 1.6 MB/s | 163 kB 00:00 2024-02-14T12:56:39.979 INFO:teuthology.orchestra.run.smithi012.stdout:(72/173): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-02-14T12:56:39.986 INFO:teuthology.orchestra.run.smithi055.stdout:(16/173): libcephfs2-19.0.0-1280.ga6fe3fa3.el9. 2.3 MB/s | 743 kB 00:00 2024-02-14T12:56:40.004 INFO:teuthology.orchestra.run.smithi012.stdout:(73/173): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-02-14T12:56:40.029 INFO:teuthology.orchestra.run.smithi012.stdout:(74/173): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-02-14T12:56:40.037 INFO:teuthology.orchestra.run.smithi055.stdout:(17/173): librados-devel-19.0.0-1280.ga6fe3fa3. 1.6 MB/s | 127 kB 00:00 2024-02-14T12:56:40.039 INFO:teuthology.orchestra.run.smithi103.stdout:(83/173): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 300 kB 00:00 2024-02-14T12:56:40.055 INFO:teuthology.orchestra.run.smithi012.stdout:(75/173): python3-prettytable-0.7.2-27.el9.noar 819 kB/s | 41 kB 00:00 2024-02-14T12:56:40.073 INFO:teuthology.orchestra.run.smithi103.stdout:(84/173): uuid-1.6.2-55.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-02-14T12:56:40.080 INFO:teuthology.orchestra.run.smithi012.stdout:(76/173): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-02-14T12:56:40.097 INFO:teuthology.orchestra.run.smithi012.stdout:(77/173): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2024-02-14T12:56:40.107 INFO:teuthology.orchestra.run.smithi103.stdout:(85/173): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.5 MB/s | 87 kB 00:00 2024-02-14T12:56:40.122 INFO:teuthology.orchestra.run.smithi012.stdout:(78/173): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-02-14T12:56:40.140 INFO:teuthology.orchestra.run.smithi103.stdout:(86/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-02-14T12:56:40.148 INFO:teuthology.orchestra.run.smithi012.stdout:(79/173): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2024-02-14T12:56:40.154 INFO:teuthology.orchestra.run.smithi055.stdout:(18/173): libradosstriper1-19.0.0-1280.ga6fe3fa 2.9 MB/s | 499 kB 00:00 2024-02-14T12:56:40.173 INFO:teuthology.orchestra.run.smithi012.stdout:(80/173): python3-requests-oauthlib-1.3.0-12.el 852 kB/s | 43 kB 00:00 2024-02-14T12:56:40.174 INFO:teuthology.orchestra.run.smithi103.stdout:(87/173): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-14T12:56:40.204 INFO:teuthology.orchestra.run.smithi055.stdout:(19/173): python3-ceph-argparse-19.0.0-1280.ga6 904 kB/s | 45 kB 00:00 2024-02-14T12:56:40.207 INFO:teuthology.orchestra.run.smithi103.stdout:(88/173): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-02-14T12:56:40.250 INFO:teuthology.orchestra.run.smithi103.stdout:(89/173): jq-1.6-16.el9.x86_64.rpm 4.3 MB/s | 186 kB 00:00 2024-02-14T12:56:40.255 INFO:teuthology.orchestra.run.smithi055.stdout:(20/173): python3-ceph-common-19.0.0-1280.ga6fe 2.6 MB/s | 131 kB 00:00 2024-02-14T12:56:40.300 INFO:teuthology.orchestra.run.smithi103.stdout:(90/173): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-02-14T12:56:40.330 INFO:teuthology.orchestra.run.smithi055.stdout:(21/173): python3-cephfs-19.0.0-1280.ga6fe3fa3. 2.1 MB/s | 161 kB 00:00 2024-02-14T12:56:40.333 INFO:teuthology.orchestra.run.smithi103.stdout:(91/173): libquadmath-11.4.1-3.el9.x86_64.rpm 5.7 MB/s | 194 kB 00:00 2024-02-14T12:56:40.375 INFO:teuthology.orchestra.run.smithi103.stdout:(92/173): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-02-14T12:56:40.417 INFO:teuthology.orchestra.run.smithi103.stdout:(93/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-02-14T12:56:40.476 INFO:teuthology.orchestra.run.smithi103.stdout:(94/173): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-02-14T12:56:40.510 INFO:teuthology.orchestra.run.smithi103.stdout:(95/173): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-02-14T12:56:40.543 INFO:teuthology.orchestra.run.smithi103.stdout:(96/173): python3-pycparser-2.20-6.el9.noarch.r 3.7 MB/s | 124 kB 00:00 2024-02-14T12:56:40.577 INFO:teuthology.orchestra.run.smithi103.stdout:(97/173): python3-requests-2.25.1-8.el9.noarch. 3.3 MB/s | 113 kB 00:00 2024-02-14T12:56:40.610 INFO:teuthology.orchestra.run.smithi103.stdout:(98/173): python3-urllib3-1.26.5-5.el9.noarch.r 5.5 MB/s | 187 kB 00:00 2024-02-14T12:56:40.615 INFO:teuthology.orchestra.run.smithi012.stdout:(81/173): ceph-test-19.0.0-1280.ga6fe3fa3.el9.x 8.3 MB/s | 47 MB 00:05 2024-02-14T12:56:40.732 INFO:teuthology.orchestra.run.smithi012.stdout:(82/173): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 39 kB 00:00 2024-02-14T12:56:40.797 INFO:teuthology.orchestra.run.smithi055.stdout:(22/173): ceph-test-19.0.0-1280.ga6fe3fa3.el9.x 5.3 MB/s | 47 MB 00:08 2024-02-14T12:56:40.824 INFO:teuthology.orchestra.run.smithi055.stdout:(23/173): python3-rados-19.0.0-1280.ga6fe3fa3.e 653 kB/s | 321 kB 00:00 2024-02-14T12:56:40.889 INFO:teuthology.orchestra.run.smithi055.stdout:(24/173): python3-rgw-19.0.0-1280.ga6fe3fa3.el9 1.5 MB/s | 99 kB 00:00 2024-02-14T12:56:40.914 INFO:teuthology.orchestra.run.smithi055.stdout:(25/173): python3-rbd-19.0.0-1280.ga6fe3fa3.el9 2.5 MB/s | 297 kB 00:00 2024-02-14T12:56:40.915 INFO:teuthology.orchestra.run.smithi012.stdout:(83/173): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-02-14T12:56:40.940 INFO:teuthology.orchestra.run.smithi055.stdout:(26/173): rbd-fuse-19.0.0-1280.ga6fe3fa3.el9.x8 1.7 MB/s | 85 kB 00:00 2024-02-14T12:56:40.940 INFO:teuthology.orchestra.run.smithi012.stdout:(84/173): python3-wcwidth-0.2.5-8.el9.noarch.rp 127 kB/s | 41 kB 00:00 2024-02-14T12:56:40.965 INFO:teuthology.orchestra.run.smithi012.stdout:(85/173): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2024-02-14T12:56:40.991 INFO:teuthology.orchestra.run.smithi012.stdout:(86/173): uuid-1.6.2-55.el9.x86_64.rpm 757 kB/s | 56 kB 00:00 2024-02-14T12:56:41.007 INFO:teuthology.orchestra.run.smithi055.stdout:(27/173): rbd-nbd-19.0.0-1280.ga6fe3fa3.el9.x86 2.5 MB/s | 171 kB 00:00 2024-02-14T12:56:41.016 INFO:teuthology.orchestra.run.smithi012.stdout:(87/173): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-02-14T12:56:41.041 INFO:teuthology.orchestra.run.smithi012.stdout:(88/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 832 kB/s | 63 kB 00:00 2024-02-14T12:56:41.048 INFO:teuthology.orchestra.run.smithi055.stdout:(28/173): ceph-grafana-dashboards-19.0.0-1280.g 686 kB/s | 28 kB 00:00 2024-02-14T12:56:41.067 INFO:teuthology.orchestra.run.smithi012.stdout:(89/173): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-02-14T12:56:41.092 INFO:teuthology.orchestra.run.smithi012.stdout:(90/173): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-02-14T12:56:41.094 INFO:teuthology.orchestra.run.smithi103.stdout:(99/173): ceph-test-19.0.0-1280.ga6fe3fa3.el9.x 4.1 MB/s | 47 MB 00:11 2024-02-14T12:56:41.099 INFO:teuthology.orchestra.run.smithi055.stdout:(29/173): ceph-mgr-cephadm-19.0.0-1280.ga6fe3fa 2.7 MB/s | 138 kB 00:00 2024-02-14T12:56:41.117 INFO:teuthology.orchestra.run.smithi012.stdout:(91/173): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-02-14T12:56:41.151 INFO:teuthology.orchestra.run.smithi012.stdout:(92/173): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-14T12:56:41.161 INFO:teuthology.orchestra.run.smithi103.stdout:(100/173): python3-devel-3.9.17-2.el9.x86_64.rp 446 kB/s | 245 kB 00:00 2024-02-14T12:56:41.176 INFO:teuthology.orchestra.run.smithi012.stdout:(93/173): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 194 kB 00:00 2024-02-14T12:56:41.201 INFO:teuthology.orchestra.run.smithi012.stdout:(94/173): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2024-02-14T12:56:41.226 INFO:teuthology.orchestra.run.smithi012.stdout:(95/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-02-14T12:56:41.268 INFO:teuthology.orchestra.run.smithi012.stdout:(96/173): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-02-14T12:56:41.291 INFO:teuthology.orchestra.run.smithi055.stdout:(30/173): librgw2-19.0.0-1280.ga6fe3fa3.el9.x86 4.1 MB/s | 5.1 MB 00:01 2024-02-14T12:56:41.293 INFO:teuthology.orchestra.run.smithi012.stdout:(97/173): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-02-14T12:56:41.319 INFO:teuthology.orchestra.run.smithi012.stdout:(98/173): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-02-14T12:56:41.336 INFO:teuthology.orchestra.run.smithi103.stdout:(101/173): ceph-mgr-diskprediction-local-19.0.0 1.3 MB/s | 7.4 MB 00:05 2024-02-14T12:56:41.344 INFO:teuthology.orchestra.run.smithi012.stdout:(99/173): python3-requests-2.25.1-8.el9.noarch. 2.2 MB/s | 113 kB 00:00 2024-02-14T12:56:41.353 INFO:teuthology.orchestra.run.smithi103.stdout:(102/173): lua-devel-5.4.4-4.el9.x86_64.rpm 86 kB/s | 22 kB 00:00 2024-02-14T12:56:41.369 INFO:teuthology.orchestra.run.smithi012.stdout:(100/173): python3-urllib3-1.26.5-5.el9.noarch. 2.4 MB/s | 187 kB 00:00 2024-02-14T12:56:41.424 INFO:teuthology.orchestra.run.smithi055.stdout:(31/173): rbd-mirror-19.0.0-1280.ga6fe3fa3.el9. 6.1 MB/s | 3.1 MB 00:00 2024-02-14T12:56:41.475 INFO:teuthology.orchestra.run.smithi055.stdout:(32/173): ceph-mgr-dashboard-19.0.0-1280.ga6fe3 4.7 MB/s | 1.8 MB 00:00 2024-02-14T12:56:41.500 INFO:teuthology.orchestra.run.smithi055.stdout:(33/173): ceph-mgr-modules-core-19.0.0-1280.ga6 3.2 MB/s | 247 kB 00:00 2024-02-14T12:56:41.526 INFO:teuthology.orchestra.run.smithi055.stdout:(34/173): ceph-mgr-rook-19.0.0-1280.ga6fe3fa3.e 1.0 MB/s | 52 kB 00:00 2024-02-14T12:56:41.528 INFO:teuthology.orchestra.run.smithi103.stdout:(103/173): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-02-14T12:56:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:(101/173): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-02-14T12:56:41.559 INFO:teuthology.orchestra.run.smithi055.stdout:(35/173): ceph-prometheus-alerts-19.0.0-1280.ga 261 kB/s | 15 kB 00:00 2024-02-14T12:56:41.610 INFO:teuthology.orchestra.run.smithi055.stdout:(36/173): ceph-volume-19.0.0-1280.ga6fe3fa3.el9 3.1 MB/s | 263 kB 00:00 2024-02-14T12:56:41.651 INFO:teuthology.orchestra.run.smithi055.stdout:(37/173): cephfs-top-19.0.0-1280.ga6fe3fa3.el9. 440 kB/s | 18 kB 00:00 2024-02-14T12:56:41.695 INFO:teuthology.orchestra.run.smithi012.stdout:(102/173): python3-devel-3.9.17-2.el9.x86_64.rp 654 kB/s | 245 kB 00:00 2024-02-14T12:56:41.718 INFO:teuthology.orchestra.run.smithi055.stdout:(38/173): cephadm-19.0.0-1280.ga6fe3fa3.el9.noa 4.6 MB/s | 748 kB 00:00 2024-02-14T12:56:41.728 INFO:teuthology.orchestra.run.smithi012.stdout:(103/173): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-02-14T12:56:41.762 INFO:teuthology.orchestra.run.smithi103.stdout:(104/173): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-02-14T12:56:41.788 INFO:teuthology.orchestra.run.smithi103.stdout:(105/173): gperftools-libs-2.9.1-2.el9.x86_64.r 712 kB/s | 309 kB 00:00 2024-02-14T12:56:41.819 INFO:teuthology.orchestra.run.smithi055.stdout:(39/173): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 662 kB 00:00 2024-02-14T12:56:41.821 INFO:teuthology.orchestra.run.smithi103.stdout:(106/173): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-02-14T12:56:41.844 INFO:teuthology.orchestra.run.smithi055.stdout:(40/173): bison-3.7.4-5.el9.x86_64.rpm 7.3 MB/s | 920 kB 00:00 2024-02-14T12:56:41.855 INFO:teuthology.orchestra.run.smithi103.stdout:(107/173): libarrow-doc-9.0.0-10.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-02-14T12:56:41.862 INFO:teuthology.orchestra.run.smithi012.stdout:(104/173): gperftools-libs-2.9.1-2.el9.x86_64.r 1.8 MB/s | 309 kB 00:00 2024-02-14T12:56:41.869 INFO:teuthology.orchestra.run.smithi055.stdout:(41/173): elfutils-libelf-devel-0.190-2.el9.x86 821 kB/s | 20 kB 00:00 2024-02-14T12:56:41.895 INFO:teuthology.orchestra.run.smithi055.stdout:(42/173): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-02-14T12:56:41.905 INFO:teuthology.orchestra.run.smithi103.stdout:(108/173): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-02-14T12:56:41.920 INFO:teuthology.orchestra.run.smithi055.stdout:(43/173): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-02-14T12:56:41.937 INFO:teuthology.orchestra.run.smithi055.stdout:(44/173): flexiblas-3.0.4-8.el9.x86_64.rpm 766 kB/s | 32 kB 00:00 2024-02-14T12:56:41.939 INFO:teuthology.orchestra.run.smithi103.stdout:(109/173): libunwind-1.6.2-1.el9.x86_64.rpm 804 kB/s | 67 kB 00:00 2024-02-14T12:56:41.989 INFO:teuthology.orchestra.run.smithi103.stdout:(110/173): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-02-14T12:56:42.020 INFO:teuthology.orchestra.run.smithi055.stdout:(45/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-02-14T12:56:42.037 INFO:teuthology.orchestra.run.smithi055.stdout:(46/173): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2024-02-14T12:56:42.063 INFO:teuthology.orchestra.run.smithi055.stdout:(47/173): libaio-devel-0.3.111-13.el9.x86_64.rp 404 kB/s | 10 kB 00:00 2024-02-14T12:56:42.079 INFO:teuthology.orchestra.run.smithi012.stdout:(105/173): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-02-14T12:56:42.088 INFO:teuthology.orchestra.run.smithi055.stdout:(48/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-02-14T12:56:42.097 INFO:teuthology.orchestra.run.smithi103.stdout:(111/173): python3-asyncssh-2.13.2-3.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-02-14T12:56:42.104 INFO:teuthology.orchestra.run.smithi012.stdout:(106/173): grpc-data-1.46.7-10.el9.noarch.rpm 56 kB/s | 19 kB 00:00 2024-02-14T12:56:42.113 INFO:teuthology.orchestra.run.smithi055.stdout:(49/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2024-02-14T12:56:42.123 INFO:teuthology.orchestra.run.smithi103.stdout:(112/173): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-02-14T12:56:42.147 INFO:teuthology.orchestra.run.smithi055.stdout:(50/173): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-14T12:56:42.163 INFO:teuthology.orchestra.run.smithi012.stdout:(107/173): libarrow-doc-9.0.0-10.el9.noarch.rpm 315 kB/s | 26 kB 00:00 2024-02-14T12:56:42.172 INFO:teuthology.orchestra.run.smithi055.stdout:(51/173): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-02-14T12:56:42.173 INFO:teuthology.orchestra.run.smithi103.stdout:(113/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-02-14T12:56:42.188 INFO:teuthology.orchestra.run.smithi012.stdout:(108/173): liboath-2.6.7-2.el9.x86_64.rpm 585 kB/s | 49 kB 00:00 2024-02-14T12:56:42.198 INFO:teuthology.orchestra.run.smithi055.stdout:(52/173): libuuid-devel-2.37.4-18.el9.x86_64.rp 493 kB/s | 24 kB 00:00 2024-02-14T12:56:42.198 INFO:teuthology.orchestra.run.smithi103.stdout:(114/173): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-02-14T12:56:42.223 INFO:teuthology.orchestra.run.smithi055.stdout:(53/173): libzstd-devel-1.5.1-2.el9.x86_64.rpm 924 kB/s | 46 kB 00:00 2024-02-14T12:56:42.248 INFO:teuthology.orchestra.run.smithi055.stdout:(54/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-02-14T12:56:42.255 INFO:teuthology.orchestra.run.smithi012.stdout:(109/173): libunwind-1.6.2-1.el9.x86_64.rpm 735 kB/s | 67 kB 00:00 2024-02-14T12:56:42.265 INFO:teuthology.orchestra.run.smithi103.stdout:(115/173): libarrow-9.0.0-10.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-02-14T12:56:42.274 INFO:teuthology.orchestra.run.smithi055.stdout:(55/173): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-02-14T12:56:42.291 INFO:teuthology.orchestra.run.smithi103.stdout:(116/173): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-02-14T12:56:42.305 INFO:teuthology.orchestra.run.smithi012.stdout:(110/173): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-02-14T12:56:42.316 INFO:teuthology.orchestra.run.smithi103.stdout:(117/173): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-02-14T12:56:42.320 INFO:teuthology.orchestra.run.smithi055.stdout:(56/173): openblas-0.3.21-2.el9.x86_64.rpm 478 kB/s | 34 kB 00:00 2024-02-14T12:56:42.391 INFO:teuthology.orchestra.run.smithi103.stdout:(118/173): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-02-14T12:56:42.416 INFO:teuthology.orchestra.run.smithi103.stdout:(119/173): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-02-14T12:56:42.441 INFO:teuthology.orchestra.run.smithi055.stdout:(57/173): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-02-14T12:56:42.446 INFO:teuthology.orchestra.run.smithi103.stdout:(120/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-02-14T12:56:42.471 INFO:teuthology.orchestra.run.smithi103.stdout:(121/173): python3-google-auth-2.27.0-1.el9.noa 2.5 MB/s | 203 kB 00:00 2024-02-14T12:56:42.500 INFO:teuthology.orchestra.run.smithi055.stdout:(58/173): openssl-devel-3.0.7-25.el9.x86_64.rpm 17 MB/s | 3.0 MB 00:00 2024-02-14T12:56:42.506 INFO:teuthology.orchestra.run.smithi012.stdout:(111/173): python3-asyncssh-2.13.2-3.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-02-14T12:56:42.521 INFO:teuthology.orchestra.run.smithi103.stdout:(122/173): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-02-14T12:56:42.533 INFO:teuthology.orchestra.run.smithi055.stdout:(59/173): postgresql-13.11-1.el9.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2024-02-14T12:56:42.538 INFO:teuthology.orchestra.run.smithi103.stdout:(123/173): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-02-14T12:56:42.548 INFO:teuthology.orchestra.run.smithi012.stdout:(112/173): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-02-14T12:56:42.567 INFO:teuthology.orchestra.run.smithi055.stdout:(60/173): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-02-14T12:56:42.593 INFO:teuthology.orchestra.run.smithi055.stdout:(61/173): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-02-14T12:56:42.597 INFO:teuthology.orchestra.run.smithi103.stdout:(124/173): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-02-14T12:56:42.614 INFO:teuthology.orchestra.run.smithi103.stdout:(125/173): python3-jaraco-classes-3.2.1-5.el9.n 191 kB/s | 18 kB 00:00 2024-02-14T12:56:42.623 INFO:teuthology.orchestra.run.smithi012.stdout:(113/173): libarrow-9.0.0-10.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-02-14T12:56:42.631 INFO:teuthology.orchestra.run.smithi103.stdout:(126/173): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-02-14T12:56:42.648 INFO:teuthology.orchestra.run.smithi012.stdout:(114/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 307 kB/s | 43 kB 00:00 2024-02-14T12:56:42.664 INFO:teuthology.orchestra.run.smithi103.stdout:(127/173): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-02-14T12:56:42.674 INFO:teuthology.orchestra.run.smithi012.stdout:(115/173): python3-cachetools-4.2.4-1.el9.noarc 257 kB/s | 32 kB 00:00 2024-02-14T12:56:42.690 INFO:teuthology.orchestra.run.smithi103.stdout:(128/173): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-02-14T12:56:42.699 INFO:teuthology.orchestra.run.smithi012.stdout:(116/173): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-02-14T12:56:42.710 INFO:teuthology.orchestra.run.smithi055.stdout:(62/173): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-02-14T12:56:42.724 INFO:teuthology.orchestra.run.smithi103.stdout:(129/173): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-02-14T12:56:42.724 INFO:teuthology.orchestra.run.smithi012.stdout:(117/173): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-02-14T12:56:42.743 INFO:teuthology.orchestra.run.smithi055.stdout:(63/173): protobuf-3.14.0-13.el9.x86_64.rpm 6.9 MB/s | 1.0 MB 00:00 2024-02-14T12:56:42.749 INFO:teuthology.orchestra.run.smithi103.stdout:(130/173): python3-logutils-0.3.5-21.el9.noarch 552 kB/s | 46 kB 00:00 2024-02-14T12:56:42.769 INFO:teuthology.orchestra.run.smithi055.stdout:(64/173): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-02-14T12:56:42.774 INFO:teuthology.orchestra.run.smithi103.stdout:(131/173): python3-more-itertools-8.12.0-2.el9. 938 kB/s | 79 kB 00:00 2024-02-14T12:56:42.791 INFO:teuthology.orchestra.run.smithi012.stdout:(118/173): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-02-14T12:56:42.808 INFO:teuthology.orchestra.run.smithi103.stdout:(132/173): python3-natsort-7.1.1-5.el9.noarch.r 687 kB/s | 58 kB 00:00 2024-02-14T12:56:42.833 INFO:teuthology.orchestra.run.smithi103.stdout:(133/173): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-02-14T12:56:42.858 INFO:teuthology.orchestra.run.smithi012.stdout:(119/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-02-14T12:56:42.859 INFO:teuthology.orchestra.run.smithi103.stdout:(134/173): python3-portend-3.1.0-2.el9.noarch.r 195 kB/s | 16 kB 00:00 2024-02-14T12:56:42.869 INFO:teuthology.orchestra.run.smithi055.stdout:(65/173): ceph-mgr-diskprediction-local-19.0.0- 4.7 MB/s | 7.4 MB 00:01 2024-02-14T12:56:42.883 INFO:teuthology.orchestra.run.smithi012.stdout:(120/173): python3-colorama-0.4.4-12.el9.noarch 222 kB/s | 35 kB 00:00 2024-02-14T12:56:42.884 INFO:teuthology.orchestra.run.smithi103.stdout:(135/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-02-14T12:56:42.908 INFO:teuthology.orchestra.run.smithi012.stdout:(121/173): python3-google-auth-2.27.0-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-02-14T12:56:42.909 INFO:teuthology.orchestra.run.smithi103.stdout:(136/173): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-02-14T12:56:42.934 INFO:teuthology.orchestra.run.smithi103.stdout:(137/173): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-02-14T12:56:42.952 INFO:teuthology.orchestra.run.smithi055.stdout:(66/173): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-02-14T12:56:42.960 INFO:teuthology.orchestra.run.smithi103.stdout:(138/173): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-02-14T12:56:42.978 INFO:teuthology.orchestra.run.smithi055.stdout:(67/173): python3-jinja2-2.11.3-5.el9.noarch.rp 1.1 MB/s | 227 kB 00:00 2024-02-14T12:56:42.994 INFO:teuthology.orchestra.run.smithi055.stdout:(68/173): python3-jsonpatch-1.21-16.el9.noarch. 199 kB/s | 24 kB 00:00 2024-02-14T12:56:43.002 INFO:teuthology.orchestra.run.smithi103.stdout:(139/173): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2024-02-14T12:56:43.011 INFO:teuthology.orchestra.run.smithi055.stdout:(69/173): python3-jsonpointer-2.0-4.el9.noarch. 308 kB/s | 18 kB 00:00 2024-02-14T12:56:43.017 INFO:teuthology.orchestra.run.smithi012.stdout:(122/173): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-02-14T12:56:43.027 INFO:teuthology.orchestra.run.smithi103.stdout:(140/173): python3-tempora-5.0.0-2.el9.noarch.r 387 kB/s | 36 kB 00:00 2024-02-14T12:56:43.028 INFO:teuthology.orchestra.run.smithi055.stdout:(70/173): python3-markupsafe-1.1.1-12.el9.x86_6 945 kB/s | 32 kB 00:00 2024-02-14T12:56:43.042 INFO:teuthology.orchestra.run.smithi012.stdout:(123/173): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2024-02-14T12:56:43.052 INFO:teuthology.orchestra.run.smithi103.stdout:(141/173): python3-typing-extensions-4.4.0-2.el 552 kB/s | 51 kB 00:00 2024-02-14T12:56:43.054 INFO:teuthology.orchestra.run.smithi055.stdout:(71/173): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-02-14T12:56:43.094 INFO:teuthology.orchestra.run.smithi103.stdout:(142/173): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-02-14T12:56:43.119 INFO:teuthology.orchestra.run.smithi103.stdout:(143/173): python3-websocket-client-1.2.3-2.el9 973 kB/s | 90 kB 00:00 2024-02-14T12:56:43.134 INFO:teuthology.orchestra.run.smithi012.stdout:(124/173): python3-jaraco-classes-3.2.1-5.el9.n 194 kB/s | 18 kB 00:00 2024-02-14T12:56:43.145 INFO:teuthology.orchestra.run.smithi103.stdout:(144/173): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-02-14T12:56:43.154 INFO:teuthology.orchestra.run.smithi055.stdout:(72/173): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-02-14T12:56:43.159 INFO:teuthology.orchestra.run.smithi012.stdout:(125/173): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-02-14T12:56:43.162 INFO:teuthology.orchestra.run.smithi103.stdout:(145/173): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-02-14T12:56:43.180 INFO:teuthology.orchestra.run.smithi055.stdout:(73/173): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-02-14T12:56:43.195 INFO:teuthology.orchestra.run.smithi103.stdout:(146/173): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-02-14T12:56:43.204 INFO:teuthology.orchestra.run.smithi055.stdout:(74/173): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-02-14T12:56:43.209 INFO:teuthology.orchestra.run.smithi012.stdout:(126/173): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-02-14T12:56:43.221 INFO:teuthology.orchestra.run.smithi055.stdout:(75/173): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-02-14T12:56:43.235 INFO:teuthology.orchestra.run.smithi012.stdout:(127/173): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-02-14T12:56:43.239 INFO:teuthology.orchestra.run.smithi055.stdout:(76/173): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-02-14T12:56:43.246 INFO:teuthology.orchestra.run.smithi103.stdout:(147/173): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-02-14T12:56:43.260 INFO:teuthology.orchestra.run.smithi012.stdout:(128/173): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-02-14T12:56:43.264 INFO:teuthology.orchestra.run.smithi055.stdout:(77/173): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-02-14T12:56:43.279 INFO:teuthology.orchestra.run.smithi103.stdout:(148/173): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-14T12:56:43.289 INFO:teuthology.orchestra.run.smithi055.stdout:(78/173): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-02-14T12:56:43.313 INFO:teuthology.orchestra.run.smithi103.stdout:(149/173): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-02-14T12:56:43.315 INFO:teuthology.orchestra.run.smithi055.stdout:(79/173): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-02-14T12:56:43.338 INFO:teuthology.orchestra.run.smithi103.stdout:(150/173): elfutils-debuginfod-client-0.190-2.e 1.4 MB/s | 35 kB 00:00 2024-02-14T12:56:43.368 INFO:teuthology.orchestra.run.smithi012.stdout:(129/173): python3-kubernetes-26.1.0-2.el9.noar 6.5 MB/s | 1.0 MB 00:00 2024-02-14T12:56:43.380 INFO:teuthology.orchestra.run.smithi103.stdout:(151/173): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-02-14T12:56:43.407 INFO:teuthology.orchestra.run.smithi055.stdout:(80/173): python3-pytz-2021.1-5.el9.noarch.rpm 405 kB/s | 47 kB 00:00 2024-02-14T12:56:43.419 INFO:teuthology.orchestra.run.smithi012.stdout:(130/173): python3-logutils-0.3.5-21.el9.noarch 292 kB/s | 46 kB 00:00 2024-02-14T12:56:43.422 INFO:teuthology.orchestra.run.smithi103.stdout:(152/173): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2024-02-14T12:56:43.432 INFO:teuthology.orchestra.run.smithi055.stdout:(81/173): python3-requests-oauthlib-1.3.0-12.el 302 kB/s | 43 kB 00:00 2024-02-14T12:56:43.444 INFO:teuthology.orchestra.run.smithi012.stdout:(131/173): python3-more-itertools-8.12.0-2.el9. 429 kB/s | 79 kB 00:00 2024-02-14T12:56:43.469 INFO:teuthology.orchestra.run.smithi012.stdout:(132/173): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-02-14T12:56:43.472 INFO:teuthology.orchestra.run.smithi103.stdout:(153/173): iproute-6.7.0-2.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-02-14T12:56:43.503 INFO:teuthology.orchestra.run.smithi012.stdout:(133/173): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-02-14T12:56:43.523 INFO:teuthology.orchestra.run.smithi103.stdout:(154/173): iproute-tc-6.7.0-2.el9.x86_64.rpm 8.5 MB/s | 433 kB 00:00 2024-02-14T12:56:43.528 INFO:teuthology.orchestra.run.smithi012.stdout:(134/173): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-02-14T12:56:43.587 INFO:teuthology.orchestra.run.smithi012.stdout:(135/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 769 kB/s | 90 kB 00:00 2024-02-14T12:56:43.612 INFO:teuthology.orchestra.run.smithi012.stdout:(136/173): python3-pyperclip-1.8.2-2.el9.noarch 259 kB/s | 28 kB 00:00 2024-02-14T12:56:43.637 INFO:teuthology.orchestra.run.smithi012.stdout:(137/173): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2024-02-14T12:56:43.640 INFO:teuthology.orchestra.run.smithi103.stdout:(155/173): libacl-2.3.1-4.el9.x86_64.rpm 188 kB/s | 22 kB 00:00 2024-02-14T12:56:43.673 INFO:teuthology.orchestra.run.smithi103.stdout:(156/173): libblkid-2.37.4-18.el9.x86_64.rpm 3.1 MB/s | 107 kB 00:00 2024-02-14T12:56:43.696 INFO:teuthology.orchestra.run.smithi012.stdout:(138/173): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-02-14T12:56:43.707 INFO:teuthology.orchestra.run.smithi103.stdout:(157/173): libfdisk-2.37.4-18.el9.x86_64.rpm 4.5 MB/s | 154 kB 00:00 2024-02-14T12:56:43.721 INFO:teuthology.orchestra.run.smithi012.stdout:(139/173): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-02-14T12:56:43.741 INFO:teuthology.orchestra.run.smithi103.stdout:(158/173): libmount-2.37.4-18.el9.x86_64.rpm 3.9 MB/s | 135 kB 00:00 2024-02-14T12:56:43.746 INFO:teuthology.orchestra.run.smithi012.stdout:(140/173): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-02-14T12:56:43.765 INFO:teuthology.orchestra.run.smithi055.stdout:(82/173): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-02-14T12:56:43.766 INFO:teuthology.orchestra.run.smithi103.stdout:(159/173): libsmartcols-2.37.4-18.el9.x86_64.rp 2.4 MB/s | 63 kB 00:00 2024-02-14T12:56:43.772 INFO:teuthology.orchestra.run.smithi012.stdout:(141/173): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-02-14T12:56:43.791 INFO:teuthology.orchestra.run.smithi055.stdout:(83/173): python3-wcwidth-0.2.5-8.el9.noarch.rp 115 kB/s | 41 kB 00:00 2024-02-14T12:56:43.792 INFO:teuthology.orchestra.run.smithi103.stdout:(160/173): libuuid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 28 kB 00:00 2024-02-14T12:56:43.816 INFO:teuthology.orchestra.run.smithi055.stdout:(84/173): python3-toml-0.10.2-6.el9.noarch.rpm 101 kB/s | 39 kB 00:00 2024-02-14T12:56:43.841 INFO:teuthology.orchestra.run.smithi055.stdout:(85/173): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-02-14T12:56:43.842 INFO:teuthology.orchestra.run.smithi103.stdout:(161/173): librbd1-19.0.0-1280.ga6fe3fa3.el9.x8 4.8 MB/s | 3.1 MB 00:00 2024-02-14T12:56:43.866 INFO:teuthology.orchestra.run.smithi055.stdout:(86/173): uuid-1.6.2-55.el9.x86_64.rpm 753 kB/s | 56 kB 00:00 2024-02-14T12:56:43.875 INFO:teuthology.orchestra.run.smithi103.stdout:(162/173): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-02-14T12:56:43.883 INFO:teuthology.orchestra.run.smithi055.stdout:(87/173): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2024-02-14T12:56:43.909 INFO:teuthology.orchestra.run.smithi055.stdout:(88/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 939 kB/s | 63 kB 00:00 2024-02-14T12:56:43.914 INFO:teuthology.orchestra.run.smithi012.stdout:(142/173): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-02-14T12:56:43.926 INFO:teuthology.orchestra.run.smithi103.stdout:(163/173): openssl-libs-3.0.7-25.el9.x86_64.rpm 26 MB/s | 2.1 MB 00:00 2024-02-14T12:56:43.934 INFO:teuthology.orchestra.run.smithi055.stdout:(89/173): zlib-devel-1.2.11-40.el9.x86_64.rpm 660 kB/s | 44 kB 00:00 2024-02-14T12:56:43.939 INFO:teuthology.orchestra.run.smithi012.stdout:(143/173): python3-websocket-client-1.2.3-2.el9 468 kB/s | 90 kB 00:00 2024-02-14T12:56:43.959 INFO:teuthology.orchestra.run.smithi055.stdout:(90/173): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-02-14T12:56:43.964 INFO:teuthology.orchestra.run.smithi012.stdout:(144/173): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-02-14T12:56:43.976 INFO:teuthology.orchestra.run.smithi103.stdout:(164/173): util-linux-2.37.4-18.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2024-02-14T12:56:43.985 INFO:teuthology.orchestra.run.smithi055.stdout:(91/173): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-02-14T12:56:43.989 INFO:teuthology.orchestra.run.smithi012.stdout:(145/173): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-02-14T12:56:44.001 INFO:teuthology.orchestra.run.smithi103.stdout:(165/173): util-linux-core-2.37.4-18.el9.x86_64 5.9 MB/s | 438 kB 00:00 2024-02-14T12:56:44.015 INFO:teuthology.orchestra.run.smithi012.stdout:(146/173): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-02-14T12:56:44.018 INFO:teuthology.orchestra.run.smithi055.stdout:(92/173): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-14T12:56:44.027 INFO:teuthology.orchestra.run.smithi103.stdout:(166/173): util-linux-user-2.37.4-18.el9.x86_64 612 kB/s | 30 kB 00:00 2024-02-14T12:56:44.048 INFO:teuthology.orchestra.run.smithi055.stdout:(93/173): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.5 MB/s | 217 kB 00:00 2024-02-14T12:56:44.060 INFO:teuthology.orchestra.run.smithi103.stdout:(167/173): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-02-14T12:56:44.073 INFO:teuthology.orchestra.run.smithi055.stdout:(94/173): libquadmath-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 194 kB 00:00 2024-02-14T12:56:44.098 INFO:teuthology.orchestra.run.smithi055.stdout:(95/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 241 kB 00:00 2024-02-14T12:56:44.102 INFO:teuthology.orchestra.run.smithi103.stdout:(168/173): xfsprogs-6.3.0-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-02-14T12:56:44.132 INFO:teuthology.orchestra.run.smithi055.stdout:(96/173): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-02-14T12:56:44.158 INFO:teuthology.orchestra.run.smithi055.stdout:(97/173): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-02-14T12:56:44.182 INFO:teuthology.orchestra.run.smithi012.stdout:(147/173): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-02-14T12:56:44.183 INFO:teuthology.orchestra.run.smithi055.stdout:(98/173): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-02-14T12:56:44.208 INFO:teuthology.orchestra.run.smithi055.stdout:(99/173): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-02-14T12:56:44.215 INFO:teuthology.orchestra.run.smithi012.stdout:(148/173): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-14T12:56:44.234 INFO:teuthology.orchestra.run.smithi055.stdout:(100/173): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-14T12:56:44.265 INFO:teuthology.orchestra.run.smithi012.stdout:(149/173): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-02-14T12:56:44.316 INFO:teuthology.orchestra.run.smithi012.stdout:(150/173): elfutils-debuginfod-client-0.190-2.e 707 kB/s | 35 kB 00:00 2024-02-14T12:56:44.343 INFO:teuthology.orchestra.run.smithi055.stdout:(101/173): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-02-14T12:56:44.352 INFO:teuthology.orchestra.run.smithi103.stdout:(169/173): librados2-19.0.0-1280.ga6fe3fa3.el9. 2.8 MB/s | 3.4 MB 00:01 2024-02-14T12:56:44.358 INFO:teuthology.orchestra.run.smithi012.stdout:(151/173): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-02-14T12:56:44.417 INFO:teuthology.orchestra.run.smithi012.stdout:(152/173): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 254 kB 00:00 2024-02-14T12:56:44.475 INFO:teuthology.orchestra.run.smithi012.stdout:(153/173): iproute-6.7.0-2.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-02-14T12:56:44.486 INFO:teuthology.orchestra.run.smithi103.stdout:(170/173): NetworkManager-libnm-1.45.91-1.el9.x 4.7 MB/s | 1.8 MB 00:00 2024-02-14T12:56:44.503 INFO:teuthology.orchestra.run.smithi103.stdout:(171/173): NetworkManager-team-1.45.91-1.el9.x8 282 kB/s | 42 kB 00:00 2024-02-14T12:56:44.525 INFO:teuthology.orchestra.run.smithi012.stdout:(154/173): librbd1-19.0.0-1280.ga6fe3fa3.el9.x8 6.1 MB/s | 3.1 MB 00:00 2024-02-14T12:56:44.528 INFO:teuthology.orchestra.run.smithi103.stdout:(172/173): NetworkManager-tui-1.45.91-1.el9.x86 5.8 MB/s | 247 kB 00:00 2024-02-14T12:56:44.550 INFO:teuthology.orchestra.run.smithi012.stdout:(155/173): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.6 MB/s | 433 kB 00:00 2024-02-14T12:56:44.576 INFO:teuthology.orchestra.run.smithi012.stdout:(156/173): libacl-2.3.1-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-02-14T12:56:44.601 INFO:teuthology.orchestra.run.smithi012.stdout:(157/173): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-14T12:56:44.601 INFO:teuthology.orchestra.run.smithi055.stdout:(102/173): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-02-14T12:56:44.626 INFO:teuthology.orchestra.run.smithi012.stdout:(158/173): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-14T12:56:44.652 INFO:teuthology.orchestra.run.smithi012.stdout:(159/173): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-14T12:56:44.670 INFO:teuthology.orchestra.run.smithi103.stdout:(173/173): NetworkManager-1.45.91-1.el9.x86_64. 3.7 MB/s | 2.3 MB 00:00 2024-02-14T12:56:44.677 INFO:teuthology.orchestra.run.smithi012.stdout:(160/173): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-14T12:56:44.679 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-02-14T12:56:44.679 INFO:teuthology.orchestra.run.smithi103.stdout:Total 12 MB/s | 222 MB 00:18 2024-02-14T12:56:44.702 INFO:teuthology.orchestra.run.smithi012.stdout:(161/173): libuuid-2.37.4-18.el9.x86_64.rpm 551 kB/s | 28 kB 00:00 2024-02-14T12:56:44.744 INFO:teuthology.orchestra.run.smithi012.stdout:(162/173): openssl-3.0.7-25.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2024-02-14T12:56:44.760 INFO:teuthology.orchestra.run.smithi055.stdout:(103/173): python3-devel-3.9.17-2.el9.x86_64.rp 426 kB/s | 245 kB 00:00 2024-02-14T12:56:44.799 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-02-14T12:56:44.803 INFO:teuthology.orchestra.run.smithi012.stdout:(163/173): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2024-02-14T12:56:44.853 INFO:teuthology.orchestra.run.smithi012.stdout:(164/173): util-linux-2.37.4-18.el9.x86_64.rpm 21 MB/s | 2.2 MB 00:00 2024-02-14T12:56:44.879 INFO:teuthology.orchestra.run.smithi012.stdout:(165/173): util-linux-core-2.37.4-18.el9.x86_64 5.9 MB/s | 438 kB 00:00 2024-02-14T12:56:44.896 INFO:teuthology.orchestra.run.smithi012.stdout:(166/173): util-linux-user-2.37.4-18.el9.x86_64 730 kB/s | 30 kB 00:00 2024-02-14T12:56:44.921 INFO:teuthology.orchestra.run.smithi012.stdout:(167/173): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2024-02-14T12:56:44.963 INFO:teuthology.orchestra.run.smithi012.stdout:(168/173): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-02-14T12:56:45.055 INFO:teuthology.orchestra.run.smithi012.stdout:(169/173): librados2-19.0.0-1280.ga6fe3fa3.el9. 3.2 MB/s | 3.4 MB 00:01 2024-02-14T12:56:45.070 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-02-14T12:56:45.070 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-02-14T12:56:45.635 INFO:teuthology.orchestra.run.smithi055.stdout:(104/173): grpc-data-1.46.7-10.el9.noarch.rpm 22 kB/s | 19 kB 00:00 2024-02-14T12:56:45.705 INFO:teuthology.orchestra.run.smithi012.stdout:(170/173): NetworkManager-team-1.45.91-1.el9.x8 65 kB/s | 42 kB 00:00 2024-02-14T12:56:46.085 INFO:teuthology.orchestra.run.smithi055.stdout:(105/173): abseil-cpp-20211102.0-3.el9.x86_64.r 315 kB/s | 548 kB 00:01 2024-02-14T12:56:46.088 INFO:teuthology.orchestra.run.smithi012.stdout:(171/173): NetworkManager-1.45.91-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-02-14T12:56:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:(172/173): NetworkManager-libnm-1.45.91-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-02-14T12:56:46.160 INFO:teuthology.orchestra.run.smithi055.stdout:(106/173): gperftools-libs-2.9.1-2.el9.x86_64.r 198 kB/s | 309 kB 00:01 2024-02-14T12:56:46.556 INFO:teuthology.orchestra.run.smithi012.stdout:(173/173): NetworkManager-tui-1.45.91-1.el9.x86 291 kB/s | 247 kB 00:00 2024-02-14T12:56:46.564 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-02-14T12:56:46.564 INFO:teuthology.orchestra.run.smithi012.stdout:Total 13 MB/s | 222 MB 00:17 2024-02-14T12:56:46.577 INFO:teuthology.orchestra.run.smithi055.stdout:(107/173): libarrow-doc-9.0.0-10.el9.noarch.rpm 53 kB/s | 26 kB 00:00 2024-02-14T12:56:46.680 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-02-14T12:56:46.702 INFO:teuthology.orchestra.run.smithi055.stdout:(108/173): liboath-2.6.7-2.el9.x86_64.rpm 90 kB/s | 49 kB 00:00 2024-02-14T12:56:46.751 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-02-14T12:56:46.752 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-02-14T12:56:46.794 INFO:teuthology.orchestra.run.smithi055.stdout:(109/173): libarrow-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-02-14T12:56:46.820 INFO:teuthology.orchestra.run.smithi055.stdout:(110/173): libunwind-1.6.2-1.el9.x86_64.rpm 279 kB/s | 67 kB 00:00 2024-02-14T12:56:46.945 INFO:teuthology.orchestra.run.smithi055.stdout:(111/173): luarocks-3.9.2-1.el9.noarch.rpm 626 kB/s | 151 kB 00:00 2024-02-14T12:56:47.002 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-02-14T12:56:47.003 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-02-14T12:56:47.054 INFO:teuthology.orchestra.run.smithi055.stdout:(112/173): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 838 kB 00:00 2024-02-14T12:56:47.079 INFO:teuthology.orchestra.run.smithi055.stdout:(113/173): python3-asyncssh-2.13.2-3.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-02-14T12:56:47.171 INFO:teuthology.orchestra.run.smithi055.stdout:(114/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 192 kB/s | 43 kB 00:00 2024-02-14T12:56:47.280 INFO:teuthology.orchestra.run.smithi055.stdout:(115/173): python3-cachetools-4.2.4-1.el9.noarc 143 kB/s | 32 kB 00:00 2024-02-14T12:56:47.297 INFO:teuthology.orchestra.run.smithi055.stdout:(116/173): python3-certifi-2021.10.8-2.el9.noar 69 kB/s | 15 kB 00:00 2024-02-14T12:56:47.406 INFO:teuthology.orchestra.run.smithi055.stdout:(117/173): python3-cheroot-8.6.0-4.el9.noarch.r 733 kB/s | 172 kB 00:00 2024-02-14T12:56:47.523 INFO:teuthology.orchestra.run.smithi055.stdout:(118/173): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-02-14T12:56:47.548 INFO:teuthology.orchestra.run.smithi055.stdout:(119/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.2 MB/s | 303 kB 00:00 2024-02-14T12:56:47.623 INFO:teuthology.orchestra.run.smithi055.stdout:(120/173): python3-colorama-0.4.4-12.el9.noarch 162 kB/s | 35 kB 00:00 2024-02-14T12:56:47.757 INFO:teuthology.orchestra.run.smithi055.stdout:(121/173): python3-google-auth-2.27.0-1.el9.noa 869 kB/s | 203 kB 00:00 2024-02-14T12:56:47.857 INFO:teuthology.orchestra.run.smithi055.stdout:(122/173): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-02-14T12:56:47.882 INFO:teuthology.orchestra.run.smithi055.stdout:(123/173): python3-grpcio-tools-1.46.7-10.el9.x 558 kB/s | 144 kB 00:00 2024-02-14T12:56:47.974 INFO:teuthology.orchestra.run.smithi055.stdout:(124/173): python3-jaraco-8.2.1-3.el9.noarch.rp 49 kB/s | 11 kB 00:00 2024-02-14T12:56:48.075 INFO:teuthology.orchestra.run.smithi055.stdout:(125/173): python3-jaraco-classes-3.2.1-5.el9.n 81 kB/s | 18 kB 00:00 2024-02-14T12:56:48.108 INFO:teuthology.orchestra.run.smithi055.stdout:(126/173): python3-jaraco-collections-3.0.0-8.e 103 kB/s | 23 kB 00:00 2024-02-14T12:56:48.192 INFO:teuthology.orchestra.run.smithi055.stdout:(127/173): python3-jaraco-functools-3.5.0-2.el9 89 kB/s | 19 kB 00:00 2024-02-14T12:56:48.301 INFO:teuthology.orchestra.run.smithi055.stdout:(128/173): python3-jaraco-text-3.2.0-6.el9.noar 87 kB/s | 20 kB 00:00 2024-02-14T12:56:48.367 INFO:teuthology.orchestra.run.smithi055.stdout:(129/173): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-02-14T12:56:48.418 INFO:teuthology.orchestra.run.smithi055.stdout:(130/173): python3-logutils-0.3.5-21.el9.noarch 205 kB/s | 46 kB 00:00 2024-02-14T12:56:48.618 INFO:teuthology.orchestra.run.smithi055.stdout:(131/173): python3-more-itertools-8.12.0-2.el9. 248 kB/s | 79 kB 00:00 2024-02-14T12:56:48.643 INFO:teuthology.orchestra.run.smithi055.stdout:(132/173): python3-natsort-7.1.1-5.el9.noarch.r 209 kB/s | 58 kB 00:00 2024-02-14T12:56:48.669 INFO:teuthology.orchestra.run.smithi055.stdout:(133/173): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-02-14T12:56:48.844 INFO:teuthology.orchestra.run.smithi055.stdout:(134/173): python3-portend-3.1.0-2.el9.noarch.r 73 kB/s | 16 kB 00:00 2024-02-14T12:56:48.878 INFO:teuthology.orchestra.run.smithi055.stdout:(135/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 385 kB/s | 90 kB 00:00 2024-02-14T12:56:48.903 INFO:teuthology.orchestra.run.smithi055.stdout:(136/173): python3-pyperclip-1.8.2-2.el9.noarch 121 kB/s | 28 kB 00:00 2024-02-14T12:56:49.053 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-02-14T12:56:49.053 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-02-14T12:56:49.078 INFO:teuthology.orchestra.run.smithi055.stdout:(137/173): python3-repoze-lru-0.7-16.el9.noarch 131 kB/s | 31 kB 00:00 2024-02-14T12:56:49.112 INFO:teuthology.orchestra.run.smithi055.stdout:(138/173): python3-routes-2.5.1-5.el9.noarch.rp 806 kB/s | 188 kB 00:00 2024-02-14T12:56:49.137 INFO:teuthology.orchestra.run.smithi055.stdout:(139/173): python3-rsa-4.9-2.el9.noarch.rpm 252 kB/s | 59 kB 00:00 2024-02-14T12:56:49.313 INFO:teuthology.orchestra.run.smithi055.stdout:(140/173): python3-tempora-5.0.0-2.el9.noarch.r 153 kB/s | 36 kB 00:00 2024-02-14T12:56:49.338 INFO:teuthology.orchestra.run.smithi055.stdout:(141/173): python3-typing-extensions-4.4.0-2.el 226 kB/s | 51 kB 00:00 2024-02-14T12:56:49.372 INFO:teuthology.orchestra.run.smithi055.stdout:(142/173): python3-webob-1.8.7-6.el9.noarch.rpm 980 kB/s | 230 kB 00:00 2024-02-14T12:56:49.539 INFO:teuthology.orchestra.run.smithi055.stdout:(143/173): python3-websocket-client-1.2.3-2.el9 397 kB/s | 90 kB 00:00 2024-02-14T12:56:49.581 INFO:teuthology.orchestra.run.smithi055.stdout:(144/173): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2024-02-14T12:56:49.598 INFO:teuthology.orchestra.run.smithi055.stdout:(145/173): python3-zc-lockfile-2.0-10.el9.noarc 88 kB/s | 20 kB 00:00 2024-02-14T12:56:49.773 INFO:teuthology.orchestra.run.smithi055.stdout:(146/173): re2-20211101-3.el9.x86_64.rpm 819 kB/s | 192 kB 00:00 2024-02-14T12:56:49.865 INFO:teuthology.orchestra.run.smithi055.stdout:(147/173): thrift-0.15.0-2.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-02-14T12:56:49.905 INFO:teuthology.orchestra.run.smithi055.stdout:(148/173): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 68 kB 00:00 2024-02-14T12:56:49.938 INFO:teuthology.orchestra.run.smithi055.stdout:(149/173): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-02-14T12:56:49.972 INFO:teuthology.orchestra.run.smithi055.stdout:(150/173): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 35 kB 00:00 2024-02-14T12:56:50.005 INFO:teuthology.orchestra.run.smithi055.stdout:(151/173): elfutils-libelf-0.190-2.el9.x86_64.r 5.6 MB/s | 191 kB 00:00 2024-02-14T12:56:50.047 INFO:teuthology.orchestra.run.smithi055.stdout:(152/173): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2024-02-14T12:56:50.098 INFO:teuthology.orchestra.run.smithi055.stdout:(153/173): iproute-6.7.0-2.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-02-14T12:56:50.139 INFO:teuthology.orchestra.run.smithi055.stdout:(154/173): iproute-tc-6.7.0-2.el9.x86_64.rpm 10 MB/s | 433 kB 00:00 2024-02-14T12:56:50.165 INFO:teuthology.orchestra.run.smithi055.stdout:(155/173): libacl-2.3.1-4.el9.x86_64.rpm 880 kB/s | 22 kB 00:00 2024-02-14T12:56:50.190 INFO:teuthology.orchestra.run.smithi055.stdout:(156/173): libblkid-2.37.4-18.el9.x86_64.rpm 4.2 MB/s | 107 kB 00:00 2024-02-14T12:56:50.240 INFO:teuthology.orchestra.run.smithi055.stdout:(157/173): librados2-19.0.0-1280.ga6fe3fa3.el9. 5.2 MB/s | 3.4 MB 00:00 2024-02-14T12:56:50.265 INFO:teuthology.orchestra.run.smithi055.stdout:(158/173): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 154 kB 00:00 2024-02-14T12:56:50.291 INFO:teuthology.orchestra.run.smithi055.stdout:(159/173): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-14T12:56:50.316 INFO:teuthology.orchestra.run.smithi055.stdout:(160/173): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-14T12:56:50.342 INFO:teuthology.orchestra.run.smithi055.stdout:(161/173): libuuid-2.37.4-18.el9.x86_64.rpm 551 kB/s | 28 kB 00:00 2024-02-14T12:56:50.400 INFO:teuthology.orchestra.run.smithi055.stdout:(162/173): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-02-14T12:56:50.451 INFO:teuthology.orchestra.run.smithi055.stdout:(163/173): openssl-libs-3.0.7-25.el9.x86_64.rpm 20 MB/s | 2.1 MB 00:00 2024-02-14T12:56:50.501 INFO:teuthology.orchestra.run.smithi055.stdout:(164/173): util-linux-2.37.4-18.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2024-02-14T12:56:50.534 INFO:teuthology.orchestra.run.smithi055.stdout:(165/173): util-linux-core-2.37.4-18.el9.x86_64 5.4 MB/s | 438 kB 00:00 2024-02-14T12:56:50.560 INFO:teuthology.orchestra.run.smithi055.stdout:(166/173): util-linux-user-2.37.4-18.el9.x86_64 521 kB/s | 30 kB 00:00 2024-02-14T12:56:50.585 INFO:teuthology.orchestra.run.smithi055.stdout:(167/173): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-02-14T12:56:50.619 INFO:teuthology.orchestra.run.smithi055.stdout:(168/173): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-02-14T12:56:50.677 INFO:teuthology.orchestra.run.smithi055.stdout:(169/173): librbd1-19.0.0-1280.ga6fe3fa3.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-02-14T12:56:51.644 INFO:teuthology.orchestra.run.smithi055.stdout:(170/173): NetworkManager-team-1.45.91-1.el9.x8 44 kB/s | 42 kB 00:00 2024-02-14T12:56:51.686 INFO:teuthology.orchestra.run.smithi055.stdout:(171/173): NetworkManager-1.45.91-1.el9.x86_64. 2.1 MB/s | 2.3 MB 00:01 2024-02-14T12:56:51.862 INFO:teuthology.orchestra.run.smithi055.stdout:(172/173): NetworkManager-libnm-1.45.91-1.el9.x 1.5 MB/s | 1.8 MB 00:01 2024-02-14T12:56:52.470 INFO:teuthology.orchestra.run.smithi055.stdout:(173/173): NetworkManager-tui-1.45.91-1.el9.x86 299 kB/s | 247 kB 00:00 2024-02-14T12:56:52.478 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2024-02-14T12:56:52.478 INFO:teuthology.orchestra.run.smithi055.stdout:Total 8.9 MB/s | 222 MB 00:24 2024-02-14T12:56:52.596 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2024-02-14T12:56:52.893 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2024-02-14T12:56:52.894 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2024-02-14T12:56:53.866 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-02-14T12:56:53.974 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/199 2024-02-14T12:56:54.008 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/199 2024-02-14T12:56:54.048 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/199 2024-02-14T12:56:54.070 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/199 2024-02-14T12:56:54.118 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/199 2024-02-14T12:56:54.157 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/199 2024-02-14T12:56:54.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/199 2024-02-14T12:56:54.244 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/199 2024-02-14T12:56:54.270 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/199 2024-02-14T12:56:54.312 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/199 2024-02-14T12:56:54.638 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/199 2024-02-14T12:56:54.665 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2024-02-14T12:56:54.665 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2024-02-14T12:56:54.723 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:56:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:56:54.872 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:56:54.963 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:56:54.992 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 13/199 2024-02-14T12:56:55.142 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/199 2024-02-14T12:56:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/199 2024-02-14T12:56:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:56:55.329 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:56:55.352 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 17/199 2024-02-14T12:56:55.416 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 17/199 2024-02-14T12:56:55.534 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/199 2024-02-14T12:56:55.632 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 19/199 2024-02-14T12:56:55.709 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 19/199 2024-02-14T12:56:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:56:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:56:56.055 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:56:56.097 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/199 2024-02-14T12:56:56.135 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/199 2024-02-14T12:56:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-3.el9.x86_64 23/199 2024-02-14T12:56:56.318 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-02-14T12:56:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 24/199 2024-02-14T12:56:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 25/199 2024-02-14T12:56:56.413 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/199 2024-02-14T12:56:56.452 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/199 2024-02-14T12:56:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 26/199 2024-02-14T12:56:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/199 2024-02-14T12:56:56.523 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/199 2024-02-14T12:56:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/199 2024-02-14T12:56:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/199 2024-02-14T12:56:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/199 2024-02-14T12:56:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 31/199 2024-02-14T12:56:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 32/199 2024-02-14T12:56:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 33/199 2024-02-14T12:56:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 34/199 2024-02-14T12:56:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 35/199 2024-02-14T12:56:56.864 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/199 2024-02-14T12:56:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 36/199 2024-02-14T12:56:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9. 37/199 2024-02-14T12:56:56.937 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/199 2024-02-14T12:56:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el 38/199 2024-02-14T12:56:56.977 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/199 2024-02-14T12:56:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 39/199 2024-02-14T12:56:57.034 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/199 2024-02-14T12:56:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 40/199 2024-02-14T12:56:57.073 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/199 2024-02-14T12:56:57.098 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/199 2024-02-14T12:56:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-1.el9.noarch 41/199 2024-02-14T12:56:57.151 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/199 2024-02-14T12:56:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 42/199 2024-02-14T12:56:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 43/199 2024-02-14T12:56:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 44/199 2024-02-14T12:56:57.511 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/199 2024-02-14T12:56:57.582 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:56:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:56:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:56:57.809 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:56:57.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 13/199 2024-02-14T12:56:57.900 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 45/199 2024-02-14T12:56:57.981 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 46/199 2024-02-14T12:56:58.003 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/199 2024-02-14T12:56:58.051 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 47/199 2024-02-14T12:56:58.052 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/199 2024-02-14T12:56:58.079 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:56:58.109 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 48/199 2024-02-14T12:56:58.129 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 48/199 2024-02-14T12:56:58.160 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 49/199 2024-02-14T12:56:58.184 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:56:58.192 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/199 2024-02-14T12:56:58.213 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 17/199 2024-02-14T12:56:58.279 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 17/199 2024-02-14T12:56:58.287 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 51/199 2024-02-14T12:56:58.326 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 52/199 2024-02-14T12:56:58.445 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/199 2024-02-14T12:56:58.553 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 53/199 2024-02-14T12:56:58.585 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 19/199 2024-02-14T12:56:58.645 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 19/199 2024-02-14T12:56:58.737 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:56:58.769 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 54/199 2024-02-14T12:56:58.774 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:56:58.845 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 55/199 2024-02-14T12:56:58.889 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 56/199 2024-02-14T12:56:58.995 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:56:59.029 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 57/199 2024-02-14T12:56:59.036 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/199 2024-02-14T12:56:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/199 2024-02-14T12:56:59.076 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 58/199 2024-02-14T12:56:59.131 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/199 2024-02-14T12:56:59.177 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-3.el9.x86_64 23/199 2024-02-14T12:56:59.203 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 60/199 2024-02-14T12:56:59.235 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 61/199 2024-02-14T12:56:59.272 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 62/199 2024-02-14T12:56:59.281 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 24/199 2024-02-14T12:56:59.318 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/199 2024-02-14T12:56:59.323 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 25/199 2024-02-14T12:56:59.354 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/199 2024-02-14T12:56:59.397 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 26/199 2024-02-14T12:56:59.398 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 65/199 2024-02-14T12:56:59.454 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/199 2024-02-14T12:56:59.485 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/199 2024-02-14T12:56:59.531 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/199 2024-02-14T12:56:59.532 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 66/199 2024-02-14T12:56:59.571 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/199 2024-02-14T12:56:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 31/199 2024-02-14T12:56:59.703 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 32/199 2024-02-14T12:56:59.747 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 33/199 2024-02-14T12:56:59.769 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 67/199 2024-02-14T12:56:59.779 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 34/199 2024-02-14T12:56:59.812 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 68/199 2024-02-14T12:56:59.815 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 35/199 2024-02-14T12:56:59.843 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 69/199 2024-02-14T12:56:59.884 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 70/199 2024-02-14T12:56:59.886 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 36/199 2024-02-14T12:56:59.920 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9. 37/199 2024-02-14T12:56:59.963 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el 38/199 2024-02-14T12:56:59.977 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/199 2024-02-14T12:56:59.992 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 39/199 2024-02-14T12:57:00.025 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 72/199 2024-02-14T12:57:00.063 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 40/199 2024-02-14T12:57:00.065 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 73/199 2024-02-14T12:57:00.091 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 74/199 2024-02-14T12:57:00.107 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-1.el9.noarch 41/199 2024-02-14T12:57:00.116 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 75/199 2024-02-14T12:57:00.179 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 76/199 2024-02-14T12:57:00.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 42/199 2024-02-14T12:57:00.316 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 77/199 2024-02-14T12:57:00.321 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 43/199 2024-02-14T12:57:00.369 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 44/199 2024-02-14T12:57:00.416 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 78/199 2024-02-14T12:57:00.458 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 79/199 2024-02-14T12:57:00.506 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 80/199 2024-02-14T12:57:00.570 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 81/199 2024-02-14T12:57:00.755 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 82/199 2024-02-14T12:57:00.796 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 83/199 2024-02-14T12:57:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 84/199 2024-02-14T12:57:00.934 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 45/199 2024-02-14T12:57:00.970 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 85/199 2024-02-14T12:57:01.003 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 86/199 2024-02-14T12:57:01.016 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 46/199 2024-02-14T12:57:01.034 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 87/199 2024-02-14T12:57:01.070 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : jq-1.6-16.el9.x86_64 88/199 2024-02-14T12:57:01.100 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 47/199 2024-02-14T12:57:01.101 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/199 2024-02-14T12:57:01.129 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/199 2024-02-14T12:57:01.140 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 48/199 2024-02-14T12:57:01.161 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 48/199 2024-02-14T12:57:01.163 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/199 2024-02-14T12:57:01.192 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 49/199 2024-02-14T12:57:01.202 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/199 2024-02-14T12:57:01.224 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/199 2024-02-14T12:57:01.234 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/199 2024-02-14T12:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/199 2024-02-14T12:57:01.324 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 51/199 2024-02-14T12:57:01.339 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/199 2024-02-14T12:57:01.375 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 52/199 2024-02-14T12:57:01.375 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/199 2024-02-14T12:57:01.409 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/199 2024-02-14T12:57:01.441 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/199 2024-02-14T12:57:01.468 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/199 2024-02-14T12:57:01.556 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/199 2024-02-14T12:57:01.646 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/199 2024-02-14T12:57:01.665 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 53/199 2024-02-14T12:57:01.683 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2024-02-14T12:57:01.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/199 2024-02-14T12:57:01.722 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/199 2024-02-14T12:57:01.769 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/199 2024-02-14T12:57:01.790 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/199 2024-02-14T12:57:01.797 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 54/199 2024-02-14T12:57:01.816 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/199 2024-02-14T12:57:01.847 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/199 2024-02-14T12:57:01.866 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/199 2024-02-14T12:57:01.871 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/199 2024-02-14T12:57:01.877 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 55/199 2024-02-14T12:57:01.917 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/199 2024-02-14T12:57:01.921 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 56/199 2024-02-14T12:57:01.923 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/199 2024-02-14T12:57:01.956 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/199 2024-02-14T12:57:02.018 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/199 2024-02-14T12:57:02.052 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/199 2024-02-14T12:57:02.069 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 57/199 2024-02-14T12:57:02.124 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 58/199 2024-02-14T12:57:02.160 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/199 2024-02-14T12:57:02.180 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/199 2024-02-14T12:57:02.220 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/199 2024-02-14T12:57:02.254 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 60/199 2024-02-14T12:57:02.291 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 61/199 2024-02-14T12:57:02.327 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 62/199 2024-02-14T12:57:02.376 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/199 2024-02-14T12:57:02.410 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/199 2024-02-14T12:57:02.454 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 65/199 2024-02-14T12:57:02.496 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 66/199 2024-02-14T12:57:02.562 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/199 2024-02-14T12:57:02.628 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:57:02.638 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 67/199 2024-02-14T12:57:02.653 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/199 2024-02-14T12:57:02.685 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 68/199 2024-02-14T12:57:02.696 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/199 2024-02-14T12:57:02.714 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 69/199 2024-02-14T12:57:02.730 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/199 2024-02-14T12:57:02.743 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:57:02.756 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 70/199 2024-02-14T12:57:02.770 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:57:02.779 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/199 2024-02-14T12:57:02.846 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:57:02.853 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/199 2024-02-14T12:57:02.865 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/199 2024-02-14T12:57:02.874 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 13/199 2024-02-14T12:57:02.897 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 72/199 2024-02-14T12:57:02.914 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/199 2024-02-14T12:57:02.938 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 73/199 2024-02-14T12:57:02.971 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 74/199 2024-02-14T12:57:02.996 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 75/199 2024-02-14T12:57:03.033 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/199 2024-02-14T12:57:03.075 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 76/199 2024-02-14T12:57:03.081 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/199 2024-02-14T12:57:03.092 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/199 2024-02-14T12:57:03.108 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:57:03.129 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/199 2024-02-14T12:57:03.201 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 77/199 2024-02-14T12:57:03.213 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:57:03.215 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/199 2024-02-14T12:57:03.242 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 17/199 2024-02-14T12:57:03.306 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 17/199 2024-02-14T12:57:03.318 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 78/199 2024-02-14T12:57:03.363 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 79/199 2024-02-14T12:57:03.411 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/199 2024-02-14T12:57:03.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 80/199 2024-02-14T12:57:03.485 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 81/199 2024-02-14T12:57:03.522 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 19/199 2024-02-14T12:57:03.582 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 19/199 2024-02-14T12:57:03.654 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:57:03.678 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 82/199 2024-02-14T12:57:03.708 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:57:03.725 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 83/199 2024-02-14T12:57:03.852 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/199 2024-02-14T12:57:03.868 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 84/199 2024-02-14T12:57:03.915 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 85/199 2024-02-14T12:57:03.917 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 20/199 2024-02-14T12:57:03.948 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 86/199 2024-02-14T12:57:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/199 2024-02-14T12:57:03.960 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/199 2024-02-14T12:57:03.979 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 87/199 2024-02-14T12:57:03.981 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/199 2024-02-14T12:57:04.040 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.6-16.el9.x86_64 88/199 2024-02-14T12:57:04.071 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/199 2024-02-14T12:57:04.093 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : re2-1:20211101-3.el9.x86_64 23/199 2024-02-14T12:57:04.099 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/199 2024-02-14T12:57:04.133 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/199 2024-02-14T12:57:04.172 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/199 2024-02-14T12:57:04.197 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 24/199 2024-02-14T12:57:04.204 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/199 2024-02-14T12:57:04.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/199 2024-02-14T12:57:04.247 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 25/199 2024-02-14T12:57:04.313 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/199 2024-02-14T12:57:04.319 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.7-2.el9.x86_64 26/199 2024-02-14T12:57:04.352 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/199 2024-02-14T12:57:04.385 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/199 2024-02-14T12:57:04.428 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/199 2024-02-14T12:57:04.462 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/199 2024-02-14T12:57:04.530 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/199 2024-02-14T12:57:04.554 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/199 2024-02-14T12:57:04.645 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/199 2024-02-14T12:57:04.694 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/199 2024-02-14T12:57:04.717 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/199 2024-02-14T12:57:04.732 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/199 2024-02-14T12:57:04.761 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/199 2024-02-14T12:57:04.789 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/199 2024-02-14T12:57:04.801 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/199 2024-02-14T12:57:04.876 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 31/199 2024-02-14T12:57:04.898 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/199 2024-02-14T12:57:04.916 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 32/199 2024-02-14T12:57:04.952 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/199 2024-02-14T12:57:04.960 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 33/199 2024-02-14T12:57:04.992 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 34/199 2024-02-14T12:57:05.020 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-5.4.4-4.el9.x86_64 35/199 2024-02-14T12:57:05.093 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 36/199 2024-02-14T12:57:05.125 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9. 37/199 2024-02-14T12:57:05.171 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el 38/199 2024-02-14T12:57:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/199 2024-02-14T12:57:05.197 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 39/199 2024-02-14T12:57:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/199 2024-02-14T12:57:05.270 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 40/199 2024-02-14T12:57:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 120/199 2024-02-14T12:57:05.312 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : luarocks-3.9.2-1.el9.noarch 41/199 2024-02-14T12:57:05.414 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 42/199 2024-02-14T12:57:05.559 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 43/199 2024-02-14T12:57:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 121/199 2024-02-14T12:57:05.615 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 44/199 2024-02-14T12:57:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 122/199 2024-02-14T12:57:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 122/199 2024-02-14T12:57:05.717 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/199 2024-02-14T12:57:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 123/199 2024-02-14T12:57:05.772 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/199 2024-02-14T12:57:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 124/199 2024-02-14T12:57:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/199 2024-02-14T12:57:05.855 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/199 2024-02-14T12:57:05.946 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/199 2024-02-14T12:57:05.982 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/199 2024-02-14T12:57:06.172 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.9-2.el9.noarch 45/199 2024-02-14T12:57:06.175 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/199 2024-02-14T12:57:06.205 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/199 2024-02-14T12:57:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 125/199 2024-02-14T12:57:06.254 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 46/199 2024-02-14T12:57:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 126/199 2024-02-14T12:57:06.284 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/199 2024-02-14T12:57:06.330 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 47/199 2024-02-14T12:57:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 126/199 2024-02-14T12:57:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 127/199 2024-02-14T12:57:06.380 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 48/199 2024-02-14T12:57:06.398 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 48/199 2024-02-14T12:57:06.430 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 49/199 2024-02-14T12:57:06.462 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/199 2024-02-14T12:57:06.545 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 51/199 2024-02-14T12:57:06.612 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 52/199 2024-02-14T12:57:06.842 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 53/199 2024-02-14T12:57:06.963 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/199 2024-02-14T12:57:06.999 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 54/199 2024-02-14T12:57:07.057 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 55/199 2024-02-14T12:57:07.080 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/199 2024-02-14T12:57:07.101 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 56/199 2024-02-14T12:57:07.243 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 57/199 2024-02-14T12:57:07.295 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 58/199 2024-02-14T12:57:07.352 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 59/199 2024-02-14T12:57:07.425 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 60/199 2024-02-14T12:57:07.463 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 61/199 2024-02-14T12:57:07.499 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 62/199 2024-02-14T12:57:07.547 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 63/199 2024-02-14T12:57:07.590 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 64/199 2024-02-14T12:57:07.634 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 65/199 2024-02-14T12:57:07.676 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 66/199 2024-02-14T12:57:07.817 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 67/199 2024-02-14T12:57:07.865 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 68/199 2024-02-14T12:57:07.894 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 69/199 2024-02-14T12:57:07.936 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 70/199 2024-02-14T12:57:08.033 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/199 2024-02-14T12:57:08.069 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 72/199 2024-02-14T12:57:08.101 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 73/199 2024-02-14T12:57:08.126 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 74/199 2024-02-14T12:57:08.151 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 75/199 2024-02-14T12:57:08.225 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 76/199 2024-02-14T12:57:08.357 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 77/199 2024-02-14T12:57:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/199 2024-02-14T12:57:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/199 2024-02-14T12:57:08.465 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 78/199 2024-02-14T12:57:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 120/199 2024-02-14T12:57:08.519 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 79/199 2024-02-14T12:57:08.576 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ply-3.11-14.el9.noarch 80/199 2024-02-14T12:57:08.632 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 81/199 2024-02-14T12:57:08.801 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 121/199 2024-02-14T12:57:08.825 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 82/199 2024-02-14T12:57:08.873 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 83/199 2024-02-14T12:57:08.923 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 122/199 2024-02-14T12:57:08.989 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:09.009 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 84/199 2024-02-14T12:57:09.014 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 122/199 2024-02-14T12:57:09.019 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:09.045 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 123/199 2024-02-14T12:57:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 85/199 2024-02-14T12:57:09.081 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 124/199 2024-02-14T12:57:09.086 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 86/199 2024-02-14T12:57:09.118 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 87/199 2024-02-14T12:57:09.154 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : jq-1.6-16.el9.x86_64 88/199 2024-02-14T12:57:09.184 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/199 2024-02-14T12:57:09.212 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/199 2024-02-14T12:57:09.247 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/199 2024-02-14T12:57:09.286 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/199 2024-02-14T12:57:09.317 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/199 2024-02-14T12:57:09.347 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/199 2024-02-14T12:57:09.426 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/199 2024-02-14T12:57:09.457 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/199 2024-02-14T12:57:09.483 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/199 2024-02-14T12:57:09.525 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/199 2024-02-14T12:57:09.536 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:09.558 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/199 2024-02-14T12:57:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 125/199 2024-02-14T12:57:09.582 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 129/199 2024-02-14T12:57:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 126/199 2024-02-14T12:57:09.650 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/199 2024-02-14T12:57:09.664 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 129/199 2024-02-14T12:57:09.664 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-14T12:57:09.664 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-14T12:57:09.664 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:09.664 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 126/199 2024-02-14T12:57:09.691 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 130/199 2024-02-14T12:57:09.694 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 127/199 2024-02-14T12:57:09.741 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/199 2024-02-14T12:57:09.799 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/199 2024-02-14T12:57:09.829 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/199 2024-02-14T12:57:09.877 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/199 2024-02-14T12:57:09.988 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/199 2024-02-14T12:57:10.040 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/199 2024-02-14T12:57:10.810 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/199 2024-02-14T12:57:10.861 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/199 2024-02-14T12:57:10.895 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/199 2024-02-14T12:57:10.945 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/199 2024-02-14T12:57:11.034 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/199 2024-02-14T12:57:11.070 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/199 2024-02-14T12:57:11.256 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/199 2024-02-14T12:57:11.285 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/199 2024-02-14T12:57:11.365 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/199 2024-02-14T12:57:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:12.061 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/199 2024-02-14T12:57:12.170 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/199 2024-02-14T12:57:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 129/199 2024-02-14T12:57:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 129/199 2024-02-14T12:57:12.702 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-14T12:57:12.703 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-14T12:57:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 130/199 2024-02-14T12:57:13.454 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/199 2024-02-14T12:57:13.522 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/199 2024-02-14T12:57:13.549 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 120/199 2024-02-14T12:57:13.873 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 121/199 2024-02-14T12:57:13.904 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 122/199 2024-02-14T12:57:13.995 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 122/199 2024-02-14T12:57:14.025 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 123/199 2024-02-14T12:57:14.062 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 124/199 2024-02-14T12:57:14.543 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 125/199 2024-02-14T12:57:14.590 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 126/199 2024-02-14T12:57:14.644 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 126/199 2024-02-14T12:57:14.675 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 127/199 2024-02-14T12:57:16.914 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:16.955 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:17.499 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 128/199 2024-02-14T12:57:17.550 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 129/199 2024-02-14T12:57:17.632 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 129/199 2024-02-14T12:57:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-14T12:57:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-14T12:57:17.633 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:17.659 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 130/199 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 130/199 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-02-14T12:57:21.485 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:21.651 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 131/199 2024-02-14T12:57:21.666 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 131/199 2024-02-14T12:57:21.666 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:21.666 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-14T12:57:21.667 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:23.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 132/199 2024-02-14T12:57:23.173 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 132/199 2024-02-14T12:57:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:23.173 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-14T12:57:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-14T12:57:23.174 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-14T12:57:23.174 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:23.381 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 133/199 2024-02-14T12:57:23.404 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 133/199 2024-02-14T12:57:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-14T12:57:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-14T12:57:23.404 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-14T12:57:23.404 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:23.849 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 134/199 2024-02-14T12:57:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 134/199 2024-02-14T12:57:23.872 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:23.872 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-14T12:57:23.872 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-14T12:57:23.872 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-14T12:57:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 135/199 2024-02-14T12:57:24.381 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 136/199 2024-02-14T12:57:24.407 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 136/199 2024-02-14T12:57:24.438 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.e 137/199 2024-02-14T12:57:24.499 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3. 138/199 2024-02-14T12:57:24.523 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 139/199 2024-02-14T12:57:24.752 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 139/199 2024-02-14T12:57:24.799 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 140/199 2024-02-14T12:57:24.950 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 130/199 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-02-14T12:57:24.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:25.124 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 131/199 2024-02-14T12:57:25.138 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 131/199 2024-02-14T12:57:25.138 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:25.138 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-14T12:57:25.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:25.766 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 140/199 2024-02-14T12:57:25.799 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 141/199 2024-02-14T12:57:25.900 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 141/199 2024-02-14T12:57:26.061 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el 142/199 2024-02-14T12:57:26.093 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 143/199 2024-02-14T12:57:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 143/199 2024-02-14T12:57:26.117 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:26.117 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-14T12:57:26.117 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-14T12:57:26.117 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-14T12:57:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 144/199 2024-02-14T12:57:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 144/199 2024-02-14T12:57:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 145/199 2024-02-14T12:57:26.668 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 132/199 2024-02-14T12:57:26.693 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 132/199 2024-02-14T12:57:26.693 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:26.693 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-14T12:57:26.693 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-14T12:57:26.693 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-14T12:57:26.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:26.911 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 133/199 2024-02-14T12:57:26.933 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 133/199 2024-02-14T12:57:26.933 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:26.933 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-14T12:57:26.933 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-14T12:57:26.933 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-14T12:57:26.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:27.084 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-45.el9.x86_64 146/199 2024-02-14T12:57:27.113 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 147/199 2024-02-14T12:57:27.136 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 147/199 2024-02-14T12:57:27.136 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:27.136 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-14T12:57:27.136 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-14T12:57:27.137 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-14T12:57:27.137 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:27.181 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 148/199 2024-02-14T12:57:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 148/199 2024-02-14T12:57:27.203 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:27.203 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-14T12:57:27.203 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:27.248 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 149/199 2024-02-14T12:57:27.270 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 149/199 2024-02-14T12:57:27.271 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:27.271 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-14T12:57:27.271 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-14T12:57:27.271 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-14T12:57:27.271 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:27.395 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 134/199 2024-02-14T12:57:27.417 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 134/199 2024-02-14T12:57:27.417 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:27.417 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-14T12:57:27.417 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-14T12:57:27.417 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-14T12:57:27.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:27.521 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 135/199 2024-02-14T12:57:27.582 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:27.604 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:27.605 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:27.605 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-14T12:57:27.605 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-14T12:57:27.605 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-14T12:57:27.605 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:27.961 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 136/199 2024-02-14T12:57:27.986 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 136/199 2024-02-14T12:57:28.017 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.e 137/199 2024-02-14T12:57:28.082 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3. 138/199 2024-02-14T12:57:28.118 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 139/199 2024-02-14T12:57:28.361 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 139/199 2024-02-14T12:57:28.393 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 140/199 2024-02-14T12:57:29.408 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 140/199 2024-02-14T12:57:29.435 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 141/199 2024-02-14T12:57:29.543 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 141/199 2024-02-14T12:57:29.705 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el 142/199 2024-02-14T12:57:29.732 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 143/199 2024-02-14T12:57:29.752 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 143/199 2024-02-14T12:57:29.752 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:29.752 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-14T12:57:29.752 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-14T12:57:29.752 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-14T12:57:29.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:29.796 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 144/199 2024-02-14T12:57:29.807 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 144/199 2024-02-14T12:57:29.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 145/199 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 130/199 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2024-02-14T12:57:30.019 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /root 2024-02-14T12:57:30.020 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2024-02-14T12:57:30.020 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:30.190 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 131/199 2024-02-14T12:57:30.206 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 131/199 2024-02-14T12:57:30.206 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:30.206 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-14T12:57:30.206 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:30.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-45.el9.x86_64 146/199 2024-02-14T12:57:30.790 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 147/199 2024-02-14T12:57:30.812 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 147/199 2024-02-14T12:57:30.812 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:30.812 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-14T12:57:30.812 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-14T12:57:30.812 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-14T12:57:30.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:30.857 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 148/199 2024-02-14T12:57:30.879 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 148/199 2024-02-14T12:57:30.879 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:30.879 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-14T12:57:30.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:30.924 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 149/199 2024-02-14T12:57:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 149/199 2024-02-14T12:57:30.947 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:30.947 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-14T12:57:30.947 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-14T12:57:30.947 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-14T12:57:30.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:31.275 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:31.297 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:31.297 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:31.297 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-14T12:57:31.297 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-14T12:57:31.297 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-14T12:57:31.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:31.726 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 132/199 2024-02-14T12:57:31.753 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 132/199 2024-02-14T12:57:31.753 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:31.753 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-14T12:57:31.753 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-14T12:57:31.754 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-14T12:57:31.754 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:31.969 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 133/199 2024-02-14T12:57:31.992 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 133/199 2024-02-14T12:57:31.993 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:31.993 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-14T12:57:31.993 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-14T12:57:31.993 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-14T12:57:31.993 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 151/199 2024-02-14T12:57:32.086 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 152/199 2024-02-14T12:57:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 153/199 2024-02-14T12:57:32.144 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 154/199 2024-02-14T12:57:32.327 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 155/199 2024-02-14T12:57:32.443 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 156/199 2024-02-14T12:57:32.453 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 134/199 2024-02-14T12:57:32.476 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 134/199 2024-02-14T12:57:32.476 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:32.477 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-14T12:57:32.477 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-14T12:57:32.477 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-14T12:57:32.477 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:32.483 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 157/199 2024-02-14T12:57:32.523 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 158/199 2024-02-14T12:57:32.580 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.2-8.el9.noarch 135/199 2024-02-14T12:57:32.584 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 159/199 2024-02-14T12:57:32.643 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 160/199 2024-02-14T12:57:32.687 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 161/199 2024-02-14T12:57:32.730 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/199 2024-02-14T12:57:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_ 163/199 2024-02-14T12:57:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 164/199 2024-02-14T12:57:32.880 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 165/199 2024-02-14T12:57:32.918 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 166/199 2024-02-14T12:57:32.973 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 167/199 2024-02-14T12:57:33.046 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 136/199 2024-02-14T12:57:33.086 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 136/199 2024-02-14T12:57:33.117 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.e 137/199 2024-02-14T12:57:33.180 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3. 138/199 2024-02-14T12:57:33.209 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 139/199 2024-02-14T12:57:33.450 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 139/199 2024-02-14T12:57:33.485 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 140/199 2024-02-14T12:57:33.599 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:33.637 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:33.657 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:34.488 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 169/199 2024-02-14T12:57:34.497 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 140/199 2024-02-14T12:57:34.529 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 141/199 2024-02-14T12:57:34.551 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 170/199 2024-02-14T12:57:34.591 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/199 2024-02-14T12:57:34.634 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 141/199 2024-02-14T12:57:34.672 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/199 2024-02-14T12:57:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/199 2024-02-14T12:57:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 174/199 2024-02-14T12:57:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 175/199 2024-02-14T12:57:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 176/199 2024-02-14T12:57:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 177/199 2024-02-14T12:57:34.798 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el 142/199 2024-02-14T12:57:34.823 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 143/199 2024-02-14T12:57:34.847 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 143/199 2024-02-14T12:57:34.847 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:34.847 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-14T12:57:34.847 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-14T12:57:34.847 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-14T12:57:34.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:34.875 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 177/199 2024-02-14T12:57:34.898 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 144/199 2024-02-14T12:57:34.902 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 178/199 2024-02-14T12:57:34.909 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 144/199 2024-02-14T12:57:34.941 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/199 2024-02-14T12:57:34.941 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/199 2024-02-14T12:57:34.955 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 145/199 2024-02-14T12:57:35.017 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/199 2024-02-14T12:57:35.043 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/199 2024-02-14T12:57:35.077 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/199 2024-02-14T12:57:35.102 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 183/199 2024-02-14T12:57:35.129 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/199 2024-02-14T12:57:35.162 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 185/199 2024-02-14T12:57:35.187 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/199 2024-02-14T12:57:35.194 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:35.194 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:35.373 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:35.405 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 188/199 2024-02-14T12:57:35.453 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 189/199 2024-02-14T12:57:35.494 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 190/199 2024-02-14T12:57:35.519 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 191/199 2024-02-14T12:57:35.544 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 192/199 2024-02-14T12:57:35.570 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 193/199 2024-02-14T12:57:35.595 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/199 2024-02-14T12:57:35.621 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/199 2024-02-14T12:57:35.621 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 196/199 2024-02-14T12:57:35.697 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 196/199 2024-02-14T12:57:35.722 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 197/199 2024-02-14T12:57:35.754 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 198/199 2024-02-14T12:57:35.828 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 199/199 2024-02-14T12:57:35.856 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-45.el9.x86_64 146/199 2024-02-14T12:57:35.884 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 147/199 2024-02-14T12:57:35.907 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 147/199 2024-02-14T12:57:35.907 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:35.907 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-14T12:57:35.908 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-14T12:57:35.908 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-14T12:57:35.908 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:35.951 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 148/199 2024-02-14T12:57:35.974 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 148/199 2024-02-14T12:57:35.974 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:35.974 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-14T12:57:35.974 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:36.019 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 149/199 2024-02-14T12:57:36.030 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 151/199 2024-02-14T12:57:36.042 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 149/199 2024-02-14T12:57:36.042 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:36.042 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-14T12:57:36.042 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-14T12:57:36.042 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-14T12:57:36.042 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:36.071 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 152/199 2024-02-14T12:57:36.101 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 153/199 2024-02-14T12:57:36.128 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 154/199 2024-02-14T12:57:36.320 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 155/199 2024-02-14T12:57:36.369 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:36.392 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:36.392 INFO:teuthology.orchestra.run.smithi055.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-14T12:57:36.393 INFO:teuthology.orchestra.run.smithi055.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-14T12:57:36.393 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-14T12:57:36.393 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-14T12:57:36.393 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:36.440 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 156/199 2024-02-14T12:57:36.493 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 157/199 2024-02-14T12:57:36.550 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 158/199 2024-02-14T12:57:36.592 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 159/199 2024-02-14T12:57:36.672 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 160/199 2024-02-14T12:57:36.720 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 161/199 2024-02-14T12:57:36.763 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/199 2024-02-14T12:57:36.832 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_ 163/199 2024-02-14T12:57:36.897 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 164/199 2024-02-14T12:57:36.938 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 165/199 2024-02-14T12:57:36.968 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 166/199 2024-02-14T12:57:37.013 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 167/199 2024-02-14T12:57:37.689 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:37.737 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:37.756 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:38.640 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 169/199 2024-02-14T12:57:38.708 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 170/199 2024-02-14T12:57:38.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/199 2024-02-14T12:57:38.844 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/199 2024-02-14T12:57:38.879 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/199 2024-02-14T12:57:38.903 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 174/199 2024-02-14T12:57:38.929 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 175/199 2024-02-14T12:57:38.955 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 176/199 2024-02-14T12:57:38.955 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 177/199 2024-02-14T12:57:39.040 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 177/199 2024-02-14T12:57:39.068 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 178/199 2024-02-14T12:57:39.098 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/199 2024-02-14T12:57:39.098 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/199 2024-02-14T12:57:39.183 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/199 2024-02-14T12:57:39.217 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/199 2024-02-14T12:57:39.259 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/199 2024-02-14T12:57:39.284 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 183/199 2024-02-14T12:57:39.315 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/199 2024-02-14T12:57:39.344 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 185/199 2024-02-14T12:57:39.369 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/199 2024-02-14T12:57:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:39.377 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:39.563 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:39.598 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 188/199 2024-02-14T12:57:39.634 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 189/199 2024-02-14T12:57:39.666 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 190/199 2024-02-14T12:57:39.692 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 191/199 2024-02-14T12:57:39.740 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 192/199 2024-02-14T12:57:39.776 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 193/199 2024-02-14T12:57:39.801 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/199 2024-02-14T12:57:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/199 2024-02-14T12:57:39.827 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 196/199 2024-02-14T12:57:39.903 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 196/199 2024-02-14T12:57:39.927 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 197/199 2024-02-14T12:57:39.961 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 198/199 2024-02-14T12:57:40.030 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 199/199 2024-02-14T12:57:40.848 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 199/199 2024-02-14T12:57:40.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 1/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 3/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 4/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 5/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 6/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 7/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 8/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 9/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 10/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:57:40.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 13/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 14/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_ 15/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 17/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 18/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 19/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 20/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el 21/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9. 22/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 23/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 24/199 2024-02-14T12:57:40.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 25/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 26/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 27/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 28/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 29/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3. 30/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 31/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 32/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 33/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el 34/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 35/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.e 36/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 37/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 38/199 2024-02-14T12:57:40.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 39/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/199 2024-02-14T12:57:40.852 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/199 2024-02-14T12:57:40.853 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/199 2024-02-14T12:57:40.854 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 87/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 88/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 89/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 90/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : jq-1.6-16.el9.x86_64 91/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 92/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 93/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 94/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 95/199 2024-02-14T12:57:40.855 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 96/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 97/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 98/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 99/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 100/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 101/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 102/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 103/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 104/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 105/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 106/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 107/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 108/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 109/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 110/199 2024-02-14T12:57:40.856 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 111/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 112/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 113/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 114/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 115/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 116/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 117/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 118/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 119/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 120/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 121/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 122/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 123/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 124/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 125/199 2024-02-14T12:57:40.857 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 126/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 127/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 128/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 129/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 130/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 131/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 132/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 133/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 134/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 135/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 136/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 137/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 138/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 139/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 140/199 2024-02-14T12:57:40.858 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 141/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 142/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 143/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 144/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 145/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-3.el9.x86_64 146/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 147/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 148/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 149/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 151/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 152/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 153/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/199 2024-02-14T12:57:40.859 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 162/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 163/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 164/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 165/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 166/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 167/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 168/199 2024-02-14T12:57:40.860 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 169/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 170/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 171/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 172/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 173/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 174/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 175/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 176/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 177/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 178/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 179/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 180/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 181/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 182/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 183/199 2024-02-14T12:57:40.861 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 184/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 185/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 186/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 187/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 188/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 189/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 190/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 191/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 192/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 193/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 194/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 195/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 196/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 197/199 2024-02-14T12:57:40.862 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 198/199 2024-02-14T12:57:41.060 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 151/199 2024-02-14T12:57:41.108 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 152/199 2024-02-14T12:57:41.137 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 153/199 2024-02-14T12:57:41.164 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 154/199 2024-02-14T12:57:41.357 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 155/199 2024-02-14T12:57:41.476 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 156/199 2024-02-14T12:57:41.521 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 157/199 2024-02-14T12:57:41.560 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 158/199 2024-02-14T12:57:41.612 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 159/199 2024-02-14T12:57:41.683 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 160/199 2024-02-14T12:57:41.723 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 161/199 2024-02-14T12:57:41.758 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/199 2024-02-14T12:57:41.812 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_ 163/199 2024-02-14T12:57:41.856 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 164/199 2024-02-14T12:57:41.900 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 165/199 2024-02-14T12:57:41.929 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 166/199 2024-02-14T12:57:41.967 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 167/199 2024-02-14T12:57:42.583 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:42.623 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:42.643 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 168/199 2024-02-14T12:57:43.513 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 169/199 2024-02-14T12:57:43.576 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 170/199 2024-02-14T12:57:43.618 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/199 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/199 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:43.641 INFO:teuthology.orchestra.run.smithi103.stdout: acl-2.3.1-4.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.642 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.643 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.644 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-14T12:57:43.645 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-14T12:57:43.646 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-14T12:57:43.646 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-14T12:57:43.646 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-14T12:57:43.646 INFO:teuthology.orchestra.run.smithi103.stdout: jq-1.6-16.el9.x86_64 2024-02-14T12:57:43.646 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-14T12:57:43.647 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-14T12:57:43.648 INFO:teuthology.orchestra.run.smithi103.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.11-1.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-14T12:57:43.649 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-14T12:57:43.650 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-14T12:57:43.651 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-14T12:57:43.652 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-14T12:57:43.653 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-3.el9.x86_64 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-14T12:57:43.654 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-14T12:57:43.655 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-14T12:57:43.655 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-14T12:57:43.655 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-14T12:57:43.655 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-14T12:57:43.655 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T12:57:43.655 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-02-14T12:57:43.702 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/199 2024-02-14T12:57:43.730 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/199 2024-02-14T12:57:43.755 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 174/199 2024-02-14T12:57:43.780 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 175/199 2024-02-14T12:57:43.815 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 176/199 2024-02-14T12:57:43.815 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 177/199 2024-02-14T12:57:43.883 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 177/199 2024-02-14T12:57:43.911 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 178/199 2024-02-14T12:57:43.941 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/199 2024-02-14T12:57:43.941 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/199 2024-02-14T12:57:44.009 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/199 2024-02-14T12:57:44.035 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/199 2024-02-14T12:57:44.078 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/199 2024-02-14T12:57:44.102 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 183/199 2024-02-14T12:57:44.130 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 184/199 2024-02-14T12:57:44.162 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 185/199 2024-02-14T12:57:44.187 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 186/199 2024-02-14T12:57:44.193 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:44.194 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:44.246 DEBUG:teuthology.parallel:result is None 2024-02-14T12:57:44.381 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 187/199 2024-02-14T12:57:44.414 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 188/199 2024-02-14T12:57:44.453 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 189/199 2024-02-14T12:57:44.485 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 190/199 2024-02-14T12:57:44.510 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 191/199 2024-02-14T12:57:44.535 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 192/199 2024-02-14T12:57:44.560 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 193/199 2024-02-14T12:57:44.586 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/199 2024-02-14T12:57:44.612 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/199 2024-02-14T12:57:44.612 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 196/199 2024-02-14T12:57:44.696 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 196/199 2024-02-14T12:57:44.721 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 197/199 2024-02-14T12:57:44.754 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 198/199 2024-02-14T12:57:44.822 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 199/199 2024-02-14T12:57:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 199/199 2024-02-14T12:57:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 1/199 2024-02-14T12:57:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2/199 2024-02-14T12:57:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 3/199 2024-02-14T12:57:44.840 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 4/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 5/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 6/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 7/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 8/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 9/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 10/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 13/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 14/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_ 15/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 17/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 18/199 2024-02-14T12:57:44.841 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 19/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 20/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el 21/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9. 22/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 23/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 24/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 25/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 26/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 27/199 2024-02-14T12:57:44.842 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 28/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 29/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3. 30/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 31/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 32/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 33/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el 34/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 35/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.e 36/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 37/199 2024-02-14T12:57:44.858 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 38/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 39/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/199 2024-02-14T12:57:44.859 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/199 2024-02-14T12:57:44.860 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/199 2024-02-14T12:57:44.861 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 87/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 88/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 89/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 90/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.6-16.el9.x86_64 91/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 92/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 93/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 94/199 2024-02-14T12:57:44.862 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 95/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 96/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 97/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 98/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 99/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 100/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 101/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 102/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 103/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 104/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 105/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 106/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 107/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 108/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 109/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 110/199 2024-02-14T12:57:44.863 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 111/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 112/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 113/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 114/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 115/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 116/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 117/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 118/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 119/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 120/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 121/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 122/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 123/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 124/199 2024-02-14T12:57:44.864 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 125/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 126/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 127/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 128/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 129/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 130/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 131/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 132/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 133/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 134/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 135/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 136/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 137/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 138/199 2024-02-14T12:57:44.865 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 139/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 140/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 141/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 142/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 143/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 144/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 145/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-3.el9.x86_64 146/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 147/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 148/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 149/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 151/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 152/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 153/199 2024-02-14T12:57:44.866 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 162/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 163/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 164/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 165/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 166/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 167/199 2024-02-14T12:57:44.867 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 168/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 169/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 170/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 171/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 172/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 173/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 174/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 175/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 176/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 177/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 178/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 179/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 180/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 181/199 2024-02-14T12:57:44.868 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 182/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 183/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 184/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 185/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 186/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 187/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 188/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 189/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 190/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 191/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 192/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 193/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 194/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 195/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 196/199 2024-02-14T12:57:44.869 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 197/199 2024-02-14T12:57:44.870 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 198/199 2024-02-14T12:57:47.603 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/199 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: acl-2.3.1-4.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-14T12:57:47.604 INFO:teuthology.orchestra.run.smithi012.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.606 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.607 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-14T12:57:47.608 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.6-16.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-14T12:57:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-14T12:57:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.11-1.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-14T12:57:47.611 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-14T12:57:47.612 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-14T12:57:47.613 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-14T12:57:47.614 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-14T12:57:47.615 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-3.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-14T12:57:47.616 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-14T12:57:47.617 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-14T12:57:47.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:57:47.617 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-02-14T12:57:48.227 DEBUG:teuthology.parallel:result is None 2024-02-14T12:57:49.513 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 199/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 1/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 3/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 4/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3 5/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 6/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 7/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 8/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 9/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 10/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 11/199 2024-02-14T12:57:49.514 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 12/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 13/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 14/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_ 15/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 16/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 17/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 18/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86 19/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 20/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el 21/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9. 22/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_6 23/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 24/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 25/199 2024-02-14T12:57:49.515 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 26/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 27/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 28/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 29/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3. 30/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noa 31/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.n 32/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6f 33/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el 34/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 35/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.e 36/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 37/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 38/199 2024-02-14T12:57:49.516 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 39/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/199 2024-02-14T12:57:49.517 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/199 2024-02-14T12:57:49.518 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/199 2024-02-14T12:57:49.519 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 87/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 88/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 89/199 2024-02-14T12:57:49.520 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 90/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : jq-1.6-16.el9.x86_64 91/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 92/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 93/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 94/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 95/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 96/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ply-3.11-14.el9.noarch 97/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 98/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 99/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 100/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 101/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 102/199 2024-02-14T12:57:49.521 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 103/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 104/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 105/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 106/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 107/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 108/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 109/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 110/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 111/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 112/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 113/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 114/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 115/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 116/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 117/199 2024-02-14T12:57:49.522 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 118/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 119/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 120/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 121/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 122/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 123/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 124/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 125/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 126/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 127/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 128/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 129/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 130/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 131/199 2024-02-14T12:57:49.523 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 132/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 133/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 134/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 135/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 136/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 137/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 138/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 139/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 140/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 141/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 142/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 143/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 144/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 145/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : re2-1:20211101-3.el9.x86_64 146/199 2024-02-14T12:57:49.524 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 147/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 148/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 149/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 150/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 151/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 152/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 153/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/199 2024-02-14T12:57:49.525 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 162/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 163/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 164/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 165/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 166/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 167/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 168/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 169/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 170/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 171/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 172/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 173/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 174/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 175/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 176/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 177/199 2024-02-14T12:57:49.526 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 178/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 179/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 180/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 181/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 182/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 183/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 184/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 185/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 186/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 187/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 188/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 189/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 190/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 191/199 2024-02-14T12:57:49.527 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 192/199 2024-02-14T12:57:49.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 193/199 2024-02-14T12:57:49.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 194/199 2024-02-14T12:57:49.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 195/199 2024-02-14T12:57:49.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 196/199 2024-02-14T12:57:49.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 197/199 2024-02-14T12:57:49.528 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 198/199 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 199/199 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: acl-2.3.1-4.el9.x86_64 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-14T12:57:52.307 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.308 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.2-8.el9.noarch 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.7.4-5.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.309 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.310 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-shell-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:19.0.0-1280.ga6fe3fa3.el9.noarch 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.4-9.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-14T12:57:52.311 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: jq-1.6-16.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-14T12:57:52.312 INFO:teuthology.orchestra.run.smithi055.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: lua-5.4.4-4.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-14T12:57:52.313 INFO:teuthology.orchestra.run.smithi055.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-13.11-1.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-14T12:57:52.314 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-14T12:57:52.315 INFO:teuthology.orchestra.run.smithi055.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-14T12:57:52.316 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ply-3.11-14.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-14T12:57:52.317 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-14T12:57:52.318 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:19.0.0-1280.ga6fe3fa3.el9.x86_64 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: re2-1:20211101-3.el9.x86_64 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-14T12:57:52.319 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-14T12:57:52.320 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-14T12:57:52.320 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-14T12:57:52.320 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-14T12:57:52.320 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-14T12:57:52.320 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-02-14T12:57:52.320 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2024-02-14T12:57:52.909 DEBUG:teuthology.parallel:result is None 2024-02-14T12:57:52.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:57:53.122 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-14T12:57:53.148 INFO:teuthology.orchestra.run.smithi012.stdout:19.0.0-1280.ga6fe3fa3.el9 2024-02-14T12:57:53.148 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1280.ga6fe3fa3.el9 2024-02-14T12:57:53.148 INFO:teuthology.task.install:The correct ceph version 19.0.0-1280.ga6fe3fa3 is installed. 2024-02-14T12:57:53.150 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:57:53.286 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-14T12:57:53.312 INFO:teuthology.orchestra.run.smithi055.stdout:19.0.0-1280.ga6fe3fa3.el9 2024-02-14T12:57:53.313 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1280.ga6fe3fa3.el9 2024-02-14T12:57:53.313 INFO:teuthology.task.install:The correct ceph version 19.0.0-1280.ga6fe3fa3 is installed. 2024-02-14T12:57:53.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:57:53.530 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-14T12:57:53.556 INFO:teuthology.orchestra.run.smithi103.stdout:19.0.0-1280.ga6fe3fa3.el9 2024-02-14T12:57:53.557 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1280.ga6fe3fa3.el9 2024-02-14T12:57:53.557 INFO:teuthology.task.install:The correct ceph version 19.0.0-1280.ga6fe3fa3 is installed. 2024-02-14T12:57:53.558 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-14T12:57:53.559 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:57:53.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-14T12:57:53.593 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T12:57:53.594 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-14T12:57:53.633 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T12:57:53.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-14T12:57:53.666 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-14T12:57:53.666 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:57:53.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-02-14T12:57:53.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-14T12:57:53.767 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T12:57:53.767 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-02-14T12:57:53.803 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-14T12:57:53.878 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T12:57:53.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-02-14T12:57:53.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-14T12:57:53.980 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-14T12:57:53.980 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:57:53.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-14T12:57:54.011 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-14T12:57:54.080 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T12:57:54.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-14T12:57:54.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-14T12:57:54.191 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T12:57:54.191 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-14T12:57:54.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-14T12:57:54.290 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-14T12:57:54.290 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:57:54.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-02-14T12:57:54.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-14T12:57:54.391 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T12:57:54.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-02-14T12:57:54.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-14T12:57:54.502 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T12:57:54.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-02-14T12:57:54.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-14T12:57:54.600 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-14T12:57:54.693 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-02-14T12:57:54.693 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:57:54.694 INFO:tasks.cephadm:Cluster fsid is ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:57:54.694 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-14T12:57:54.695 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.12', 'mon.b': '172.21.15.55', 'mon.c': '172.21.15.103'} 2024-02-14T12:57:54.695 INFO:tasks.cephadm:First mon is mon.a on smithi012 2024-02-14T12:57:54.695 INFO:tasks.cephadm:First mgr is x 2024-02-14T12:57:54.695 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-14T12:57:54.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2024-02-14T12:57:54.726 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname $(hostname -s) 2024-02-14T12:57:54.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-02-14T12:57:54.792 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-02-14T12:57:54.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:57:55.009 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76546/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1280-ga6fe3fa3', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1280.ga6fe3fa3'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-06 07:00:06.982899', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240206.051942', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-02-14T12:57:55.163 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-vshankar-testing-20240206.051942, sha1 a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:57:55.164 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/x86_64/flavors/default/cephadm 2024-02-14T12:57:55.165 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:55.785 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-r--r--. 1 ubuntu ubuntu 766939 Feb 14 12:57 /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:55.785 DEBUG:teuthology.orchestra.run.smithi055:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.234 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r--. 1 ubuntu ubuntu 766939 Feb 14 12:57 /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.235 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240206.051942/a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 766939 Feb 14 12:57 /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.653 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.672 DEBUG:teuthology.orchestra.run.smithi055:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.692 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-14T12:57:56.729 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 on all hosts... 2024-02-14T12:57:56.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 pull 2024-02-14T12:57:56.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 pull 2024-02-14T12:57:56.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 pull 2024-02-14T12:57:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0... 2024-02-14T12:57:57.706 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0... 2024-02-14T12:57:57.707 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0... 2024-02-14T12:58:30.798 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-02-14T12:58:30.799 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev)", 2024-02-14T12:58:30.799 INFO:teuthology.orchestra.run.smithi055.stdout: "image_id": "87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90", 2024-02-14T12:58:30.799 INFO:teuthology.orchestra.run.smithi055.stdout: "repo_digests": [ 2024-02-14T12:58:30.799 INFO:teuthology.orchestra.run.smithi055.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836" 2024-02-14T12:58:30.799 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-02-14T12:58:30.799 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-02-14T12:58:44.556 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-02-14T12:58:44.557 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev)", 2024-02-14T12:58:44.557 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90", 2024-02-14T12:58:44.557 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2024-02-14T12:58:44.557 INFO:teuthology.orchestra.run.smithi012.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836" 2024-02-14T12:58:44.557 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T12:58:44.557 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev)", 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90", 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836" 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-02-14T12:58:44.649 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-02-14T12:58:44.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2024-02-14T12:58:44.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph 2024-02-14T12:58:44.741 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-02-14T12:58:44.771 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2024-02-14T12:58:44.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /etc/ceph 2024-02-14T12:58:44.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-02-14T12:58:44.859 INFO:tasks.cephadm:Writing seed config... 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-14T12:58:44.860 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-14T12:58:44.861 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-14T12:58:44.862 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-14T12:58:44.863 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-02-14T12:58:44.863 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:58:44.863 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-14T12:58:44.877 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ab42aa14-cb38-11ee-95b9-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-14T12:58:44.878 DEBUG:teuthology.orchestra.run.smithi012:mon.a> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a.service 2024-02-14T12:58:44.919 DEBUG:teuthology.orchestra.run.smithi012:mgr.x> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x.service 2024-02-14T12:58:44.962 INFO:tasks.cephadm:Bootstrapping... 2024-02-14T12:58:44.962 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 -v bootstrap --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-14T12:58:45.160 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-02-14T12:58:45.160 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0', '-v', 'bootstrap', '--fsid', 'ab42aa14-cb38-11ee-95b9-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.12', '--skip-admin-label'] 2024-02-14T12:58:45.187 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-14T12:58:45.187 INFO:teuthology.orchestra.run.smithi012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-14T12:58:45.187 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying podman|docker is present... 2024-02-14T12:58:45.211 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-14T12:58:45.211 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying lvm2 is present... 2024-02-14T12:58:45.211 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying time synchronization is in place... 2024-02-14T12:58:45.218 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-14T12:58:45.218 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-14T12:58:45.224 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-14T12:58:45.224 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-02-14T12:58:45.230 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-02-14T12:58:45.236 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-02-14T12:58:45.236 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-02-14T12:58:45.236 INFO:teuthology.orchestra.run.smithi012.stdout:Repeating the final host check... 2024-02-14T12:58:45.258 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-14T12:58:45.258 INFO:teuthology.orchestra.run.smithi012.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-14T12:58:45.258 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl is present 2024-02-14T12:58:45.258 INFO:teuthology.orchestra.run.smithi012.stdout:lvcreate is present 2024-02-14T12:58:45.264 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-14T12:58:45.264 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-14T12:58:45.270 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-14T12:58:45.270 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-02-14T12:58:45.276 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-02-14T12:58:45.282 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-02-14T12:58:45.282 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-02-14T12:58:45.282 INFO:teuthology.orchestra.run.smithi012.stdout:Host looks OK 2024-02-14T12:58:45.283 INFO:teuthology.orchestra.run.smithi012.stdout:Cluster fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:45.283 INFO:teuthology.orchestra.run.smithi012.stdout:Acquiring lock 140533180837840 on /run/cephadm/ab42aa14-cb38-11ee-95b9-87774f69a715.lock 2024-02-14T12:58:45.283 INFO:teuthology.orchestra.run.smithi012.stdout:Lock 140533180837840 acquired on /run/cephadm/ab42aa14-cb38-11ee-95b9-87774f69a715.lock 2024-02-14T12:58:45.283 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 3300 ... 2024-02-14T12:58:45.283 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 6789 ... 2024-02-14T12:58:45.284 INFO:teuthology.orchestra.run.smithi012.stdout:Base mon IP(s) is [172.21.15.12:3300, 172.21.15.12:6789], mon addrv is [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-02-14T12:58:45.287 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.12 metric 100 2024-02-14T12:58:45.287 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.12 metric 100 2024-02-14T12:58:45.289 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-14T12:58:45.290 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-02-14T12:58:45.290 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-02-14T12:58:45.292 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-14T12:58:45.292 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-14T12:58:45.292 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-14T12:58:45.292 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-14T12:58:45.292 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2024-02-14T12:58:45.292 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-14T12:58:45.293 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-02-14T12:58:45.293 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-02-14T12:58:45.293 INFO:teuthology.orchestra.run.smithi012.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-14T12:58:45.293 INFO:teuthology.orchestra.run.smithi012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-14T12:58:45.294 INFO:teuthology.orchestra.run.smithi012.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0... 2024-02-14T12:58:45.959 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 2024-02-14T12:58:45.959 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0... 2024-02-14T12:58:45.959 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Getting image source signatures 2024-02-14T12:58:45.959 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:9c40cf8047e524d6cb701163cfe8fa35604e82efa085066a178ca58e787e46ad 2024-02-14T12:58:45.959 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:58df4e03ba066accf3a7e07426bab5f1c867e27a139801c642bdafb42b9a2d9a 2024-02-14T12:58:45.959 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying config sha256:87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 2024-02-14T12:58:45.960 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-14T12:58:46.872 INFO:teuthology.orchestra.run.smithi012.stdout:ceph: stdout ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev) 2024-02-14T12:58:46.872 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph version: ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev) 2024-02-14T12:58:46.872 INFO:teuthology.orchestra.run.smithi012.stdout:Extracting ceph user uid/gid from container image... 2024-02-14T12:58:47.744 INFO:teuthology.orchestra.run.smithi012.stdout:stat: stdout 167 167 2024-02-14T12:58:47.744 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial keys... 2024-02-14T12:58:48.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAIucxlEpCZAhAA6qeZz9nfGVfkZaIsFO1dwg== 2024-02-14T12:58:49.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAIucxlZEaIOxAAW2Eb1IR7BqPKwu9X3vSPjQ== 2024-02-14T12:58:50.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQAJucxlL+ECNxAAH/IFn+si3N4EWl6KvizW5w== 2024-02-14T12:58:50.487 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial monmap... 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool for a [v2:172.21.15.12:3300,v1:172.21.15.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-02-14T12:58:51.393 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: set fsid to ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:51.394 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-14T12:58:51.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:58:51.394 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mon... 2024-02-14T12:58:52.298 INFO:teuthology.orchestra.run.smithi012.stdout:create mon.a on 2024-02-14T12:58:52.500 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-14T12:58:52.637 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-14T12:58:52.811 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715.target → /etc/systemd/system/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715.target. 2024-02-14T12:58:52.812 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715.target → /etc/systemd/system/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715.target. 2024-02-14T12:58:53.046 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a 2024-02-14T12:58:53.046 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a.service: Unit ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a.service not loaded. 2024-02-14T12:58:53.210 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715.target.wants/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a.service → /etc/systemd/system/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@.service. 2024-02-14T12:58:53.748 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-14T12:58:53.748 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-02-14T12:58:53.754 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-14T12:58:53.755 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-02-14T12:58:53.755 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-02-14T12:58:53.755 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-02-14T12:58:53.755 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon to start... 2024-02-14T12:58:53.755 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon... 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout cluster: 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout id: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout services: 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.588009s) 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:58:54.808 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout data: 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pgs: 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d7e893700 1 Processor -- start 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d7e893700 1 -- start start 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d7e893700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d78107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d7e893700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78108130 con 0x7f8d78107740 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d78107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d78107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53112/0 (socket says 172.21.15.12:53112) 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.210+0000 7f8d77fff700 1 -- 172.21.15.12:0/201548867 learned_addr learned my addr 172.21.15.12:0/201548867 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:54.809 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d77fff700 1 -- 172.21.15.12:0/201548867 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d781088f0 con 0x7f8d78107740 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d77fff700 1 --2- 172.21.15.12:0/201548867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d78107b60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8d680098a0 tx=0x7f8d68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a803e4de8fa3fc server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d76ffd700 1 -- 172.21.15.12:0/201548867 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d68004160 con 0x7f8d78107740 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d76ffd700 1 -- 172.21.15.12:0/201548867 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d680042c0 con 0x7f8d78107740 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d76ffd700 1 -- 172.21.15.12:0/201548867 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d680045a0 con 0x7f8d78107740 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d7e893700 1 -- 172.21.15.12:0/201548867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 msgr2=0x7f8d78107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.211+0000 7f8d7e893700 1 --2- 172.21.15.12:0/201548867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d78107b60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8d680098a0 tx=0x7f8d68009bb0 comp rx=0 tx=0).stop 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 -- 172.21.15.12:0/201548867 shutdown_connections 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 --2- 172.21.15.12:0/201548867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d78107b60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 -- 172.21.15.12:0/201548867 >> 172.21.15.12:0/201548867 conn(0x7f8d78102d60 msgr2=0x7f8d78105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 -- 172.21.15.12:0/201548867 shutdown_connections 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 -- 172.21.15.12:0/201548867 wait complete. 2024-02-14T12:58:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 Processor -- start 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 -- start start 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.212+0000 7f8d7e893700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d7819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d7e893700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7819b0d0 con 0x7f8d78107740 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d7819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d7819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53126/0 (socket says 172.21.15.12:53126) 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d77fff700 1 -- 172.21.15.12:0/544385110 learned_addr learned my addr 172.21.15.12:0/544385110 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d77fff700 1 -- 172.21.15.12:0/544385110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68009550 con 0x7f8d78107740 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d77fff700 1 --2- 172.21.15.12:0/544385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d7819ab90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8d68004000 tx=0x7f8d68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d68011630 con 0x7f8d78107740 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68011790 con 0x7f8d78107740 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7819b2d0 con 0x7f8d78107740 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d68011a30 con 0x7f8d78107740 2024-02-14T12:58:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7819b770 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.213+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8d68021070 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.214+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8d6801b7d0 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.214+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78194870 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.217+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8d6801ba30 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.290+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8d7802d770 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.290+0000 7f8d757fa700 1 -- 172.21.15.12:0/544385110 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f8d6801bbd0 con 0x7f8d78107740 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 msgr2=0x7f8d7819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 --2- 172.21.15.12:0/544385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d7819ab90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8d68004000 tx=0x7f8d68004750 comp rx=0 tx=0).stop 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 shutdown_connections 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 --2- 172.21.15.12:0/544385110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d78107740 0x7f8d7819ab90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 >> 172.21.15.12:0/544385110 conn(0x7f8d78102d60 msgr2=0x7f8d781919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:54.812 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 shutdown_connections 2024-02-14T12:58:54.813 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:54.291+0000 7f8d7e893700 1 -- 172.21.15.12:0/544385110 wait complete. 2024-02-14T12:58:54.813 INFO:teuthology.orchestra.run.smithi012.stdout:mon is available 2024-02-14T12:58:54.813 INFO:teuthology.orchestra.run.smithi012.stdout:Assimilating anything we can from ceph.conf... 2024-02-14T12:58:55.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-14T12:58:55.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdad0790700 1 Processor -- start 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdad0790700 1 -- start start 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdad0790700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac810a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdad0790700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac810aa40 con 0x7fdac8108110 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdace52c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac810a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdace52c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac810a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39102/0 (socket says 172.21.15.12:39102) 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.237+0000 7fdace52c700 1 -- 172.21.15.12:0/3858979743 learned_addr learned my addr 172.21.15.12:0/3858979743 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdace52c700 1 -- 172.21.15.12:0/3858979743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac810ab80 con 0x7fdac8108110 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdace52c700 1 --2- 172.21.15.12:0/3858979743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac810a500 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdac40098a0 tx=0x7fdac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be31fc2a8e90a29 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:55.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdacd52a700 1 -- 172.21.15.12:0/3858979743 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdac4004160 con 0x7fdac8108110 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdacd52a700 1 -- 172.21.15.12:0/3858979743 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40042c0 con 0x7fdac8108110 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdacd52a700 1 -- 172.21.15.12:0/3858979743 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdac40045a0 con 0x7fdac8108110 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdad0790700 1 -- 172.21.15.12:0/3858979743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 msgr2=0x7fdac810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.238+0000 7fdad0790700 1 --2- 172.21.15.12:0/3858979743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac810a500 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdac40098a0 tx=0x7fdac4009bb0 comp rx=0 tx=0).stop 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 -- 172.21.15.12:0/3858979743 shutdown_connections 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 --2- 172.21.15.12:0/3858979743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac810a500 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 -- 172.21.15.12:0/3858979743 >> 172.21.15.12:0/3858979743 conn(0x7fdac8101b80 msgr2=0x7fdac8103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 -- 172.21.15.12:0/3858979743 shutdown_connections 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 -- 172.21.15.12:0/3858979743 wait complete. 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 Processor -- start 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 -- start start 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:55.792 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.239+0000 7fdad0790700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac819b1a0 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdace52c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdace52c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac819ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39108/0 (socket says 172.21.15.12:39108) 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdace52c700 1 -- 172.21.15.12:0/1545204013 learned_addr learned my addr 172.21.15.12:0/1545204013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdace52c700 1 -- 172.21.15.12:0/1545204013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009550 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdace52c700 1 --2- 172.21.15.12:0/1545204013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac819ac60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdac807a300 tx=0x7fdac4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdac4011630 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4011790 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdac4011a30 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac819b3a0 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac819b840 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdac4022070 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.240+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdac401c450 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.241+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac8194aa0 con 0x7fdac8108110 2024-02-14T12:58:55.793 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.243+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdac4011b90 con 0x7fdac8108110 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.313+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdac810b0a0 con 0x7fdac8108110 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.316+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fdac4011de0 con 0x7fdac8108110 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdabf7fe700 1 -- 172.21.15.12:0/1545204013 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdac401c6b0 con 0x7fdac8108110 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 msgr2=0x7fdac819ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 --2- 172.21.15.12:0/1545204013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac819ac60 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdac807a300 tx=0x7fdac4004750 comp rx=0 tx=0).stop 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 shutdown_connections 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 --2- 172.21.15.12:0/1545204013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdac8108110 0x7fdac819ac60 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 >> 172.21.15.12:0/1545204013 conn(0x7fdac8101b80 msgr2=0x7fdac8103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 shutdown_connections 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:55.317+0000 7fdad0790700 1 -- 172.21.15.12:0/1545204013 wait complete. 2024-02-14T12:58:55.794 INFO:teuthology.orchestra.run.smithi012.stdout:Generating new minimal ceph.conf... 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac590a8700 1 Processor -- start 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac590a8700 1 -- start start 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac590a8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac54107f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac590a8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac54108530 con 0x7fac54107b40 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac52d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac54107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac52d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac54107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39110/0 (socket says 172.21.15.12:39110) 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac52d9d700 1 -- 172.21.15.12:0/3234135516 learned_addr learned my addr 172.21.15.12:0/3234135516 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.185+0000 7fac52d9d700 1 -- 172.21.15.12:0/3234135516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac541067a0 con 0x7fac54107b40 2024-02-14T12:58:56.802 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac52d9d700 1 --2- 172.21.15.12:0/3234135516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac54107f60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fac440098a0 tx=0x7fac44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426784552aa50a48 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac51d9b700 1 -- 172.21.15.12:0/3234135516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac44004160 con 0x7fac54107b40 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac51d9b700 1 -- 172.21.15.12:0/3234135516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac440042c0 con 0x7fac54107b40 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac51d9b700 1 -- 172.21.15.12:0/3234135516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac44011ac0 con 0x7fac54107b40 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 -- 172.21.15.12:0/3234135516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 msgr2=0x7fac54107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 --2- 172.21.15.12:0/3234135516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac54107f60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fac440098a0 tx=0x7fac44009bb0 comp rx=0 tx=0).stop 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 -- 172.21.15.12:0/3234135516 shutdown_connections 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 --2- 172.21.15.12:0/3234135516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac54107f60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 -- 172.21.15.12:0/3234135516 >> 172.21.15.12:0/3234135516 conn(0x7fac541012d0 msgr2=0x7fac541036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 -- 172.21.15.12:0/3234135516 shutdown_connections 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.186+0000 7fac590a8700 1 -- 172.21.15.12:0/3234135516 wait complete. 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.187+0000 7fac590a8700 1 Processor -- start 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.187+0000 7fac590a8700 1 -- start start 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.187+0000 7fac590a8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac5419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:56.803 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.187+0000 7fac590a8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5419b9e0 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac52d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac5419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac52d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac5419b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39114/0 (socket says 172.21.15.12:39114) 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac52d9d700 1 -- 172.21.15.12:0/892195273 learned_addr learned my addr 172.21.15.12:0/892195273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac52d9d700 1 -- 172.21.15.12:0/892195273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44009550 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac52d9d700 1 --2- 172.21.15.12:0/892195273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac5419b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fac44011a70 tx=0x7fac44011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac440039c0 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac44003b20 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5419bbe0 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac44024610 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5419c080 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fac44024c00 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.188+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fac44019920 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.189+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac541955c0 con 0x7fac54107b40 2024-02-14T12:58:56.804 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.191+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fac4401aa10 con 0x7fac54107b40 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.261+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fac5410ac10 con 0x7fac54107b40 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.261+0000 7fac3bfff700 1 -- 172.21.15.12:0/892195273 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fac4401abb0 con 0x7fac54107b40 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 msgr2=0x7fac5419b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 --2- 172.21.15.12:0/892195273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac5419b4a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fac44011a70 tx=0x7fac44011b50 comp rx=0 tx=0).stop 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 shutdown_connections 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 --2- 172.21.15.12:0/892195273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac54107b40 0x7fac5419b4a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 >> 172.21.15.12:0/892195273 conn(0x7fac541012d0 msgr2=0x7fac54102190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 shutdown_connections 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:56.262+0000 7fac590a8700 1 -- 172.21.15.12:0/892195273 wait complete. 2024-02-14T12:58:56.805 INFO:teuthology.orchestra.run.smithi012.stdout:Restarting the monitor... 2024-02-14T12:58:56.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:56 smithi012 systemd[1]: Stopping Ceph mon.a for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T12:58:57.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a[31991]: 2024-02-14T12:58:57.071+0000 7f0989a3e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T12:58:57.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a[31991]: 2024-02-14T12:58:57.071+0000 7f0989a3e700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-14T12:58:57.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:57 smithi012 podman[32241]: 2024-02-14 12:58:57.266384362 +0000 UTC m=+0.307414297 container died 3bb5026223802e0fcf5ee085a88949eb16bcd609248f69c7c156bddda547ca52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0) 2024-02-14T12:58:57.782 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:57 smithi012 podman[32241]: 2024-02-14 12:58:57.580291693 +0000 UTC m=+0.621321639 container cleanup 3bb5026223802e0fcf5ee085a88949eb16bcd609248f69c7c156bddda547ca52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-02-14T12:58:57.782 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:57 smithi012 bash[32241]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a 2024-02-14T12:58:58.199 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:57 smithi012 podman[32255]: 2024-02-14 12:58:57.781254666 +0000 UTC m=+0.515104660 container remove 3bb5026223802e0fcf5ee085a88949eb16bcd609248f69c7c156bddda547ca52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T12:58:58.199 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a.service: Deactivated successfully. 2024-02-14T12:58:58.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 systemd[1]: Stopped Ceph mon.a for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T12:58:58.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 systemd[1]: Starting Ceph mon.a for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 podman[32352]: 2024-02-14 12:58:58.198505381 +0000 UTC m=+0.091574710 container create 3413393e387400fe5a3cd7fd6a1791b6f862ddc74d3f6f31b2b501a80c33ed8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 podman[32352]: 2024-02-14 12:58:58.123975672 +0000 UTC m=+0.017045006 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 podman[32352]: 2024-02-14 12:58:58.41789035 +0000 UTC m=+0.310959692 container init 3413393e387400fe5a3cd7fd6a1791b6f862ddc74d3f6f31b2b501a80c33ed8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 podman[32352]: 2024-02-14 12:58:58.420653663 +0000 UTC m=+0.313722989 container start 3413393e387400fe5a3cd7fd6a1791b6f862ddc74d3f6f31b2b501a80c33ed8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: set uid:gid to 167:167 (ceph:ceph) 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev), process ceph-mon, pid 2 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: pidfile_write: ignore empty --pid-file 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: load: jerasure load: lrc 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: RocksDB version: 7.9.2 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Git sha 0 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Compile date 2024-02-06 05:38:06 2024-02-14T12:58:58.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: DB SUMMARY 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: DB Session ID: I2PCJXN6WWYIZC73M7ZW 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: CURRENT file: CURRENT 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: IDENTITY file: IDENTITY 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 100064 ; 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.error_if_exists: 0 2024-02-14T12:58:58.451 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.create_if_missing: 0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.paranoid_checks: 1 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.env: 0x564208ee1ae0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.fs: PosixFileSystem 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.info_log: 0x56420a47d8c0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_file_opening_threads: 16 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.statistics: (nil) 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.use_fsync: 0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_log_file_size: 0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-14T12:58:58.452 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.keep_log_file_num: 1000 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.recycle_log_file_num: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.allow_fallocate: 1 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.allow_mmap_reads: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.allow_mmap_writes: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.use_direct_reads: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.create_missing_column_families: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.db_log_dir: 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.wal_dir: 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-14T12:58:58.453 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.advise_random_on_open: 1 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.db_write_buffer_size: 0 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.write_buffer_manager: 0x56420a451400 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.rate_limiter: (nil) 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.wal_recovery_mode: 2 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.enable_thread_tracking: 0 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.enable_pipelined_write: 0 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.unordered_write: 0 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-14T12:58:58.454 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.row_cache: None 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.wal_filter: None 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.allow_ingest_behind: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.two_write_queues: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.manual_wal_flush: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.wal_compression: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.atomic_flush: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.log_readahead_size: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.best_efforts_recovery: 0 2024-02-14T12:58:58.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.allow_data_in_errors: 0 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.db_host_id: __hostname__ 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_background_jobs: 2 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_background_compactions: -1 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_subcompactions: 1 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_total_wal_size: 0 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-14T12:58:58.456 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_open_files: -1 2024-02-14T12:58:58.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bytes_per_sync: 0 2024-02-14T12:58:58.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-14T12:58:58.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-14T12:58:58.457 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_readahead_size: 0 2024-02-14T12:58:58.541 INFO:teuthology.orchestra.run.smithi012.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-14T12:58:58.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_background_flushes: -1 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Compression algorithms supported: 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kZSTD supported: 0 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kXpressCompression supported: 0 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kLZ4HCCompression supported: 1 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kZlibCompression supported: 1 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kSnappyCompression supported: 1 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kLZ4Compression supported: 1 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: kBZip2Compression supported: 0 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-14T12:58:58.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.merge_operator: 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_filter: None 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_filter_factory: None 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.sst_partitioner_factory: None 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56420a47d9c0) 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2024-02-14T12:58:58.719 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x56420a481090 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2024-02-14T12:58:58.720 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-02-14T12:58:58.721 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.write_buffer_size: 33554432 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_write_buffer_number: 2 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression: NoCompression 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression: Disabled 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.prefix_extractor: nullptr 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.num_levels: 7 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-14T12:58:58.722 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.level: 32767 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.strategy: 0 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.enabled: false 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-14T12:58:58.723 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-14T12:58:58.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-14T12:58:58.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.target_file_size_base: 67108864 2024-02-14T12:58:58.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-14T12:58:58.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-14T12:58:58.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-14T12:58:58.724 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.arena_block_size: 1048576 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.disable_auto_compactions: 0 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-14T12:58:58.725 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.table_properties_collectors: 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.inplace_update_support: 0 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.bloom_locality: 0 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.max_successive_merges: 0 2024-02-14T12:58:58.726 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.paranoid_file_checks: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.force_consistency_checks: 1 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.report_bg_io_stats: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.ttl: 2592000 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.enable_blob_files: false 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.min_blob_size: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.blob_file_size: 268435456 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-14T12:58:58.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.blob_file_starting_level: 0 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cf8bc9e6-eff8-49fa-b669-ed4df2917d47 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707915538449303, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707915538450232, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95239, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 93237, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13878, "raw_average_key_size": 50, "raw_value_size": 85657, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 277, "num_filter_entries": 277, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707915538, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf8bc9e6-eff8-49fa-b669-ed4df2917d47", "db_session_id": "I2PCJXN6WWYIZC73M7ZW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707915538450314, "job": 1, "event": "recovery_finished"} 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56420a572000 2024-02-14T12:58:58.728 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: DB pointer 0x56420a55c000 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 2/0 94.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-14T12:58:58.729 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 94.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 156.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-14T12:58:58.730 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 29.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 29.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x56420a481090#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???) e1 preinit fsid ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).mds e1 new map 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).mds e1 print_map 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: e1 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: -1 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-02-14T12:58:58.731 INFO:journalctl@ceph.mon.a.smithi012.stdout: No filesystems configured 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mon.a is new leader, mons a in quorum (ranks 0) 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: monmap e1: 1 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: fsmap 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: osdmap e1: 0 total, 0 up, 0 in 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 ceph-mon[32370]: mgrmap e1: no daemons active 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 bash[32352]: 3413393e387400fe5a3cd7fd6a1791b6f862ddc74d3f6f31b2b501a80c33ed8d 2024-02-14T12:58:58.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:58:58 smithi012 systemd[1]: Started Ceph mon.a for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T12:58:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.940+0000 7fca0f22d700 1 Processor -- start 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.940+0000 7fca0f22d700 1 -- start start 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0f22d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0810a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0f22d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080754e0 con 0x7fca08108140 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0cfc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0810a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0cfc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0810a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39118/0 (socket says 172.21.15.12:39118) 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0cfc9700 1 -- 172.21.15.12:0/959400485 learned_addr learned my addr 172.21.15.12:0/959400485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0cfc9700 1 -- 172.21.15.12:0/959400485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0810aa70 con 0x7fca08108140 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca0cfc9700 1 --2- 172.21.15.12:0/959400485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0810a530 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0098a0 tx=0x7fc9fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9819f5ecc05bc512 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.941+0000 7fca077fe700 1 -- 172.21.15.12:0/959400485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc004160 con 0x7fca08108140 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca077fe700 1 -- 172.21.15.12:0/959400485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9fc0042c0 con 0x7fca08108140 2024-02-14T12:58:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca077fe700 1 -- 172.21.15.12:0/959400485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc011ac0 con 0x7fca08108140 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 -- 172.21.15.12:0/959400485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 msgr2=0x7fca0810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 --2- 172.21.15.12:0/959400485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0810a530 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0098a0 tx=0x7fc9fc009bb0 comp rx=0 tx=0).stop 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 -- 172.21.15.12:0/959400485 shutdown_connections 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 --2- 172.21.15.12:0/959400485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0810a530 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 -- 172.21.15.12:0/959400485 >> 172.21.15.12:0/959400485 conn(0x7fca08101b70 msgr2=0x7fca08103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 -- 172.21.15.12:0/959400485 shutdown_connections 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.942+0000 7fca0f22d700 1 -- 172.21.15.12:0/959400485 wait complete. 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0f22d700 1 Processor -- start 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0f22d700 1 -- start start 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0f22d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0f22d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819b970 con 0x7fca08108140 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0cfc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0cfc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0819b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39130/0 (socket says 172.21.15.12:39130) 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0cfc9700 1 -- 172.21.15.12:0/8636394 learned_addr learned my addr 172.21.15.12:0/8636394 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:58:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0cfc9700 1 -- 172.21.15.12:0/8636394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009550 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.943+0000 7fca0cfc9700 1 --2- 172.21.15.12:0/8636394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0819b430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009130 tx=0x7fc9fc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc003aa0 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9fc003c00 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0819bb70 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc024800 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0819c010 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc9fc02d3f0 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.944+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc9fc019760 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.945+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0810b870 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:58.947+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc9fc024e00 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.017+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fca0810ba30 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.019+0000 7fca05ffb700 1 -- 172.21.15.12:0/8636394 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc9fc01abd0 con 0x7fca08108140 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 msgr2=0x7fca0819b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 --2- 172.21.15.12:0/8636394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0819b430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009130 tx=0x7fc9fc011b40 comp rx=0 tx=0).stop 2024-02-14T12:58:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 shutdown_connections 2024-02-14T12:58:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 --2- 172.21.15.12:0/8636394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca08108140 0x7fca0819b430 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:58:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 >> 172.21.15.12:0/8636394 conn(0x7fca08101b70 msgr2=0x7fca08102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:58:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 shutdown_connections 2024-02-14T12:58:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:58:59.020+0000 7fca0f22d700 1 -- 172.21.15.12:0/8636394 wait complete. 2024-02-14T12:58:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-14T12:58:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-14T12:58:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mgr... 2024-02-14T12:58:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-14T12:58:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-14T12:58:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x 2024-02-14T12:58:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x.service: Unit ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x.service not loaded. 2024-02-14T12:58:59.952 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715.target.wants/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@.service. 2024-02-14T12:59:00.169 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:00 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/8636394' entity='client.admin' 2024-02-14T12:59:00.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:00 smithi012 podman[32590]: 2024-02-14 12:59:00.085483755 +0000 UTC m=+0.017270358 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T12:59:01.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:01 smithi012 podman[32590]: 2024-02-14 12:59:01.546873475 +0000 UTC m=+1.478660078 container init 454a9a83b62c1a49cddb2153e4807261190e35064efe338745c267d9d7aac997 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-02-14T12:59:01.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:01 smithi012 podman[32590]: 2024-02-14 12:59:01.55033351 +0000 UTC m=+1.482120119 container start 454a9a83b62c1a49cddb2153e4807261190e35064efe338745c267d9d7aac997 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-14T12:59:02.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:02.114+0000 7fcf0673f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-14T12:59:02.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:02.209+0000 7fcf0673f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-14T12:59:02.563 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-14T12:59:02.563 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-02-14T12:59:02.570 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-14T12:59:02.570 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-02-14T12:59:02.570 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-02-14T12:59:02.570 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-02-14T12:59:02.579 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-14T12:59:02.579 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-02-14T12:59:02.587 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-14T12:59:02.587 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-02-14T12:59:02.587 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-02-14T12:59:02.587 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-02-14T12:59:02.587 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr to start... 2024-02-14T12:59:02.587 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr... 2024-02-14T12:59:02.896 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:02 smithi012 bash[32590]: 454a9a83b62c1a49cddb2153e4807261190e35064efe338745c267d9d7aac997 2024-02-14T12:59:02.896 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:02 smithi012 systemd[1]: Started Ceph mgr.x for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T12:59:02.896 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:02.894+0000 7fcf0673f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-14T12:59:03.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:02.989+0000 7fcf0673f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-14T12:59:03.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.132+0000 7fcf0673f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-14T12:59:03.575 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.230+0000 7fcf0673f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-14T12:59:03.575 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.315+0000 7fcf0673f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-14T12:59:03.885 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.584+0000 7fcf0673f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-14T12:59:03.885 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.697+0000 7fcf0673f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-14T12:59:03.885 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.786+0000 7fcf0673f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-14T12:59:03.885 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:03.883+0000 7fcf0673f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-14T12:59:04.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:04.061+0000 7fcf0673f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-14T12:59:05.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:05.071+0000 7fcf0673f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-14T12:59:05.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:05.206+0000 7fcf0673f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-14T12:59:05.835 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:05.544+0000 7fcf0673f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-14T12:59:05.835 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:05.637+0000 7fcf0673f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-14T12:59:06.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:05 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2642610907' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-14T12:59:06.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:05.847+0000 7fcf0673f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-14T12:59:06.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:06.035+0000 7fcf0673f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-14T12:59:06.588 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:06.323+0000 7fcf0673f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-14T12:59:06.588 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:06.586+0000 7fcf0673f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-14T12:59:06.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:06.828+0000 7fcf0673f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-14T12:59:07.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:07.659+0000 7fcf0673f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-14T12:59:08.569 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:08.244+0000 7fcf0673f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-14T12:59:08.569 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:08.346+0000 7fcf0673f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-14T12:59:08.569 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:08.567+0000 7fcf0673f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-14T12:59:09.000 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "ab42aa14-cb38-11ee-95b9-87774f69a715", 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-02-14T12:59:09.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-14T12:59:09.004 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-14T12:59:09.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-14T12:59:09.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-14T12:59:09.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-14T12:59:09.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-14T12:59:09.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-14T12:59:09.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-02-14T12:58:53.704528+0000", 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-02-14T12:59:09.014 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.699+0000 7f075d5bf700 1 Processor -- start 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.699+0000 7f075d5bf700 1 -- start start 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.699+0000 7f075d5bf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f07581069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.699+0000 7f075d5bf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758106f80 con 0x7f0758106590 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.700+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f07581069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.700+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f07581069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37038/0 (socket says 172.21.15.12:37038) 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.700+0000 7f0756ffd700 1 -- 172.21.15.12:0/2046771550 learned_addr learned my addr 172.21.15.12:0/2046771550 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.700+0000 7f0756ffd700 1 -- 172.21.15.12:0/2046771550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758107790 con 0x7f0758106590 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.700+0000 7f0756ffd700 1 --2- 172.21.15.12:0/2046771550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f07581069b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f07480098a0 tx=0x7f0748009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a720bc76104f22 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.700+0000 7f0755ffb700 1 -- 172.21.15.12:0/2046771550 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0748004160 con 0x7f0758106590 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f0755ffb700 1 -- 172.21.15.12:0/2046771550 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07480042c0 con 0x7f0758106590 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f0755ffb700 1 -- 172.21.15.12:0/2046771550 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0748011ac0 con 0x7f0758106590 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 -- 172.21.15.12:0/2046771550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 msgr2=0x7f07581069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 --2- 172.21.15.12:0/2046771550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f07581069b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f07480098a0 tx=0x7f0748009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:09.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 -- 172.21.15.12:0/2046771550 shutdown_connections 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 --2- 172.21.15.12:0/2046771550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f07581069b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 -- 172.21.15.12:0/2046771550 >> 172.21.15.12:0/2046771550 conn(0x7f0758101b70 msgr2=0x7f0758103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 -- 172.21.15.12:0/2046771550 shutdown_connections 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.701+0000 7f075d5bf700 1 -- 172.21.15.12:0/2046771550 wait complete. 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f075d5bf700 1 Processor -- start 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f075d5bf700 1 -- start start 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f075d5bf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f0758191700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f075d5bf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758191c40 con 0x7f0758106590 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f0758191700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f0756ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f0758191700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37052/0 (socket says 172.21.15.12:37052) 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.702+0000 7f0756ffd700 1 -- 172.21.15.12:0/2642610907 learned_addr learned my addr 172.21.15.12:0/2642610907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f0756ffd700 1 -- 172.21.15.12:0/2642610907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748009550 con 0x7f0758106590 2024-02-14T12:59:09.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f0756ffd700 1 --2- 172.21.15.12:0/2642610907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f0758191700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0748000c00 tx=0x7f0748011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0748003aa0 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075818fe30 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0748003c00 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07480248a0 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07581902d0 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f074802d3f0 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.703+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f07480197b0 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.704+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758068df0 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.707+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f074801ac60 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.781+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0758195070 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.782+0000 7f073ffff700 1 -- 172.21.15.12:0/2642610907 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f0748035090 con 0x7f0758106590 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 msgr2=0x7f0758191700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:09.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 --2- 172.21.15.12:0/2642610907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f0758191700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0748000c00 tx=0x7f0748011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 shutdown_connections 2024-02-14T12:59:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 --2- 172.21.15.12:0/2642610907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758106590 0x7f0758191700 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 >> 172.21.15.12:0/2642610907 conn(0x7f0758101b70 msgr2=0x7f07581029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 shutdown_connections 2024-02-14T12:59:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:05.783+0000 7f075d5bf700 1 -- 172.21.15.12:0/2642610907 wait complete. 2024-02-14T12:59:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (1/15)... 2024-02-14T12:59:09.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: Activating manager daemon x 2024-02-14T12:59:09.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: mgrmap e2: x(active, starting, since 0.00299229s) 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: Manager daemon x is now available 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' 2024-02-14T12:59:09.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:09 smithi012 ceph-mon[32370]: from='mgr.14100 172.21.15.12:0/2015205137' entity='mgr.x' 2024-02-14T12:59:10.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:10 smithi012 ceph-mon[32370]: mgrmap e3: x(active, since 1.00734s) 2024-02-14T12:59:12.333 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:59:12.333 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-02-14T12:59:12.333 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "ab42aa14-cb38-11ee-95b9-87774f69a715", 2024-02-14T12:59:12.333 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-14T12:59:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-14T12:59:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-14T12:59:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-02-14T12:58:53.704528+0000", 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.425+0000 7fb2db19a700 1 Processor -- start 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.425+0000 7fb2db19a700 1 -- start start 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2db19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d407b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2db19a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d407b830 con 0x7fb2d407ce40 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2d8f36700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d407b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2d8f36700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d407b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37098/0 (socket says 172.21.15.12:37098) 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2d8f36700 1 -- 172.21.15.12:0/3997451679 learned_addr learned my addr 172.21.15.12:0/3997451679 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2d8f36700 1 -- 172.21.15.12:0/3997451679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d407b970 con 0x7fb2d407ce40 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2d8f36700 1 --2- 172.21.15.12:0/3997451679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d407b2f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098a0 tx=0x7fb2c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bef24d933320b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.426+0000 7fb2d37fe700 1 -- 172.21.15.12:0/3997451679 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c4004160 con 0x7fb2d407ce40 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2d37fe700 1 -- 172.21.15.12:0/3997451679 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2c40042c0 con 0x7fb2d407ce40 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2d37fe700 1 -- 172.21.15.12:0/3997451679 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c4011ac0 con 0x7fb2d407ce40 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 -- 172.21.15.12:0/3997451679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 msgr2=0x7fb2d407b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 --2- 172.21.15.12:0/3997451679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d407b2f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098a0 tx=0x7fb2c4009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 -- 172.21.15.12:0/3997451679 shutdown_connections 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 --2- 172.21.15.12:0/3997451679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d407b2f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 -- 172.21.15.12:0/3997451679 >> 172.21.15.12:0/3997451679 conn(0x7fb2d4102ca0 msgr2=0x7fb2d41050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 -- 172.21.15.12:0/3997451679 shutdown_connections 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.427+0000 7fb2db19a700 1 -- 172.21.15.12:0/3997451679 wait complete. 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2db19a700 1 Processor -- start 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2db19a700 1 -- start start 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2db19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2db19a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d419db40 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2d8f36700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2d8f36700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37102/0 (socket says 172.21.15.12:37102) 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2d8f36700 1 -- 172.21.15.12:0/1295051984 learned_addr learned my addr 172.21.15.12:0/1295051984 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.428+0000 7fb2d8f36700 1 -- 172.21.15.12:0/1295051984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4009550 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.429+0000 7fb2d8f36700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d419d600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009130 tx=0x7fb2c4011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.429+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c4003aa0 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.429+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2c4003c00 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.429+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d419dd40 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.429+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2c4024800 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.429+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d419e1e0 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.430+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 3) v1 ==== 45815+0+0 (secure 0 0 0) 0x7fb2c4024a90 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.430+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d410da10 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.430+0000 7fb2d1ffb700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fb2bc038dc0 0x7fb2bc03b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.430+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb2c404ca90 con 0x7fb2d407ce40 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.430+0000 7fb2d3fff700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fb2bc038dc0 0x7fb2bc03b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.431+0000 7fb2d3fff700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fb2bc038dc0 0x7fb2bc03b280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8006fd0 tx=0x7fb2c8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.435+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb2c4024d40 con 0x7fb2d407ce40 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.587+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 4) v1 ==== 45921+0+0 (secure 0 0 0) 0x7fb2c4018350 con 0x7fb2d407ce40 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.719+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb2d41a0e00 con 0x7fb2d407ce40 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.720+0000 7fb2d1ffb700 1 -- 172.21.15.12:0/1295051984 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fb2c401abd0 con 0x7fb2d407ce40 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fb2bc038dc0 msgr2=0x7fb2bc03b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fb2bc038dc0 0x7fb2bc03b280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8006fd0 tx=0x7fb2c8006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 msgr2=0x7fb2d419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d419d600 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4009130 tx=0x7fb2c4011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 shutdown_connections 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fb2bc038dc0 0x7fb2bc03b280 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 --2- 172.21.15.12:0/1295051984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d407ce40 0x7fb2d419d600 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 >> 172.21.15.12:0/1295051984 conn(0x7fb2d4102ca0 msgr2=0x7fb2d4103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 shutdown_connections 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:11.722+0000 7fb2db19a700 1 -- 172.21.15.12:0/1295051984 wait complete. 2024-02-14T12:59:12.340 INFO:teuthology.orchestra.run.smithi012.stdout:mgr is available 2024-02-14T12:59:12.698 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:12 smithi012 ceph-mon[32370]: mgrmap e4: x(active, since 3s) 2024-02-14T12:59:12.699 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:12 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1295051984' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-14T12:59:13.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f388496a700 1 Processor -- start 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f388496a700 1 -- start start 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f388496a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f3880107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f388496a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880108130 con 0x7f3880107740 2024-02-14T12:59:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f387e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f3880107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f387e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f3880107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37118/0 (socket says 172.21.15.12:37118) 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.728+0000 7f387e59c700 1 -- 172.21.15.12:0/1392931000 learned_addr learned my addr 172.21.15.12:0/1392931000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.729+0000 7f387e59c700 1 -- 172.21.15.12:0/1392931000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38801088f0 con 0x7f3880107740 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.729+0000 7f387e59c700 1 --2- 172.21.15.12:0/1392931000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f3880107b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f38700098a0 tx=0x7f3870009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e4ecbbe3541fac server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.729+0000 7f387d59a700 1 -- 172.21.15.12:0/1392931000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3870004160 con 0x7f3880107740 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.729+0000 7f387d59a700 1 -- 172.21.15.12:0/1392931000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38700042c0 con 0x7f3880107740 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.729+0000 7f387d59a700 1 -- 172.21.15.12:0/1392931000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3870011ac0 con 0x7f3880107740 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 -- 172.21.15.12:0/1392931000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 msgr2=0x7f3880107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 --2- 172.21.15.12:0/1392931000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f3880107b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f38700098a0 tx=0x7f3870009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 -- 172.21.15.12:0/1392931000 shutdown_connections 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 --2- 172.21.15.12:0/1392931000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f3880107b60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 -- 172.21.15.12:0/1392931000 >> 172.21.15.12:0/1392931000 conn(0x7f3880102d60 msgr2=0x7f3880105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 -- 172.21.15.12:0/1392931000 shutdown_connections 2024-02-14T12:59:13.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 -- 172.21.15.12:0/1392931000 wait complete. 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 Processor -- start 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.730+0000 7f388496a700 1 -- start start 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f388496a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f388007cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f388496a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388007d0c0 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f387e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f388007cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f387e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f388007cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37126/0 (socket says 172.21.15.12:37126) 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f387e59c700 1 -- 172.21.15.12:0/3257341640 learned_addr learned my addr 172.21.15.12:0/3257341640 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f387e59c700 1 -- 172.21.15.12:0/3257341640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3870009550 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f387e59c700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f388007cb80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3870009fb0 tx=0x7f3870011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38700038b0 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388007b2b0 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3870003a10 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38700195e0 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.731+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388007b750 con 0x7f3880107740 2024-02-14T12:59:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.732+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 45921+0+0 (secure 0 0 0) 0x7f38700198a0 con 0x7f3880107740 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.733+0000 7f386f7fe700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f3868038e40 0x7f386803b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.733+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3880068df0 con 0x7f3880107740 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.733+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f387004d210 con 0x7f3880107740 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.733+0000 7f387dd9b700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f3868038e40 0x7f386803b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.733+0000 7f387dd9b700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f3868038e40 0x7f386803b300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3874006fd0 tx=0x7f3874006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.738+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3870019b50 con 0x7f3880107740 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.938+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f388010bb20 con 0x7f3880107740 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.939+0000 7f386f7fe700 1 -- 172.21.15.12:0/3257341640 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3870018be0 con 0x7f3880107740 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f3868038e40 msgr2=0x7f386803b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f3868038e40 0x7f386803b300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3874006fd0 tx=0x7f3874006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 msgr2=0x7f388007cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f388007cb80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3870009fb0 tx=0x7f3870011b20 comp rx=0 tx=0).stop 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 shutdown_connections 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f3868038e40 0x7f386803b300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 --2- 172.21.15.12:0/3257341640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3880107740 0x7f388007cb80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:13.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 >> 172.21.15.12:0/3257341640 conn(0x7f3880102d60 msgr2=0x7f38801038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:13.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 shutdown_connections 2024-02-14T12:59:13.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:12.941+0000 7f388496a700 1 -- 172.21.15.12:0/3257341640 wait complete. 2024-02-14T12:59:13.492 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling cephadm module... 2024-02-14T12:59:13.839 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:13 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3257341640' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-14T12:59:14.905 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:14 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1111367310' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-14T12:59:14.906 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:14 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: ignoring --setuser ceph since I am not root 2024-02-14T12:59:14.906 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:14 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: ignoring --setgroup ceph since I am not root 2024-02-14T12:59:15.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:15 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:15.209+0000 7fd3618ad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-14T12:59:15.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:15 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:15.306+0000 7fd3618ad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-14T12:59:15.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:15 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1111367310' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-14T12:59:15.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:15 smithi012 ceph-mon[32370]: mgrmap e5: x(active, since 6s) 2024-02-14T12:59:16.207 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:15 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:15.967+0000 7fd3618ad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-14T12:59:16.208 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.061+0000 7fd3618ad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-14T12:59:16.208 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.205+0000 7fd3618ad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-14T12:59:16.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.304+0000 7fd3618ad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-14T12:59:16.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.388+0000 7fd3618ad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-14T12:59:16.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c971d700 1 Processor -- start 2024-02-14T12:59:16.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c971d700 1 -- start start 2024-02-14T12:59:16.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c971d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c410a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:16.492 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c971d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40754e0 con 0x7f60c4108140 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c410a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c410a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37130/0 (socket says 172.21.15.12:37130) 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.865+0000 7f60c2ffd700 1 -- 172.21.15.12:0/1066201651 learned_addr learned my addr 172.21.15.12:0/1066201651 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.866+0000 7f60c2ffd700 1 -- 172.21.15.12:0/1066201651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c410aa70 con 0x7f60c4108140 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.866+0000 7f60c2ffd700 1 --2- 172.21.15.12:0/1066201651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c410a530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009e80 tx=0x7f60bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c73c424b6d66301 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.866+0000 7f60c1ffb700 1 -- 172.21.15.12:0/1066201651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60bc00e070 con 0x7f60c4108140 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.866+0000 7f60c1ffb700 1 -- 172.21.15.12:0/1066201651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60bc00b8c0 con 0x7f60c4108140 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.866+0000 7f60c1ffb700 1 -- 172.21.15.12:0/1066201651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60bc004550 con 0x7f60c4108140 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 -- 172.21.15.12:0/1066201651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 msgr2=0x7f60c410a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 --2- 172.21.15.12:0/1066201651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c410a530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009e80 tx=0x7f60bc00b330 comp rx=0 tx=0).stop 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 -- 172.21.15.12:0/1066201651 shutdown_connections 2024-02-14T12:59:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 --2- 172.21.15.12:0/1066201651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c410a530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 -- 172.21.15.12:0/1066201651 >> 172.21.15.12:0/1066201651 conn(0x7f60c4101b70 msgr2=0x7f60c4103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 -- 172.21.15.12:0/1066201651 shutdown_connections 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 -- 172.21.15.12:0/1066201651 wait complete. 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 Processor -- start 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.867+0000 7f60c971d700 1 -- start start 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c971d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c971d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c419dad0 con 0x7f60c4108140 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c419d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37136/0 (socket says 172.21.15.12:37136) 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c2ffd700 1 -- 172.21.15.12:0/1111367310 learned_addr learned my addr 172.21.15.12:0/1111367310 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c2ffd700 1 -- 172.21.15.12:0/1111367310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc009b30 con 0x7f60c4108140 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c2ffd700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c419d590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0042e0 tx=0x7f60bc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:16.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60bc00e040 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60bc00bd70 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c419dcd0 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60bc01c7f0 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.868+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c419e150 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.869+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 45921+0+0 (secure 0 0 0) 0x7f60bc01cab0 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.869+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c410b870 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.869+0000 7f60bbfff700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f60b0038e40 0x7f60b003b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.869+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f60bc04cf20 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.869+0000 7f60c27fc700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f60b0038e40 0x7f60b003b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.870+0000 7f60c27fc700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f60b0038e40 0x7f60b003b300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60ac006fd0 tx=0x7f60ac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:13.874+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f60bc01b3a0 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.136+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f60c41a0e20 con 0x7f60c4108140 2024-02-14T12:59:16.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.590+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f60bc017a00 con 0x7f60c4108140 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.592+0000 7f60bbfff700 1 -- 172.21.15.12:0/1111367310 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 5) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f60bc01b720 con 0x7f60c4108140 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f60b0038e40 msgr2=0x7f60b003b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f60b0038e40 0x7f60b003b300 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60ac006fd0 tx=0x7f60ac006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 msgr2=0x7f60c419d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c419d590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0042e0 tx=0x7f60bc003d00 comp rx=0 tx=0).stop 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 shutdown_connections 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f60b0038e40 0x7f60b003b300 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 --2- 172.21.15.12:0/1111367310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60c4108140 0x7f60c419d590 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 >> 172.21.15.12:0/1111367310 conn(0x7f60c4101b70 msgr2=0x7f60c4102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 shutdown_connections 2024-02-14T12:59:16.496 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:14.594+0000 7f60c971d700 1 -- 172.21.15.12:0/1111367310 wait complete. 2024-02-14T12:59:16.793 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.675+0000 7fd3618ad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-14T12:59:16.793 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.791+0000 7fd3618ad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-14T12:59:17.128 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.879+0000 7fd3618ad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-14T12:59:17.128 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:16 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:16.983+0000 7fd3618ad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-14T12:59:17.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:17 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3054263313' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-14T12:59:17.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:17 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:17.162+0000 7fd3618ad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-02-14T12:59:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.920+0000 7fce38c70700 1 Processor -- start 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.920+0000 7fce38c70700 1 -- start start 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce38c70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce341069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce38c70700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34106f80 con 0x7fce34106590 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce341069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce341069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48530/0 (socket says 172.21.15.12:48530) 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3259c700 1 -- 172.21.15.12:0/3997095735 learned_addr learned my addr 172.21.15.12:0/3997095735 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3259c700 1 -- 172.21.15.12:0/3997095735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34107790 con 0x7fce34106590 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3259c700 1 --2- 172.21.15.12:0/3997095735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce341069b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce280098a0 tx=0x7fce28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe06dec4f2090af server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3159a700 1 -- 172.21.15.12:0/3997095735 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fce28004160 con 0x7fce34106590 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3159a700 1 -- 172.21.15.12:0/3997095735 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce280042c0 con 0x7fce34106590 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.921+0000 7fce3159a700 1 -- 172.21.15.12:0/3997095735 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fce28011ac0 con 0x7fce34106590 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 -- 172.21.15.12:0/3997095735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 msgr2=0x7fce341069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 --2- 172.21.15.12:0/3997095735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce341069b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce280098a0 tx=0x7fce28009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 -- 172.21.15.12:0/3997095735 shutdown_connections 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 --2- 172.21.15.12:0/3997095735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce341069b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 -- 172.21.15.12:0/3997095735 >> 172.21.15.12:0/3997095735 conn(0x7fce34101b70 msgr2=0x7fce34103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 -- 172.21.15.12:0/3997095735 shutdown_connections 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.922+0000 7fce38c70700 1 -- 172.21.15.12:0/3997095735 wait complete. 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce38c70700 1 Processor -- start 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce38c70700 1 -- start start 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce38c70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce34191700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce38c70700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce34191c40 con 0x7fce34106590 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce3259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce34191700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce3259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce34191700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48542/0 (socket says 172.21.15.12:48542) 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce3259c700 1 -- 172.21.15.12:0/3054263313 learned_addr learned my addr 172.21.15.12:0/3054263313 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.923+0000 7fce3259c700 1 -- 172.21.15.12:0/3054263313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28009550 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.924+0000 7fce3259c700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce34191700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce28000c00 tx=0x7fce28011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.924+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fce28003aa0 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.924+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce28003c00 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.924+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3418fe30 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.924+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fce280248a0 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.924+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce341902d0 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.925+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34068df0 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.925+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 45932+0+0 (secure 0 0 0) 0x7fce2802d3f0 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.925+0000 7fce237fe700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 0x7fce1c03b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.925+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fce2804cd20 con 0x7fce34106590 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.925+0000 7fce31d9b700 1 -- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 msgr2=0x7fce1c03b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.925+0000 7fce31d9b700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 0x7fce1c03b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-14T12:59:17.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:16.934+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fce28010740 con 0x7fce34106590 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.126+0000 7fce31d9b700 1 -- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 msgr2=0x7fce1c03b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.126+0000 7fce31d9b700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 0x7fce1c03b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.194+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fce34195260 con 0x7fce34106590 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.195+0000 7fce237fe700 1 -- 172.21.15.12:0/3054263313 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fce28010380 con 0x7fce34106590 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 msgr2=0x7fce1c03b3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 0x7fce1c03b3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 msgr2=0x7fce34191700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce34191700 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce28000c00 tx=0x7fce28011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 shutdown_connections 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7fce1c038f30 0x7fce1c03b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:17.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 --2- 172.21.15.12:0/3054263313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce34106590 0x7fce34191700 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:17.781 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.198+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 >> 172.21.15.12:0/3054263313 conn(0x7fce34101b70 msgr2=0x7fce341029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:17.781 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.199+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 shutdown_connections 2024-02-14T12:59:17.781 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:17.199+0000 7fce38c70700 1 -- 172.21.15.12:0/3054263313 wait complete. 2024-02-14T12:59:17.781 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-02-14T12:59:17.781 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 5... 2024-02-14T12:59:18.385 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:18 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:18.185+0000 7fd3618ad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-14T12:59:18.385 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:18 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:18.319+0000 7fd3618ad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-14T12:59:18.946 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:18 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:18.655+0000 7fd3618ad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-14T12:59:18.947 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:18 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:18.746+0000 7fd3618ad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-14T12:59:18.947 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:18 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:18.944+0000 7fd3618ad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-14T12:59:19.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:19 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:19.131+0000 7fd3618ad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-14T12:59:19.682 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:19 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:19.419+0000 7fd3618ad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-14T12:59:19.682 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:19 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:19.680+0000 7fd3618ad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-14T12:59:19.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:19 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:19.919+0000 7fd3618ad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-14T12:59:21.187 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:20 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:20.738+0000 7fd3618ad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-14T12:59:21.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:21.319+0000 7fd3618ad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-14T12:59:21.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:21.418+0000 7fd3618ad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-14T12:59:21.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:21.637+0000 7fd3618ad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-14T12:59:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: Active manager daemon x restarted 2024-02-14T12:59:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: Activating manager daemon x 2024-02-14T12:59:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: osdmap e2: 0 total, 0 up, 0 in 2024-02-14T12:59:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: mgrmap e6: x(active, starting, since 0.00318913s) 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: Manager daemon x is now available 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:21 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: Found migration_current of "None". Setting to last migration. 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:22] ENGINE Bus STARTING 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:22] ENGINE Serving on http://172.21.15.12:8765 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: mgrmap e7: x(active, since 1.00811s) 2024-02-14T12:59:22.964 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:22 smithi012 ceph-mon[32370]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-14T12:59:23.184 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cf23b9700 1 Processor -- start 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cf23b9700 1 -- start start 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cf23b9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec10a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cf23b9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec07ae00 con 0x7f8cec1081e0 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec10a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec10a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48558/0 (socket says 172.21.15.12:48558) 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.177+0000 7f8cebfff700 1 -- 172.21.15.12:0/1154332619 learned_addr learned my addr 172.21.15.12:0/1154332619 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.178+0000 7f8cebfff700 1 -- 172.21.15.12:0/1154332619 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec07af40 con 0x7f8cec1081e0 2024-02-14T12:59:23.192 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.178+0000 7f8cebfff700 1 --2- 172.21.15.12:0/1154332619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec10a5d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0098a0 tx=0x7f8cdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9247d7b88c2a266c server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.178+0000 7f8ceaffd700 1 -- 172.21.15.12:0/1154332619 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc004160 con 0x7f8cec1081e0 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.178+0000 7f8ceaffd700 1 -- 172.21.15.12:0/1154332619 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cdc0042c0 con 0x7f8cec1081e0 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.178+0000 7f8ceaffd700 1 -- 172.21.15.12:0/1154332619 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc011ac0 con 0x7f8cec1081e0 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1154332619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 msgr2=0x7f8cec10a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1154332619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec10a5d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0098a0 tx=0x7f8cdc009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1154332619 shutdown_connections 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1154332619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec10a5d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1154332619 >> 172.21.15.12:0/1154332619 conn(0x7f8cec101bd0 msgr2=0x7f8cec103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1154332619 shutdown_connections 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.179+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1154332619 wait complete. 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cf23b9700 1 Processor -- start 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cf23b9700 1 -- start start 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cf23b9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:23.193 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cf23b9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec19b920 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec19b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48568/0 (socket says 172.21.15.12:48568) 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cebfff700 1 -- 172.21.15.12:0/1549849534 learned_addr learned my addr 172.21.15.12:0/1549849534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.180+0000 7f8cebfff700 1 -- 172.21.15.12:0/1549849534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc009550 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.181+0000 7f8cebfff700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec19b3e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc003f70 tx=0x7f8cdc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.181+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc0039f0 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.181+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cdc003b50 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.181+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec19bb20 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.181+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cdc01a760 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.181+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec19bfc0 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.182+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f8cdc024430 con 0x7f8cec1081e0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.182+0000 7f8ce97fa700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.182+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 --> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cd403bab0 con 0x7f8cd4038ee0 2024-02-14T12:59:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.182+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8cdc04d070 con 0x7f8cec1081e0 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.182+0000 7f8ceb7fe700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 msgr2=0x7f8cd403b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.182+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.383+0000 7f8ceb7fe700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 msgr2=0x7f8cd403b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.383+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.784+0000 7f8ceb7fe700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 msgr2=0x7f8cd403b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:18.784+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:19.585+0000 7f8ceb7fe700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 msgr2=0x7f8cd403b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:19.585+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:21.186+0000 7f8ceb7fe700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 msgr2=0x7f8cd403b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/1478984094 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:21.186+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:21.652+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 6) v1 ==== 45699+0+0 (secure 0 0 0) 0x7f8cdc02d910 con 0x7f8cec1081e0 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:21.652+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 msgr2=0x7f8cd403b3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:21.652+0000 7f8ce97fa700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.656+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 7) v1 ==== 45826+0+0 (secure 0 0 0) 0x7f8cdc00bba0 con 0x7f8cec1081e0 2024-02-14T12:59:23.195 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.656+0000 7f8ce97fa700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f8cd403c7c0 0x7f8cd403ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.656+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cd403bab0 con 0x7f8cd403c7c0 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.656+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f8cd403c7c0 0x7f8cd403ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.657+0000 7f8ceb7fe700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f8cd403c7c0 0x7f8cd403ebb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0003a10 tx=0x7f8ce00092b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.657+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f8cd403bab0 con 0x7f8cd403c7c0 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8cec10b8a0 con 0x7f8cd403c7c0 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8ce97fa700 1 -- 172.21.15.12:0/1549849534 <== mgr.14116 v2:172.21.15.12:6800/955464513 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8cec10b8a0 con 0x7f8cd403c7c0 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f8cd403c7c0 msgr2=0x7f8cd403ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f8cd403c7c0 0x7f8cd403ebb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0003a10 tx=0x7f8ce00092b0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 msgr2=0x7f8cec19b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec19b3e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc003f70 tx=0x7f8cdc011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 shutdown_connections 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f8cd403c7c0 0x7f8cd403ebb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.196 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8cec1081e0 0x7f8cec19b3e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 --2- 172.21.15.12:0/1549849534 >> [v2:172.21.15.12:6800/1478984094,v1:172.21.15.12:6801/1478984094] conn(0x7f8cd4038ee0 0x7f8cd403b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.664+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 >> 172.21.15.12:0/1549849534 conn(0x7f8cec101bd0 msgr2=0x7f8cec1026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.665+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 shutdown_connections 2024-02-14T12:59:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:22.665+0000 7f8cf23b9700 1 -- 172.21.15.12:0/1549849534 wait complete. 2024-02-14T12:59:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 5 is available 2024-02-14T12:59:23.197 INFO:teuthology.orchestra.run.smithi012.stdout:Setting orchestrator backend to cephadm... 2024-02-14T12:59:23.840 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:23 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:22] ENGINE Serving on https://172.21.15.12:7150 2024-02-14T12:59:23.840 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:23 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:22] ENGINE Bus STARTED 2024-02-14T12:59:23.840 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:23 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:24.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.587+0000 7f1b0dfaa700 1 Processor -- start 2024-02-14T12:59:24.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.587+0000 7f1b0dfaa700 1 -- start start 2024-02-14T12:59:24.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.587+0000 7f1b0dfaa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b0810a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:24.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.587+0000 7f1b0dfaa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08075520 con 0x7f1b08108100 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b0810a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b0810a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48644/0 (socket says 172.21.15.12:48644) 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b077fe700 1 -- 172.21.15.12:0/2434236921 learned_addr learned my addr 172.21.15.12:0/2434236921 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b077fe700 1 -- 172.21.15.12:0/2434236921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0810aa30 con 0x7f1b08108100 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b077fe700 1 --2- 172.21.15.12:0/2434236921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b0810a4f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e80 tx=0x7f1b0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6be9cf2dd7dae6 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b067fc700 1 -- 172.21.15.12:0/2434236921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b0000e070 con 0x7f1b08108100 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b067fc700 1 -- 172.21.15.12:0/2434236921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b0000b8c0 con 0x7f1b08108100 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.588+0000 7f1b067fc700 1 -- 172.21.15.12:0/2434236921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b00004550 con 0x7f1b08108100 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/2434236921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 msgr2=0x7f1b0810a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 --2- 172.21.15.12:0/2434236921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b0810a4f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e80 tx=0x7f1b0000b330 comp rx=0 tx=0).stop 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/2434236921 shutdown_connections 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 --2- 172.21.15.12:0/2434236921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b0810a4f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/2434236921 >> 172.21.15.12:0/2434236921 conn(0x7f1b08101b70 msgr2=0x7f1b08103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:24.388 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/2434236921 shutdown_connections 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.589+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/2434236921 wait complete. 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b0dfaa700 1 Processor -- start 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b0dfaa700 1 -- start start 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b0dfaa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b08107980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b0dfaa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08107ec0 con 0x7f1b08108100 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b08107980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b08107980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48650/0 (socket says 172.21.15.12:48650) 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b077fe700 1 -- 172.21.15.12:0/1030878051 learned_addr learned my addr 172.21.15.12:0/1030878051 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.590+0000 7f1b077fe700 1 -- 172.21.15.12:0/1030878051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009b30 con 0x7f1b08108100 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.591+0000 7f1b077fe700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b08107980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009fd0 tx=0x7f1b00003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.591+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b0000e040 con 0x7f1b08108100 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.591+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b000128f0 con 0x7f1b08108100 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.591+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b081060b0 con 0x7f1b08108100 2024-02-14T12:59:24.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.591+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b0001c890 con 0x7f1b08108100 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.591+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08106530 con 0x7f1b08108100 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.592+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) v1 ==== 45826+0+0 (secure 0 0 0) 0x7f1b00012430 con 0x7f1b08108100 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.592+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0810b890 con 0x7f1b08108100 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.592+0000 7f1b04ff9700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f1af4038e10 0x7f1af403b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.592+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1b0004ce20 con 0x7f1b08108100 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.592+0000 7f1b06ffd700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f1af4038e10 0x7f1af403b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.593+0000 7f1b06ffd700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f1af4038e10 0x7f1af403b2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006fd0 tx=0x7f1af0006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.597+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1b00011390 con 0x7f1b08108100 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.817+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b08106c20 con 0x7f1af4038e10 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.824+0000 7f1b04ff9700 1 -- 172.21.15.12:0/1030878051 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1b08106c20 con 0x7f1af4038e10 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f1af4038e10 msgr2=0x7f1af403b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f1af4038e10 0x7f1af403b2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1af0006fd0 tx=0x7f1af0006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 msgr2=0x7f1b08107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:24.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b08107980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009fd0 tx=0x7f1b00003d70 comp rx=0 tx=0).stop 2024-02-14T12:59:24.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 shutdown_connections 2024-02-14T12:59:24.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f1af4038e10 0x7f1af403b2d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:24.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 --2- 172.21.15.12:0/1030878051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b08108100 0x7f1b08107980 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:24.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 >> 172.21.15.12:0/1030878051 conn(0x7f1b08101b70 msgr2=0x7f1b08102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:24.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 shutdown_connections 2024-02-14T12:59:24.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:23.827+0000 7f1b0dfaa700 1 -- 172.21.15.12:0/1030878051 wait complete. 2024-02-14T12:59:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:24 smithi012 ceph-mon[32370]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:24 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:24 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:24 smithi012 ceph-mon[32370]: mgrmap e8: x(active, since 2s) 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519f29e700 1 Processor -- start 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519f29e700 1 -- start start 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519f29e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519810a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519f29e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519807ae60 con 0x7f5198108180 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519d03a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519810a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519d03a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519810a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40892/0 (socket says 172.21.15.12:40892) 2024-02-14T12:59:25.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.796+0000 7f519d03a700 1 -- 172.21.15.12:0/1837809239 learned_addr learned my addr 172.21.15.12:0/1837809239 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f519d03a700 1 -- 172.21.15.12:0/1837809239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519810aab0 con 0x7f5198108180 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f519d03a700 1 --2- 172.21.15.12:0/1837809239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519810a570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51940098a0 tx=0x7f5194009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ed797aa5d06e52 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f518ffff700 1 -- 172.21.15.12:0/1837809239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5194004160 con 0x7f5198108180 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f518ffff700 1 -- 172.21.15.12:0/1837809239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51940042c0 con 0x7f5198108180 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f518ffff700 1 -- 172.21.15.12:0/1837809239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5194011ac0 con 0x7f5198108180 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f519f29e700 1 -- 172.21.15.12:0/1837809239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 msgr2=0x7f519810a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.797+0000 7f519f29e700 1 --2- 172.21.15.12:0/1837809239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519810a570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51940098a0 tx=0x7f5194009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 -- 172.21.15.12:0/1837809239 shutdown_connections 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 --2- 172.21.15.12:0/1837809239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519810a570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 -- 172.21.15.12:0/1837809239 >> 172.21.15.12:0/1837809239 conn(0x7f5198101b90 msgr2=0x7f5198103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 -- 172.21.15.12:0/1837809239 shutdown_connections 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 -- 172.21.15.12:0/1837809239 wait complete. 2024-02-14T12:59:25.569 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 Processor -- start 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 -- start start 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519819b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.798+0000 7f519f29e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519819b940 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519d03a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519819b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519d03a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519819b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40902/0 (socket says 172.21.15.12:40902) 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519d03a700 1 -- 172.21.15.12:0/1886277854 learned_addr learned my addr 172.21.15.12:0/1886277854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519d03a700 1 -- 172.21.15.12:0/1886277854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009550 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519d03a700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519819b400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5194003f70 tx=0x7f5194011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51940039f0 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5194003b50 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519819bb40 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f519401a760 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.799+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519819bfe0 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.800+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f519401a9d0 con 0x7f5198108180 2024-02-14T12:59:25.570 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.800+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519810b8b0 con 0x7f5198108180 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.800+0000 7f518e7fc700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f5184038e90 0x7f518403b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.800+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f519404d310 con 0x7f5198108180 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.800+0000 7f519c839700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f5184038e90 0x7f518403b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.801+0000 7f519c839700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f5184038e90 0x7f518403b350 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5188006fd0 tx=0x7f5188006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:24.805+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f519401ac80 con 0x7f5198108180 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.009+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f5198102dc0 con 0x7f5184038e90 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.010+0000 7f518e7fc700 1 -- 172.21.15.12:0/1886277854 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f5198102dc0 con 0x7f5184038e90 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f5184038e90 msgr2=0x7f518403b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f5184038e90 0x7f518403b350 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5188006fd0 tx=0x7f5188006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 msgr2=0x7f519819b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519819b400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5194003f70 tx=0x7f5194011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 shutdown_connections 2024-02-14T12:59:25.571 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f5184038e90 0x7f518403b350 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:25.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 --2- 172.21.15.12:0/1886277854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5198108180 0x7f519819b400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:25.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 >> 172.21.15.12:0/1886277854 conn(0x7f5198101b90 msgr2=0x7f51981026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:25.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.012+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 shutdown_connections 2024-02-14T12:59:25.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:25.013+0000 7f519f29e700 1 -- 172.21.15.12:0/1886277854 wait complete. 2024-02-14T12:59:25.572 INFO:teuthology.orchestra.run.smithi012.stdout:Generating ssh key... 2024-02-14T12:59:26.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:25 smithi012 ceph-mon[32370]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:26.633 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: Generating public/private rsa key pair. 2024-02-14T12:59:26.633 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: Your identification has been saved in /tmp/tmp3x3ds6sj/key. 2024-02-14T12:59:26.633 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: Your public key has been saved in /tmp/tmp3x3ds6sj/key.pub. 2024-02-14T12:59:26.633 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: The key fingerprint is: 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: SHA256:eRsGn4tAI+71n7cIBmbmdVKnyCzd6S1sAdNOg+ZyMtM ceph-ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: The key's randomart image is: 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: +---[RSA 3072]----+ 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | o | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | . o * = . | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | . o O % * | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | . & E & | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | . * % O * | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | . . = B . | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | . + +. | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: | +... | 2024-02-14T12:59:26.634 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: +----[SHA256]-----+ 2024-02-14T12:59:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbacb66e700 1 Processor -- start 2024-02-14T12:59:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbacb66e700 1 -- start start 2024-02-14T12:59:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbacb66e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac4107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbacb66e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4108130 con 0x7fbac4107740 2024-02-14T12:59:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbac940a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac4107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:26.950 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbac940a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac4107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40906/0 (socket says 172.21.15.12:40906) 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.015+0000 7fbac940a700 1 -- 172.21.15.12:0/998740812 learned_addr learned my addr 172.21.15.12:0/998740812 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbac940a700 1 -- 172.21.15.12:0/998740812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac41088f0 con 0x7fbac4107740 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbac940a700 1 --2- 172.21.15.12:0/998740812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac4107b60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbac00098a0 tx=0x7fbac0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29a8d3896f47668 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbabbfff700 1 -- 172.21.15.12:0/998740812 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbac0004160 con 0x7fbac4107740 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbabbfff700 1 -- 172.21.15.12:0/998740812 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbac00042c0 con 0x7fbac4107740 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbabbfff700 1 -- 172.21.15.12:0/998740812 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbac0011ac0 con 0x7fbac4107740 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbacb66e700 1 -- 172.21.15.12:0/998740812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 msgr2=0x7fbac4107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.016+0000 7fbacb66e700 1 --2- 172.21.15.12:0/998740812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac4107b60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbac00098a0 tx=0x7fbac0009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 -- 172.21.15.12:0/998740812 shutdown_connections 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 --2- 172.21.15.12:0/998740812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac4107b60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 -- 172.21.15.12:0/998740812 >> 172.21.15.12:0/998740812 conn(0x7fbac4102d60 msgr2=0x7fbac4105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 -- 172.21.15.12:0/998740812 shutdown_connections 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 -- 172.21.15.12:0/998740812 wait complete. 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 Processor -- start 2024-02-14T12:59:26.951 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 -- start start 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac407cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.017+0000 7fbacb66e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac407d0c0 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbac940a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac407cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbac940a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac407cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40914/0 (socket says 172.21.15.12:40914) 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbac940a700 1 -- 172.21.15.12:0/1088682257 learned_addr learned my addr 172.21.15.12:0/1088682257 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbac940a700 1 -- 172.21.15.12:0/1088682257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0009550 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbac940a700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac407cb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009fb0 tx=0x7fbac0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbac00038b0 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbac0003a10 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac407b2b0 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbac00195e0 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.018+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac407b750 con 0x7fbac4107740 2024-02-14T12:59:26.952 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.019+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7fbac001aa10 con 0x7fbac4107740 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.019+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac4068df0 con 0x7fbac4107740 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.019+0000 7fbaba7fc700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fbab0038e90 0x7fbab003b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.019+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbac004d110 con 0x7fbac4107740 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.019+0000 7fbac8c09700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fbab0038e90 0x7fbab003b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.020+0000 7fbac8c09700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fbab0038e90 0x7fbab003b350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbab4006fd0 tx=0x7fbab4006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.024+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbac0003b80 con 0x7fbac4107740 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.228+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fbac407bde0 con 0x7fbab0038e90 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.406+0000 7fbaba7fc700 1 -- 172.21.15.12:0/1088682257 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbac407bde0 con 0x7fbab0038e90 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fbab0038e90 msgr2=0x7fbab003b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fbab0038e90 0x7fbab003b350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbab4006fd0 tx=0x7fbab4006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 msgr2=0x7fbac407cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac407cb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009fb0 tx=0x7fbac0011b20 comp rx=0 tx=0).stop 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 shutdown_connections 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fbab0038e90 0x7fbab003b350 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:26.953 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 --2- 172.21.15.12:0/1088682257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbac4107740 0x7fbac407cb80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 >> 172.21.15.12:0/1088682257 conn(0x7fbac4102d60 msgr2=0x7fbac41038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 shutdown_connections 2024-02-14T12:59:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:26.409+0000 7fbacb66e700 1 -- 172.21.15.12:0/1088682257 wait complete. 2024-02-14T12:59:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:27 smithi012 ceph-mon[32370]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:27 smithi012 ceph-mon[32370]: Generating ssh key... 2024-02-14T12:59:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:27 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:27 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e56a81700 1 Processor -- start 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e56a81700 1 -- start start 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e56a81700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e501069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e56a81700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50106f80 con 0x7f6e50106590 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e5481d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e501069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:28.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e5481d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e501069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40928/0 (socket says 172.21.15.12:40928) 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.367+0000 7f6e5481d700 1 -- 172.21.15.12:0/2431415011 learned_addr learned my addr 172.21.15.12:0/2431415011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e5481d700 1 -- 172.21.15.12:0/2431415011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50107790 con 0x7f6e50106590 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e5481d700 1 --2- 172.21.15.12:0/2431415011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e501069b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e440098a0 tx=0x7f6e44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514687aa95d0d0c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e4f7fe700 1 -- 172.21.15.12:0/2431415011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e44004160 con 0x7f6e50106590 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e4f7fe700 1 -- 172.21.15.12:0/2431415011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e440042c0 con 0x7f6e50106590 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e4f7fe700 1 -- 172.21.15.12:0/2431415011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e44011ac0 con 0x7f6e50106590 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e56a81700 1 -- 172.21.15.12:0/2431415011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 msgr2=0x7f6e501069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e56a81700 1 --2- 172.21.15.12:0/2431415011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e501069b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6e440098a0 tx=0x7f6e44009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e56a81700 1 -- 172.21.15.12:0/2431415011 shutdown_connections 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e56a81700 1 --2- 172.21.15.12:0/2431415011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e501069b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.368+0000 7f6e56a81700 1 -- 172.21.15.12:0/2431415011 >> 172.21.15.12:0/2431415011 conn(0x7f6e50101b70 msgr2=0x7f6e50103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:28.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e56a81700 1 -- 172.21.15.12:0/2431415011 shutdown_connections 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e56a81700 1 -- 172.21.15.12:0/2431415011 wait complete. 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e56a81700 1 Processor -- start 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e56a81700 1 -- start start 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e56a81700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e5019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e56a81700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5019b9a0 con 0x7f6e50106590 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e5481d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e5019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e5481d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e5019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40942/0 (socket says 172.21.15.12:40942) 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.369+0000 7f6e5481d700 1 -- 172.21.15.12:0/1094527946 learned_addr learned my addr 172.21.15.12:0/1094527946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e5481d700 1 -- 172.21.15.12:0/1094527946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009550 con 0x7f6e50106590 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e5481d700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e5019b460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000c00 tx=0x7f6e44011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e44003aa0 con 0x7f6e50106590 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e44003c00 con 0x7f6e50106590 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e440248a0 con 0x7f6e50106590 2024-02-14T12:59:28.118 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5019bba0 con 0x7f6e50106590 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.370+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5019c040 con 0x7f6e50106590 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.371+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f6e4401ac60 con 0x7f6e50106590 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.371+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e50195630 con 0x7f6e50106590 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.371+0000 7f6e4dffb700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f6e40038f30 0x7f6e4003b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.371+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6e4404d060 con 0x7f6e50106590 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.371+0000 7f6e4ffff700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f6e40038f30 0x7f6e4003b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.372+0000 7f6e4ffff700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f6e40038f30 0x7f6e4003b3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c006fd0 tx=0x7f6e3c006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.376+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e44018530 con 0x7f6e50106590 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.580+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e5002da40 con 0x7f6e40038f30 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.581+0000 7f6e4dffb700 1 -- 172.21.15.12:0/1094527946 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f6e5002da40 con 0x7f6e40038f30 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f6e40038f30 msgr2=0x7f6e4003b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f6e40038f30 0x7f6e4003b3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c006fd0 tx=0x7f6e3c006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 msgr2=0x7f6e5019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:28.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e5019b460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e44000c00 tx=0x7f6e44011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 shutdown_connections 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f6e40038f30 0x7f6e4003b3f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 --2- 172.21.15.12:0/1094527946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e50106590 0x7f6e5019b460 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 >> 172.21.15.12:0/1094527946 conn(0x7f6e50101b70 msgr2=0x7f6e50102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 shutdown_connections 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:27.583+0000 7f6e56a81700 1 -- 172.21.15.12:0/1094527946 wait complete. 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:Adding key to root@localhost authorized_keys... 2024-02-14T12:59:28.120 INFO:teuthology.orchestra.run.smithi012.stdout:Adding host smithi012... 2024-02-14T12:59:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:28 smithi012 ceph-mon[32370]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:29.962 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:29 smithi012 ceph-mon[32370]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:29.963 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:29 smithi012 ceph-mon[32370]: Deploying cephadm binary to smithi012 2024-02-14T12:59:33.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Added host 'smithi012' with addr '172.21.15.12' 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.549+0000 7fb1f10cb700 1 Processor -- start 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.549+0000 7fb1f10cb700 1 -- start start 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1f10cb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec10a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1f10cb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec075520 con 0x7fb1ec108100 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1ead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec10a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1ead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec10a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40952/0 (socket says 172.21.15.12:40952) 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1ead9d700 1 -- 172.21.15.12:0/3169933606 learned_addr learned my addr 172.21.15.12:0/3169933606 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1ead9d700 1 -- 172.21.15.12:0/3169933606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec10aa30 con 0x7fb1ec108100 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1ead9d700 1 --2- 172.21.15.12:0/3169933606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec10a4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0098a0 tx=0x7fb1dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b670d56679d3eb75 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1e9d9b700 1 -- 172.21.15.12:0/3169933606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1dc004160 con 0x7fb1ec108100 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1e9d9b700 1 -- 172.21.15.12:0/3169933606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1dc0042c0 con 0x7fb1ec108100 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.550+0000 7fb1e9d9b700 1 -- 172.21.15.12:0/3169933606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1dc011ac0 con 0x7fb1ec108100 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 -- 172.21.15.12:0/3169933606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 msgr2=0x7fb1ec10a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:33.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 --2- 172.21.15.12:0/3169933606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec10a4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0098a0 tx=0x7fb1dc009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 -- 172.21.15.12:0/3169933606 shutdown_connections 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 --2- 172.21.15.12:0/3169933606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec10a4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 -- 172.21.15.12:0/3169933606 >> 172.21.15.12:0/3169933606 conn(0x7fb1ec101b70 msgr2=0x7fb1ec103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 -- 172.21.15.12:0/3169933606 shutdown_connections 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.551+0000 7fb1f10cb700 1 -- 172.21.15.12:0/3169933606 wait complete. 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1f10cb700 1 Processor -- start 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1f10cb700 1 -- start start 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1f10cb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1f10cb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec19b960 con 0x7fb1ec108100 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1ead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1ead9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec19b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40958/0 (socket says 172.21.15.12:40958) 2024-02-14T12:59:33.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.552+0000 7fb1ead9d700 1 -- 172.21.15.12:0/1355555354 learned_addr learned my addr 172.21.15.12:0/1355555354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1ead9d700 1 -- 172.21.15.12:0/1355555354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc009550 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1ead9d700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec19b420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009130 tx=0x7fb1dc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1dc003aa0 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec19bb60 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1dc003c00 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1dc024800 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.553+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec19c000 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.554+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7fb1dc024a70 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.554+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec10b890 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.554+0000 7fb1d3fff700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fb1d4038f30 0x7fb1d403b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.554+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb1dc04d130 con 0x7fb1ec108100 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.554+0000 7fb1ea59c700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fb1d4038f30 0x7fb1d403b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:33.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.555+0000 7fb1ea59c700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fb1d4038f30 0x7fb1d403b3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0006fd0 tx=0x7fb1e0006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.559+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb1dc024d20 con 0x7fb1ec108100 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:28.765+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1ec102d50 con 0x7fb1d4038f30 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.180+0000 7fb1d3fff700 1 -- 172.21.15.12:0/1355555354 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fb1ec102d50 con 0x7fb1d4038f30 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fb1d4038f30 msgr2=0x7fb1d403b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fb1d4038f30 0x7fb1d403b3f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0006fd0 tx=0x7fb1e0006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 msgr2=0x7fb1ec19b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec19b420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009130 tx=0x7fb1dc011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 shutdown_connections 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fb1d4038f30 0x7fb1d403b3f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 --2- 172.21.15.12:0/1355555354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1ec108100 0x7fb1ec19b420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 >> 172.21.15.12:0/1355555354 conn(0x7fb1ec101b70 msgr2=0x7fb1ec102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 shutdown_connections 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:33.183+0000 7fb1f10cb700 1 -- 172.21.15.12:0/1355555354 wait complete. 2024-02-14T12:59:33.777 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mon service... 2024-02-14T12:59:34.440 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:34 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:34.440 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:34 smithi012 ceph-mon[32370]: Added host smithi012 2024-02-14T12:59:34.440 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:34 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:35.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:35 smithi012 ceph-mon[32370]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:35.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:35 smithi012 ceph-mon[32370]: Saving service mon spec with placement count:5 2024-02-14T12:59:35.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:35 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a83f75700 1 Processor -- start 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a83f75700 1 -- start start 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a83f75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a83f75700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c1080a0 con 0x7f9a7c1076b0 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a81d11700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a81d11700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59488/0 (socket says 172.21.15.12:59488) 2024-02-14T12:59:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.255+0000 7f9a81d11700 1 -- 172.21.15.12:0/3198192899 learned_addr learned my addr 172.21.15.12:0/3198192899 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a81d11700 1 -- 172.21.15.12:0/3198192899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c108860 con 0x7f9a7c1076b0 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a81d11700 1 --2- 172.21.15.12:0/3198192899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c107ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a740098a0 tx=0x7f9a74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45cb79514c21cdc server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a80d0f700 1 -- 172.21.15.12:0/3198192899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a74004160 con 0x7f9a7c1076b0 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a80d0f700 1 -- 172.21.15.12:0/3198192899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a740042c0 con 0x7f9a7c1076b0 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a80d0f700 1 -- 172.21.15.12:0/3198192899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a74011ac0 con 0x7f9a7c1076b0 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a83f75700 1 -- 172.21.15.12:0/3198192899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 msgr2=0x7f9a7c107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a83f75700 1 --2- 172.21.15.12:0/3198192899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c107ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a740098a0 tx=0x7f9a74009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a83f75700 1 -- 172.21.15.12:0/3198192899 shutdown_connections 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a83f75700 1 --2- 172.21.15.12:0/3198192899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c107ad0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.256+0000 7f9a83f75700 1 -- 172.21.15.12:0/3198192899 >> 172.21.15.12:0/3198192899 conn(0x7f9a7c102d30 msgr2=0x7f9a7c105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a83f75700 1 -- 172.21.15.12:0/3198192899 shutdown_connections 2024-02-14T12:59:36.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a83f75700 1 -- 172.21.15.12:0/3198192899 wait complete. 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a83f75700 1 Processor -- start 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a83f75700 1 -- start start 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a83f75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a83f75700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c19b950 con 0x7f9a7c1076b0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.257+0000 7f9a81d11700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a81d11700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c19b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59492/0 (socket says 172.21.15.12:59492) 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a81d11700 1 -- 172.21.15.12:0/1398027163 learned_addr learned my addr 172.21.15.12:0/1398027163 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a81d11700 1 -- 172.21.15.12:0/1398027163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74009550 con 0x7f9a7c1076b0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a81d11700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c19b410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a74003f70 tx=0x7f9a74011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a740039f0 con 0x7f9a7c1076b0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a74003b50 con 0x7f9a7c1076b0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c19bb50 con 0x7f9a7c1076b0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a7401a690 con 0x7f9a7c1076b0 2024-02-14T12:59:36.059 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.258+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c19bff0 con 0x7f9a7c1076b0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.259+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f9a7401a900 con 0x7f9a7c1076b0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.259+0000 7f9a72ffd700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f9a68038ee0 0x7f9a6803b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.259+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9a7404d1e0 con 0x7f9a7c1076b0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.259+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c10ba90 con 0x7f9a7c1076b0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.259+0000 7f9a81510700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f9a68038ee0 0x7f9a6803b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.259+0000 7f9a81510700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f9a68038ee0 0x7f9a6803b3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c006fd0 tx=0x7f9a6c006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.264+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9a74018c20 con 0x7f9a7c1076b0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.482+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9a7c103f00 con 0x7f9a68038ee0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.488+0000 7f9a72ffd700 1 -- 172.21.15.12:0/1398027163 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9a7c103f00 con 0x7f9a68038ee0 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f9a68038ee0 msgr2=0x7f9a6803b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f9a68038ee0 0x7f9a6803b3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c006fd0 tx=0x7f9a6c006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 msgr2=0x7f9a7c19b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:36.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c19b410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a74003f70 tx=0x7f9a74011b40 comp rx=0 tx=0).stop 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 shutdown_connections 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f9a68038ee0 0x7f9a6803b3a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 --2- 172.21.15.12:0/1398027163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a7c1076b0 0x7f9a7c19b410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 >> 172.21.15.12:0/1398027163 conn(0x7f9a7c102d30 msgr2=0x7f9a7c1037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 shutdown_connections 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:34.491+0000 7f9a83f75700 1 -- 172.21.15.12:0/1398027163 wait complete. 2024-02-14T12:59:36.061 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mgr service... 2024-02-14T12:59:36.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:36 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:36.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:36 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:37.304 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-14T12:59:37.304 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37adaba700 1 Processor -- start 2024-02-14T12:59:37.304 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37adaba700 1 -- start start 2024-02-14T12:59:37.304 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37adaba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a810a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:37.304 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37adaba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80754c0 con 0x7f37a8108160 2024-02-14T12:59:37.304 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a810a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a810a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59494/0 (socket says 172.21.15.12:59494) 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37a77fe700 1 -- 172.21.15.12:0/3267179006 learned_addr learned my addr 172.21.15.12:0/3267179006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37a77fe700 1 -- 172.21.15.12:0/3267179006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a810aa90 con 0x7f37a8108160 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.505+0000 7f37a77fe700 1 --2- 172.21.15.12:0/3267179006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a810a550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37980098a0 tx=0x7f3798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351e8f6b7e3a315c server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37a67fc700 1 -- 172.21.15.12:0/3267179006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3798004160 con 0x7f37a8108160 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37a67fc700 1 -- 172.21.15.12:0/3267179006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f37980042c0 con 0x7f37a8108160 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37a67fc700 1 -- 172.21.15.12:0/3267179006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3798011a80 con 0x7f37a8108160 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 -- 172.21.15.12:0/3267179006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 msgr2=0x7f37a810a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 --2- 172.21.15.12:0/3267179006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a810a550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37980098a0 tx=0x7f3798009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 -- 172.21.15.12:0/3267179006 shutdown_connections 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 --2- 172.21.15.12:0/3267179006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a810a550 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 -- 172.21.15.12:0/3267179006 >> 172.21.15.12:0/3267179006 conn(0x7f37a8101b70 msgr2=0x7f37a8103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 -- 172.21.15.12:0/3267179006 shutdown_connections 2024-02-14T12:59:37.305 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.506+0000 7f37adaba700 1 -- 172.21.15.12:0/3267179006 wait complete. 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.507+0000 7f37adaba700 1 Processor -- start 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.507+0000 7f37adaba700 1 -- start start 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.507+0000 7f37adaba700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.507+0000 7f37adaba700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a819b8e0 con 0x7f37a8108160 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.507+0000 7f37a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a819b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59496/0 (socket says 172.21.15.12:59496) 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a77fe700 1 -- 172.21.15.12:0/2498379406 learned_addr learned my addr 172.21.15.12:0/2498379406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a77fe700 1 -- 172.21.15.12:0/2498379406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009550 con 0x7f37a8108160 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a77fe700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a819b3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3798011740 tx=0x7f3798011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3798003b20 con 0x7f37a8108160 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f379801a910 con 0x7f37a8108160 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a819bae0 con 0x7f37a8108160 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37980248c0 con 0x7f37a8108160 2024-02-14T12:59:37.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.508+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a819bf80 con 0x7f37a8108160 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.509+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f379802d3f0 con 0x7f37a8108160 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.509+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a810b8d0 con 0x7f37a8108160 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.509+0000 7f37a4ff9700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f3790038ee0 0x7f379003b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.510+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f379804d3e0 con 0x7f37a8108160 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.510+0000 7f37a6ffd700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f3790038ee0 0x7f379003b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.510+0000 7f37a6ffd700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f3790038ee0 0x7f379003b3a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f379c006fd0 tx=0x7f379c006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.515+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3798010970 con 0x7f37a8108160 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.734+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f37a819e8c0 con 0x7f3790038ee0 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.741+0000 7f37a4ff9700 1 -- 172.21.15.12:0/2498379406 <== mgr.14116 v2:172.21.15.12:6800/955464513 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f37a819e8c0 con 0x7f3790038ee0 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f3790038ee0 msgr2=0x7f379003b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f3790038ee0 0x7f379003b3a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f379c006fd0 tx=0x7f379c006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 msgr2=0x7f37a819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a819b3a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3798011740 tx=0x7f3798011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 shutdown_connections 2024-02-14T12:59:37.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f3790038ee0 0x7f379003b3a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:37.308 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 --2- 172.21.15.12:0/2498379406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37a8108160 0x7f37a819b3a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:37.308 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.743+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 >> 172.21.15.12:0/2498379406 conn(0x7f37a8101b70 msgr2=0x7f37a81025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:37.308 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.744+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 shutdown_connections 2024-02-14T12:59:37.308 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:36.744+0000 7f37adaba700 1 -- 172.21.15.12:0/2498379406 wait complete. 2024-02-14T12:59:37.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:37 smithi012 ceph-mon[32370]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:37.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:37 smithi012 ceph-mon[32370]: Saving service mgr spec with placement count:2 2024-02-14T12:59:37.919 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:37 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe26c17c700 1 Processor -- start 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe26c17c700 1 -- start start 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe26c17c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264107f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe26c17c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264108530 con 0x7fe264107b40 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe269f18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe269f18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59500/0 (socket says 172.21.15.12:59500) 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe269f18700 1 -- 172.21.15.12:0/134562575 learned_addr learned my addr 172.21.15.12:0/134562575 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.710+0000 7fe269f18700 1 -- 172.21.15.12:0/134562575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2641067a0 con 0x7fe264107b40 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe269f18700 1 --2- 172.21.15.12:0/134562575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264107f60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe26000bb40 tx=0x7fe26000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac840d5f7130ca4 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:38.907 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe268f16700 1 -- 172.21.15.12:0/134562575 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe26000dbe0 con 0x7fe264107b40 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe268f16700 1 -- 172.21.15.12:0/134562575 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fe260004510 con 0x7fe264107b40 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe268f16700 1 -- 172.21.15.12:0/134562575 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe260010470 con 0x7fe264107b40 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe26c17c700 1 -- 172.21.15.12:0/134562575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 msgr2=0x7fe264107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe26c17c700 1 --2- 172.21.15.12:0/134562575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264107f60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe26000bb40 tx=0x7fe26000be50 comp rx=0 tx=0).stop 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe26c17c700 1 -- 172.21.15.12:0/134562575 shutdown_connections 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe26c17c700 1 --2- 172.21.15.12:0/134562575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264107f60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.711+0000 7fe26c17c700 1 -- 172.21.15.12:0/134562575 >> 172.21.15.12:0/134562575 conn(0x7fe2641012d0 msgr2=0x7fe2641036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe26c17c700 1 -- 172.21.15.12:0/134562575 shutdown_connections 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe26c17c700 1 -- 172.21.15.12:0/134562575 wait complete. 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe26c17c700 1 Processor -- start 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe26c17c700 1 -- start start 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe26c17c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:38.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe26c17c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2641997b0 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe269f18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe269f18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59512/0 (socket says 172.21.15.12:59512) 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.712+0000 7fe269f18700 1 -- 172.21.15.12:0/2753535972 learned_addr learned my addr 172.21.15.12:0/2753535972 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe269f18700 1 -- 172.21.15.12:0/2753535972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26000b7f0 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe269f18700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264199270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b340 tx=0x7fe260003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe26001e070 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fe260004300 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2641999b0 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe260022a20 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.713+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe264199e50 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.714+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7fe26002c440 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.714+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe264105690 con 0x7fe264107b40 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.714+0000 7fe25affd700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fe250038ee0 0x7fe25003b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:38.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.714+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe26004f6f0 con 0x7fe264107b40 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.714+0000 7fe269717700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fe250038ee0 0x7fe25003b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.714+0000 7fe269717700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fe250038ee0 0x7fe25003b3a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe254006fd0 tx=0x7fe254006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.719+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe26002a950 con 0x7fe264107b40 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.925+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe264192950 con 0x7fe264107b40 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.928+0000 7fe25affd700 1 -- 172.21.15.12:0/2753535972 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe260027020 con 0x7fe264107b40 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fe250038ee0 msgr2=0x7fe25003b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fe250038ee0 0x7fe25003b3a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe254006fd0 tx=0x7fe254006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 msgr2=0x7fe264199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264199270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b340 tx=0x7fe260003980 comp rx=0 tx=0).stop 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 shutdown_connections 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fe250038ee0 0x7fe25003b3a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 --2- 172.21.15.12:0/2753535972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe264107b40 0x7fe264199270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 >> 172.21.15.12:0/2753535972 conn(0x7fe2641012d0 msgr2=0x7fe26418fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:38.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 shutdown_connections 2024-02-14T12:59:38.911 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:37.930+0000 7fe26c17c700 1 -- 172.21.15.12:0/2753535972 wait complete. 2024-02-14T12:59:39.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2753535972' entity='client.admin' 2024-02-14T12:59:40.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:39 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:40.131 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3141881703' entity='client.admin' 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.354+0000 7fad7f147700 1 Processor -- start 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.354+0000 7fad7f147700 1 -- start start 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.354+0000 7fad7f147700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad78106330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.354+0000 7fad7f147700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7807aec0 con 0x7fad78105f10 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.354+0000 7fad7cee3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad78106330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad7cee3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad78106330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59524/0 (socket says 172.21.15.12:59524) 2024-02-14T12:59:40.138 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad7cee3700 1 -- 172.21.15.12:0/1174231437 learned_addr learned my addr 172.21.15.12:0/1174231437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad7cee3700 1 -- 172.21.15.12:0/1174231437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78106870 con 0x7fad78105f10 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad7cee3700 1 --2- 172.21.15.12:0/1174231437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad78106330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0098a0 tx=0x7fad6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65d9172987c6ad9 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad777fe700 1 -- 172.21.15.12:0/1174231437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad6c004160 con 0x7fad78105f10 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad777fe700 1 -- 172.21.15.12:0/1174231437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fad6c0042c0 con 0x7fad78105f10 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.355+0000 7fad777fe700 1 -- 172.21.15.12:0/1174231437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad6c011a80 con 0x7fad78105f10 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 -- 172.21.15.12:0/1174231437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 msgr2=0x7fad78106330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 --2- 172.21.15.12:0/1174231437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad78106330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0098a0 tx=0x7fad6c009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 -- 172.21.15.12:0/1174231437 shutdown_connections 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 --2- 172.21.15.12:0/1174231437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad78106330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 -- 172.21.15.12:0/1174231437 >> 172.21.15.12:0/1174231437 conn(0x7fad78101b90 msgr2=0x7fad78103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 -- 172.21.15.12:0/1174231437 shutdown_connections 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.356+0000 7fad7f147700 1 -- 172.21.15.12:0/1174231437 wait complete. 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7f147700 1 Processor -- start 2024-02-14T12:59:40.139 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7f147700 1 -- start start 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7f147700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad7819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7f147700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7819dc60 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7cee3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad7819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7cee3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad7819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59538/0 (socket says 172.21.15.12:59538) 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7cee3700 1 -- 172.21.15.12:0/3141881703 learned_addr learned my addr 172.21.15.12:0/3141881703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.357+0000 7fad7cee3700 1 -- 172.21.15.12:0/3141881703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009550 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.358+0000 7fad7cee3700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad7819d720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009130 tx=0x7fad6c011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.358+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad6c003aa0 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.358+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fad6c003c00 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.358+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7819de60 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.358+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad6c0248a0 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.358+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7819ea10 con 0x7fad78105f10 2024-02-14T12:59:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.359+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78063350 con 0x7fad78105f10 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.359+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7fad6c01ac10 con 0x7fad78105f10 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.359+0000 7fad75ffb700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fad68038f30 0x7fad6803b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.359+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad6c04d150 con 0x7fad78105f10 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.360+0000 7fad77fff700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fad68038f30 0x7fad6803b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.360+0000 7fad77fff700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fad68038f30 0x7fad6803b3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad64006fd0 tx=0x7fad64006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.364+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad6c018760 con 0x7fad78105f10 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.578+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fad78107f00 con 0x7fad78105f10 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.581+0000 7fad75ffb700 1 -- 172.21.15.12:0/3141881703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fad6c00b3e0 con 0x7fad78105f10 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fad68038f30 msgr2=0x7fad6803b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fad68038f30 0x7fad6803b3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad64006fd0 tx=0x7fad64006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 msgr2=0x7fad7819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad7819d720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009130 tx=0x7fad6c011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 shutdown_connections 2024-02-14T12:59:40.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fad68038f30 0x7fad6803b3f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:40.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 --2- 172.21.15.12:0/3141881703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad78105f10 0x7fad7819d720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:40.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 >> 172.21.15.12:0/3141881703 conn(0x7fad78101b90 msgr2=0x7fad78194420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:40.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 shutdown_connections 2024-02-14T12:59:40.142 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:39.584+0000 7fad7f147700 1 -- 172.21.15.12:0/3141881703 wait complete. 2024-02-14T12:59:40.142 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling the dashboard module... 2024-02-14T12:59:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:41 smithi012 ceph-mon[32370]: from='mgr.14116 172.21.15.12:0/1974266109' entity='mgr.x' 2024-02-14T12:59:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:41 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2910901382' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-14T12:59:41.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: ignoring --setuser ceph since I am not root 2024-02-14T12:59:41.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: ignoring --setgroup ceph since I am not root 2024-02-14T12:59:42.111 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:41.810+0000 7fc990aad200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-14T12:59:42.111 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:41.907+0000 7fc990aad200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.587+0000 7f2d7d46e700 1 Processor -- start 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.587+0000 7f2d7d46e700 1 -- start start 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.587+0000 7f2d7d46e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d781069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.587+0000 7f2d7d46e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d78106f80 con 0x7f2d78106590 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d781069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d781069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59542/0 (socket says 172.21.15.12:59542) 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d76ffd700 1 -- 172.21.15.12:0/4156890863 learned_addr learned my addr 172.21.15.12:0/4156890863 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d76ffd700 1 -- 172.21.15.12:0/4156890863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78107790 con 0x7f2d78106590 2024-02-14T12:59:42.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d76ffd700 1 --2- 172.21.15.12:0/4156890863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d781069b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d600098a0 tx=0x7f2d60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1147529e7e1c318 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d75ffb700 1 -- 172.21.15.12:0/4156890863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d60004160 con 0x7f2d78106590 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d75ffb700 1 -- 172.21.15.12:0/4156890863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2d600042c0 con 0x7f2d78106590 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.588+0000 7f2d75ffb700 1 -- 172.21.15.12:0/4156890863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d60011a80 con 0x7f2d78106590 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 -- 172.21.15.12:0/4156890863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 msgr2=0x7f2d781069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 --2- 172.21.15.12:0/4156890863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d781069b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d600098a0 tx=0x7f2d60009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 -- 172.21.15.12:0/4156890863 shutdown_connections 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 --2- 172.21.15.12:0/4156890863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d781069b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 -- 172.21.15.12:0/4156890863 >> 172.21.15.12:0/4156890863 conn(0x7f2d78101b70 msgr2=0x7f2d78103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:42.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 -- 172.21.15.12:0/4156890863 shutdown_connections 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 -- 172.21.15.12:0/4156890863 wait complete. 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.589+0000 7f2d7d46e700 1 Processor -- start 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d7d46e700 1 -- start start 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d7d46e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d7819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d7d46e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7819dba0 con 0x7f2d78106590 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d7819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d7819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59544/0 (socket says 172.21.15.12:59544) 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d76ffd700 1 -- 172.21.15.12:0/2910901382 learned_addr learned my addr 172.21.15.12:0/2910901382 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d76ffd700 1 -- 172.21.15.12:0/2910901382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60009550 con 0x7f2d78106590 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.590+0000 7f2d76ffd700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d7819d660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d60011740 tx=0x7f2d60011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.591+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d600039e0 con 0x7f2d78106590 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.591+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7819dda0 con 0x7f2d78106590 2024-02-14T12:59:42.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.591+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7819e240 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.591+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2d60003b40 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.591+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d60024740 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.591+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) v1 ==== 45932+0+0 (secure 0 0 0) 0x7f2d6002d3f0 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.592+0000 7f2d6ffff700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f2d64038f30 0x7f2d6403b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.592+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2d6004d140 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.592+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d58005330 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.592+0000 7f2d767fc700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f2d64038f30 0x7f2d6403b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.592+0000 7f2d767fc700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f2d64038f30 0x7f2d6403b3f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d68006fd0 tx=0x7f2d68006e40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.597+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2d6002d6f0 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:40.870+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f2d580055e0 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.232+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f2d60010380 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.234+0000 7f2d6ffff700 1 -- 172.21.15.12:0/2910901382 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 9) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f2d60019410 con 0x7f2d78106590 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f2d64038f30 msgr2=0x7f2d6403b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f2d64038f30 0x7f2d6403b3f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d68006fd0 tx=0x7f2d68006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 msgr2=0x7f2d7819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d7819d660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d60011740 tx=0x7f2d60011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 shutdown_connections 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7f2d64038f30 0x7f2d6403b3f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 --2- 172.21.15.12:0/2910901382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d78106590 0x7f2d7819d660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 >> 172.21.15.12:0/2910901382 conn(0x7f2d78101b70 msgr2=0x7f2d781029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 shutdown_connections 2024-02-14T12:59:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:41.235+0000 7f2d7d46e700 1 -- 172.21.15.12:0/2910901382 wait complete. 2024-02-14T12:59:42.430 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:42 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2910901382' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-14T12:59:42.430 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:42 smithi012 ceph-mon[32370]: mgrmap e9: x(active, since 19s) 2024-02-14T12:59:42.717 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:42.574+0000 7fc990aad200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-14T12:59:42.717 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:42.670+0000 7fc990aad200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-14T12:59:43.005 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:42.815+0000 7fc990aad200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-14T12:59:43.005 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:42.918+0000 7fc990aad200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-14T12:59:43.005 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:43.003+0000 7fc990aad200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-14T12:59:43.276 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/463321344' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-14T12:59:43.409 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.529+0000 7fee0a7fb700 1 Processor -- start 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.529+0000 7fee0a7fb700 1 -- start start 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.529+0000 7fee0a7fb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee041069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.529+0000 7fee0a7fb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee04106f80 con 0x7fee04106590 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.529+0000 7fee03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee041069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee041069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59576/0 (socket says 172.21.15.12:59576) 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee03fff700 1 -- 172.21.15.12:0/3958051612 learned_addr learned my addr 172.21.15.12:0/3958051612 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:43.410 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee03fff700 1 -- 172.21.15.12:0/3958051612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04107790 con 0x7fee04106590 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee03fff700 1 --2- 172.21.15.12:0/3958051612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee041069b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedf40098a0 tx=0x7fedf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e4738193280fb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee02ffd700 1 -- 172.21.15.12:0/3958051612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedf4004160 con 0x7fee04106590 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee02ffd700 1 -- 172.21.15.12:0/3958051612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fedf40042c0 con 0x7fee04106590 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.530+0000 7fee02ffd700 1 -- 172.21.15.12:0/3958051612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedf4011a80 con 0x7fee04106590 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 -- 172.21.15.12:0/3958051612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 msgr2=0x7fee041069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 --2- 172.21.15.12:0/3958051612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee041069b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fedf40098a0 tx=0x7fedf4009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 -- 172.21.15.12:0/3958051612 shutdown_connections 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 --2- 172.21.15.12:0/3958051612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee041069b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 -- 172.21.15.12:0/3958051612 >> 172.21.15.12:0/3958051612 conn(0x7fee04101b50 msgr2=0x7fee04103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 -- 172.21.15.12:0/3958051612 shutdown_connections 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 -- 172.21.15.12:0/3958051612 wait complete. 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 Processor -- start 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.531+0000 7fee0a7fb700 1 -- start start 2024-02-14T12:59:43.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee0a7fb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee0419b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee0a7fb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0419b9d0 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee0419b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee0419b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59578/0 (socket says 172.21.15.12:59578) 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee03fff700 1 -- 172.21.15.12:0/463321344 learned_addr learned my addr 172.21.15.12:0/463321344 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee03fff700 1 -- 172.21.15.12:0/463321344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4009550 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee03fff700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee0419b490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fedf4011740 tx=0x7fedf4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedf40039e0 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fedf4003b40 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.532+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0419bbd0 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.533+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fedf4024710 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.533+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0419c070 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.533+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) v1 ==== 45945+0+0 (secure 0 0 0) 0x7fedf4024980 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.533+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee04195630 con 0x7fee04106590 2024-02-14T12:59:43.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.534+0000 7fee017fa700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 0x7fedf003b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.534+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fedf404d0e0 con 0x7fee04106590 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.534+0000 7fee037fe700 1 -- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 msgr2=0x7fedf003b400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.534+0000 7fee037fe700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 0x7fedf003b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.538+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fedf4022310 con 0x7fee04106590 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.735+0000 7fee037fe700 1 -- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 msgr2=0x7fedf003b400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.735+0000 7fee037fe700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 0x7fedf003b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.799+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fee0402d950 con 0x7fee04106590 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.799+0000 7fee017fa700 1 -- 172.21.15.12:0/463321344 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fedf4018be0 con 0x7fee04106590 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 msgr2=0x7fedf003b400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 0x7fedf003b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 msgr2=0x7fee0419b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee0419b490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fedf4011740 tx=0x7fedf4011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 shutdown_connections 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fedf0038f40 0x7fedf003b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 --2- 172.21.15.12:0/463321344 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee04106590 0x7fee0419b490 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:43.414 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 >> 172.21.15.12:0/463321344 conn(0x7fee04101b50 msgr2=0x7fee041029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:43.414 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 shutdown_connections 2024-02-14T12:59:43.414 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:42.801+0000 7fee0a7fb700 1 -- 172.21.15.12:0/463321344 wait complete. 2024-02-14T12:59:43.414 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-02-14T12:59:43.414 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 9... 2024-02-14T12:59:43.527 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:43.273+0000 7fc990aad200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-14T12:59:43.527 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:43.385+0000 7fc990aad200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-14T12:59:43.528 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:43.482+0000 7fc990aad200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-14T12:59:43.829 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:43.580+0000 7fc990aad200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-14T12:59:43.829 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:43.761+0000 7fc990aad200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-14T12:59:45.113 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:44.757+0000 7fc990aad200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-14T12:59:45.113 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:44.894+0000 7fc990aad200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-14T12:59:45.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:45.242+0000 7fc990aad200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-14T12:59:45.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:45.338+0000 7fc990aad200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-14T12:59:45.909 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:45.542+0000 7fc990aad200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-14T12:59:45.909 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:45.732+0000 7fc990aad200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-14T12:59:46.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:46.027+0000 7fc990aad200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-14T12:59:46.717 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:46.290+0000 7fc990aad200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-14T12:59:46.717 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:46.530+0000 7fc990aad200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-14T12:59:47.717 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:47 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:47.352+0000 7fc990aad200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-14T12:59:48.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:47 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:47.937+0000 7fc990aad200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-14T12:59:48.217 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:48.038+0000 7fc990aad200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-14T12:59:48.717 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T12:59:48.258+0000 7fc990aad200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-14T12:59:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: Active manager daemon x restarted 2024-02-14T12:59:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: Activating manager daemon x 2024-02-14T12:59:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: osdmap e3: 0 total, 0 up, 0 in 2024-02-14T12:59:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: mgrmap e10: x(active, starting, since 0.00323325s) 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: Manager daemon x is now available 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:48.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T12:59:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-14T12:59:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-14T12:59:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:48] ENGINE Bus STARTING 2024-02-14T12:59:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:49] ENGINE Serving on http://172.21.15.12:8765 2024-02-14T12:59:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:49] ENGINE Serving on https://172.21.15.12:7150 2024-02-14T12:59:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: [14/Feb/2024:12:59:49] ENGINE Bus STARTED 2024-02-14T12:59:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-14T12:59:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: mgrmap e11: x(active, since 1.00539s) 2024-02-14T12:59:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:49 smithi012 ceph-mon[32370]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.844+0000 7fc7733cd700 1 Processor -- start 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.844+0000 7fc7733cd700 1 -- start start 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc7733cd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c1069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc7733cd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c106f80 con 0x7fc76c106590 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc771169700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c1069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:50.080 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc771169700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c1069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59582/0 (socket says 172.21.15.12:59582) 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc771169700 1 -- 172.21.15.12:0/374893086 learned_addr learned my addr 172.21.15.12:0/374893086 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc771169700 1 -- 172.21.15.12:0/374893086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c107790 con 0x7fc76c106590 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.845+0000 7fc771169700 1 --2- 172.21.15.12:0/374893086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c1069b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7680098a0 tx=0x7fc768009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5887ccef95212d23 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc75ffff700 1 -- 172.21.15.12:0/374893086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc768004160 con 0x7fc76c106590 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc75ffff700 1 -- 172.21.15.12:0/374893086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc7680042c0 con 0x7fc76c106590 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc75ffff700 1 -- 172.21.15.12:0/374893086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc768011a80 con 0x7fc76c106590 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 -- 172.21.15.12:0/374893086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 msgr2=0x7fc76c1069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 --2- 172.21.15.12:0/374893086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c1069b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7680098a0 tx=0x7fc768009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 -- 172.21.15.12:0/374893086 shutdown_connections 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 --2- 172.21.15.12:0/374893086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c1069b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 -- 172.21.15.12:0/374893086 >> 172.21.15.12:0/374893086 conn(0x7fc76c101b70 msgr2=0x7fc76c103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 -- 172.21.15.12:0/374893086 shutdown_connections 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.846+0000 7fc7733cd700 1 -- 172.21.15.12:0/374893086 wait complete. 2024-02-14T12:59:50.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.847+0000 7fc7733cd700 1 Processor -- start 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.847+0000 7fc7733cd700 1 -- start start 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.847+0000 7fc7733cd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c0750e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.847+0000 7fc7733cd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c19e150 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc771169700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c0750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc771169700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c0750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59596/0 (socket says 172.21.15.12:59596) 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc771169700 1 -- 172.21.15.12:0/981927866 learned_addr learned my addr 172.21.15.12:0/981927866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc771169700 1 -- 172.21.15.12:0/981927866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009550 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc771169700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c0750e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc768011740 tx=0x7fc768011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7680039e0 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc768003b40 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.848+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c19e290 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc768024740 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) v1 ==== 45945+0+0 (secure 0 0 0) 0x7fc7680193c0 con 0x7fc76c106590 2024-02-14T12:59:50.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c19e670 con 0x7fc76c106590 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc75e7fc700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc768052580 con 0x7fc76c106590 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc770968700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 msgr2=0x7fc75803b050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.849+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:43.850+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 --> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc76c10a9c0 con 0x7fc758038b90 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:44.050+0000 7fc770968700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 msgr2=0x7fc75803b050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:44.050+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:44.451+0000 7fc770968700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 msgr2=0x7fc75803b050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:44.451+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:45.252+0000 7fc770968700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 msgr2=0x7fc75803b050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:45.252+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:46.853+0000 7fc770968700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 msgr2=0x7fc75803b050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/955464513 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:46.853+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:48.273+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 10) v1 ==== 45712+0+0 (secure 0 0 0) 0x7fc76801ab10 con 0x7fc76c106590 2024-02-14T12:59:50.083 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:48.273+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 msgr2=0x7fc75803b050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:48.273+0000 7fc75e7fc700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.274+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 11) v1 ==== 45839+0+0 (secure 0 0 0) 0x7fc76801dd90 con 0x7fc76c106590 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.274+0000 7fc75e7fc700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc75803c560 0x7fc75803e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.274+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc76c10a9c0 con 0x7fc75803c560 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.275+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc75803c560 0x7fc75803e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.275+0000 7fc770968700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc75803c560 0x7fc75803e950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc760003a10 tx=0x7fc760009270 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.276+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fc76c10a9c0 con 0x7fc75803c560 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc76c10ab30 con 0x7fc75803c560 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc75e7fc700 1 -- 172.21.15.12:0/981927866 <== mgr.14148 v2:172.21.15.12:6800/1684027624 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc76c10ab30 con 0x7fc75803c560 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc75803c560 msgr2=0x7fc75803e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc75803c560 0x7fc75803e950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc760003a10 tx=0x7fc760009270 comp rx=0 tx=0).stop 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 msgr2=0x7fc76c0750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c0750e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc768011740 tx=0x7fc768011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:50.084 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 shutdown_connections 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc75803c560 0x7fc75803e950 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc76c106590 0x7fc76c0750e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 --2- 172.21.15.12:0/981927866 >> [v2:172.21.15.12:6800/955464513,v1:172.21.15.12:6801/955464513] conn(0x7fc758038b90 0x7fc75803b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 >> 172.21.15.12:0/981927866 conn(0x7fc76c101b70 msgr2=0x7fc76c102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 shutdown_connections 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:49.283+0000 7fc7733cd700 1 -- 172.21.15.12:0/981927866 wait complete. 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 9 is available 2024-02-14T12:59:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:Generating a dashboard self-signed certificate... 2024-02-14T12:59:51.143 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T12:59:51.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-14T12:59:51.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.524+0000 7f75d0bcc700 1 Processor -- start 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.524+0000 7f75d0bcc700 1 -- start start 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.524+0000 7f75d0bcc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc10a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.524+0000 7f75d0bcc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0754c0 con 0x7f75cc108160 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc10a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc10a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48548/0 (socket says 172.21.15.12:48548) 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75ca59c700 1 -- 172.21.15.12:0/531111726 learned_addr learned my addr 172.21.15.12:0/531111726 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75ca59c700 1 -- 172.21.15.12:0/531111726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc10aa90 con 0x7f75cc108160 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75ca59c700 1 --2- 172.21.15.12:0/531111726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc10a550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0098a0 tx=0x7f75bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f05618438776c76 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75c959a700 1 -- 172.21.15.12:0/531111726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc004160 con 0x7f75cc108160 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75c959a700 1 -- 172.21.15.12:0/531111726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f75bc0042c0 con 0x7f75cc108160 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.525+0000 7f75c959a700 1 -- 172.21.15.12:0/531111726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc011a80 con 0x7f75cc108160 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 -- 172.21.15.12:0/531111726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 msgr2=0x7f75cc10a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:51.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 --2- 172.21.15.12:0/531111726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc10a550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0098a0 tx=0x7f75bc009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 -- 172.21.15.12:0/531111726 shutdown_connections 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 --2- 172.21.15.12:0/531111726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc10a550 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 -- 172.21.15.12:0/531111726 >> 172.21.15.12:0/531111726 conn(0x7f75cc101b70 msgr2=0x7f75cc103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 -- 172.21.15.12:0/531111726 shutdown_connections 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.526+0000 7f75d0bcc700 1 -- 172.21.15.12:0/531111726 wait complete. 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75d0bcc700 1 Processor -- start 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75d0bcc700 1 -- start start 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75d0bcc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75d0bcc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc19b8e0 con 0x7f75cc108160 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75ca59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc19b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48564/0 (socket says 172.21.15.12:48564) 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.527+0000 7f75ca59c700 1 -- 172.21.15.12:0/901786918 learned_addr learned my addr 172.21.15.12:0/901786918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75ca59c700 1 -- 172.21.15.12:0/901786918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009550 con 0x7f75cc108160 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75ca59c700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc19b3a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75bc011740 tx=0x7f75bc011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:51.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc003b20 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc19bae0 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f75bc01a910 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75bc0248c0 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.528+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc19bf80 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.529+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 11) v1 ==== 45839+0+0 (secure 0 0 0) 0x7f75bc02d3f0 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.529+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc10b8d0 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.529+0000 7f75bb7fe700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75b4038e10 0x7f75b403b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.529+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f75bc04d320 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.529+0000 7f75c9d9b700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75b4038e10 0x7f75b403b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.529+0000 7f75c9d9b700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75b4038e10 0x7f75b403b2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75c0006fd0 tx=0x7f75c0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.534+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f75bc010a70 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.742+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f75cc102cd0 con 0x7f75b4038e10 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.792+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 12) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f75bc021d40 con 0x7f75cc108160 2024-02-14T12:59:51.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.827+0000 7f75bb7fe700 1 -- 172.21.15.12:0/901786918 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f75cc102cd0 con 0x7f75b4038e10 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75b4038e10 msgr2=0x7f75b403b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75b4038e10 0x7f75b403b2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f75c0006fd0 tx=0x7f75c0006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 msgr2=0x7f75cc19b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc19b3a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75bc011740 tx=0x7f75bc011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 shutdown_connections 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75b4038e10 0x7f75b403b2d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 --2- 172.21.15.12:0/901786918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75cc108160 0x7f75cc19b3a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 >> 172.21.15.12:0/901786918 conn(0x7f75cc101b70 msgr2=0x7f75cc1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 shutdown_connections 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:50.829+0000 7f75d0bcc700 1 -- 172.21.15.12:0/901786918 wait complete. 2024-02-14T12:59:51.421 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial admin user... 2024-02-14T12:59:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:51 smithi012 ceph-mon[32370]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:51 smithi012 ceph-mon[32370]: mgrmap e12: x(active, since 2s) 2024-02-14T12:59:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:51 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T12:59:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:51 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T12:59:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:51 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T12:59:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:52 smithi012 ceph-mon[32370]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T12:59:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$/hrP26P7GhmEXsn0vJ7kCeUefucXOJmU6vEyUEau3Tw1v.bR8K13u", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707915592, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.814+0000 7f54c1f9c700 1 Processor -- start 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54c1f9c700 1 -- start start 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54c1f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc1069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54c1f9c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc106fa0 con 0x7f54bc1065b0 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc1069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc1069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48574/0 (socket says 172.21.15.12:48574) 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54bb7fe700 1 -- 172.21.15.12:0/4007857527 learned_addr learned my addr 172.21.15.12:0/4007857527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54bb7fe700 1 -- 172.21.15.12:0/4007857527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc1077b0 con 0x7f54bc1065b0 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54bb7fe700 1 --2- 172.21.15.12:0/4007857527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc1069d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00bb40 tx=0x7f54ac00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c58621a6bc1507b server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.815+0000 7f54ba7fc700 1 -- 172.21.15.12:0/4007857527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54ac00dbe0 con 0x7f54bc1065b0 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54ba7fc700 1 -- 172.21.15.12:0/4007857527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f54ac004510 con 0x7f54bc1065b0 2024-02-14T12:59:52.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54ba7fc700 1 -- 172.21.15.12:0/4007857527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54ac010470 con 0x7f54bc1065b0 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 -- 172.21.15.12:0/4007857527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 msgr2=0x7f54bc1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 --2- 172.21.15.12:0/4007857527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc1069d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00bb40 tx=0x7f54ac00be50 comp rx=0 tx=0).stop 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 -- 172.21.15.12:0/4007857527 shutdown_connections 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 --2- 172.21.15.12:0/4007857527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc1069d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 -- 172.21.15.12:0/4007857527 >> 172.21.15.12:0/4007857527 conn(0x7f54bc101bd0 msgr2=0x7f54bc103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 -- 172.21.15.12:0/4007857527 shutdown_connections 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.816+0000 7f54c1f9c700 1 -- 172.21.15.12:0/4007857527 wait complete. 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54c1f9c700 1 Processor -- start 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54c1f9c700 1 -- start start 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54c1f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54c1f9c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc19db80 con 0x7f54bc1065b0 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:52.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48590/0 (socket says 172.21.15.12:48590) 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54bb7fe700 1 -- 172.21.15.12:0/6564222 learned_addr learned my addr 172.21.15.12:0/6564222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.817+0000 7f54bb7fe700 1 -- 172.21.15.12:0/6564222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac00b7f0 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.818+0000 7f54bb7fe700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc19d640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54ac006fa0 tx=0x7f54ac003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.818+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54ac004230 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.818+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc19dd80 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.818+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f54ac004390 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.818+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54ac019c40 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.818+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc19e1c0 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.819+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f54ac010730 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.819+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc079fe0 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.819+0000 7f54b8ff9700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54a4038ee0 0x7f54a403b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.819+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f54ac04d2c0 con 0x7f54bc1065b0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.819+0000 7f54baffd700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54a4038ee0 0x7f54a403b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:52.989 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.819+0000 7f54baffd700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54a4038ee0 0x7f54a403b3a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006fd0 tx=0x7f54b0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:51.824+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f54ac0193f0 con 0x7f54bc1065b0 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.060+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f54bc1a0bc0 con 0x7f54a4038ee0 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.309+0000 7f54b8ff9700 1 -- 172.21.15.12:0/6564222 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f54bc1a0bc0 con 0x7f54a4038ee0 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54a4038ee0 msgr2=0x7f54a403b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54a4038ee0 0x7f54a403b3a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006fd0 tx=0x7f54b0006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 msgr2=0x7f54bc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc19d640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54ac006fa0 tx=0x7f54ac003d40 comp rx=0 tx=0).stop 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 shutdown_connections 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54a4038ee0 0x7f54a403b3a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 --2- 172.21.15.12:0/6564222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54bc1065b0 0x7f54bc19d640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 >> 172.21.15.12:0/6564222 conn(0x7f54bc101bd0 msgr2=0x7f54bc18f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 shutdown_connections 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:52.312+0000 7f54c1f9c700 1 -- 172.21.15.12:0/6564222 wait complete. 2024-02-14T12:59:52.990 INFO:teuthology.orchestra.run.smithi012.stdout:Fetching dashboard port number... 2024-02-14T12:59:54.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:54 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/4193035946' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-14T12:59:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 8443 2024-02-14T12:59:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.404+0000 7fd2ec4a0700 1 Processor -- start 2024-02-14T12:59:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.404+0000 7fd2ec4a0700 1 -- start start 2024-02-14T12:59:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.404+0000 7fd2ec4a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e41069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.404+0000 7fd2ec4a0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4106f80 con 0x7fd2e4106590 2024-02-14T12:59:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2ea23c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e41069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2ea23c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e41069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48604/0 (socket says 172.21.15.12:48604) 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2ea23c700 1 -- 172.21.15.12:0/1330981695 learned_addr learned my addr 172.21.15.12:0/1330981695 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2ea23c700 1 -- 172.21.15.12:0/1330981695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4107790 con 0x7fd2e4106590 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2ea23c700 1 --2- 172.21.15.12:0/1330981695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e41069b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40098a0 tx=0x7fd2d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917d6c44bcaafbba server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2e923a700 1 -- 172.21.15.12:0/1330981695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d4004160 con 0x7fd2e4106590 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2e923a700 1 -- 172.21.15.12:0/1330981695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd2d40042c0 con 0x7fd2e4106590 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.405+0000 7fd2e923a700 1 -- 172.21.15.12:0/1330981695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d4011a80 con 0x7fd2e4106590 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/1330981695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 msgr2=0x7fd2e41069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 --2- 172.21.15.12:0/1330981695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e41069b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40098a0 tx=0x7fd2d4009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/1330981695 shutdown_connections 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 --2- 172.21.15.12:0/1330981695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e41069b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/1330981695 >> 172.21.15.12:0/1330981695 conn(0x7fd2e4101b70 msgr2=0x7fd2e4103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/1330981695 shutdown_connections 2024-02-14T12:59:54.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.406+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/1330981695 wait complete. 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ec4a0700 1 Processor -- start 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ec4a0700 1 -- start start 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ec4a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e4191700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ec4a0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4191c40 con 0x7fd2e4106590 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ea23c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e4191700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ea23c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e4191700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48612/0 (socket says 172.21.15.12:48612) 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ea23c700 1 -- 172.21.15.12:0/4193035946 learned_addr learned my addr 172.21.15.12:0/4193035946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ea23c700 1 -- 172.21.15.12:0/4193035946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4009550 con 0x7fd2e4106590 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.407+0000 7fd2ea23c700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e4191700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4011740 tx=0x7fd2d4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.408+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d40039e0 con 0x7fd2e4106590 2024-02-14T12:59:54.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.408+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd2d4003b40 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.408+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e418fe30 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.408+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d4024740 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.408+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e41902d0 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.409+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) v1 ==== 45945+0+0 (secure 0 0 0) 0x7fd2d401a430 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.409+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e410a9c0 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.409+0000 7fd2db7fe700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2d0038f90 0x7fd2d003b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.409+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd2d404d240 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.409+0000 7fd2e9a3b700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2d0038f90 0x7fd2d003b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.410+0000 7fd2e9a3b700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2d0038f90 0x7fd2d003b450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0006fd0 tx=0x7fd2e0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.414+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd2d4010380 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.621+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fd2e4195220 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.621+0000 7fd2db7fe700 1 -- 172.21.15.12:0/4193035946 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fd2d4018be0 con 0x7fd2e4106590 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2d0038f90 msgr2=0x7fd2d003b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:54.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2d0038f90 0x7fd2d003b450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0006fd0 tx=0x7fd2e0006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 msgr2=0x7fd2e4191700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e4191700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4011740 tx=0x7fd2d4011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 shutdown_connections 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2d0038f90 0x7fd2d003b450 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 --2- 172.21.15.12:0/4193035946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2e4106590 0x7fd2e4191700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 >> 172.21.15.12:0/4193035946 conn(0x7fd2e4101b70 msgr2=0x7fd2e41029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 shutdown_connections 2024-02-14T12:59:54.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:53.623+0000 7fd2ec4a0700 1 -- 172.21.15.12:0/4193035946 wait complete. 2024-02-14T12:59:54.598 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-14T12:59:54.598 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-02-14T12:59:54.606 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-14T12:59:54.606 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-02-14T12:59:54.606 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-02-14T12:59:54.607 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-14T12:59:54.609 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph Dashboard is now available at: 2024-02-14T12:59:54.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:54.609 INFO:teuthology.orchestra.run.smithi012.stdout: URL: https://smithi012.front.sepia.ceph.com:8443/ 2024-02-14T12:59:54.609 INFO:teuthology.orchestra.run.smithi012.stdout: User: admin 2024-02-14T12:59:54.609 INFO:teuthology.orchestra.run.smithi012.stdout: Password: zaopanhmgz 2024-02-14T12:59:54.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:54.610 INFO:teuthology.orchestra.run.smithi012.stdout:Saving cluster configuration to /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config directory 2024-02-14T12:59:54.610 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling autotune for osd_memory_target 2024-02-14T12:59:55.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:55 smithi012 ceph-mon[32370]: mgrmap e13: x(active, since 6s) 2024-02-14T12:59:55.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1726e1a700 1 Processor -- start 2024-02-14T12:59:55.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1726e1a700 1 -- start start 2024-02-14T12:59:55.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1726e1a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f1720107b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:55.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1726e1a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1720108130 con 0x7f1720107740 2024-02-14T12:59:55.821 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1724bb6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f1720107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1724bb6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f1720107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40606/0 (socket says 172.21.15.12:40606) 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.029+0000 7f1724bb6700 1 -- 172.21.15.12:0/4183234903 learned_addr learned my addr 172.21.15.12:0/4183234903 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.030+0000 7f1724bb6700 1 -- 172.21.15.12:0/4183234903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17201088f0 con 0x7f1720107740 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.030+0000 7f1724bb6700 1 --2- 172.21.15.12:0/4183234903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f1720107b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17100098a0 tx=0x7f1710009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f2e669e421a077 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.030+0000 7f171f7fe700 1 -- 172.21.15.12:0/4183234903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1710004160 con 0x7f1720107740 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.030+0000 7f171f7fe700 1 -- 172.21.15.12:0/4183234903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f17100042c0 con 0x7f1720107740 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.030+0000 7f171f7fe700 1 -- 172.21.15.12:0/4183234903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1710011a80 con 0x7f1720107740 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 -- 172.21.15.12:0/4183234903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 msgr2=0x7f1720107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 --2- 172.21.15.12:0/4183234903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f1720107b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17100098a0 tx=0x7f1710009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 -- 172.21.15.12:0/4183234903 shutdown_connections 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 --2- 172.21.15.12:0/4183234903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f1720107b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 -- 172.21.15.12:0/4183234903 >> 172.21.15.12:0/4183234903 conn(0x7f1720102d60 msgr2=0x7f1720105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:55.822 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 -- 172.21.15.12:0/4183234903 shutdown_connections 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 -- 172.21.15.12:0/4183234903 wait complete. 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 Processor -- start 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.031+0000 7f1726e1a700 1 -- start start 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1726e1a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f172019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1726e1a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172019b930 con 0x7f1720107740 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1724bb6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f172019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1724bb6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f172019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40618/0 (socket says 172.21.15.12:40618) 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1724bb6700 1 -- 172.21.15.12:0/1404413487 learned_addr learned my addr 172.21.15.12:0/1404413487 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1724bb6700 1 -- 172.21.15.12:0/1404413487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710009550 con 0x7f1720107740 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1724bb6700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f172019b3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1710003f20 tx=0x7f1710011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17100039f0 con 0x7f1720107740 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1710003b50 con 0x7f1720107740 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172019bb30 con 0x7f1720107740 2024-02-14T12:59:55.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.032+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f171001a690 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.033+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172019bfd0 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.033+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f171001a950 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.033+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172010bb20 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.034+0000 7f171dffb700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1708038f80 0x7f170803b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.034+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f171004d680 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.034+0000 7f171ffff700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1708038f80 0x7f170803b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.034+0000 7f171ffff700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1708038f80 0x7f170803b440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1714006fd0 tx=0x7f1714006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.039+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1710018be0 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.240+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f172019e8b0 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.240+0000 7f171dffb700 1 -- 172.21.15.12:0/1404413487 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1710019e40 con 0x7f1720107740 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1708038f80 msgr2=0x7f170803b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1708038f80 0x7f170803b440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1714006fd0 tx=0x7f1714006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:55.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 msgr2=0x7f172019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f172019b3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1710003f20 tx=0x7f1710011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 shutdown_connections 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1708038f80 0x7f170803b440 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 --2- 172.21.15.12:0/1404413487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1720107740 0x7f172019b3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 >> 172.21.15.12:0/1404413487 conn(0x7f1720102d60 msgr2=0x7f1720103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 shutdown_connections 2024-02-14T12:59:55.825 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:55.242+0000 7f1726e1a700 1 -- 172.21.15.12:0/1404413487 wait complete. 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a888c3700 1 Processor -- start 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a888c3700 1 -- start start 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a888c3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a841069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a888c3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84106fa0 con 0x7f3a841065b0 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a841069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a841069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40626/0 (socket says 172.21.15.12:40626) 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.233+0000 7f3a8259c700 1 -- 172.21.15.12:0/4260781434 learned_addr learned my addr 172.21.15.12:0/4260781434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a8259c700 1 -- 172.21.15.12:0/4260781434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a841077b0 con 0x7f3a841065b0 2024-02-14T12:59:57.095 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a8259c700 1 --2- 172.21.15.12:0/4260781434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a841069d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a740098a0 tx=0x7f3a74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adfb2e5bd36cc4c server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a8159a700 1 -- 172.21.15.12:0/4260781434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a74004160 con 0x7f3a841065b0 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a8159a700 1 -- 172.21.15.12:0/4260781434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3a740042c0 con 0x7f3a841065b0 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a8159a700 1 -- 172.21.15.12:0/4260781434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a74011a80 con 0x7f3a841065b0 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a888c3700 1 -- 172.21.15.12:0/4260781434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 msgr2=0x7f3a841069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.234+0000 7f3a888c3700 1 --2- 172.21.15.12:0/4260781434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a841069d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a740098a0 tx=0x7f3a74009bb0 comp rx=0 tx=0).stop 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 -- 172.21.15.12:0/4260781434 shutdown_connections 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 --2- 172.21.15.12:0/4260781434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a841069d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 -- 172.21.15.12:0/4260781434 >> 172.21.15.12:0/4260781434 conn(0x7f3a84101bd0 msgr2=0x7f3a84103ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 -- 172.21.15.12:0/4260781434 shutdown_connections 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 -- 172.21.15.12:0/4260781434 wait complete. 2024-02-14T12:59:57.096 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 Processor -- start 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 -- start start 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a8419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.235+0000 7f3a888c3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8419db50 con 0x7f3a841065b0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a8419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a8419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40642/0 (socket says 172.21.15.12:40642) 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a8259c700 1 -- 172.21.15.12:0/4185018740 learned_addr learned my addr 172.21.15.12:0/4185018740 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a8259c700 1 -- 172.21.15.12:0/4185018740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009550 con 0x7f3a841065b0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a8259c700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a8419d610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a74011740 tx=0x7f3a74011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a740039e0 con 0x7f3a841065b0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3a74003b40 con 0x7f3a841065b0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8419dd50 con 0x7f3a841065b0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a74024740 con 0x7f3a841065b0 2024-02-14T12:59:57.097 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.236+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8419e1f0 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.237+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f3a7402d3f0 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.237+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84197a50 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.237+0000 7f3a737fe700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a6c039030 0x7f3a6c03b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.237+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3a7404d330 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.237+0000 7f3a81d9b700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a6c039030 0x7f3a6c03b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.238+0000 7f3a81d9b700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a6c039030 0x7f3a6c03b4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a78006fd0 tx=0x7f3a78006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.242+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3a74010a70 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.557+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f3a8410a9e0 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.559+0000 7f3a737fe700 1 -- 172.21.15.12:0/4185018740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f3a74010ed0 con 0x7f3a841065b0 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a6c039030 msgr2=0x7f3a6c03b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a6c039030 0x7f3a6c03b4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a78006fd0 tx=0x7f3a78006e40 comp rx=0 tx=0).stop 2024-02-14T12:59:57.098 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 msgr2=0x7f3a8419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a8419d610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a74011740 tx=0x7f3a74011b00 comp rx=0 tx=0).stop 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 shutdown_connections 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a6c039030 0x7f3a6c03b4f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 --2- 172.21.15.12:0/4185018740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a841065b0 0x7f3a8419d610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 >> 172.21.15.12:0/4185018740 conn(0x7f3a84101bd0 msgr2=0x7f3a841029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 shutdown_connections 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-02-14T12:59:56.561+0000 7f3a888c3700 1 -- 172.21.15.12:0/4185018740 wait complete. 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.099 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout:Or, if you are only running a single cluster on this host: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: ceph telemetry on 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout:For more information see: 2024-02-14T12:59:57.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.101 INFO:teuthology.orchestra.run.smithi012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-14T12:59:57.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T12:59:57.101 INFO:teuthology.orchestra.run.smithi012.stdout:Bootstrap complete. 2024-02-14T12:59:57.136 INFO:tasks.cephadm:Fetching config... 2024-02-14T12:59:57.137 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:59:57.137 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-14T12:59:57.153 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-14T12:59:57.153 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:59:57.153 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-14T12:59:57.208 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-14T12:59:57.208 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:59:57.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-14T12:59:57.275 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-14T12:59:57.275 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T12:59:57.275 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-14T12:59:57.330 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-14T12:59:57.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-14T12:59:57.415 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:59:57.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-14T12:59:57.485 INFO:teuthology.orchestra.run.smithi055.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:59:57.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-14T12:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJKLjmNREFmqU5MIUyW7QkjJIc1gOOW8yPRNfzy15wPv8GOCxfmqrT/cr1SY6Dw7JYFwjkMBvvzV2q2Z++RRYSF9EA7o+33EMWfDxFgxs1dGi19TtoV5HMWZNTQmwMYLtjIaSh5AFoMUZsfDfP8H48Xhn+CXRHX6S0eT460rnvuBazhNiSrhH/M/kZVRK8zUQmY8N2TC2+nBKQoCpZrIsb9FegSISdCiLugWYfWPoWyw3blOvMJbTXfD6jJ7cooBOhiO3TkuxnuixRsFuX3cNhJHdvzAa3ehi+T8F/X7HLMt9MnTyc26tzkcTk36vlM+i0O99EY3oH8ujkNBclWnB/ljvY1q3F6n23PVchyc4c4zxlrClHo+hF+i4UpAo7Ng++yuWBeT9TPuRRlrJQN+1yiPveFfeIYqeXUkN9ru9ddahvul172YSkcCidWqQpwa0CYXgixo0rr+LyjLpDgIlVZTNDGD1paXaKESGt2wm+LaOon+J/PsLWD0oyclA6Ol0= ceph-ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T12:59:57.564 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-14T12:59:57.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 12:59:57 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/4185018740' entity='client.admin' 2024-02-14T12:59:57.812 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 -- 172.21.15.12:0/464080010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 msgr2=0x7f2434101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 --2- 172.21.15.12:0/464080010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434101b70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2424009910 tx=0x7f2424009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 -- 172.21.15.12:0/464080010 shutdown_connections 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 --2- 172.21.15.12:0/464080010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434101b70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 -- 172.21.15.12:0/464080010 >> 172.21.15.12:0/464080010 conn(0x7f24340fccf0 msgr2=0x7f24340ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 -- 172.21.15.12:0/464080010 shutdown_connections 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.067+0000 7f24397d6700 1 -- 172.21.15.12:0/464080010 wait complete. 2024-02-14T13:00:00.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f24397d6700 1 Processor -- start 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f24397d6700 1 -- start start 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f24397d6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f24397d6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24341971a0 con 0x7f2434101750 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f2432ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f2432ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40648/0 (socket says 172.21.15.12:40648) 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.068+0000 7f2432ffd700 1 -- 172.21.15.12:0/1984856915 learned_addr learned my addr 172.21.15.12:0/1984856915 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f2432ffd700 1 -- 172.21.15.12:0/1984856915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240095f0 con 0x7f2434101750 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f2432ffd700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434196c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2424005850 tx=0x7f2424004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f242401d070 con 0x7f2434101750 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24341973a0 con 0x7f2434101750 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f242400be40 con 0x7f2434101750 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2424022ea0 con 0x7f2434101750 2024-02-14T13:00:00.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.069+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2434197840 con 0x7f2434101750 2024-02-14T13:00:00.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.070+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f242400f500 con 0x7f2434101750 2024-02-14T13:00:00.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.070+0000 7f241bfff700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f241c038f80 0x7f241c03b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:00.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.070+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f242404d350 con 0x7f2434101750 2024-02-14T13:00:00.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.070+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24341905b0 con 0x7f2434101750 2024-02-14T13:00:00.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.070+0000 7f24327fc700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f241c038f80 0x7f241c03b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:00.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.071+0000 7f24327fc700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f241c038f80 0x7f241c03b440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2428006fd0 tx=0x7f2428006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:00.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.075+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2424027020 con 0x7f2434101750 2024-02-14T13:00:00.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.279+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2434107820 con 0x7f2434101750 2024-02-14T13:00:00.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.281+0000 7f241bfff700 1 -- 172.21.15.12:0/1984856915 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2424017440 con 0x7f2434101750 2024-02-14T13:00:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f241c038f80 msgr2=0x7f241c03b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f241c038f80 0x7f241c03b440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2428006fd0 tx=0x7f2428006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 msgr2=0x7f2434196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434196c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2424005850 tx=0x7f2424004ff0 comp rx=0 tx=0).stop 2024-02-14T13:00:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 shutdown_connections 2024-02-14T13:00:00.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f241c038f80 0x7f241c03b440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:00.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 --2- 172.21.15.12:0/1984856915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2434101750 0x7f2434196c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:00.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 >> 172.21.15.12:0/1984856915 conn(0x7f24340fccf0 msgr2=0x7f24340fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:00.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 shutdown_connections 2024-02-14T13:00:00.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:00.284+0000 7f24397d6700 1 -- 172.21.15.12:0/1984856915 wait complete. 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1984856915' entity='client.admin' 2024-02-14T13:00:00.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:00.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:00.917 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-14T13:00:00.917 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-14T13:00:01.605 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 -- 172.21.15.12:0/3748865093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 msgr2=0x7fc264101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 --2- 172.21.15.12:0/3748865093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264101b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc260009910 tx=0x7fc260009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 -- 172.21.15.12:0/3748865093 shutdown_connections 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 --2- 172.21.15.12:0/3748865093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264101b90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 -- 172.21.15.12:0/3748865093 >> 172.21.15.12:0/3748865093 conn(0x7fc2640fcd10 msgr2=0x7fc2640ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 -- 172.21.15.12:0/3748865093 shutdown_connections 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.923+0000 7fc26bd49700 1 -- 172.21.15.12:0/3748865093 wait complete. 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc26bd49700 1 Processor -- start 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc26bd49700 1 -- start start 2024-02-14T13:00:02.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc26bd49700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc26bd49700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264197260 con 0x7fc264101770 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc269ae5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc269ae5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40674/0 (socket says 172.21.15.12:40674) 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc269ae5700 1 -- 172.21.15.12:0/274659661 learned_addr learned my addr 172.21.15.12:0/274659661 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.924+0000 7fc269ae5700 1 -- 172.21.15.12:0/274659661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600095f0 con 0x7fc264101770 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.925+0000 7fc269ae5700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264196d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc260005850 tx=0x7fc260004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.925+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26001d070 con 0x7fc264101770 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.925+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc26000be40 con 0x7fc264101770 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.925+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc260022ea0 con 0x7fc264101770 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.925+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc264197460 con 0x7fc264101770 2024-02-14T13:00:02.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.925+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc264197900 con 0x7fc264101770 2024-02-14T13:00:02.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.926+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2641905d0 con 0x7fc264101770 2024-02-14T13:00:02.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.926+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7fc260022670 con 0x7fc264101770 2024-02-14T13:00:02.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.926+0000 7fc25affd700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc250038f80 0x7fc25003b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:02.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.926+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc26004d140 con 0x7fc264101770 2024-02-14T13:00:02.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.926+0000 7fc2692e4700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc250038f80 0x7fc25003b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:02.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.926+0000 7fc2692e4700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc250038f80 0x7fc25003b440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc254006fd0 tx=0x7fc254006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:02.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:02.931+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc26000b960 con 0x7fc264101770 2024-02-14T13:00:03.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.137+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fc264062160 con 0x7fc250038f80 2024-02-14T13:00:03.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.141+0000 7fc25affd700 1 -- 172.21.15.12:0/274659661 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc264062160 con 0x7fc250038f80 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc250038f80 msgr2=0x7fc25003b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc250038f80 0x7fc25003b440 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc254006fd0 tx=0x7fc254006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 msgr2=0x7fc264196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264196d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc260005850 tx=0x7fc260004ff0 comp rx=0 tx=0).stop 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 shutdown_connections 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc250038f80 0x7fc25003b440 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:03.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 --2- 172.21.15.12:0/274659661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc264101770 0x7fc264196d20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 >> 172.21.15.12:0/274659661 conn(0x7fc2640fcd10 msgr2=0x7fc2640fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 shutdown_connections 2024-02-14T13:00:03.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:03.143+0000 7fc26bd49700 1 -- 172.21.15.12:0/274659661 wait complete. 2024-02-14T13:00:03.856 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi055 2024-02-14T13:00:03.856 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T13:00:03.857 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/etc/ceph/ceph.conf 2024-02-14T13:00:03.876 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T13:00:03.876 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:03.934 INFO:tasks.cephadm:Adding host smithi055 to orchestrator... 2024-02-14T13:00:03.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch host add smithi055 2024-02-14T13:00:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: Updating smithi012:/etc/ceph/ceph.conf 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:04.396 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:04.397 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:05.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:05 smithi012 ceph-mon[32370]: Updating smithi012:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:05.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:05 smithi012 ceph-mon[32370]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:05.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:05 smithi012 ceph-mon[32370]: Updating smithi012:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.526+0000 7f1aaa17c700 1 -- 172.21.15.12:0/4271523529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 msgr2=0x7f1aa4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.526+0000 7f1aaa17c700 1 --2- 172.21.15.12:0/4271523529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4107ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009910 tx=0x7f1a94009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.526+0000 7f1aaa17c700 1 -- 172.21.15.12:0/4271523529 shutdown_connections 2024-02-14T13:00:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.526+0000 7f1aaa17c700 1 --2- 172.21.15.12:0/4271523529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4107ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.526+0000 7f1aaa17c700 1 -- 172.21.15.12:0/4271523529 >> 172.21.15.12:0/4271523529 conn(0x7f1aa40fb870 msgr2=0x7f1aa40fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.527+0000 7f1aaa17c700 1 -- 172.21.15.12:0/4271523529 shutdown_connections 2024-02-14T13:00:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.527+0000 7f1aaa17c700 1 -- 172.21.15.12:0/4271523529 wait complete. 2024-02-14T13:00:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.527+0000 7f1aaa17c700 1 Processor -- start 2024-02-14T13:00:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.527+0000 7f1aaa17c700 1 -- start start 2024-02-14T13:00:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.527+0000 7f1aaa17c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.527+0000 7f1aaa17c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4102d20 con 0x7f1aa4107700 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51464/0 (socket says 172.21.15.12:51464) 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa37fe700 1 -- 172.21.15.12:0/2835190685 learned_addr learned my addr 172.21.15.12:0/2835190685 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa37fe700 1 -- 172.21.15.12:0/2835190685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940095f0 con 0x7f1aa4107700 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa37fe700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4100e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a94004f40 tx=0x7f1a94005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9401d070 con 0x7f1aa4107700 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1a9400bbd0 con 0x7f1aa4107700 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4101370 con 0x7f1aa4107700 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a94003900 con 0x7f1aa4107700 2024-02-14T13:00:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.528+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa41017f0 con 0x7f1aa4107700 2024-02-14T13:00:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.529+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f1a94003bc0 con 0x7f1aa4107700 2024-02-14T13:00:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.529+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4102360 con 0x7f1aa4107700 2024-02-14T13:00:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.529+0000 7f1aa0ff9700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1a8c038f80 0x7f1a8c03b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.529+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1a9404cdc0 con 0x7f1aa4107700 2024-02-14T13:00:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.529+0000 7f1aa2ffd700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1a8c038f80 0x7f1a8c03b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.530+0000 7f1aa2ffd700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1a8c038f80 0x7f1a8c03b440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a98006fd0 tx=0x7f1a98006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.534+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a94029540 con 0x7f1aa4107700 2024-02-14T13:00:05.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:05.741+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi055", "target": ["mon-mgr", ""]}) v1 -- 0x7f1aa4101b20 con 0x7f1a8c038f80 2024-02-14T13:00:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:06 smithi012 ceph-mon[32370]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi055", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:07.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:07 smithi012 ceph-mon[32370]: Deploying cephadm binary to smithi055 2024-02-14T13:00:09.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:09 smithi012 ceph-mon[32370]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:10.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.168+0000 7f1aa0ff9700 1 -- 172.21.15.12:0/2835190685 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f1aa4101b20 con 0x7f1a8c038f80 2024-02-14T13:00:10.170 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi055' with addr '172.21.15.55' 2024-02-14T13:00:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1a8c038f80 msgr2=0x7f1a8c03b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1a8c038f80 0x7f1a8c03b440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a98006fd0 tx=0x7f1a98006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:10.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 msgr2=0x7f1aa4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4100e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a94004f40 tx=0x7f1a94005020 comp rx=0 tx=0).stop 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 shutdown_connections 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1a8c038f80 0x7f1a8c03b440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 --2- 172.21.15.12:0/2835190685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1aa4107700 0x7f1aa4100e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 >> 172.21.15.12:0/2835190685 conn(0x7f1aa40fb870 msgr2=0x7f1aa40fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 shutdown_connections 2024-02-14T13:00:10.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:10.171+0000 7f1aaa17c700 1 -- 172.21.15.12:0/2835190685 wait complete. 2024-02-14T13:00:10.765 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch host ls --format=json 2024-02-14T13:00:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:11.387 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:11.388 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:11 smithi012 ceph-mon[32370]: Added host smithi055 2024-02-14T13:00:11.388 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:11.388 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:11 smithi012 ceph-mon[32370]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:11.388 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:12.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 -- 172.21.15.12:0/3518852948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 msgr2=0x7ff230107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 --2- 172.21.15.12:0/3518852948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230107ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff220009910 tx=0x7ff220009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 -- 172.21.15.12:0/3518852948 shutdown_connections 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 --2- 172.21.15.12:0/3518852948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230107ae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 -- 172.21.15.12:0/3518852948 >> 172.21.15.12:0/3518852948 conn(0x7ff2300fd230 msgr2=0x7ff2300ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 -- 172.21.15.12:0/3518852948 shutdown_connections 2024-02-14T13:00:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.396+0000 7ff2361f0700 1 -- 172.21.15.12:0/3518852948 wait complete. 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff2361f0700 1 Processor -- start 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff2361f0700 1 -- start start 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff2361f0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff2361f0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230199750 con 0x7ff230107700 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff22f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff22f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51482/0 (socket says 172.21.15.12:51482) 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff22f7fe700 1 -- 172.21.15.12:0/566219576 learned_addr learned my addr 172.21.15.12:0/566219576 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.397+0000 7ff22f7fe700 1 -- 172.21.15.12:0/566219576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200095f0 con 0x7ff230107700 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.398+0000 7ff22f7fe700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230199210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff220006010 tx=0x7ff220004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:12.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.398+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff22001d070 con 0x7ff230107700 2024-02-14T13:00:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.398+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff22000bbd0 con 0x7ff230107700 2024-02-14T13:00:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.398+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2301999b0 con 0x7ff230107700 2024-02-14T13:00:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.398+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff220003880 con 0x7ff230107700 2024-02-14T13:00:12.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.398+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff230199e30 con 0x7ff230107700 2024-02-14T13:00:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.399+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7ff220003ac0 con 0x7ff230107700 2024-02-14T13:00:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.399+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230063350 con 0x7ff230107700 2024-02-14T13:00:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.399+0000 7ff22cff9700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff218038f80 0x7ff21803b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.399+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff22004cd30 con 0x7ff230107700 2024-02-14T13:00:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.399+0000 7ff22effd700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff218038f80 0x7ff21803b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:12.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.399+0000 7ff22effd700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff218038f80 0x7ff21803b440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff224006fd0 tx=0x7ff224006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.404+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff220029700 con 0x7ff230107700 2024-02-14T13:00:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.610+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff23010bcf0 con 0x7ff218038f80 2024-02-14T13:00:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.611+0000 7ff22cff9700 1 -- 172.21.15.12:0/566219576 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7ff23010bcf0 con 0x7ff218038f80 2024-02-14T13:00:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:00:12.612 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.55", "hostname": "smithi055", "labels": [], "status": ""}] 2024-02-14T13:00:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff218038f80 msgr2=0x7ff21803b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff218038f80 0x7ff21803b440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff224006fd0 tx=0x7ff224006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 msgr2=0x7ff230199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230199210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff220006010 tx=0x7ff220004ff0 comp rx=0 tx=0).stop 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 shutdown_connections 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff218038f80 0x7ff21803b440 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 --2- 172.21.15.12:0/566219576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff230107700 0x7ff230199210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 >> 172.21.15.12:0/566219576 conn(0x7ff2300fd230 msgr2=0x7ff230075a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.613+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 shutdown_connections 2024-02-14T13:00:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:12.614+0000 7ff2361f0700 1 -- 172.21.15.12:0/566219576 wait complete. 2024-02-14T13:00:13.199 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi103 2024-02-14T13:00:13.199 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T13:00:13.199 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.conf 2024-02-14T13:00:13.218 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T13:00:13.218 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:13.275 INFO:tasks.cephadm:Adding host smithi103 to orchestrator... 2024-02-14T13:00:13.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch host add smithi103 2024-02-14T13:00:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:13 smithi012 ceph-mon[32370]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:13.516 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:14.426 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:14 smithi012 ceph-mon[32370]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 -- 172.21.15.12:0/101738261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 msgr2=0x7f6a24107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 --2- 172.21.15.12:0/101738261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24107b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009910 tx=0x7f6a14009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 -- 172.21.15.12:0/101738261 shutdown_connections 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 --2- 172.21.15.12:0/101738261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24107b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 -- 172.21.15.12:0/101738261 >> 172.21.15.12:0/101738261 conn(0x7f6a240fb870 msgr2=0x7f6a240fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 -- 172.21.15.12:0/101738261 shutdown_connections 2024-02-14T13:00:14.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.864+0000 7f6a28bea700 1 -- 172.21.15.12:0/101738261 wait complete. 2024-02-14T13:00:14.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.865+0000 7f6a28bea700 1 Processor -- start 2024-02-14T13:00:14.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.865+0000 7f6a28bea700 1 -- start start 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a28bea700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a28bea700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a241974e0 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a2259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a2259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35368/0 (socket says 172.21.15.12:35368) 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a2259c700 1 -- 172.21.15.12:0/1544730085 learned_addr learned my addr 172.21.15.12:0/1544730085 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a2259c700 1 -- 172.21.15.12:0/1544730085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140095f0 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a2259c700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24196fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004f40 tx=0x7f6a14005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a1401d070 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a24197740 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6a1400bbd0 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a14003900 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.866+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a24197c40 con 0x7f6a24107780 2024-02-14T13:00:14.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.867+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f6a14003bc0 con 0x7f6a24107780 2024-02-14T13:00:14.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.867+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24063350 con 0x7f6a24107780 2024-02-14T13:00:14.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.867+0000 7f6a137fe700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6a0c038f80 0x7f6a0c03b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:14.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.867+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6a1404dbc0 con 0x7f6a24107780 2024-02-14T13:00:14.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.868+0000 7f6a21d9b700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6a0c038f80 0x7f6a0c03b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:14.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.868+0000 7f6a21d9b700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6a0c038f80 0x7f6a0c03b440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a18006fd0 tx=0x7f6a18006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:14.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:14.873+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6a14029360 con 0x7f6a24107780 2024-02-14T13:00:15.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:15.083+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a24197c40 con 0x7f6a0c038f80 2024-02-14T13:00:15.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:15 smithi012 ceph-mon[32370]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:16.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:16.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:17.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:17 smithi012 ceph-mon[32370]: Deploying cephadm binary to smithi103 2024-02-14T13:00:17.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:17 smithi012 ceph-mon[32370]: Updating smithi055:/etc/ceph/ceph.conf 2024-02-14T13:00:17.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:17 smithi012 ceph-mon[32370]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:18 smithi012 ceph-mon[32370]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:19.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.418+0000 7f6a137fe700 1 -- 172.21.15.12:0/1544730085 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6a24197c40 con 0x7f6a0c038f80 2024-02-14T13:00:19.421 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi103' with addr '172.21.15.103' 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6a0c038f80 msgr2=0x7f6a0c03b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6a0c038f80 0x7f6a0c03b440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6a18006fd0 tx=0x7f6a18006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 msgr2=0x7f6a24196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24196fa0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a14004f40 tx=0x7f6a14005020 comp rx=0 tx=0).stop 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 shutdown_connections 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6a0c038f80 0x7f6a0c03b440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 --2- 172.21.15.12:0/1544730085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a24107780 0x7f6a24196fa0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 >> 172.21.15.12:0/1544730085 conn(0x7f6a240fb870 msgr2=0x7f6a240fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 shutdown_connections 2024-02-14T13:00:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:19.421+0000 7f6a28bea700 1 -- 172.21.15.12:0/1544730085 wait complete. 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:19.993 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch host ls --format=json 2024-02-14T13:00:20.230 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:20.677 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:20 smithi012 ceph-mon[32370]: Added host smithi103 2024-02-14T13:00:20.677 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:20.677 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:20.678 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:20 smithi012 ceph-mon[32370]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:21.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:21.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/2141733456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 msgr2=0x7f8f88106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:21.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 --2- 172.21.15.12:0/2141733456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88106a60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b0a0 tx=0x7f8f8000b3b0 comp rx=0 tx=0).stop 2024-02-14T13:00:21.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/2141733456 shutdown_connections 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 --2- 172.21.15.12:0/2141733456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88106a60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/2141733456 >> 172.21.15.12:0/2141733456 conn(0x7f8f88077260 msgr2=0x7f8f880fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/2141733456 shutdown_connections 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/2141733456 wait complete. 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.752+0000 7f8f8d4e2700 1 Processor -- start 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f8d4e2700 1 -- start start 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f8d4e2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f8d4e2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8806a0c0 con 0x7f8f88106680 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f86ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f86ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35386/0 (socket says 172.21.15.12:35386) 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f86ffd700 1 -- 172.21.15.12:0/1070064280 learned_addr learned my addr 172.21.15.12:0/1070064280 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f86ffd700 1 -- 172.21.15.12:0/1070064280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80009d00 con 0x7f8f88106680 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f86ffd700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88197de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b830 tx=0x7f8f8000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:21.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f8000e040 con 0x7f8f88106680 2024-02-14T13:00:21.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f8f80003c10 con 0x7f8f88106680 2024-02-14T13:00:21.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f8001d6b0 con 0x7f8f88106680 2024-02-14T13:00:21.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.753+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f881983e0 con 0x7f8f88106680 2024-02-14T13:00:21.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.754+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f88198860 con 0x7f8f88106680 2024-02-14T13:00:21.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.754+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f8f80019070 con 0x7f8f88106680 2024-02-14T13:00:21.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.754+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f88063350 con 0x7f8f88106680 2024-02-14T13:00:21.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.754+0000 7f8f7ffff700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8f74038fe0 0x7f8f7403b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:21.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.754+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8f8004d180 con 0x7f8f88106680 2024-02-14T13:00:21.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.755+0000 7f8f867fc700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8f74038fe0 0x7f8f7403b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:21.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.755+0000 7f8f867fc700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8f74038fe0 0x7f8f7403b4a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8f70006fd0 tx=0x7f8f70006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.759+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8f80026a00 con 0x7f8f88106680 2024-02-14T13:00:21.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.966+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f88198c10 con 0x7f8f74038fe0 2024-02-14T13:00:21.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.967+0000 7f8f7ffff700 1 -- 172.21.15.12:0/1070064280 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7f8f88198c10 con 0x7f8f74038fe0 2024-02-14T13:00:21.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:00:21.969 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.55", "hostname": "smithi055", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}] 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8f74038fe0 msgr2=0x7f8f7403b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8f74038fe0 0x7f8f7403b4a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8f70006fd0 tx=0x7f8f70006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 msgr2=0x7f8f88197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88197de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000b830 tx=0x7f8f8000bd40 comp rx=0 tx=0).stop 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 shutdown_connections 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8f74038fe0 0x7f8f7403b4a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 --2- 172.21.15.12:0/1070064280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f88106680 0x7f8f88197de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 >> 172.21.15.12:0/1070064280 conn(0x7f8f88077260 msgr2=0x7f8f880fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:21.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 shutdown_connections 2024-02-14T13:00:21.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:21.969+0000 7f8f8d4e2700 1 -- 172.21.15.12:0/1070064280 wait complete. 2024-02-14T13:00:22.666 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-14T13:00:22.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd crush tunables default 2024-02-14T13:00:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:23.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:23 smithi012 ceph-mon[32370]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:00:23.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:23.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:23 smithi012 ceph-mon[32370]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 -- 172.21.15.12:0/2756941845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 msgr2=0x7fe52c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 --2- 172.21.15.12:0/2756941845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c102c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe52400b0a0 tx=0x7fe52400b3b0 comp rx=0 tx=0).stop 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 -- 172.21.15.12:0/2756941845 shutdown_connections 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 --2- 172.21.15.12:0/2756941845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c102c90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 -- 172.21.15.12:0/2756941845 >> 172.21.15.12:0/2756941845 conn(0x7fe52c077260 msgr2=0x7fe52c0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 -- 172.21.15.12:0/2756941845 shutdown_connections 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 -- 172.21.15.12:0/2756941845 wait complete. 2024-02-14T13:00:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 Processor -- start 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.324+0000 7fe53143e700 1 -- start start 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe53143e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c100510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe53143e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c102400 con 0x7fe52c1028b0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe52affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c100510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe52affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c100510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54670/0 (socket says 172.21.15.12:54670) 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe52affd700 1 -- 172.21.15.12:0/2023752166 learned_addr learned my addr 172.21.15.12:0/2023752166 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe52affd700 1 -- 172.21.15.12:0/2023752166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524009d00 con 0x7fe52c1028b0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe52affd700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c100510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe52400b830 tx=0x7fe5240096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe52400e040 con 0x7fe52c1028b0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fe524007bb0 con 0x7fe52c1028b0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c100a50 con 0x7fe52c1028b0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe52401d610 con 0x7fe52c1028b0 2024-02-14T13:00:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.325+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c100e70 con 0x7fe52c1028b0 2024-02-14T13:00:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.326+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7fe52401d8d0 con 0x7fe52c1028b0 2024-02-14T13:00:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.326+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c063350 con 0x7fe52c1028b0 2024-02-14T13:00:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.326+0000 7fe523fff700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe518038f80 0x7fe51803b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:24.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.326+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe52404d450 con 0x7fe52c1028b0 2024-02-14T13:00:24.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.327+0000 7fe52a7fc700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe518038f80 0x7fe51803b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:24.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.327+0000 7fe52a7fc700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe518038f80 0x7fe51803b440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe514006fd0 tx=0x7fe514006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.331+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe52401ac80 con 0x7fe52c1028b0 2024-02-14T13:00:24.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:24.538+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe52c10bc30 con 0x7fe52c1028b0 2024-02-14T13:00:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:24 smithi012 ceph-mon[32370]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.477+0000 7fe523fff700 1 -- 172.21.15.12:0/2023752166 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe524017070 con 0x7fe52c1028b0 2024-02-14T13:00:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe518038f80 msgr2=0x7fe51803b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe518038f80 0x7fe51803b440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe514006fd0 tx=0x7fe514006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 msgr2=0x7fe52c100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c100510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe52400b830 tx=0x7fe5240096e0 comp rx=0 tx=0).stop 2024-02-14T13:00:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 shutdown_connections 2024-02-14T13:00:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe518038f80 0x7fe51803b440 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 --2- 172.21.15.12:0/2023752166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe52c1028b0 0x7fe52c100510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.479+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 >> 172.21.15.12:0/2023752166 conn(0x7fe52c077260 msgr2=0x7fe52c103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.480+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 shutdown_connections 2024-02-14T13:00:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:25.480+0000 7fe53143e700 1 -- 172.21.15.12:0/2023752166 wait complete. 2024-02-14T13:00:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2023752166' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:25.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:25.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: Updating smithi103:/etc/ceph/ceph.conf 2024-02-14T13:00:25.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:25 smithi012 ceph-mon[32370]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:26.125 INFO:tasks.cephadm:Adding mon.a on smithi012 2024-02-14T13:00:26.125 INFO:tasks.cephadm:Adding mon.b on smithi055 2024-02-14T13:00:26.125 INFO:tasks.cephadm:Adding mon.c on smithi103 2024-02-14T13:00:26.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch apply mon '3;smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c' 2024-02-14T13:00:26.349 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2023752166' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-14T13:00:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:26.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:26.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:26 smithi012 ceph-mon[32370]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 -- 172.21.15.103:0/1026458644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 msgr2=0x7facec106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 --2- 172.21.15.103:0/1026458644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec106a60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facdc009910 tx=0x7facdc009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 -- 172.21.15.103:0/1026458644 shutdown_connections 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 --2- 172.21.15.103:0/1026458644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec106a60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 -- 172.21.15.103:0/1026458644 >> 172.21.15.103:0/1026458644 conn(0x7facec077260 msgr2=0x7facec0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 -- 172.21.15.103:0/1026458644 shutdown_connections 2024-02-14T13:00:27.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.644+0000 7facf1561700 1 -- 172.21.15.103:0/1026458644 wait complete. 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.645+0000 7facf1561700 1 Processor -- start 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.645+0000 7facf1561700 1 -- start start 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.645+0000 7facf1561700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.645+0000 7facf1561700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec06a0c0 con 0x7facec106680 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.645+0000 7faceaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7faceaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.103:39382/0 (socket says 172.21.15.103:39382) 2024-02-14T13:00:27.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7faceaffd700 1 -- 172.21.15.103:0/1950529905 learned_addr learned my addr 172.21.15.103:0/1950529905 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7faceaffd700 1 -- 172.21.15.103:0/1950529905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0095f0 con 0x7facec106680 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7faceaffd700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec197de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facdc004f40 tx=0x7facdc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facdc01d070 con 0x7facec106680 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7facdc00b750 con 0x7facec106680 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec1983e0 con 0x7facec106680 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facdc003870 con 0x7facec106680 2024-02-14T13:00:27.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.646+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec198860 con 0x7facec106680 2024-02-14T13:00:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.647+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec063350 con 0x7facec106680 2024-02-14T13:00:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.647+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7facdc004260 con 0x7facec106680 2024-02-14T13:00:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.647+0000 7facd3fff700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7facd4038fe0 0x7facd403b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.647+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7facdc04ce30 con 0x7facec106680 2024-02-14T13:00:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.648+0000 7facea7fc700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7facd4038fe0 0x7facd403b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:27.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.648+0000 7facea7fc700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7facd4038fe0 0x7facd403b4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7face0006fd0 tx=0x7face0006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:27.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.653+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7facdc029540 con 0x7facec106680 2024-02-14T13:00:27.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.859+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c", "target": ["mon-mgr", ""]}) v1 -- 0x7facec198bc0 con 0x7facd4038fe0 2024-02-14T13:00:27.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.867+0000 7facd3fff700 1 -- 172.21.15.103:0/1950529905 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7facec198bc0 con 0x7facd4038fe0 2024-02-14T13:00:27.868 INFO:teuthology.orchestra.run.smithi103.stdout:Scheduled mon update... 2024-02-14T13:00:27.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7facd4038fe0 msgr2=0x7facd403b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:27.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7facd4038fe0 0x7facd403b4a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7face0006fd0 tx=0x7face0006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:27.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 msgr2=0x7facec197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:27.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec197de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7facdc004f40 tx=0x7facdc005020 comp rx=0 tx=0).stop 2024-02-14T13:00:27.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 shutdown_connections 2024-02-14T13:00:27.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7facd4038fe0 0x7facd403b4a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:27.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 --2- 172.21.15.103:0/1950529905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facec106680 0x7facec197de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:27.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.868+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 >> 172.21.15.103:0/1950529905 conn(0x7facec077260 msgr2=0x7facec0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:27.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.869+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 shutdown_connections 2024-02-14T13:00:27.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:27.869+0000 7facf1561700 1 -- 172.21.15.103:0/1950529905 wait complete. 2024-02-14T13:00:28.413 DEBUG:teuthology.orchestra.run.smithi055:mon.b> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.b.service 2024-02-14T13:00:28.416 DEBUG:teuthology.orchestra.run.smithi103:mon.c> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.c.service 2024-02-14T13:00:28.418 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-14T13:00:28.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-14T13:00:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c;count:3 2024-02-14T13:00:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:29.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:29.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:29.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:29.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:29.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: Deploying daemon mon.c on smithi103 2024-02-14T13:00:29.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:28 smithi012 ceph-mon[32370]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:29.218 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:30 smithi012 ceph-mon[32370]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:32.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.312+0000 7f5aa0547700 1 -- 172.21.15.103:0/3471590978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 msgr2=0x7f5a98101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.312+0000 7f5aa0547700 1 --2- 172.21.15.103:0/3471590978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98101360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009910 tx=0x7f5a94009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 -- 172.21.15.103:0/3471590978 shutdown_connections 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 --2- 172.21.15.103:0/3471590978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98101360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 -- 172.21.15.103:0/3471590978 >> 172.21.15.103:0/3471590978 conn(0x7f5a980fb870 msgr2=0x7f5a980fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 -- 172.21.15.103:0/3471590978 shutdown_connections 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 -- 172.21.15.103:0/3471590978 wait complete. 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 Processor -- start 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 -- start start 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.313+0000 7f5aa0547700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98198320 con 0x7f5a98100f80 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a9e2e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:32.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a9e2e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.103:39402/0 (socket says 172.21.15.103:39402) 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a9e2e3700 1 -- 172.21.15.103:0/2564620633 learned_addr learned my addr 172.21.15.103:0/2564620633 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a9e2e3700 1 -- 172.21.15.103:0/2564620633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a940095f0 con 0x7f5a98100f80 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a9e2e3700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98197de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a94004f40 tx=0x7f5a94005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a9401d070 con 0x7f5a98100f80 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a98198520 con 0x7f5a98100f80 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5a9400bc30 con 0x7f5a98100f80 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a94003970 con 0x7f5a98100f80 2024-02-14T13:00:32.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.314+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a98198940 con 0x7f5a98100f80 2024-02-14T13:00:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.315+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f5a94003c30 con 0x7f5a98100f80 2024-02-14T13:00:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.315+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a98063350 con 0x7f5a98100f80 2024-02-14T13:00:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.316+0000 7f5a8f7fe700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5a84038f80 0x7f5a8403b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.316+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5a9404cff0 con 0x7f5a98100f80 2024-02-14T13:00:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.316+0000 7f5a9dae2700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5a84038f80 0x7f5a8403b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.316+0000 7f5a9dae2700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5a84038f80 0x7f5a8403b440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006fd0 tx=0x7f5a88006e40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.321+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5a94029910 con 0x7f5a98100f80 2024-02-14T13:00:32.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.612+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5a98198b30 con 0x7f5a98100f80 2024-02-14T13:00:32.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.613+0000 7f5a8f7fe700 1 -- 172.21.15.103:0/2564620633 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+745 (secure 0 0 0) 0x7f5a94026030 con 0x7f5a98100f80 2024-02-14T13:00:32.615 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T13:00:32.615 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","modified":"2024-02-14T12:58:50.809694Z","created":"2024-02-14T12:58:50.809694Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-14T13:00:32.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 podman[36885]: 2024-02-14 13:00:32.570048107 +0000 UTC m=+0.120681706 container create 0dc130bedecee20beddbe7bf585996adf708b8d7f761594a46d2bdf0207d7ead (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:00:32.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5a84038f80 msgr2=0x7f5a8403b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5a84038f80 0x7f5a8403b440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006fd0 tx=0x7f5a88006e40 comp rx=0 tx=0).stop 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 msgr2=0x7f5a98197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98197de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a94004f40 tx=0x7f5a94005020 comp rx=0 tx=0).stop 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 shutdown_connections 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5a84038f80 0x7f5a8403b440 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 --2- 172.21.15.103:0/2564620633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a98100f80 0x7f5a98197de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 >> 172.21.15.103:0/2564620633 conn(0x7f5a980fb870 msgr2=0x7f5a98108130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 shutdown_connections 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:32.615+0000 7f5aa0547700 1 -- 172.21.15.103:0/2564620633 wait complete. 2024-02-14T13:00:32.622 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-02-14T13:00:32.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:32 smithi012 ceph-mon[32370]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 podman[36885]: 2024-02-14 13:00:32.890125284 +0000 UTC m=+0.440758888 container init 0dc130bedecee20beddbe7bf585996adf708b8d7f761594a46d2bdf0207d7ead (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 podman[36885]: 2024-02-14 13:00:32.893281381 +0000 UTC m=+0.443914989 container start 0dc130bedecee20beddbe7bf585996adf708b8d7f761594a46d2bdf0207d7ead (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS) 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: set uid:gid to 167:167 (ceph:ceph) 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: ceph version 19.0.0-1280-ga6fe3fa3 (a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0) squid (dev), process ceph-mon, pid 2 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pidfile_write: ignore empty --pid-file 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: load: jerasure load: lrc 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: RocksDB version: 7.9.2 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Git sha 0 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Compile date 2024-02-06 05:38:06 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: DB SUMMARY 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: DB Session ID: 7O5BD1EB2DIV8WJ6BDXL 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: CURRENT file: CURRENT 2024-02-14T13:00:33.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: IDENTITY file: IDENTITY 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.error_if_exists: 0 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.create_if_missing: 0 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.paranoid_checks: 1 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.env: 0x561393adbae0 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.fs: PosixFileSystem 2024-02-14T13:00:33.244 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.info_log: 0x561395fd18c0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_file_opening_threads: 16 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.statistics: (nil) 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.use_fsync: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_log_file_size: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.keep_log_file_num: 1000 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.recycle_log_file_num: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.allow_fallocate: 1 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.allow_mmap_reads: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.allow_mmap_writes: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.use_direct_reads: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-14T13:00:33.245 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.create_missing_column_families: 0 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.db_log_dir: 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.wal_dir: 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.advise_random_on_open: 1 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.db_write_buffer_size: 0 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.write_buffer_manager: 0x561395fa5400 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-14T13:00:33.246 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.rate_limiter: (nil) 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.wal_recovery_mode: 2 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.enable_thread_tracking: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.enable_pipelined_write: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.unordered_write: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.row_cache: None 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.wal_filter: None 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.allow_ingest_behind: 0 2024-02-14T13:00:33.247 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.two_write_queues: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.manual_wal_flush: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.wal_compression: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.atomic_flush: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.log_readahead_size: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.best_efforts_recovery: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.allow_data_in_errors: 0 2024-02-14T13:00:33.248 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.db_host_id: __hostname__ 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_background_jobs: 2 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_background_compactions: -1 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_subcompactions: 1 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_total_wal_size: 0 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_open_files: -1 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bytes_per_sync: 0 2024-02-14T13:00:33.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_readahead_size: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_background_flushes: -1 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Compression algorithms supported: 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kZSTD supported: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kXpressCompression supported: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kLZ4HCCompression supported: 1 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kZlibCompression supported: 1 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kSnappyCompression supported: 1 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kLZ4Compression supported: 1 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: kBZip2Compression supported: 0 2024-02-14T13:00:33.250 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.merge_operator: 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_filter: None 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_filter_factory: None 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.sst_partitioner_factory: None 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561395fd19c0) 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-14T13:00:33.251 INFO:journalctl@ceph.mon.c.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: index_type: 0 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: data_block_index_type: 0 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: index_shortening: 1 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: checksum: 4 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: no_block_cache: 0 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_cache: 0x561395fd5090 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_cache_options: 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: capacity : 536870912 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: num_shard_bits : 4 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: strict_capacity_limit : 0 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-02-14T13:00:33.252 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_cache_compressed: (nil) 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: persistent_cache: (nil) 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_size: 4096 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_size_deviation: 10 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_restart_interval: 16 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: index_block_restart_interval: 1 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: metadata_block_size: 4096 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: partition_filters: 0 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: use_delta_encoding: 1 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: filter_policy: bloomfilter 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: whole_key_filtering: 1 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: verify_compression: 0 2024-02-14T13:00:33.253 INFO:journalctl@ceph.mon.c.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-02-14T13:00:33.254 INFO:journalctl@ceph.mon.c.smithi103.stdout: format_version: 5 2024-02-14T13:00:33.254 INFO:journalctl@ceph.mon.c.smithi103.stdout: enable_index_compression: 1 2024-02-14T13:00:33.254 INFO:journalctl@ceph.mon.c.smithi103.stdout: block_align: 0 2024-02-14T13:00:33.254 INFO:journalctl@ceph.mon.c.smithi103.stdout: max_auto_readahead_size: 262144 2024-02-14T13:00:33.254 INFO:journalctl@ceph.mon.c.smithi103.stdout: prepopulate_block_cache: 0 2024-02-14T13:00:33.254 INFO:journalctl@ceph.mon.c.smithi103.stdout: initial_auto_readahead_size: 8192 2024-02-14T13:00:33.255 INFO:journalctl@ceph.mon.c.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-02-14T13:00:33.255 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.write_buffer_size: 33554432 2024-02-14T13:00:33.255 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_write_buffer_number: 2 2024-02-14T13:00:33.255 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression: NoCompression 2024-02-14T13:00:33.255 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression: Disabled 2024-02-14T13:00:33.255 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.prefix_extractor: nullptr 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.num_levels: 7 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-14T13:00:33.256 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.level: 32767 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.strategy: 0 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.enabled: false 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.target_file_size_base: 67108864 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-14T13:00:33.257 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.arena_block_size: 1048576 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.disable_auto_compactions: 0 2024-02-14T13:00:33.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.table_properties_collectors: 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.inplace_update_support: 0 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-14T13:00:33.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.bloom_locality: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.max_successive_merges: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.paranoid_file_checks: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.force_consistency_checks: 1 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.report_bg_io_stats: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.ttl: 2592000 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.enable_blob_files: false 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.min_blob_size: 0 2024-02-14T13:00:33.260 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.blob_file_size: 268435456 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.blob_file_starting_level: 0 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 63ec7467-9a47-4db3-afd3-4db8f585ba50 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707915632922692, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707915632923117, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707915632, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "63ec7467-9a47-4db3-afd3-4db8f585ba50", "db_session_id": "7O5BD1EB2DIV8WJ6BDXL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707915632923194, "job": 1, "event": "recovery_finished"} 2024-02-14T13:00:33.261 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5613960c6000 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: DB pointer 0x5613960b0000 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: ** DB Stats ** 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: ** Compaction Stats [default] ** 2024-02-14T13:00:33.262 INFO:journalctl@ceph.mon.c.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: ** Compaction Stats [default] ** 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-14T13:00:33.263 INFO:journalctl@ceph.mon.c.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: Block cache BinnedLRUCache@0x561395fd5090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: using public_addr v2:172.21.15.103:0/0 -> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: starting mon.c rank -1 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(???) e0 preinit fsid ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).mds e1 new map 2024-02-14T13:00:33.264 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).mds e1 print_map 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout: e1 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout: legacy client fscid: -1 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout: 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout: No filesystems configured 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T13:00:33.265 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Deploying cephadm binary to smithi103 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi055:/etc/ceph/ceph.conf 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:33.266 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Added host smithi103 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2023752166' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.267 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi103:/etc/ceph/ceph.conf 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2023752166' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:33.268 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c;count:3 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:33.269 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: Deploying daemon mon.c on smithi103 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 ceph-mon[36921]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 bash[36885]: 0dc130bedecee20beddbe7bf585996adf708b8d7f761594a46d2bdf0207d7ead 2024-02-14T13:00:33.270 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:32 smithi103 systemd[1]: Started Ceph mon.c for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:00:34.299 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-14T13:00:34.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-14T13:00:34.542 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:00:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:00:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: mon.a calling monitor election 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: mon.c calling monitor election 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: fsmap 2024-02-14T13:00:38.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: mgrmap e13: x(active, since 49s) 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: overall HEALTH_OK 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:38.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: mon.a calling monitor election 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: mon.c calling monitor election 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: fsmap 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: mgrmap e13: x(active, since 49s) 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: overall HEALTH_OK 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:38.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 -- 172.21.15.103:0/2593084438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 msgr2=0x7f237c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 --2- 172.21.15.103:0/2593084438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f237c005a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2390100e00 tx=0x7f238000feb0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 -- 172.21.15.103:0/2593084438 shutdown_connections 2024-02-14T13:00:39.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 --2- 172.21.15.103:0/2593084438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f237c005a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 -- 172.21.15.103:0/2593084438 >> 172.21.15.103:0/2593084438 conn(0x7f2390076e10 msgr2=0x7f2390077220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 -- 172.21.15.103:0/2593084438 shutdown_connections 2024-02-14T13:00:39.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.041+0000 7f2397811700 1 -- 172.21.15.103:0/2593084438 wait complete. 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.042+0000 7f2397811700 1 Processor -- start 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.042+0000 7f2397811700 1 -- start start 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2397811700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f23901971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2397811700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2397811700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390197cb0 con 0x7f237c0035c0 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2397811700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390197e20 con 0x7f2390197720 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49152/0 (socket says 172.21.15.103:49152) 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 -- 172.21.15.103:0/1546799691 learned_addr learned my addr 172.21.15.103:0/1546799691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f23955ad700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f23901971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 -- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 msgr2=0x7f239019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 -- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 msgr2=0x7f239019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-14T13:00:39.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f2394dac700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f23955ad700 1 -- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 msgr2=0x7f239019bab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f23955ad700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.043+0000 7f23955ad700 1 -- 172.21.15.103:0/1546799691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238000f900 con 0x7f237c0035c0 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.044+0000 7f23955ad700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f23901971e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2390100e00 tx=0x7f23800056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.044+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2380004b60 con 0x7f237c0035c0 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.044+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2380013e40 con 0x7f237c0035c0 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.044+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239019c050 con 0x7f237c0035c0 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.044+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2380011ad0 con 0x7f237c0035c0 2024-02-14T13:00:39.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.044+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239019c5a0 con 0x7f237c0035c0 2024-02-14T13:00:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.045+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f2380011c70 con 0x7f237c0035c0 2024-02-14T13:00:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.045+0000 7f23867fc700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2374038d70 0x7f237403b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.045+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2390191070 con 0x7f237c0035c0 2024-02-14T13:00:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.045+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f238004e870 con 0x7f237c0035c0 2024-02-14T13:00:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.045+0000 7f2394dac700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2374038d70 0x7f237403b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.046+0000 7f2394dac700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2374038d70 0x7f237403b230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f238c009180 tx=0x7f238c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.052+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2380010790 con 0x7f237c0035c0 2024-02-14T13:00:39.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.328+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f239019c870 con 0x7f237c0035c0 2024-02-14T13:00:39.330 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:39 smithi103 ceph-mon[36921]: Deploying daemon mon.b on smithi055 2024-02-14T13:00:39.330 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:39 smithi103 ceph-mon[36921]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:39.330 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:39.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.329+0000 7f23867fc700 1 -- 172.21.15.103:0/1546799691 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1015 (secure 0 0 0) 0x7f23800222c0 con 0x7f237c0035c0 2024-02-14T13:00:39.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T13:00:39.331 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","modified":"2024-02-14T13:00:32.946382Z","created":"2024-02-14T12:58:50.809694Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2374038d70 msgr2=0x7f237403b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2374038d70 0x7f237403b230 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f238c009180 tx=0x7f238c008040 comp rx=0 tx=0).stop 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 msgr2=0x7f23901971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f23901971e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2390100e00 tx=0x7f23800056f0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 shutdown_connections 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2374038d70 0x7f237403b230 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f237c0035c0 0x7f23901971e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 --2- 172.21.15.103:0/1546799691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2390197720 0x7f239019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 >> 172.21.15.103:0/1546799691 conn(0x7f2390076e10 msgr2=0x7f23901047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 shutdown_connections 2024-02-14T13:00:39.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:39.331+0000 7f2397811700 1 -- 172.21.15.103:0/1546799691 wait complete. 2024-02-14T13:00:39.334 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 2 2024-02-14T13:00:39.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:39 smithi012 ceph-mon[32370]: Deploying daemon mon.b on smithi055 2024-02-14T13:00:39.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:39 smithi012 ceph-mon[32370]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:39.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:40.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/1546799691' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-14T13:00:40.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/1546799691' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-14T13:00:40.907 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-14T13:00:40.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-14T13:00:41.148 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:00:41.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:41 smithi103 ceph-mon[36921]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:41 smithi012 ceph-mon[32370]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).mds e1 new map 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).mds e1 print_map 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout: e1 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout: legacy client fscid: -1 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout: 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout: No filesystems configured 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-14T13:00:41.736 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-14T13:00:41.737 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-14T13:00:41.737 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:42.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi055", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Deploying cephadm binary to smithi103 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi055:/etc/ceph/ceph.conf 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi055:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:42.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Added host smithi103 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2023752166' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi103:/etc/ceph/ceph.conf 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2023752166' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.064 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c;count:3 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Deploying daemon mon.c on smithi103 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.065 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.a calling monitor election 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.c calling monitor election 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-14T13:00:42.066 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: monmap e2: 2 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: fsmap 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mgrmap e13: x(active, since 49s) 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: overall HEALTH_OK 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: Deploying daemon mon.b on smithi055 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/1546799691' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:42.067 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 ceph-mon[36853]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-14T13:00:42.068 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 bash[36834]: 820f66574326e078d9616f5e992a6b38c5fb360c2119f929300d6710cf9cca22 2024-02-14T13:00:42.068 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:41 smithi055 systemd[1]: Started Ceph mon.b for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:00:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 -- 172.21.15.103:0/476651658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 msgr2=0x7fc21c007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 --2- 172.21.15.103:0/476651658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc21c007c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc230100610 tx=0x7fc22000fe60 comp rx=0 tx=0).stop 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 -- 172.21.15.103:0/476651658 shutdown_connections 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 --2- 172.21.15.103:0/476651658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc21c007c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 -- 172.21.15.103:0/476651658 >> 172.21.15.103:0/476651658 conn(0x7fc2300fc1d0 msgr2=0x7fc2300fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 -- 172.21.15.103:0/476651658 shutdown_connections 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.966+0000 7fc23694d700 1 -- 172.21.15.103:0/476651658 wait complete. 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 Processor -- start 2024-02-14T13:00:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 -- start start 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc230195090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2301955d0 0x7fc230199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230195cc0 con 0x7fc21c0057d0 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301a1c10 con 0x7fc2301955d0 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc23694d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301a1d50 con 0x7fc230199ea0 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc234eea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:46.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc22ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc230195090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc22ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc230195090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.103:43094/0 (socket says 172.21.15.103:43094) 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc234eea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48556/0 (socket says 172.21.15.103:48556) 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.967+0000 7fc22ffff700 1 -- 172.21.15.103:0/2805103806 learned_addr learned my addr 172.21.15.103:0/2805103806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc234eea700 1 -- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 msgr2=0x7fc23019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc234eea700 1 -- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 msgr2=0x7fc23019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc234eea700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22f7fe700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2301955d0 0x7fc230199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc234eea700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22ffff700 1 -- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 msgr2=0x7fc23019a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22ffff700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22ffff700 1 -- 172.21.15.103:0/2805103806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2301955d0 msgr2=0x7fc230199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22ffff700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2301955d0 0x7fc230199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:46.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22ffff700 1 -- 172.21.15.103:0/2805103806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22000f8b0 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22ffff700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc230195090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc220015040 tx=0x7fc220005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2200040e0 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc220004240 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2301a1fd0 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.968+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220027870 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.969+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2301a23e0 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.969+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7fc220024050 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.970+0000 7fc22d7fa700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc210039410 0x7fc21003b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.970+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc22004fd40 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.970+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc230063350 con 0x7fc21c0057d0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.970+0000 7fc22f7fe700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc210039410 0x7fc21003b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:46.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.970+0000 7fc22f7fe700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc210039410 0x7fc21003b8d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc218009850 tx=0x7fc218008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:46.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:46.979+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc220022080 con 0x7fc21c0057d0 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: mon.a calling monitor election 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: mon.c calling monitor election 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:47.152 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: fsmap 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: mgrmap e13: x(active, since 58s) 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: mon.b (rank 2) addr [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] is down (out of quorum) 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.153 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.154 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: mon.a calling monitor election 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: mon.c calling monitor election 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: fsmap 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: mgrmap e13: x(active, since 58s) 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: mon.b (rank 2) addr [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] is down (out of quorum) 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:47.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.263+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc230107610 con 0x7fc21c0057d0 2024-02-14T13:00:47.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.264+0000 7fc22d7fa700 1 -- 172.21.15.103:0/2805103806 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1279 (secure 0 0 0) 0x7fc22002b020 con 0x7fc21c0057d0 2024-02-14T13:00:47.266 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-02-14T13:00:47.266 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","modified":"2024-02-14T13:00:41.740221Z","created":"2024-02-14T12:58:50.809694Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:3300","nonce":0},{"type":"v1","addr":"172.21.15.55:6789","nonce":0}]},"addr":"172.21.15.55:6789/0","public_addr":"172.21.15.55:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-14T13:00:47.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc210039410 msgr2=0x7fc21003b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:47.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc210039410 0x7fc21003b8d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc218009850 tx=0x7fc218008040 comp rx=0 tx=0).stop 2024-02-14T13:00:47.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 msgr2=0x7fc230195090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc230195090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc220015040 tx=0x7fc220005c80 comp rx=0 tx=0).stop 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 shutdown_connections 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc230199ea0 0x7fc23019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc210039410 0x7fc21003b8d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc21c0057d0 0x7fc230195090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 --2- 172.21.15.103:0/2805103806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2301955d0 0x7fc230199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 >> 172.21.15.103:0/2805103806 conn(0x7fc2300fc1d0 msgr2=0x7fc2300fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 shutdown_connections 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:47.266+0000 7fc23694d700 1 -- 172.21.15.103:0/2805103806 wait complete. 2024-02-14T13:00:47.269 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 3 2024-02-14T13:00:47.845 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-14T13:00:47.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph config generate-minimal-conf 2024-02-14T13:00:48.092 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:47 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/2805103806' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-14T13:00:48.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:48.177 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:48.178 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:47 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/2805103806' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-14T13:00:48.178 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: mon.a calling monitor election 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: mon.c calling monitor election 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: fsmap 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: mgrmap e13: x(active, since 58s) 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: mon.b (rank 2) addr [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] is down (out of quorum) 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/2805103806' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-14T13:00:49.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:49.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 -- 172.21.15.12:0/3412055971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 msgr2=0x7f123c106a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 --2- 172.21.15.12:0/3412055971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c106a60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1230009910 tx=0x7f1230009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 -- 172.21.15.12:0/3412055971 shutdown_connections 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 --2- 172.21.15.12:0/3412055971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c106a60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 -- 172.21.15.12:0/3412055971 >> 172.21.15.12:0/3412055971 conn(0x7f123c077260 msgr2=0x7f123c0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 -- 172.21.15.12:0/3412055971 shutdown_connections 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.628+0000 7f1241ed0700 1 -- 172.21.15.12:0/3412055971 wait complete. 2024-02-14T13:00:49.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 Processor -- start 2024-02-14T13:00:49.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 -- start start 2024-02-14T13:00:49.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c1961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:49.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c1966e0 0x7f123c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:49.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f123c19af10 0x7f123c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:49.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c196dd0 con 0x7f123c106680 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c069110 con 0x7f123c1966e0 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.629+0000 7f1241ed0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0692d0 con 0x7f123c19af10 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c1961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c1961a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58992/0 (socket says 172.21.15.12:58992) 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 -- 172.21.15.12:0/2106385358 learned_addr learned my addr 172.21.15.12:0/2106385358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123bfff700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f123c19af10 0x7f123c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123affd700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c1966e0 0x7f123c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 -- 172.21.15.12:0/2106385358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f123c19af10 msgr2=0x7f123c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f123c19af10 0x7f123c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 -- 172.21.15.12:0/2106385358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c1966e0 msgr2=0x7f123c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c1966e0 0x7f123c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 -- 172.21.15.12:0/2106385358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12300095f0 con 0x7f123c106680 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f123b7fe700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c1961a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f123000bd20 tx=0x7f123000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:49.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123001d070 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f123000fb50 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c069550 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230022e00 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.630+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c069ad0 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.631+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f1230017440 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.631+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c101d30 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.631+0000 7f1238ff9700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1224039410 0x7f122403b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.631+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f123004ce00 con 0x7f123c106680 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.632+0000 7f123affd700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1224039410 0x7f122403b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:49.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.632+0000 7f123affd700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1224039410 0x7f122403b8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f122c009850 tx=0x7f122c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:49.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.636+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1230020920 con 0x7f123c106680 2024-02-14T13:00:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: mon.b calling monitor election 2024-02-14T13:00:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Updating smithi012:/etc/ceph/ceph.conf 2024-02-14T13:00:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Updating smithi055:/etc/ceph/ceph.conf 2024-02-14T13:00:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Updating smithi103:/etc/ceph/ceph.conf 2024-02-14T13:00:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: mon.b calling monitor election 2024-02-14T13:00:49.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: mon.c calling monitor election 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: mon.a calling monitor election 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: fsmap 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: mgrmap e13: x(active, since 60s) 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Cluster is now healthy 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: overall HEALTH_OK 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Updating smithi012:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Reconfiguring mon.a (unknown last config time)... 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:49.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:49 smithi012 ceph-mon[32370]: Reconfiguring daemon mon.a on smithi012 2024-02-14T13:00:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.843+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f123c10a9e0 con 0x7f123c106680 2024-02-14T13:00:49.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.844+0000 7f1238ff9700 1 -- 172.21.15.12:0/2106385358 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f1230027030 con 0x7f123c106680 2024-02-14T13:00:49.846 INFO:teuthology.orchestra.run.smithi012.stdout:# minimal ceph.conf for ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:00:49.846 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-02-14T13:00:49.846 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:00:49.846 INFO:teuthology.orchestra.run.smithi012.stdout: mon_host = [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1224039410 msgr2=0x7f122403b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1224039410 0x7f122403b8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f122c009850 tx=0x7f122c008040 comp rx=0 tx=0).stop 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 msgr2=0x7f123c1961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c1961a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f123000bd20 tx=0x7f123000bd50 comp rx=0 tx=0).stop 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 shutdown_connections 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f123c19af10 0x7f123c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1224039410 0x7f122403b8d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f123c106680 0x7f123c1961a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 --2- 172.21.15.12:0/2106385358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123c1966e0 0x7f123c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 >> 172.21.15.12:0/2106385358 conn(0x7f123c077260 msgr2=0x7f123c0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:49.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 shutdown_connections 2024-02-14T13:00:49.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:00:49.846+0000 7f1241ed0700 1 -- 172.21.15.12:0/2106385358 wait complete. 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: mon.b calling monitor election 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Updating smithi012:/etc/ceph/ceph.conf 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Updating smithi055:/etc/ceph/ceph.conf 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Updating smithi103:/etc/ceph/ceph.conf 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: mon.b calling monitor election 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: mon.c calling monitor election 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: mon.a calling monitor election 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: fsmap 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: mgrmap e13: x(active, since 60s) 2024-02-14T13:00:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Cluster is now healthy 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: overall HEALTH_OK 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Updating smithi012:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:49.994 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Reconfiguring mon.a (unknown last config time)... 2024-02-14T13:00:49.994 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:49.994 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:49.994 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:49.994 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:49 smithi103 ceph-mon[36921]: Reconfiguring daemon mon.a on smithi012 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: mon.b calling monitor election 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Updating smithi012:/etc/ceph/ceph.conf 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Updating smithi055:/etc/ceph/ceph.conf 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Updating smithi103:/etc/ceph/ceph.conf 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: mon.b calling monitor election 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: mon.c calling monitor election 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: mon.a calling monitor election 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: monmap e3: 3 mons at {a=[v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0],b=[v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: fsmap 2024-02-14T13:00:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: osdmap e4: 0 total, 0 up, 0 in 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: mgrmap e13: x(active, since 60s) 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Cluster is now healthy 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: overall HEALTH_OK 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Updating smithi012:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Updating smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Updating smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Reconfiguring mon.a (unknown last config time)... 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:50.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:49 smithi055 ceph-mon[36853]: Reconfiguring daemon mon.a on smithi012 2024-02-14T13:00:50.949 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:50.950 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:50 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2106385358' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:50.950 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:50 smithi012 ceph-mon[32370]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:50 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2106385358' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:50 smithi103 ceph-mon[36921]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:00:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:50 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2106385358' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:50 smithi055 ceph-mon[36853]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:51.364 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-14T13:00:51.364 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:00:51.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2024-02-14T13:00:51.394 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:00:51.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:51.462 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T13:00:51.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.conf 2024-02-14T13:00:51.496 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T13:00:51.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:51.570 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T13:00:51.570 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-02-14T13:00:51.605 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T13:00:51.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-14T13:00:51.676 INFO:tasks.cephadm:Adding mgr.x on smithi012 2024-02-14T13:00:51.676 INFO:tasks.cephadm:Adding mgr.y on smithi055 2024-02-14T13:00:51.676 INFO:tasks.cephadm:Adding mgr.z on smithi103 2024-02-14T13:00:51.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch apply mgr '3;smithi012=x;smithi055=y;smithi103=z' 2024-02-14T13:00:51.952 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:00:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: Reconfiguring mon.b (monmap changed)... 2024-02-14T13:00:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:52 smithi055 ceph-mon[36853]: Reconfiguring daemon mon.b on smithi055 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: Reconfiguring mon.b (monmap changed)... 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:52.323 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:52 smithi103 ceph-mon[36921]: Reconfiguring daemon mon.b on smithi055 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: Reconfiguring mon.b (monmap changed)... 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:52.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:52 smithi012 ceph-mon[32370]: Reconfiguring daemon mon.b on smithi055 2024-02-14T13:00:53.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:53 smithi103 ceph-mon[36921]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:53.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:53.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:53.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:53.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:53.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:53 smithi055 ceph-mon[36853]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:53.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:53.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:53.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:53 smithi012 ceph-mon[32370]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-14T13:00:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-14T13:00:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:53.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 -- 172.21.15.103:0/4278173071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08100790 msgr2=0x7f7c08100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:53.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 --2- 172.21.15.103:0/4278173071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08100790 0x7f7c08100bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009910 tx=0x7f7bf8009c20 comp rx=0 tx=0).stop 2024-02-14T13:00:53.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 -- 172.21.15.103:0/4278173071 shutdown_connections 2024-02-14T13:00:53.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 --2- 172.21.15.103:0/4278173071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08100790 0x7f7c08100bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 -- 172.21.15.103:0/4278173071 >> 172.21.15.103:0/4278173071 conn(0x7f7c080fbd30 msgr2=0x7f7c080fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:53.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 -- 172.21.15.103:0/4278173071 shutdown_connections 2024-02-14T13:00:53.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 -- 172.21.15.103:0/4278173071 wait complete. 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.506+0000 7f7c0e931700 1 Processor -- start 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 -- start start 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 0x7f7c08195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c08196380 0x7f7c0819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08196800 0x7f7c0819d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0819e120 con 0x7f7c08196800 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0819e290 con 0x7f7c08196380 2024-02-14T13:00:53.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0e931700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0819e450 con 0x7f7c08100790 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 0x7f7c08195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 0x7f7c08195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46588/0 (socket says 172.21.15.103:46588) 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 -- 172.21.15.103:0/464495405 learned_addr learned my addr 172.21.15.103:0/464495405 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c0cece700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08196800 0x7f7c0819d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c077fe700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c08196380 0x7f7c0819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 -- 172.21.15.103:0/464495405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c08196380 msgr2=0x7f7c0819b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c08196380 0x7f7c0819b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 -- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08196800 msgr2=0x7f7c0819d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08196800 0x7f7c0819d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.507+0000 7f7c07fff700 1 -- 172.21.15.103:0/464495405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf80095f0 con 0x7f7c08100790 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.508+0000 7f7c07fff700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 0x7f7c08195e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800bcf0 tx=0x7f7bf800bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.508+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf801d070 con 0x7f7c08100790 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.508+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f7bf8004ec0 con 0x7f7c08100790 2024-02-14T13:00:53.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.508+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0819e6d0 con 0x7f7c08100790 2024-02-14T13:00:53.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.508+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8022e30 con 0x7f7c08100790 2024-02-14T13:00:53.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.508+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0819ebc0 con 0x7f7c08100790 2024-02-14T13:00:53.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.509+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f7bf800f460 con 0x7f7c08100790 2024-02-14T13:00:53.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.509+0000 7f7c057fa700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7bf0039410 0x7f7bf003b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:00:53.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.509+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7bf804ded0 con 0x7f7c08100790 2024-02-14T13:00:53.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.509+0000 7f7c077fe700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7bf0039410 0x7f7bf003b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:00:53.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.509+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0818f5a0 con 0x7f7c08100790 2024-02-14T13:00:53.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.510+0000 7f7c077fe700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7bf0039410 0x7f7bf003b8d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009850 tx=0x7f7bfc008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:00:53.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.514+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7bf8027030 con 0x7f7c08100790 2024-02-14T13:00:53.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.723+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi055=y;smithi103=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c08062160 con 0x7f7bf0039410 2024-02-14T13:00:53.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.731+0000 7f7c057fa700 1 -- 172.21.15.103:0/464495405 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7c08062160 con 0x7f7bf0039410 2024-02-14T13:00:53.733 INFO:teuthology.orchestra.run.smithi103.stdout:Scheduled mgr update... 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7bf0039410 msgr2=0x7f7bf003b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7bf0039410 0x7f7bf003b8d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009850 tx=0x7f7bfc008040 comp rx=0 tx=0).stop 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 msgr2=0x7f7c08195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 0x7f7c08195e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800bcf0 tx=0x7f7bf800bd20 comp rx=0 tx=0).stop 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 shutdown_connections 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7bf0039410 0x7f7bf003b8d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c08196800 0x7f7c0819d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c08100790 0x7f7c08195e40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 --2- 172.21.15.103:0/464495405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c08196380 0x7f7c0819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:00:53.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 >> 172.21.15.103:0/464495405 conn(0x7f7c080fbd30 msgr2=0x7f7c080fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:00:53.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 shutdown_connections 2024-02-14T13:00:53.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:00:53.734+0000 7f7c0e931700 1 -- 172.21.15.103:0/464495405 wait complete. 2024-02-14T13:00:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:54 smithi055 ceph-mon[36853]: Reconfiguring mon.c (monmap changed)... 2024-02-14T13:00:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:54 smithi055 ceph-mon[36853]: Reconfiguring daemon mon.c on smithi103 2024-02-14T13:00:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:54.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:54 smithi103 ceph-mon[36921]: Reconfiguring mon.c (monmap changed)... 2024-02-14T13:00:54.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:54 smithi103 ceph-mon[36921]: Reconfiguring daemon mon.c on smithi103 2024-02-14T13:00:54.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:54.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:54 smithi012 ceph-mon[32370]: Reconfiguring mon.c (monmap changed)... 2024-02-14T13:00:54.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:54 smithi012 ceph-mon[32370]: Reconfiguring daemon mon.c on smithi103 2024-02-14T13:00:54.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.035 DEBUG:teuthology.orchestra.run.smithi055:mgr.y> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.y.service 2024-02-14T13:00:55.038 DEBUG:teuthology.orchestra.run.smithi103:mgr.z> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.z.service 2024-02-14T13:00:55.041 INFO:tasks.cephadm:Deploying OSDs... 2024-02-14T13:00:55.041 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:00:55.041 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-02-14T13:00:55.056 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-14T13:00:55.056 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-02-14 13:00:00.656094429 +0000 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-02-14 12:55:15.150452468 +0000 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-02-14 12:55:15.150452468 +0000 2024-02-14T13:00:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-02-14 12:55:15.150452468 +0000 2024-02-14T13:00:55.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-14T13:00:55.176 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-02-14T13:00:55.176 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-02-14T13:00:55.176 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000204829 s, 2.5 MB/s 2024-02-14T13:00:55.177 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-14T13:00:55.233 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-02-14T13:00:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-14T13:00:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:55.288 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-14T13:00:55.288 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:55.288 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:55.289 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-02-14 13:00:00.691094174 +0000 2024-02-14T13:00:55.289 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-02-14 12:55:15.489449884 +0000 2024-02-14T13:00:55.289 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-02-14 12:55:15.489449884 +0000 2024-02-14T13:00:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-02-14 12:55:15.489449884 +0000 2024-02-14T13:00:55.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-14T13:00:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:55 smithi055 ceph-mon[36853]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi055=y;smithi103=z", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:55 smithi055 ceph-mon[36853]: Saving service mgr spec with placement smithi012=x;smithi055=y;smithi103=z;count:3 2024-02-14T13:00:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:55 smithi055 ceph-mon[36853]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:55 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:55 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:55 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:55.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:55 smithi012 ceph-mon[32370]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi055=y;smithi103=z", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:55.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:55 smithi012 ceph-mon[32370]: Saving service mgr spec with placement smithi012=x;smithi055=y;smithi103=z;count:3 2024-02-14T13:00:55.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:55 smithi012 ceph-mon[32370]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:55.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:55 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:55 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.352 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:55 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:55.354 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-02-14T13:00:55.354 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-02-14T13:00:55.354 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000228064 s, 2.2 MB/s 2024-02-14T13:00:55.355 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-14T13:00:55.410 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-02-14 13:00:00.725093926 +0000 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-02-14 12:55:15.832447268 +0000 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-02-14 12:55:15.832447268 +0000 2024-02-14T13:00:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-02-14 12:55:15.832447268 +0000 2024-02-14T13:00:55.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-14T13:00:55.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:55 smithi103 ceph-mon[36921]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi055=y;smithi103=z", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:00:55.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:55 smithi103 ceph-mon[36921]: Saving service mgr spec with placement smithi012=x;smithi055=y;smithi103=z;count:3 2024-02-14T13:00:55.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:55 smithi103 ceph-mon[36921]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:55.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:55 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:55 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:55.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:55 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:00:55.529 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-02-14T13:00:55.530 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-02-14T13:00:55.530 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000199698 s, 2.6 MB/s 2024-02-14T13:00:55.531 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-14T13:00:55.587 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-02-14 13:00:00.759093678 +0000 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-02-14 12:55:16.171444683 +0000 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-02-14 12:55:16.171444683 +0000 2024-02-14T13:00:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-02-14 12:55:16.171444683 +0000 2024-02-14T13:00:55.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-14T13:00:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-02-14T13:00:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-02-14T13:00:55.706 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000172595 s, 3.0 MB/s 2024-02-14T13:00:55.707 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-14T13:00:55.762 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-02-14T13:00:55.762 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-02-14T13:00:55.782 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-14T13:00:55.782 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-02-14T13:00:55.840 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-14T13:00:55.840 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:55.840 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 660 Links: 1 2024-02-14T13:00:55.840 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:55.841 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:55.841 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-02-14 13:00:41.195320942 +0000 2024-02-14T13:00:55.841 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-02-14 12:55:38.711121460 +0000 2024-02-14T13:00:55.841 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-02-14 12:55:38.711121460 +0000 2024-02-14T13:00:55.841 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-02-14 12:55:38.711121460 +0000 2024-02-14T13:00:55.841 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-14T13:00:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-02-14T13:00:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-02-14T13:00:55.914 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000313869 s, 1.6 MB/s 2024-02-14T13:00:55.915 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-14T13:00:55.974 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-02-14T13:00:56.032 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 679 Links: 1 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-02-14 13:00:41.195320942 +0000 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-02-14 12:55:39.071114569 +0000 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-02-14 12:55:39.071114569 +0000 2024-02-14T13:00:56.033 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-02-14 12:55:39.071114569 +0000 2024-02-14T13:00:56.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-14T13:00:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-02-14T13:00:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-02-14T13:00:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000313287 s, 1.6 MB/s 2024-02-14T13:00:56.108 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-14T13:00:56.165 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-02-14T13:00:56.215 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:56.215 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:56.215 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:56.216 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:00:56.216 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-14T13:00:56.216 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:00:56.216 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-02-14 13:00:41.196320924 +0000 2024-02-14T13:00:56.223 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-02-14 12:55:39.425107794 +0000 2024-02-14T13:00:56.224 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-02-14 12:55:39.425107794 +0000 2024-02-14T13:00:56.224 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-02-14 12:55:39.425107794 +0000 2024-02-14T13:00:56.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-14T13:00:56.292 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:56.292 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:56.292 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:56.292 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:00:56.292 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-14T13:00:56.292 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:00:56.293 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:56.294 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-02-14T13:00:56.295 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-02-14T13:00:56.295 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000320964 s, 1.6 MB/s 2024-02-14T13:00:56.296 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-14T13:00:56.353 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-02-14 13:00:41.196320924 +0000 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-02-14 12:55:39.764101305 +0000 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-02-14 12:55:39.764101305 +0000 2024-02-14T13:00:56.409 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-02-14 12:55:39.764101305 +0000 2024-02-14T13:00:56.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:00:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:56.480 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-02-14T13:00:56.480 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-02-14T13:00:56.480 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000269894 s, 1.9 MB/s 2024-02-14T13:00:56.481 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-14T13:00:56.539 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-02-14T13:00:56.539 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-02-14T13:00:56.555 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-14T13:00:56.555 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-14 13:00:32.240055772 +0000 2024-02-14T13:00:56.610 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-14 12:55:27.252736163 +0000 2024-02-14T13:00:56.611 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-14 12:55:27.252736163 +0000 2024-02-14T13:00:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-14 12:55:27.252736163 +0000 2024-02-14T13:00:56.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-14T13:00:56.676 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-14T13:00:56.676 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-14T13:00:56.677 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00024583 s, 2.1 MB/s 2024-02-14T13:00:56.678 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-14T13:00:56.733 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-02-14T13:00:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-14T13:00:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-14 13:00:32.240055772 +0000 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-14 12:55:27.606729289 +0000 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-14 12:55:27.606729289 +0000 2024-02-14T13:00:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-14 12:55:27.606729289 +0000 2024-02-14T13:00:56.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-14T13:00:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-14T13:00:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-14T13:00:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000194147 s, 2.6 MB/s 2024-02-14T13:00:56.854 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-14T13:00:56.910 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-02-14T13:00:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-14T13:00:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:56.965 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-02-14T13:00:56.965 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:56.965 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:56.966 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-14 13:00:32.241055753 +0000 2024-02-14T13:00:56.966 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-14 12:55:27.945722707 +0000 2024-02-14T13:00:56.966 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-14 12:55:27.945722707 +0000 2024-02-14T13:00:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-14 12:55:27.945722707 +0000 2024-02-14T13:00:56.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-14T13:00:57.146 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-14T13:00:57.146 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-14T13:00:57.146 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00019463 s, 2.6 MB/s 2024-02-14T13:00:57.147 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-14T13:00:57.162 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-02-14T13:00:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-14T13:00:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-14T13:00:57.221 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-02-14T13:00:57.222 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:00:57.222 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-02-14T13:00:57.222 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-02-14 13:00:57.087585022 +0000 2024-02-14T13:00:57.222 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-02-14 12:55:28.292715970 +0000 2024-02-14T13:00:57.222 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-02-14 12:55:28.292715970 +0000 2024-02-14T13:00:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-02-14 12:55:28.292715970 +0000 2024-02-14T13:00:57.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-14T13:00:57.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:57 smithi103 ceph-mon[36921]: Deploying daemon mgr.z on smithi103 2024-02-14T13:00:57.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:57 smithi103 ceph-mon[36921]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:57.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:57 smithi055 ceph-mon[36853]: Deploying daemon mgr.z on smithi103 2024-02-14T13:00:57.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:57 smithi055 ceph-mon[36853]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-02-14T13:00:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-02-14T13:00:57.337 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000192956 s, 2.7 MB/s 2024-02-14T13:00:57.339 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-14T13:00:57.354 INFO:tasks.cephadm:Deploying osd.0 on smithi012 with /dev/vg_nvme/lv_4... 2024-02-14T13:00:57.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-14T13:00:57.383 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:57 smithi012 ceph-mon[32370]: Deploying daemon mgr.z on smithi103 2024-02-14T13:00:57.383 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:57 smithi012 ceph-mon[32370]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:57.560 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 systemd[1]: Starting Ceph mgr.z for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:00:57.603 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:00:57.832 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 podman[38761]: 2024-02-14 13:00:57.461796554 +0000 UTC m=+0.017969524 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:00:57.832 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 podman[38761]: 2024-02-14 13:00:57.562195093 +0000 UTC m=+0.118368046 container create 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:00:57.832 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 podman[38761]: 2024-02-14 13:00:57.764382833 +0000 UTC m=+0.320555786 container init 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2) 2024-02-14T13:00:57.832 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 podman[38761]: 2024-02-14 13:00:57.767029144 +0000 UTC m=+0.323202090 container start 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240131, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-14T13:00:57.832 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 ceph-mgr[38780]: -- 172.21.15.103:0/2456936529 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55848bb11520 con 0x55848bae6800 2024-02-14T13:00:57.832 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 bash[38761]: 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 2024-02-14T13:00:58.241 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:57 smithi103 systemd[1]: Started Ceph mgr.z for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:00:58.741 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:58.307+0000 7ff27a845200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-14T13:00:58.741 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:58.397+0000 7ff27a845200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-14T13:00:59.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.119 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:00:59.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-14T13:00:59.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:00:59.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:59.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: Deploying daemon mgr.y on smithi055 2024-02-14T13:00:59.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:00:58 smithi012 ceph-mon[32370]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:59.241 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.027+0000 7ff27a845200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-14T13:00:59.241 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.116+0000 7ff27a845200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: Deploying daemon mgr.y on smithi055 2024-02-14T13:00:59.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:00:58 smithi103 ceph-mon[36921]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:59.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:00:59.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:00:59.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-14T13:00:59.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:00:59.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:00:59.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: Deploying daemon mgr.y on smithi055 2024-02-14T13:00:59.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:00:58 smithi055 ceph-mon[36853]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:00:59.502 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-14T13:00:59.502 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-14T13:00:59.502 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2024-02-14T13:00:59.502 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2024-02-14T13:00:59.502 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113234 s, 926 MB/s 2024-02-14T13:00:59.502 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2024-02-14T13:00:59.684 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.253+0000 7ff27a845200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-14T13:00:59.684 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.346+0000 7ff27a845200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-14T13:00:59.684 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.427+0000 7ff27a845200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-14T13:00:59.684 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.682+0000 7ff27a845200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-14T13:00:59.969 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.789+0000 7ff27a845200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-14T13:00:59.969 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.872+0000 7ff27a845200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-14T13:00:59.969 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:00:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:00:59.967+0000 7ff27a845200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-14T13:01:00.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2024-02-14T13:01:00.241 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:00.143+0000 7ff27a845200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-14T13:01:00.263 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 systemd[1]: Starting Ceph mgr.y for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:01:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:01:00.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:00 smithi055 ceph-mon[36853]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:00.560 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 podman[38222]: 2024-02-14 13:01:00.261564876 +0000 UTC m=+0.103241895 container create dea078cbb750ae25efd2a3675662516de6fca8bdaa9bba1dc7d45e4def6b4e63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=) 2024-02-14T13:01:00.561 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 podman[38222]: 2024-02-14 13:01:00.176187652 +0000 UTC m=+0.017864679 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:01:00.561 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 podman[38222]: 2024-02-14 13:01:00.481135989 +0000 UTC m=+0.322813020 container init dea078cbb750ae25efd2a3675662516de6fca8bdaa9bba1dc7d45e4def6b4e63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2) 2024-02-14T13:01:00.561 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 podman[38222]: 2024-02-14 13:01:00.484195576 +0000 UTC m=+0.325872602 container start dea078cbb750ae25efd2a3675662516de6fca8bdaa9bba1dc7d45e4def6b4e63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-14T13:01:00.561 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 ceph-mgr[38248]: -- 172.21.15.55:0/1210644157 <== mon.2 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d4b182b520 con 0x55d4b1800800 2024-02-14T13:01:00.673 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:00 smithi012 ceph-mon[32370]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:00.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:00 smithi103 ceph-mon[36921]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:01.060 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 bash[38222]: dea078cbb750ae25efd2a3675662516de6fca8bdaa9bba1dc7d45e4def6b4e63 2024-02-14T13:01:01.060 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:00 smithi055 systemd[1]: Started Ceph mgr.y for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:01:01.327 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:01.071+0000 7efc7ea78200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-14T13:01:01.327 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:01.171+0000 7efc7ea78200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-14T13:01:01.491 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:01.174+0000 7ff27a845200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-14T13:01:01.491 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:01.318+0000 7ff27a845200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-14T13:01:01.940 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.941 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.941 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.941 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.941 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:01.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.974 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:01.975 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:01.675+0000 7ff27a845200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-14T13:01:01.975 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:01.772+0000 7ff27a845200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-14T13:01:01.975 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:01.972+0000 7ff27a845200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-14T13:01:01.977 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.978 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.978 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.978 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:01.978 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:01.978 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:01.879+0000 7efc7ea78200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-14T13:01:01.978 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:01.975+0000 7efc7ea78200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 -- 172.21.15.12:0/1219565479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 msgr2=0x7f8ba81022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 --2- 172.21.15.12:0/1219565479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba81022b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0099c0 tx=0x7f8b9c009cd0 comp rx=0 tx=0).stop 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 -- 172.21.15.12:0/1219565479 shutdown_connections 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 --2- 172.21.15.12:0/1219565479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ba81027f0 0x7f8ba81090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 --2- 172.21.15.12:0/1219565479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ba8100c50 0x7f8ba8101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 --2- 172.21.15.12:0/1219565479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba81022b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 -- 172.21.15.12:0/1219565479 >> 172.21.15.12:0/1219565479 conn(0x7f8ba80fc1f0 msgr2=0x7f8ba80fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:01:02.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 -- 172.21.15.12:0/1219565479 shutdown_connections 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.045+0000 7f8bad639700 1 -- 172.21.15.12:0/1219565479 wait complete. 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 Processor -- start 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 -- start start 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ba8100c50 0x7f8ba8104be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba8103230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ba81027f0 0x7f8ba8103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba8103ef0 con 0x7f8ba8101e50 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba8104060 con 0x7f8ba8100c50 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8bad639700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba81a1db0 con 0x7f8ba81027f0 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba8103230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba6ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ba8100c50 0x7f8ba8104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba8103230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36290/0 (socket says 172.21.15.12:36290) 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 -- 172.21.15.12:0/2451743014 learned_addr learned my addr 172.21.15.12:0/2451743014 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:01:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba77fe700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ba81027f0 0x7f8ba8103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 -- 172.21.15.12:0/2451743014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ba81027f0 msgr2=0x7f8ba8103770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ba81027f0 0x7f8ba8103770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 -- 172.21.15.12:0/2451743014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ba8100c50 msgr2=0x7f8ba8104be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.046+0000 7f8ba67fc700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ba8100c50 0x7f8ba8104be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8ba67fc700 1 -- 172.21.15.12:0/2451743014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0095f0 con 0x7f8ba8101e50 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8ba67fc700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba8103230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000c00 tx=0x7f8b9c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c01d070 con 0x7f8ba8101e50 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba81a2030 con 0x7f8ba8101e50 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f8b9c003680 con 0x7f8ba8101e50 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c022d00 con 0x7f8ba8101e50 2024-02-14T13:01:02.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.047+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba81a2440 con 0x7f8ba8101e50 2024-02-14T13:01:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.048+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 45988+0+0 (secure 0 0 0) 0x7f8b9c00f460 con 0x7f8ba8101e50 2024-02-14T13:01:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.048+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba80689e0 con 0x7f8ba8101e50 2024-02-14T13:01:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.048+0000 7f8b8ffff700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8b900391c0 0x7f8b9003b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.048+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b9c04d060 con 0x7f8ba8101e50 2024-02-14T13:01:02.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.048+0000 7f8ba6ffd700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8b900391c0 0x7f8b9003b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.049+0000 7f8ba6ffd700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8b900391c0 0x7f8b9003b680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8101cb0 tx=0x7f8b9800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:01:02.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.055+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b9c016780 con 0x7f8ba8101e50 2024-02-14T13:01:02.228 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.126+0000 7efc7ea78200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-14T13:01:02.228 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.226+0000 7efc7ea78200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-14T13:01:02.241 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:02.178+0000 7ff27a845200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-14T13:01:02.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:02.274+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ba80fe430 con 0x7f8b900391c0 2024-02-14T13:01:02.560 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.312+0000 7efc7ea78200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-14T13:01:02.718 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:02.462+0000 7ff27a845200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-14T13:01:02.718 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:02.716+0000 7ff27a845200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-14T13:01:02.897 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.593+0000 7efc7ea78200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-14T13:01:02.897 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.707+0000 7efc7ea78200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-14T13:01:02.897 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.796+0000 7efc7ea78200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-14T13:01:02.897 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:02.895+0000 7efc7ea78200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-14T13:01:02.991 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:02.950+0000 7ff27a845200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-14T13:01:03.173 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:03.077+0000 7efc7ea78200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-14T13:01:03.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:01:03.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:01:03.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:01:03.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-14T13:01:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:04.203 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:03.749+0000 7ff27a845200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-14T13:01:04.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:04 smithi012 ceph-mon[32370]: Reconfiguring mgr.x (unknown last config time)... 2024-02-14T13:01:04.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:04 smithi012 ceph-mon[32370]: Reconfiguring daemon mgr.x on smithi012 2024-02-14T13:01:04.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:04.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:04 smithi103 ceph-mon[36921]: Reconfiguring mgr.x (unknown last config time)... 2024-02-14T13:01:04.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:04 smithi103 ceph-mon[36921]: Reconfiguring daemon mgr.x on smithi012 2024-02-14T13:01:04.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:04 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:04.492 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:04.313+0000 7ff27a845200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-14T13:01:04.492 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:04.410+0000 7ff27a845200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-14T13:01:04.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-mon[36853]: Reconfiguring mgr.x (unknown last config time)... 2024-02-14T13:01:04.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-mon[36853]: Reconfiguring daemon mgr.x on smithi012 2024-02-14T13:01:04.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:04.560 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:04.111+0000 7efc7ea78200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-14T13:01:04.561 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:04.247+0000 7efc7ea78200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-14T13:01:04.891 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:04.592+0000 7efc7ea78200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-14T13:01:04.891 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:04.685+0000 7efc7ea78200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-14T13:01:04.891 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:04.886+0000 7efc7ea78200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-14T13:01:04.991 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:01:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z[38776]: 2024-02-14T13:01:04.626+0000 7ff27a845200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-14T13:01:05.209 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:05.075+0000 7efc7ea78200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: Standby manager daemon z started 2024-02-14T13:01:05.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-02-14T13:01:05.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-14T13:01:05.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-02-14T13:01:05.350 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:05 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-14T13:01:05.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:05.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: Standby manager daemon z started 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-02-14T13:01:05.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:05 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-14T13:01:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:05.491+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 14) v1 ==== 91350+0+0 (secure 0 0 0) 0x7f8b9c022470 con 0x7f8ba8101e50 2024-02-14T13:01:05.560 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:05.364+0000 7efc7ea78200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-14T13:01:05.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:05.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:05.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: Standby manager daemon z started 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-02-14T13:01:05.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.103:0/2210441619' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-14T13:01:06.060 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:05.634+0000 7efc7ea78200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-14T13:01:06.061 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:05.875+0000 7efc7ea78200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: mgrmap e14: x(active, since 77s), standbys: z 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2431460451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baab6740-5c44-4b37-a37b-47e3bc605f46"}]: dispatch 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2431460451' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baab6740-5c44-4b37-a37b-47e3bc605f46"}]': finished 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: osdmap e5: 1 total, 0 up, 1 in 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:06 smithi012 ceph-mon[32370]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:06.810 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:06.707+0000 7efc7ea78200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-14T13:01:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: mgrmap e14: x(active, since 77s), standbys: z 2024-02-14T13:01:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-02-14T13:01:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2431460451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baab6740-5c44-4b37-a37b-47e3bc605f46"}]: dispatch 2024-02-14T13:01:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2431460451' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baab6740-5c44-4b37-a37b-47e3bc605f46"}]': finished 2024-02-14T13:01:06.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: osdmap e5: 1 total, 0 up, 1 in 2024-02-14T13:01:06.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:06.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:06 smithi055 ceph-mon[36853]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:06.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: mgrmap e14: x(active, since 77s), standbys: z 2024-02-14T13:01:06.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-02-14T13:01:06.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2431460451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baab6740-5c44-4b37-a37b-47e3bc605f46"}]: dispatch 2024-02-14T13:01:06.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2431460451' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baab6740-5c44-4b37-a37b-47e3bc605f46"}]': finished 2024-02-14T13:01:06.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: osdmap e5: 1 total, 0 up, 1 in 2024-02-14T13:01:06.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:06.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:06 smithi103 ceph-mon[36921]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:07.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:07 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1751804764' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:07.560 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:07.302+0000 7efc7ea78200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-14T13:01:07.561 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:07.402+0000 7efc7ea78200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-14T13:01:07.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:07 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1751804764' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:07.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:07 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1751804764' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:08.060 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:01:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y[38237]: 2024-02-14T13:01:07.622+0000 7efc7ea78200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-14T13:01:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:08.507+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 15) v1 ==== 136712+0+0 (secure 0 0 0) 0x7f8b9c04cb70 con 0x7f8ba8101e50 2024-02-14T13:01:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:08 smithi055 ceph-mon[36853]: Standby manager daemon y started 2024-02-14T13:01:08.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:08 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-14T13:01:08.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:08 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-14T13:01:08.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:08 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-14T13:01:08.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:08 smithi055 ceph-mon[36853]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-14T13:01:08.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:08 smithi055 ceph-mon[36853]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:08 smithi012 ceph-mon[32370]: Standby manager daemon y started 2024-02-14T13:01:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:08 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-14T13:01:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:08 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-14T13:01:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:08 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-14T13:01:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:08 smithi012 ceph-mon[32370]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-14T13:01:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:08 smithi012 ceph-mon[32370]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:08 smithi103 ceph-mon[36921]: Standby manager daemon y started 2024-02-14T13:01:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:08 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-14T13:01:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:08 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-14T13:01:08.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:08 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-14T13:01:08.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:08 smithi103 ceph-mon[36921]: from='mgr.? 172.21.15.55:0/1722944919' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-14T13:01:08.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:08 smithi103 ceph-mon[36921]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:09 smithi055 ceph-mon[36853]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-02-14T13:01:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:09 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-14T13:01:09.943 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:09 smithi012 ceph-mon[32370]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-02-14T13:01:09.944 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:09 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-14T13:01:09.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:09 smithi103 ceph-mon[36921]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-02-14T13:01:09.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:09 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-14T13:01:10.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:10 smithi012 ceph-mon[32370]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:10.787 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:10 smithi055 ceph-mon[36853]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:10.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:10 smithi103 ceph-mon[36921]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:12.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:12 smithi012 ceph-mon[32370]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:12 smithi103 ceph-mon[36921]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:12 smithi055 ceph-mon[36853]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:13.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-14T13:01:13.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-14T13:01:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-14T13:01:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:14.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:14 smithi012 ceph-mon[32370]: Deploying daemon osd.0 on smithi012 2024-02-14T13:01:14.705 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:14 smithi012 ceph-mon[32370]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:14 smithi055 ceph-mon[36853]: Deploying daemon osd.0 on smithi012 2024-02-14T13:01:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:14 smithi055 ceph-mon[36853]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:14 smithi103 ceph-mon[36921]: Deploying daemon osd.0 on smithi012 2024-02-14T13:01:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:14 smithi103 ceph-mon[36921]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:16.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:16 smithi012 ceph-mon[32370]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:16.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:16 smithi103 ceph-mon[36921]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:16.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:16 smithi055 ceph-mon[36853]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:18 smithi012 ceph-mon[32370]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:18.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:18 smithi103 ceph-mon[36921]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:18 smithi055 ceph-mon[36853]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:19.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:19.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:19.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:19.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:19 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:19.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:19 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:19.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:19 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:20.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:19 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:19 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:19 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:20.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:20 smithi012 ceph-mon[32370]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:20.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:20.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:20.900 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:20 smithi103 ceph-mon[36921]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:20.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:20.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:20.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:20.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:21.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:20 smithi055 ceph-mon[36853]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:21.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:21.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:21.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:21.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:21.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:22.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.230+0000 7f8b8ffff700 1 -- 172.21.15.12:0/2451743014 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8ba80fe430 con 0x7f8b900391c0 2024-02-14T13:01:22.232 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 0 on host 'smithi012' 2024-02-14T13:01:22.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8b900391c0 msgr2=0x7f8b9003b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:22.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8b900391c0 0x7f8b9003b680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8101cb0 tx=0x7f8b9800b410 comp rx=0 tx=0).stop 2024-02-14T13:01:22.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 msgr2=0x7f8ba8103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:22.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba8103230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000c00 tx=0x7f8b9c00bfd0 comp rx=0 tx=0).stop 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 shutdown_connections 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ba81027f0 0x7f8ba8103770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ba8100c50 0x7f8ba8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8b900391c0 0x7f8b9003b680 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 --2- 172.21.15.12:0/2451743014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba8101e50 0x7f8ba8103230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.232+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 >> 172.21.15.12:0/2451743014 conn(0x7f8ba80fc1f0 msgr2=0x7f8ba80fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.233+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 shutdown_connections 2024-02-14T13:01:22.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:01:22.233+0000 7f8bad639700 1 -- 172.21.15.12:0/2451743014 wait complete. 2024-02-14T13:01:22.807 DEBUG:teuthology.orchestra.run.smithi012:osd.0> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.0.service 2024-02-14T13:01:22.810 INFO:tasks.cephadm:Deploying osd.1 on smithi055 with /dev/vg_nvme/lv_4... 2024-02-14T13:01:22.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-14T13:01:23.065 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:01:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:23 smithi012 ceph-mon[32370]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:23 smithi012 ceph-mon[32370]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-14T13:01:23.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:23.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:23.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:23.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:23 smithi103 ceph-mon[36921]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:23.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:23 smithi103 ceph-mon[36921]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-14T13:01:23.497 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:23.498 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:23.498 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:23.498 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:23 smithi055 ceph-mon[36853]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:23.498 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:23 smithi055 ceph-mon[36853]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-14T13:01:24.388 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:24 smithi055 ceph-mon[36853]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-14T13:01:24.389 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:24 smithi055 ceph-mon[36853]: osdmap e6: 1 total, 0 up, 1 in 2024-02-14T13:01:24.389 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:24 smithi055 ceph-mon[36853]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:01:24.389 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:24 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:24.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:24 smithi012 ceph-mon[32370]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-14T13:01:24.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:24 smithi012 ceph-mon[32370]: osdmap e6: 1 total, 0 up, 1 in 2024-02-14T13:01:24.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:24 smithi012 ceph-mon[32370]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:01:24.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:24 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:24.469 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:01:24 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0[47095]: 2024-02-14T13:01:24.196+0000 7f3d519db700 -1 osd.0 0 waiting for initial osdmap 2024-02-14T13:01:24.469 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:01:24 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0[47095]: 2024-02-14T13:01:24.198+0000 7f3d4dfd6700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:01:24.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:24 smithi103 ceph-mon[36921]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-14T13:01:24.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:24 smithi103 ceph-mon[36921]: osdmap e6: 1 total, 0 up, 1 in 2024-02-14T13:01:24.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:24 smithi103 ceph-mon[36921]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:01:24.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:24 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:24.980 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-14T13:01:24.980 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-14T13:01:24.980 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-02-14T13:01:24.980 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-02-14T13:01:24.980 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01608 s, 652 MB/s 2024-02-14T13:01:24.980 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-02-14T13:01:25.432 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:25 smithi012 ceph-mon[32370]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:01:25.433 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:25 smithi012 ceph-mon[32370]: osdmap e7: 1 total, 0 up, 1 in 2024-02-14T13:01:25.433 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.433 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.433 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:25 smithi012 ceph-mon[32370]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:25.433 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.470 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:25 smithi055 ceph-mon[36853]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:01:25.470 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:25 smithi055 ceph-mon[36853]: osdmap e7: 1 total, 0 up, 1 in 2024-02-14T13:01:25.470 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.470 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.470 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:25 smithi055 ceph-mon[36853]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:25.470 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:25 smithi103 ceph-mon[36921]: from='osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:01:25.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:25 smithi103 ceph-mon[36921]: osdmap e7: 1 total, 0 up, 1 in 2024-02-14T13:01:25.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:25 smithi103 ceph-mon[36921]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-14T13:01:25.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:25.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_4 2024-02-14T13:01:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:01:26.270 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:01:26.270 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:01:26.270 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] boot 2024-02-14T13:01:26.270 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: osdmap e8: 1 total, 1 up, 1 in 2024-02-14T13:01:26.270 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:26.271 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] boot 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: osdmap e8: 1 total, 1 up, 1 in 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:01:26.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:26.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:26.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:01:26.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:01:26.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: osd.0 [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] boot 2024-02-14T13:01:26.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: osdmap e8: 1 total, 1 up, 1 in 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 -- 172.21.15.55:0/4092530369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c101e50 msgr2=0x7eff0c1022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 --2- 172.21.15.55:0/4092530369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c101e50 0x7eff0c1022b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efefc0099c0 tx=0x7efefc009cd0 comp rx=0 tx=0).stop 2024-02-14T13:01:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 -- 172.21.15.55:0/4092530369 shutdown_connections 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 --2- 172.21.15.55:0/4092530369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0c1027f0 0x7eff0c1090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 --2- 172.21.15.55:0/4092530369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c100c50 0x7eff0c101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 --2- 172.21.15.55:0/4092530369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c101e50 0x7eff0c1022b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 -- 172.21.15.55:0/4092530369 >> 172.21.15.55:0/4092530369 conn(0x7eff0c0fc1f0 msgr2=0x7eff0c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 -- 172.21.15.55:0/4092530369 shutdown_connections 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.376+0000 7eff14645700 1 -- 172.21.15.55:0/4092530369 wait complete. 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 Processor -- start 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 -- start start 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c100c50 0x7eff0c197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0c101e50 0x7eff0c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 0x7eff0c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c19f8e0 con 0x7eff0c101e50 2024-02-14T13:01:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c19fa20 con 0x7eff0c1027f0 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff14645700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c19fbe0 con 0x7eff0c100c50 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff12be2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 0x7eff0c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff12be2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 0x7eff0c19f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58734/0 (socket says 172.21.15.55:58734) 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff12be2700 1 -- 172.21.15.55:0/2633721150 learned_addr learned my addr 172.21.15.55:0/2633721150 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.377+0000 7eff123e1700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c100c50 0x7eff0c197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff11be0700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0c101e50 0x7eff0c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff12be2700 1 -- 172.21.15.55:0/2633721150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c100c50 msgr2=0x7eff0c197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff12be2700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c100c50 0x7eff0c197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff12be2700 1 -- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0c101e50 msgr2=0x7eff0c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff12be2700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0c101e50 0x7eff0c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff12be2700 1 -- 172.21.15.55:0/2633721150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc0095f0 con 0x7eff0c1027f0 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff12be2700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 0x7eff0c19f310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b970 tx=0x7eff0400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:01:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400c930 con 0x7eff0c1027f0 2024-02-14T13:01:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c19fec0 con 0x7eff0c1027f0 2024-02-14T13:01:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7eff04014440 con 0x7eff0c1027f0 2024-02-14T13:01:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040075d0 con 0x7eff0c1027f0 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.378+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c1a0280 con 0x7eff0c1027f0 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.379+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c10c610 con 0x7eff0c1027f0 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.380+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mon.2 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 15) v1 ==== 136712+0+0 (secure 0 0 0) 0x7eff040145b0 con 0x7eff0c1027f0 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.381+0000 7eff037fe700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efef80a20c0 0x7efef80a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.381+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mon.2 v2:172.21.15.55:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7eff04006e40 con 0x7eff0c1027f0 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.381+0000 7eff123e1700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efef80a20c0 0x7efef80a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.382+0000 7eff123e1700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efef80a20c0 0x7efef80a4580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff0c199270 tx=0x7eff0800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:01:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.385+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mon.2 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7eff040966e0 con 0x7eff0c1027f0 2024-02-14T13:01:27.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:27 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi012 2024-02-14T13:01:27.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:27 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi012 to 17093M 2024-02-14T13:01:27.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:27 smithi103 ceph-mon[36921]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:27.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:27 smithi103 ceph-mon[36921]: osdmap e9: 1 total, 1 up, 1 in 2024-02-14T13:01:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:27 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi012 2024-02-14T13:01:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:27 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi012 to 17093M 2024-02-14T13:01:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:27 smithi055 ceph-mon[36853]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:27.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:27 smithi055 ceph-mon[36853]: osdmap e9: 1 total, 1 up, 1 in 2024-02-14T13:01:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:27.598+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7eff0c0fe3e0 con 0x7efef80a20c0 2024-02-14T13:01:27.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:27 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi012 2024-02-14T13:01:27.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:27 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi012 to 17093M 2024-02-14T13:01:27.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:27 smithi012 ceph-mon[32370]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:27.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:27 smithi012 ceph-mon[32370]: osdmap e9: 1 total, 1 up, 1 in 2024-02-14T13:01:28.329 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:28 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:28.329 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:28 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:28.329 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:28 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:28.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:28 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:28.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:28 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:28.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:28 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:29.433 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:29 smithi055 ceph-mon[36853]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:29.433 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:29 smithi055 ceph-mon[36853]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:29.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:29 smithi103 ceph-mon[36921]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:29.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:29 smithi103 ceph-mon[36921]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:29 smithi012 ceph-mon[32370]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:29 smithi012 ceph-mon[32370]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:30.614 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:30 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/3266017365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]: dispatch 2024-02-14T13:01:30.614 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:30 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]: dispatch 2024-02-14T13:01:30.615 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:30 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]': finished 2024-02-14T13:01:30.615 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:30 smithi055 ceph-mon[36853]: osdmap e10: 2 total, 1 up, 2 in 2024-02-14T13:01:30.615 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:30 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:30.615 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:30 smithi055 ceph-mon[36853]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:30 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/3266017365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]: dispatch 2024-02-14T13:01:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:30 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]: dispatch 2024-02-14T13:01:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:30 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]': finished 2024-02-14T13:01:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:30 smithi012 ceph-mon[32370]: osdmap e10: 2 total, 1 up, 2 in 2024-02-14T13:01:30.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:30 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:30.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:30 smithi012 ceph-mon[32370]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:30.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:30 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/3266017365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]: dispatch 2024-02-14T13:01:30.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:30 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]: dispatch 2024-02-14T13:01:30.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:30 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "578b4ffb-958f-47ee-b59c-174e3c36865b"}]': finished 2024-02-14T13:01:30.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:30 smithi103 ceph-mon[36921]: osdmap e10: 2 total, 1 up, 2 in 2024-02-14T13:01:30.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:30 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:30.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:30 smithi103 ceph-mon[36921]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:31.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:31 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/4292386856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:31.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:31 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/4292386856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:32.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:31 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/4292386856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:32 smithi012 ceph-mon[32370]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:32.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:32 smithi103 ceph-mon[36921]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:33.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:32 smithi055 ceph-mon[36853]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:34.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:34 smithi055 ceph-mon[36853]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:34 smithi012 ceph-mon[32370]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:34.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:34 smithi103 ceph-mon[36921]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:36.647 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:36 smithi055 ceph-mon[36853]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:36.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:36 smithi012 ceph-mon[32370]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:36.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:36 smithi103 ceph-mon[36921]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:38.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:38 smithi055 ceph-mon[36853]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:38.649 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:38 smithi103 ceph-mon[36921]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:38.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:38 smithi012 ceph-mon[32370]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:39.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-14T13:01:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:39 smithi103 ceph-mon[36921]: Deploying daemon osd.1 on smithi055 2024-02-14T13:01:39.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-14T13:01:39.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:39.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:39 smithi055 ceph-mon[36853]: Deploying daemon osd.1 on smithi055 2024-02-14T13:01:39.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-14T13:01:39.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:39.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:39 smithi012 ceph-mon[32370]: Deploying daemon osd.1 on smithi055 2024-02-14T13:01:40.551 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:40 smithi055 ceph-mon[36853]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:40 smithi012 ceph-mon[32370]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:40 smithi103 ceph-mon[36921]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:42 smithi012 ceph-mon[32370]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:42.719 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:42 smithi055 ceph-mon[36853]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:42.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:42 smithi103 ceph-mon[36921]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:45.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:45.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:45.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:45.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:44 smithi012 ceph-mon[32370]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:45.225 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:45.225 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:45.225 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:45.225 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:44 smithi055 ceph-mon[36853]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:45.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:45.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:45.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:45.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:44 smithi103 ceph-mon[36921]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:46.709 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:46 smithi055 ceph-mon[36853]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:46.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:46 smithi012 ceph-mon[32370]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:46.743 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:46 smithi103 ceph-mon[36921]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:47.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.065+0000 7eff037fe700 1 -- 172.21.15.55:0/2633721150 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7eff0c0fe3e0 con 0x7efef80a20c0 2024-02-14T13:01:47.067 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 1 on host 'smithi055' 2024-02-14T13:01:47.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efef80a20c0 msgr2=0x7efef80a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efef80a20c0 0x7efef80a4580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff0c199270 tx=0x7eff0800b410 comp rx=0 tx=0).stop 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 msgr2=0x7eff0c19f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 0x7eff0c19f310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff0400b970 tx=0x7eff0400bc80 comp rx=0 tx=0).stop 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 shutdown_connections 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff0c1027f0 0x7eff0c19f310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff0c100c50 0x7eff0c197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efef80a20c0 0x7efef80a4580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 --2- 172.21.15.55:0/2633721150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0c101e50 0x7eff0c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 >> 172.21.15.55:0/2633721150 conn(0x7eff0c0fc1f0 msgr2=0x7eff0c0fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 shutdown_connections 2024-02-14T13:01:47.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:01:47.068+0000 7eff14645700 1 -- 172.21.15.55:0/2633721150 wait complete. 2024-02-14T13:01:47.675 DEBUG:teuthology.orchestra.run.smithi055:osd.1> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.1.service 2024-02-14T13:01:47.677 INFO:tasks.cephadm:Deploying osd.2 on smithi103 with /dev/vg_nvme/lv_4... 2024-02-14T13:01:47.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-14T13:01:47.922 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.965 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.983 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:47.984 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:01:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1[41491]: 2024-02-14T13:01:47.785+0000 7fb15ac927c0 -1 osd.1 0 log_to_monitors true 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:01:48.941 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:48 smithi055 ceph-mon[36853]: from='osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-14T13:01:48.941 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:48 smithi055 ceph-mon[36853]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-14T13:01:48.941 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:48 smithi055 ceph-mon[36853]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:48.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:48 smithi012 ceph-mon[32370]: from='osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-14T13:01:48.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:48 smithi012 ceph-mon[32370]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-14T13:01:48.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:48 smithi012 ceph-mon[32370]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:48.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:48 smithi103 ceph-mon[36921]: from='osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-14T13:01:48.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:48 smithi103 ceph-mon[36921]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-14T13:01:48.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:48 smithi103 ceph-mon[36921]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:49.704 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-14T13:01:49.704 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-14T13:01:49.704 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-02-14T13:01:49.704 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-02-14T13:01:49.704 INFO:teuthology.orchestra.run.smithi103.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130989 s, 801 MB/s 2024-02-14T13:01:49.704 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-02-14T13:01:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:49 smithi012 ceph-mon[32370]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-14T13:01:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:49 smithi012 ceph-mon[32370]: osdmap e11: 2 total, 1 up, 2 in 2024-02-14T13:01:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:49 smithi012 ceph-mon[32370]: from='osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:01:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:49 smithi012 ceph-mon[32370]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:01:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:49 smithi103 ceph-mon[36921]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-14T13:01:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:49 smithi103 ceph-mon[36921]: osdmap e11: 2 total, 1 up, 2 in 2024-02-14T13:01:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:49 smithi103 ceph-mon[36921]: from='osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:01:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:49 smithi103 ceph-mon[36921]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:01:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:49 smithi055 ceph-mon[36853]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-14T13:01:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:49 smithi055 ceph-mon[36853]: osdmap e11: 2 total, 1 up, 2 in 2024-02-14T13:01:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:49 smithi055 ceph-mon[36853]: from='osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:01:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:49 smithi055 ceph-mon[36853]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:01:50.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-02-14T13:01:50.565 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:01:50.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:01:50.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: osdmap e12: 2 total, 1 up, 2 in 2024-02-14T13:01:50.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:50.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:50.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:50.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.970 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:50 smithi012 ceph-mon[32370]: from='osd.1 ' entity='osd.1' 2024-02-14T13:01:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:01:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: osdmap e12: 2 total, 1 up, 2 in 2024-02-14T13:01:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:50.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:50 smithi103 ceph-mon[36921]: from='osd.1 ' entity='osd.1' 2024-02-14T13:01:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: osdmap e12: 2 total, 1 up, 2 in 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:01:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-mon[36853]: from='osd.1 ' entity='osd.1' 2024-02-14T13:01:51.062 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1[41491]: 2024-02-14T13:01:50.636+0000 7fb1512f9700 -1 osd.1 0 waiting for initial osdmap 2024-02-14T13:01:51.062 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:01:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1[41491]: 2024-02-14T13:01:50.642+0000 7fb1480e9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi055 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi055 to 17084M 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] boot 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: osdmap e13: 2 total, 2 up, 2 in 2024-02-14T13:01:51.816 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:51 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:01:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:01:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi055 2024-02-14T13:01:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi055 to 17084M 2024-02-14T13:01:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:51.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] boot 2024-02-14T13:01:51.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: osdmap e13: 2 total, 2 up, 2 in 2024-02-14T13:01:51.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:51 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:52.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 -- 172.21.15.103:0/512450693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea01027f0 msgr2=0x7feea01090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:52.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 --2- 172.21.15.103:0/512450693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea01027f0 0x7feea01090a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fee9800b0a0 tx=0x7fee9800b3b0 comp rx=0 tx=0).stop 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 -- 172.21.15.103:0/512450693 shutdown_connections 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 --2- 172.21.15.103:0/512450693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea01027f0 0x7feea01090a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 --2- 172.21.15.103:0/512450693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feea0100c50 0x7feea0101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 --2- 172.21.15.103:0/512450693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea0101e50 0x7feea01022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 -- 172.21.15.103:0/512450693 >> 172.21.15.103:0/512450693 conn(0x7feea00fc210 msgr2=0x7feea00fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.040+0000 7feea66bc700 1 -- 172.21.15.103:0/512450693 shutdown_connections 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 -- 172.21.15.103:0/512450693 wait complete. 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 Processor -- start 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 -- start start 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feea0100c50 0x7feea010b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:52.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 0x7feea0109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea01027f0 0x7feea010a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea010a870 con 0x7feea0100c50 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea010a9e0 con 0x7feea01027f0 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7feea66bc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea01a2010 con 0x7feea0101e50 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.041+0000 7fee9f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 0x7feea0109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 0x7feea0109bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51178/0 (socket says 172.21.15.103:51178) 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 -- 172.21.15.103:0/3182833653 learned_addr learned my addr 172.21.15.103:0/3182833653 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9ffff700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feea0100c50 0x7feea010b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7feea4c59700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea01027f0 0x7feea010a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 -- 172.21.15.103:0/3182833653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea01027f0 msgr2=0x7feea010a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea01027f0 0x7feea010a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 -- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feea0100c50 msgr2=0x7feea010b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:01:52.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feea0100c50 0x7feea010b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 -- 172.21.15.103:0/3182833653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009d00 con 0x7feea0101e50 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7feea4c59700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea01027f0 0x7feea010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9f7fe700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 0x7feea0109bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b530 tx=0x7fee9400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94011830 con 0x7feea0101e50 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea01a22f0 con 0x7feea0101e50 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fee94011e70 con 0x7feea0101e50 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400f300 con 0x7feea0101e50 2024-02-14T13:01:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.042+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea01a28c0 con 0x7feea0101e50 2024-02-14T13:01:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.043+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea0108010 con 0x7feea0101e50 2024-02-14T13:01:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.044+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) v1 ==== 136712+0+0 (secure 0 0 0) 0x7fee940106d0 con 0x7feea0101e50 2024-02-14T13:01:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.045+0000 7fee9d7fa700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fee880a20c0 0x7fee880a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:01:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.045+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fee940cc450 con 0x7feea0101e50 2024-02-14T13:01:52.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.045+0000 7fee9ffff700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fee880a20c0 0x7fee880a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:01:52.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.046+0000 7fee9ffff700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fee880a20c0 0x7fee880a4580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feea0101cb0 tx=0x7fee90009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:01:52.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.049+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee94096c70 con 0x7feea0101e50 2024-02-14T13:01:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:01:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:01:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi055 2024-02-14T13:01:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi055 to 17084M 2024-02-14T13:01:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: osd.1 [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] boot 2024-02-14T13:01:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: osdmap e13: 2 total, 2 up, 2 in 2024-02-14T13:01:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:51 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-14T13:01:52.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:01:52.250+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7feea002d7e0 con 0x7fee880a20c0 2024-02-14T13:01:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:52 smithi012 ceph-mon[32370]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:52.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:52 smithi012 ceph-mon[32370]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:52.988 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:52 smithi103 ceph-mon[36921]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:52.988 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:52.988 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:52.989 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:52.989 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:52 smithi103 ceph-mon[36921]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:53.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:52 smithi055 ceph-mon[36853]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:01:53.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:01:53.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:01:53.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:01:53.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:52 smithi055 ceph-mon[36853]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:53.916 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:53 smithi103 ceph-mon[36921]: osdmap e14: 2 total, 2 up, 2 in 2024-02-14T13:01:53.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:53 smithi012 ceph-mon[32370]: osdmap e14: 2 total, 2 up, 2 in 2024-02-14T13:01:54.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:53 smithi055 ceph-mon[36853]: osdmap e14: 2 total, 2 up, 2 in 2024-02-14T13:01:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:54 smithi012 ceph-mon[32370]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:54.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:54 smithi103 ceph-mon[36921]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:55.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:54 smithi055 ceph-mon[36853]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:56.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:55 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/2547061182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]: dispatch 2024-02-14T13:01:56.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:55 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]: dispatch 2024-02-14T13:01:56.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:55 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]': finished 2024-02-14T13:01:56.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:55 smithi055 ceph-mon[36853]: osdmap e15: 3 total, 2 up, 3 in 2024-02-14T13:01:56.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:55 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:01:56.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:55 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/2680831962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:55 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/2547061182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]: dispatch 2024-02-14T13:01:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:55 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]: dispatch 2024-02-14T13:01:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:55 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]': finished 2024-02-14T13:01:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:55 smithi012 ceph-mon[32370]: osdmap e15: 3 total, 2 up, 3 in 2024-02-14T13:01:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:55 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:01:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:55 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/2680831962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:55 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/2547061182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]: dispatch 2024-02-14T13:01:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:55 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]: dispatch 2024-02-14T13:01:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:55 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa0a5301-f06a-43e3-9451-a8991fda5a4f"}]': finished 2024-02-14T13:01:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:55 smithi103 ceph-mon[36921]: osdmap e15: 3 total, 2 up, 3 in 2024-02-14T13:01:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:55 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:01:56.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:55 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/2680831962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:01:56.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:56 smithi103 ceph-mon[36921]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:57.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:56 smithi055 ceph-mon[36853]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:57.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:56 smithi012 ceph-mon[32370]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:58.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:01:58 smithi012 ceph-mon[32370]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:58.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:01:58 smithi103 ceph-mon[36921]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:01:58.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:01:58 smithi055 ceph-mon[36853]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:00.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:00 smithi103 ceph-mon[36921]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:00 smithi012 ceph-mon[32370]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:00.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:00 smithi055 ceph-mon[36853]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:02.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:02 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-14T13:02:02.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:02 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:02.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:02 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-14T13:02:02.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:02 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:02 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-14T13:02:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:02 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:03.438 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:03 smithi103 ceph-mon[36921]: Deploying daemon osd.2 on smithi103 2024-02-14T13:02:03.439 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:03 smithi103 ceph-mon[36921]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:03 smithi055 ceph-mon[36853]: Deploying daemon osd.2 on smithi103 2024-02-14T13:02:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:03 smithi055 ceph-mon[36853]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:03 smithi012 ceph-mon[32370]: Deploying daemon osd.2 on smithi103 2024-02-14T13:02:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:03 smithi012 ceph-mon[32370]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:04.703 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:04 smithi103 ceph-mon[36921]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:04.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:04 smithi055 ceph-mon[36853]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:04.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:04 smithi012 ceph-mon[32370]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:06.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:06 smithi103 ceph-mon[36921]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:06 smithi012 ceph-mon[32370]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:06 smithi055 ceph-mon[36853]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:08 smithi055 ceph-mon[36853]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:08 smithi012 ceph-mon[32370]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:08 smithi103 ceph-mon[36921]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:11.316 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.316 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.316 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:11.316 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:11.317 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.317 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:11 smithi103 ceph-mon[36921]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:11.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.369+0000 7fee9d7fa700 1 -- 172.21.15.103:0/3182833653 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feea002d7e0 con 0x7fee880a20c0 2024-02-14T13:02:11.370 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 2 on host 'smithi103' 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fee880a20c0 msgr2=0x7fee880a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fee880a20c0 0x7fee880a4580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feea0101cb0 tx=0x7fee90009190 comp rx=0 tx=0).stop 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 msgr2=0x7feea0109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 0x7feea0109bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b530 tx=0x7fee9400b840 comp rx=0 tx=0).stop 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 shutdown_connections 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feea01027f0 0x7feea010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fee880a20c0 0x7fee880a4580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feea0100c50 0x7feea010b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 --2- 172.21.15.103:0/3182833653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feea0101e50 0x7feea0109bb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 >> 172.21.15.103:0/3182833653 conn(0x7feea00fc210 msgr2=0x7feea0105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:02:11.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 shutdown_connections 2024-02-14T13:02:11.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:02:11.371+0000 7feea66bc700 1 -- 172.21.15.103:0/3182833653 wait complete. 2024-02-14T13:02:11.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:11.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:11.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:11 smithi055 ceph-mon[36853]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:11.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:11.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:11.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:11.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:11 smithi012 ceph-mon[32370]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:12.045 DEBUG:teuthology.orchestra.run.smithi103:osd.2> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.2.service 2024-02-14T13:02:12.047 INFO:tasks.cephadm:Deploying osd.3 on smithi012 with /dev/vg_nvme/lv_3... 2024-02-14T13:02:12.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-14T13:02:12.299 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:02:12.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:12.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:12.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:12.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:12 smithi012 ceph-mon[32370]: from='osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-14T13:02:12.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:12 smithi012 ceph-mon[32370]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-14T13:02:12.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:12 smithi012 ceph-mon[32370]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:12.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:12.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:12 smithi103 ceph-mon[36921]: from='osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-14T13:02:12.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:12 smithi103 ceph-mon[36921]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-14T13:02:12.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:12 smithi103 ceph-mon[36921]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:12 smithi055 ceph-mon[36853]: from='osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-14T13:02:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:12 smithi055 ceph-mon[36853]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-14T13:02:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:12 smithi055 ceph-mon[36853]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:13.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:13 smithi012 ceph-mon[32370]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-14T13:02:13.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:13 smithi012 ceph-mon[32370]: from='osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:02:13.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:13 smithi012 ceph-mon[32370]: osdmap e16: 3 total, 2 up, 3 in 2024-02-14T13:02:13.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:13.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:13 smithi012 ceph-mon[32370]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:02:13.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:13 smithi103 ceph-mon[36921]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-14T13:02:13.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:13 smithi103 ceph-mon[36921]: from='osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:02:13.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:13 smithi103 ceph-mon[36921]: osdmap e16: 3 total, 2 up, 3 in 2024-02-14T13:02:13.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:13.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:13 smithi103 ceph-mon[36921]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:02:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:13 smithi055 ceph-mon[36853]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-14T13:02:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:13 smithi055 ceph-mon[36853]: from='osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:02:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:13 smithi055 ceph-mon[36853]: osdmap e16: 3 total, 2 up, 3 in 2024-02-14T13:02:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:13.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:13 smithi055 ceph-mon[36853]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:02:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-14T13:02:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-14T13:02:14.301 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2024-02-14T13:02:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2024-02-14T13:02:14.301 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112091 s, 935 MB/s 2024-02-14T13:02:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2024-02-14T13:02:14.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-mon[36921]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:02:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-mon[36921]: osdmap e17: 3 total, 2 up, 3 in 2024-02-14T13:02:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-mon[36921]: from='osd.2 ' entity='osd.2' 2024-02-14T13:02:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-mon[36921]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:14.492 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2[42102]: 2024-02-14T13:02:14.214+0000 7fc90a95d700 -1 osd.2 0 waiting for initial osdmap 2024-02-14T13:02:14.492 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2[42102]: 2024-02-14T13:02:14.221+0000 7fc90174d700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:02:14.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:14 smithi012 ceph-mon[32370]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:02:14.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:14 smithi012 ceph-mon[32370]: osdmap e17: 3 total, 2 up, 3 in 2024-02-14T13:02:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:14 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:14 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:14 smithi012 ceph-mon[32370]: from='osd.2 ' entity='osd.2' 2024-02-14T13:02:14.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:14 smithi012 ceph-mon[32370]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:14 smithi055 ceph-mon[36853]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:02:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:14 smithi055 ceph-mon[36853]: osdmap e17: 3 total, 2 up, 3 in 2024-02-14T13:02:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:14 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:14 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:14 smithi055 ceph-mon[36853]: from='osd.2 ' entity='osd.2' 2024-02-14T13:02:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:14 smithi055 ceph-mon[36853]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-14T13:02:14.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2024-02-14T13:02:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:02:15.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:02:15.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:02:15.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi103 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi103 to 17080M 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] boot 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: osdmap e18: 3 total, 3 up, 3 in 2024-02-14T13:02:15.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi103 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi103 to 17080M 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:15.743 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:15.743 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.743 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] boot 2024-02-14T13:02:15.743 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: osdmap e18: 3 total, 3 up, 3 in 2024-02-14T13:02:15.743 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:15.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:02:15.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:02:15.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi103 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi103 to 17080M 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:15.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:15.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: osd.2 [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] boot 2024-02-14T13:02:15.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: osdmap e18: 3 total, 3 up, 3 in 2024-02-14T13:02:15.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-14T13:02:16.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:16 smithi012 ceph-mon[32370]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 -- 172.21.15.12:0/3221453183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0100cc0 msgr2=0x7fa8f01010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 --2- 172.21.15.12:0/3221453183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0100cc0 0x7fa8f01010e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00099c0 tx=0x7fa8e0009cd0 comp rx=0 tx=0).stop 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 -- 172.21.15.12:0/3221453183 shutdown_connections 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 --2- 172.21.15.12:0/3221453183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f0102860 0x7fa8f0109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 --2- 172.21.15.12:0/3221453183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0100cc0 0x7fa8f01010e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 --2- 172.21.15.12:0/3221453183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0101ec0 0x7fa8f0102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 -- 172.21.15.12:0/3221453183 >> 172.21.15.12:0/3221453183 conn(0x7fa8f00fc280 msgr2=0x7fa8f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 -- 172.21.15.12:0/3221453183 shutdown_connections 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.693+0000 7fa8f529f700 1 -- 172.21.15.12:0/3221453183 wait complete. 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 Processor -- start 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 -- start start 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f0100cc0 0x7fa8f006af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 0x7fa8f019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0102860 0x7fa8f019f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f019f890 con 0x7fa8f0101ec0 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f019fa00 con 0x7fa8f0102860 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8f529f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f019fbc0 con 0x7fa8f0100cc0 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.694+0000 7fa8ee7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 0x7fa8f019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 0x7fa8f019cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42122/0 (socket says 172.21.15.12:42122) 2024-02-14T13:02:16.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 -- 172.21.15.12:0/4268538403 learned_addr learned my addr 172.21.15.12:0/4268538403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8eeffd700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f0100cc0 0x7fa8f006af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ef7fe700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0102860 0x7fa8f019f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 -- 172.21.15.12:0/4268538403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f0100cc0 msgr2=0x7fa8f006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f0100cc0 0x7fa8f006af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 -- 172.21.15.12:0/4268538403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0102860 msgr2=0x7fa8f019f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0102860 0x7fa8f019f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 -- 172.21.15.12:0/4268538403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00095f0 con 0x7fa8f0101ec0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ef7fe700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0102860 0x7fa8f019f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8ee7fc700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 0x7fa8f019cab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400b530 tx=0x7fa8e400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4011830 con 0x7fa8f0101ec0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa8e4011e70 con 0x7fa8f0101ec0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400f340 con 0x7fa8f0101ec0 2024-02-14T13:02:16.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f019fea0 con 0x7fa8f0101ec0 2024-02-14T13:02:16.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.695+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f01a02c0 con 0x7fa8f0101ec0 2024-02-14T13:02:16.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.696+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f0068a20 con 0x7fa8f0101ec0 2024-02-14T13:02:16.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.698+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) v1 ==== 136712+0+0 (secure 0 0 0) 0x7fa8e40106d0 con 0x7fa8f0101ec0 2024-02-14T13:02:16.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.698+0000 7fa8d7fff700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa8d80a2140 0x7fa8d80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:16.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.698+0000 7fa8eeffd700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa8d80a2140 0x7fa8d80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:16.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.698+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2851+0+0 (secure 0 0 0) 0x7fa8e40cc6b0 con 0x7fa8f0101ec0 2024-02-14T13:02:16.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.699+0000 7fa8eeffd700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa8d80a2140 0x7fa8d80a4600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00038c0 tx=0x7fa8e000b540 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:02:16.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.702+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa8e4096c10 con 0x7fa8f0101ec0 2024-02-14T13:02:16.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:16 smithi103 ceph-mon[36921]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:16.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:16 smithi055 ceph-mon[36853]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:16.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:16.912+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8f002d9c0 con 0x7fa8d80a2140 2024-02-14T13:02:17.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:02:17.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:17 smithi012 ceph-mon[32370]: osdmap e19: 3 total, 3 up, 3 in 2024-02-14T13:02:17.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:17 smithi012 ceph-mon[32370]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:02:17.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:02:17.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:02:17.639 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:17.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:02:17.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:17 smithi103 ceph-mon[36921]: osdmap e19: 3 total, 3 up, 3 in 2024-02-14T13:02:17.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:17 smithi103 ceph-mon[36921]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:02:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:02:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:02:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:02:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:17 smithi055 ceph-mon[36853]: osdmap e19: 3 total, 3 up, 3 in 2024-02-14T13:02:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:17 smithi055 ceph-mon[36853]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:02:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:02:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:02:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:18.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:18 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-14T13:02:18.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:18 smithi012 ceph-mon[32370]: osdmap e20: 3 total, 3 up, 3 in 2024-02-14T13:02:18.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:18 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:02:18.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:18 smithi012 ceph-mon[32370]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:18 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-14T13:02:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:18 smithi103 ceph-mon[36921]: osdmap e20: 3 total, 3 up, 3 in 2024-02-14T13:02:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:18 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:02:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:18 smithi103 ceph-mon[36921]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:18 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-14T13:02:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:18 smithi055 ceph-mon[36853]: osdmap e20: 3 total, 3 up, 3 in 2024-02-14T13:02:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:18 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:02:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:18 smithi055 ceph-mon[36853]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:18.845 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:18 smithi012 sudo[51650]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-14T13:02:18.845 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:18 smithi012 sudo[51650]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:18.845 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:18 smithi012 sudo[51650]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:18.845 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:18 smithi012 sudo[51650]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:19.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:19 smithi012 sudo[51660]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-14T13:02:19.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:19 smithi012 sudo[51660]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:19.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:19 smithi012 sudo[51660]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:19.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:02:19 smithi012 sudo[51660]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:19 smithi012 ceph-mon[32370]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-14T13:02:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-14T13:02:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:19 smithi012 ceph-mon[32370]: osdmap e21: 3 total, 3 up, 3 in 2024-02-14T13:02:19.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:19 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:19.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:19 smithi103 ceph-mon[36921]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-14T13:02:19.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:19 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-14T13:02:19.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:19 smithi103 ceph-mon[36921]: osdmap e21: 3 total, 3 up, 3 in 2024-02-14T13:02:19.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:19 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:19.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:19 smithi055 ceph-mon[36853]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-14T13:02:19.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:19 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-14T13:02:19.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:19 smithi055 ceph-mon[36853]: osdmap e21: 3 total, 3 up, 3 in 2024-02-14T13:02:19.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:19 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:19.810 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45656]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-14T13:02:19.810 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:19.810 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45656]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:19.811 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45656]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:20.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:20.055+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fa8e4010380 con 0x7fa8f0101ec0 2024-02-14T13:02:20.310 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45659]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-14T13:02:20.310 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45659]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:20.311 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45659]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:20.311 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:02:19 smithi055 sudo[45659]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: osdmap e22: 3 total, 3 up, 3 in 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3021505403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7"}]: dispatch 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3021505403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7"}]': finished 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: osdmap e23: 4 total, 3 up, 4 in 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:20.474 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:20 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/517113135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:02:20.474 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45749]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-14T13:02:20.475 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45749]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:20.475 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45749]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:20.475 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45749]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: osdmap e22: 3 total, 3 up, 3 in 2024-02-14T13:02:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3021505403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7"}]: dispatch 2024-02-14T13:02:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3021505403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7"}]': finished 2024-02-14T13:02:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: osdmap e23: 4 total, 3 up, 4 in 2024-02-14T13:02:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:20.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-02-14T13:02:20.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:20.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/517113135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:02:20.741 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45752]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-14T13:02:20.741 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45752]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:20.741 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45752]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:20.741 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:02:20 smithi103 sudo[45752]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: osdmap e22: 3 total, 3 up, 3 in 2024-02-14T13:02:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3021505403' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7"}]: dispatch 2024-02-14T13:02:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3021505403' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7"}]': finished 2024-02-14T13:02:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: osdmap e23: 4 total, 3 up, 4 in 2024-02-14T13:02:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:20.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-02-14T13:02:20.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:20.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:20 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/517113135' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:02:21.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 sudo[51787]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-14T13:02:21.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 sudo[51787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:21.121 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 sudo[51787]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:21.121 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:20 smithi012 sudo[51787]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:21.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 sudo[51792]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-14T13:02:21.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 sudo[51792]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:21.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 sudo[51792]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:21.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 sudo[51792]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:21.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45755]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-14T13:02:21.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45755]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:21.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45755]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:21.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45755]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: Cluster is now healthy 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:21.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:21.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45758]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-14T13:02:21.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45758]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:21.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45758]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 sudo[45758]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: Cluster is now healthy 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:21.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: Cluster is now healthy 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:22.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:22.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:22.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:22.516 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45662]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-14T13:02:22.516 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45662]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:22.516 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45662]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:22.516 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45662]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:22.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45665]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-14T13:02:22.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45665]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45665]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 sudo[45665]: pam_unix(sudo:session): session closed for user root 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:22.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:22 smithi055 ceph-mon[36853]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:22.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:22.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:22.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:22.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:22.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:22.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:22 smithi012 ceph-mon[32370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:22.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:22.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-14T13:02:22.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-14T13:02:22.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-14T13:02:22.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-14T13:02:22.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:22.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:22 smithi103 ceph-mon[36921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-14T13:02:24.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:24 smithi012 ceph-mon[32370]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:24.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:24 smithi055 ceph-mon[36853]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:24.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:24 smithi103 ceph-mon[36921]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:26 smithi012 ceph-mon[32370]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:26.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:26 smithi103 ceph-mon[36921]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:26.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:26 smithi055 ceph-mon[36853]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:27.678 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:27 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-14T13:02:27.678 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:27 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:27.679 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:27 smithi012 ceph-mon[32370]: Deploying daemon osd.3 on smithi012 2024-02-14T13:02:27.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:27 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-14T13:02:27.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:27 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:27.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:27 smithi103 ceph-mon[36921]: Deploying daemon osd.3 on smithi012 2024-02-14T13:02:27.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:27 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-14T13:02:27.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:27 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:27.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:27 smithi055 ceph-mon[36853]: Deploying daemon osd.3 on smithi012 2024-02-14T13:02:28.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:28 smithi103 ceph-mon[36921]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-02-14T13:02:28.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:28 smithi055 ceph-mon[36853]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-02-14T13:02:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:28 smithi012 ceph-mon[32370]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-02-14T13:02:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:30 smithi012 ceph-mon[32370]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-02-14T13:02:30.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:30 smithi103 ceph-mon[36921]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-02-14T13:02:30.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:30 smithi055 ceph-mon[36853]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-02-14T13:02:32.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:32 smithi012 ceph-mon[32370]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-02-14T13:02:32.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:32 smithi103 ceph-mon[36921]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-02-14T13:02:32.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:32 smithi055 ceph-mon[36853]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-02-14T13:02:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:33 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:33 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:33 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:33 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:33 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:33 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:33.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:33 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:33.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:33 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:33.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:33 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:34.663 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:34 smithi012 ceph-mon[32370]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-02-14T13:02:34.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:34 smithi055 ceph-mon[36853]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-02-14T13:02:34.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:34 smithi103 ceph-mon[36921]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-02-14T13:02:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.068+0000 7fa8d7fff700 1 -- 172.21.15.12:0/4268538403 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa8f002d9c0 con 0x7fa8d80a2140 2024-02-14T13:02:36.070 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 3 on host 'smithi012' 2024-02-14T13:02:36.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa8d80a2140 msgr2=0x7fa8d80a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:36.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa8d80a2140 0x7fa8d80a4600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00038c0 tx=0x7fa8e000b540 comp rx=0 tx=0).stop 2024-02-14T13:02:36.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 msgr2=0x7fa8f019cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:36.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 0x7fa8f019cab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400b530 tx=0x7fa8e400b840 comp rx=0 tx=0).stop 2024-02-14T13:02:36.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 shutdown_connections 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8f0102860 0x7fa8f019f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8f0100cc0 0x7fa8f006af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa8d80a2140 0x7fa8d80a4600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 --2- 172.21.15.12:0/4268538403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8f0101ec0 0x7fa8f019cab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 >> 172.21.15.12:0/4268538403 conn(0x7fa8f00fc280 msgr2=0x7fa8f0105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 shutdown_connections 2024-02-14T13:02:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:02:36.070+0000 7fa8f529f700 1 -- 172.21.15.12:0/4268538403 wait complete. 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:36.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:36.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:36.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:36.645 DEBUG:teuthology.orchestra.run.smithi012:osd.3> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.3.service 2024-02-14T13:02:36.647 INFO:tasks.cephadm:Deploying osd.4 on smithi055 with /dev/vg_nvme/lv_3... 2024-02-14T13:02:36.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-14T13:02:36.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:36.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:36.906 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:02:37.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:37 smithi055 ceph-mon[36853]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-02-14T13:02:37.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:37 smithi055 ceph-mon[36853]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-14T13:02:37.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:37 smithi012 ceph-mon[32370]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-02-14T13:02:37.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:37 smithi012 ceph-mon[32370]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-14T13:02:37.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:37 smithi103 ceph-mon[36921]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-02-14T13:02:37.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:37 smithi103 ceph-mon[36921]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: osdmap e24: 4 total, 3 up, 4 in 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: osdmap e25: 4 total, 3 up, 4 in 2024-02-14T13:02:38.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:38 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: osdmap e24: 4 total, 3 up, 4 in 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: osdmap e25: 4 total, 3 up, 4 in 2024-02-14T13:02:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:38 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:38.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-14T13:02:38.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: osdmap e24: 4 total, 3 up, 4 in 2024-02-14T13:02:38.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:02:38.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:38.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:02:38.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: osdmap e25: 4 total, 3 up, 4 in 2024-02-14T13:02:38.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:38 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-14T13:02:38.901 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-14T13:02:38.902 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-02-14T13:02:38.902 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-02-14T13:02:38.902 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113526 s, 924 MB/s 2024-02-14T13:02:38.902 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-02-14T13:02:39.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:02:39.156+0000 7fb7a2ec1700 -1 osd.3 0 waiting for initial osdmap 2024-02-14T13:02:39.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:02:39.165+0000 7fb79b4b4700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:02:39.517 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.517 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:39 smithi055 ceph-mon[36853]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:39.517 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:39 smithi055 ceph-mon[36853]: osdmap e26: 4 total, 3 up, 4 in 2024-02-14T13:02:39.517 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.517 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:39 smithi055 ceph-mon[36853]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' 2024-02-14T13:02:39.517 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.518 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_3 2024-02-14T13:02:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-mon[32370]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-mon[32370]: osdmap e26: 4 total, 3 up, 4 in 2024-02-14T13:02:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-mon[32370]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' 2024-02-14T13:02:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:39 smithi103 ceph-mon[36921]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-02-14T13:02:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:39 smithi103 ceph-mon[36921]: osdmap e26: 4 total, 3 up, 4 in 2024-02-14T13:02:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:39 smithi103 ceph-mon[36921]: from='osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866]' entity='osd.3' 2024-02-14T13:02:39.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:39.772 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:02:40.422 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] boot 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: osdmap e27: 4 total, 4 up, 4 in 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:40.423 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:02:40.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:02:40.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] boot 2024-02-14T13:02:40.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: osdmap e27: 4 total, 4 up, 4 in 2024-02-14T13:02:40.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:40.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: osd.3 [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] boot 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: osdmap e27: 4 total, 4 up, 4 in 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:02:40.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 -- 172.21.15.55:0/1690049629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 msgr2=0x7f13dc101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 --2- 172.21.15.55:0/1690049629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc101060 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0099c0 tx=0x7f13cc009cd0 comp rx=0 tx=0).stop 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 -- 172.21.15.55:0/1690049629 shutdown_connections 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 --2- 172.21.15.55:0/1690049629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 0x7f13dc109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 --2- 172.21.15.55:0/1690049629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc101060 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 --2- 172.21.15.55:0/1690049629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13dc101e40 0x7f13dc1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 -- 172.21.15.55:0/1690049629 >> 172.21.15.55:0/1690049629 conn(0x7f13dc0fc1e0 msgr2=0x7f13dc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 -- 172.21.15.55:0/1690049629 shutdown_connections 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.189+0000 7f13e13b7700 1 -- 172.21.15.55:0/1690049629 wait complete. 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.190+0000 7f13e13b7700 1 Processor -- start 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.190+0000 7f13e13b7700 1 -- start start 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.190+0000 7f13e13b7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc06adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.190+0000 7f13e13b7700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13dc101e40 0x7f13dc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.190+0000 7f13e13b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 0x7f13dc19f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13e13b7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19f810 con 0x7f13dc1027e0 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13e13b7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19f980 con 0x7f13dc100c40 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13e13b7700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19fb40 con 0x7f13dc101e40 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc06adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc06adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35520/0 (socket says 172.21.15.55:35520) 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 -- 172.21.15.55:0/2388133970 learned_addr learned my addr 172.21.15.55:0/2388133970 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13db7fe700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 0x7f13dc19f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 -- 172.21.15.55:0/2388133970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13dc101e40 msgr2=0x7f13dc19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13da7fc700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13dc101e40 0x7f13dc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13dc101e40 0x7f13dc19ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 -- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 msgr2=0x7f13dc19f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 0x7f13dc19f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 -- 172.21.15.55:0/2388133970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0095f0 con 0x7f13dc100c40 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13db7fe700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 0x7f13dc19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13daffd700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc06adc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00b580 tx=0x7f13cc00f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:02:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc01d070 con 0x7f13dc100c40 2024-02-14T13:02:41.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f13cc00fbf0 con 0x7f13dc100c40 2024-02-14T13:02:41.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc19fdc0 con 0x7f13dc100c40 2024-02-14T13:02:41.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc017650 con 0x7f13dc100c40 2024-02-14T13:02:41.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.191+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc1a0180 con 0x7f13dc100c40 2024-02-14T13:02:41.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.192+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc108000 con 0x7f13dc100c40 2024-02-14T13:02:41.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.193+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mon.2 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f13cc022470 con 0x7f13dc100c40 2024-02-14T13:02:41.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.194+0000 7f13c3fff700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13c40a2150 0x7f13c40a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:02:41.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.194+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mon.2 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f13cc022e40 con 0x7f13dc100c40 2024-02-14T13:02:41.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.194+0000 7f13da7fc700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13c40a2150 0x7f13c40a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:02:41.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.195+0000 7f13da7fc700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13c40a2150 0x7f13c40a4610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13dc06b340 tx=0x7f13d0005cf0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:02:41.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.199+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mon.2 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f13cc098250 con 0x7f13dc100c40 2024-02-14T13:02:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:02:41.411+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f13dc02da10 con 0x7f13c40a2150 2024-02-14T13:02:41.413 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:41 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi012 2024-02-14T13:02:41.413 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:41 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi012 to 8546M 2024-02-14T13:02:41.413 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:41 smithi055 ceph-mon[36853]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:41.413 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:41 smithi055 ceph-mon[36853]: osdmap e28: 4 total, 4 up, 4 in 2024-02-14T13:02:41.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:41 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi012 2024-02-14T13:02:41.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:41 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi012 to 8546M 2024-02-14T13:02:41.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:41 smithi012 ceph-mon[32370]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:41.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:41 smithi012 ceph-mon[32370]: osdmap e28: 4 total, 4 up, 4 in 2024-02-14T13:02:41.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:41 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi012 2024-02-14T13:02:41.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:41 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi012 to 8546M 2024-02-14T13:02:41.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:41 smithi103 ceph-mon[36921]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:41.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:41 smithi103 ceph-mon[36921]: osdmap e28: 4 total, 4 up, 4 in 2024-02-14T13:02:42.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:42 smithi055 ceph-mon[36853]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:02:42.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:02:42.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:02:42.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:42.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:42 smithi055 ceph-mon[36853]: osdmap e29: 4 total, 4 up, 4 in 2024-02-14T13:02:42.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:42 smithi055 ceph-mon[36853]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-14T13:02:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:42 smithi012 ceph-mon[32370]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:02:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:02:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:02:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:42 smithi012 ceph-mon[32370]: osdmap e29: 4 total, 4 up, 4 in 2024-02-14T13:02:42.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:42 smithi012 ceph-mon[32370]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-14T13:02:42.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:42 smithi103 ceph-mon[36921]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:02:42.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:02:42.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:02:42.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:42.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:42 smithi103 ceph-mon[36921]: osdmap e29: 4 total, 4 up, 4 in 2024-02-14T13:02:42.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:42 smithi103 ceph-mon[36921]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-14T13:02:43.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:43 smithi055 ceph-mon[36853]: osdmap e30: 4 total, 4 up, 4 in 2024-02-14T13:02:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:43 smithi012 ceph-mon[32370]: osdmap e30: 4 total, 4 up, 4 in 2024-02-14T13:02:43.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:43 smithi103 ceph-mon[36921]: osdmap e30: 4 total, 4 up, 4 in 2024-02-14T13:02:44.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: osdmap e31: 4 total, 4 up, 4 in 2024-02-14T13:02:44.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/2592570630' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]: dispatch 2024-02-14T13:02:44.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]: dispatch 2024-02-14T13:02:44.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]': finished 2024-02-14T13:02:44.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: osdmap e32: 5 total, 4 up, 5 in 2024-02-14T13:02:44.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:02:44.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:44 smithi055 ceph-mon[36853]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-02-14T13:02:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: osdmap e31: 4 total, 4 up, 4 in 2024-02-14T13:02:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/2592570630' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]: dispatch 2024-02-14T13:02:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]: dispatch 2024-02-14T13:02:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]': finished 2024-02-14T13:02:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: osdmap e32: 5 total, 4 up, 5 in 2024-02-14T13:02:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:02:44.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:44 smithi012 ceph-mon[32370]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-02-14T13:02:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: osdmap e31: 4 total, 4 up, 4 in 2024-02-14T13:02:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/2592570630' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]: dispatch 2024-02-14T13:02:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]: dispatch 2024-02-14T13:02:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab18809-48a8-4c56-b06a-fc56396a0246"}]': finished 2024-02-14T13:02:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: osdmap e32: 5 total, 4 up, 5 in 2024-02-14T13:02:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:02:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:44 smithi103 ceph-mon[36921]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-02-14T13:02:45.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:45 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/3299435393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:02:45.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:45 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/3299435393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:02:46.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:45 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/3299435393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:02:46.887 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:46 smithi012 ceph-mon[32370]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:02:46.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:46 smithi103 ceph-mon[36921]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:02:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:46 smithi055 ceph-mon[36853]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:02:48.372 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:02:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:02:48.299+0000 7fc92045b700 -1 calc_pg_upmaps abort due to max <= 0 2024-02-14T13:02:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:48 smithi012 ceph-mon[32370]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:48.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:48 smithi103 ceph-mon[36921]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:48.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:48 smithi055 ceph-mon[36853]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:50.667 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:50 smithi055 ceph-mon[36853]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:50 smithi012 ceph-mon[32370]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:50.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:50 smithi103 ceph-mon[36921]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:52.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-14T13:02:52.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:52.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-14T13:02:52.720 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-14T13:02:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:02:53.488 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:53 smithi055 ceph-mon[36853]: Deploying daemon osd.4 on smithi055 2024-02-14T13:02:53.488 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:53 smithi055 ceph-mon[36853]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:53.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:53 smithi012 ceph-mon[32370]: Deploying daemon osd.4 on smithi055 2024-02-14T13:02:53.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:53 smithi012 ceph-mon[32370]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:53 smithi103 ceph-mon[36921]: Deploying daemon osd.4 on smithi055 2024-02-14T13:02:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:53 smithi103 ceph-mon[36921]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:54.762 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:54 smithi055 ceph-mon[36853]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:54 smithi012 ceph-mon[32370]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:54.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:54 smithi103 ceph-mon[36921]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:56 smithi012 ceph-mon[32370]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:56.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:56 smithi103 ceph-mon[36921]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:56.767 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:56 smithi055 ceph-mon[36853]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:58.921 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:58.921 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:58.921 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:58.922 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:02:58 smithi055 ceph-mon[36853]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:58.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:58.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:58.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:58.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:02:58 smithi012 ceph-mon[32370]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:02:58.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:58.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:02:58.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:02:58.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:02:58 smithi103 ceph-mon[36921]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:01.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.128+0000 7f13c3fff700 1 -- 172.21.15.55:0/2388133970 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f13dc02da10 con 0x7f13c40a2150 2024-02-14T13:03:01.132 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 4 on host 'smithi055' 2024-02-14T13:03:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13c40a2150 msgr2=0x7f13c40a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:01.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13c40a2150 0x7f13c40a4610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13dc06b340 tx=0x7f13d0005cf0 comp rx=0 tx=0).stop 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 msgr2=0x7f13dc06adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc06adc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00b580 tx=0x7f13cc00f740 comp rx=0 tx=0).stop 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 shutdown_connections 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13c40a2150 0x7f13c40a4610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13dc1027e0 0x7f13dc19f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc100c40 0x7f13dc06adc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 --2- 172.21.15.55:0/2388133970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13dc101e40 0x7f13dc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 >> 172.21.15.55:0/2388133970 conn(0x7f13dc0fc1e0 msgr2=0x7f13dc105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 shutdown_connections 2024-02-14T13:03:01.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:01.131+0000 7f13e13b7700 1 -- 172.21.15.55:0/2388133970 wait complete. 2024-02-14T13:03:01.438 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:01.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:01 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:01.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:01 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:01.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:01 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:01.744 DEBUG:teuthology.orchestra.run.smithi055:osd.4> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.4.service 2024-02-14T13:03:01.748 INFO:tasks.cephadm:Deploying osd.5 on smithi103 with /dev/vg_nvme/lv_3... 2024-02-14T13:03:01.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-14T13:03:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:03:02.385 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:02 smithi103 ceph-mon[36921]: from='osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-14T13:03:02.385 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:02 smithi103 ceph-mon[36921]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-14T13:03:02.559 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:02 smithi055 ceph-mon[36853]: from='osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-14T13:03:02.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:02 smithi055 ceph-mon[36853]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-14T13:03:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:02 smithi012 ceph-mon[32370]: from='osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-14T13:03:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:02 smithi012 ceph-mon[32370]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-14T13:03:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-mon[36853]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:03.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-mon[36853]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-14T13:03:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-mon[36853]: from='osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:03:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-mon[36853]: osdmap e33: 5 total, 4 up, 5 in 2024-02-14T13:03:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:03.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-mon[36853]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:03:03.561 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:03:03.319+0000 7f3e76e65700 -1 osd.4 0 waiting for initial osdmap 2024-02-14T13:03:03.561 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:03:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:03:03.331+0000 7f3e73460700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:03:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:03 smithi012 ceph-mon[32370]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:03 smithi012 ceph-mon[32370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-14T13:03:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:03 smithi012 ceph-mon[32370]: from='osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:03:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:03 smithi012 ceph-mon[32370]: osdmap e33: 5 total, 4 up, 5 in 2024-02-14T13:03:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:03 smithi012 ceph-mon[32370]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:03:03.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:03 smithi103 ceph-mon[36921]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:03.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:03 smithi103 ceph-mon[36921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-14T13:03:03.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:03 smithi103 ceph-mon[36921]: from='osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:03:03.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:03 smithi103 ceph-mon[36921]: osdmap e33: 5 total, 4 up, 5 in 2024-02-14T13:03:03.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:03.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:03 smithi103 ceph-mon[36921]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:03:03.833 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-14T13:03:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-14T13:03:03.834 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-02-14T13:03:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-02-14T13:03:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113579 s, 923 MB/s 2024-02-14T13:03:03.834 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 2024-02-14T13:03:03.834 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-02-14T13:03:04.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:04 smithi055 ceph-mon[36853]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:03:04.440 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:04 smithi055 ceph-mon[36853]: osdmap e34: 5 total, 4 up, 5 in 2024-02-14T13:03:04.440 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:04 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:04.440 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:04 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:04.440 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:04 smithi055 ceph-mon[36853]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:04.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:04 smithi103 ceph-mon[36921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:03:04.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:04 smithi103 ceph-mon[36921]: osdmap e34: 5 total, 4 up, 5 in 2024-02-14T13:03:04.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:04 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:04.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:04 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:04.445 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:04 smithi103 ceph-mon[36921]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:04.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-02-14T13:03:04.717 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:03:04.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:04 smithi012 ceph-mon[32370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:03:04.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:04 smithi012 ceph-mon[32370]: osdmap e34: 5 total, 4 up, 5 in 2024-02-14T13:03:04.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:04.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:04 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:04.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:04 smithi012 ceph-mon[32370]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-02-14T13:03:05.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:03:05.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:03:05.660 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] boot 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: osdmap e35: 5 total, 5 up, 5 in 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi055 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi055 to 8542M 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:05.661 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:05 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:03:05.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:03:05.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] boot 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: osdmap e35: 5 total, 5 up, 5 in 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi055 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi055 to 8542M 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:05.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:05 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:03:05.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: osd.4 [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] boot 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: osdmap e35: 5 total, 5 up, 5 in 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi055 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi055 to 8542M 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:05.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:05 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:06.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 -- 172.21.15.103:0/37393929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 msgr2=0x7f4fd81022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/37393929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd81022a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009990 tx=0x7f4fcc009ca0 comp rx=0 tx=0).stop 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 -- 172.21.15.103:0/37393929 shutdown_connections 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/37393929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 0x7f4fd8109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/37393929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 0x7f4fd8101060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/37393929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd81022a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 -- 172.21.15.103:0/37393929 >> 172.21.15.103:0/37393929 conn(0x7f4fd80fc1e0 msgr2=0x7f4fd80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.215+0000 7f4fddcc5700 1 -- 172.21.15.103:0/37393929 shutdown_connections 2024-02-14T13:03:06.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.216+0000 7f4fddcc5700 1 -- 172.21.15.103:0/37393929 wait complete. 2024-02-14T13:03:06.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.216+0000 7f4fddcc5700 1 Processor -- start 2024-02-14T13:03:06.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.216+0000 7f4fddcc5700 1 -- start start 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.216+0000 7f4fddcc5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 0x7f4fd810b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd8109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 0x7f4fd810a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd810a860 con 0x7f4fd8100c40 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd810a9d0 con 0x7f4fd81027e0 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81a1d40 con 0x7f4fd8101e40 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd8109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd8109ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53810/0 (socket says 172.21.15.103:53810) 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 -- 172.21.15.103:0/2542153187 learned_addr learned my addr 172.21.15.103:0/2542153187 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd77fe700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 0x7f4fd810b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd7fff700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 0x7f4fd810a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 -- 172.21.15.103:0/2542153187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 msgr2=0x7f4fd810a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:06.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 0x7f4fd810a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 -- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 msgr2=0x7f4fd810b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 0x7f4fd810b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 -- 172.21.15.103:0/2542153187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0095f0 con 0x7f4fd8101e40 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd77fe700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 0x7f4fd810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd7fff700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 0x7f4fd810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fc7fff700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd8109ba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0095c0 tx=0x7f4fcc00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc01d070 con 0x7f4fd8101e40 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4fcc00fbf0 con 0x7f4fd8101e40 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0173f0 con 0x7f4fd8101e40 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd81a1fc0 con 0x7f4fd8101e40 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.217+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd81a2320 con 0x7f4fd8101e40 2024-02-14T13:03:06.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.218+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8108000 con 0x7f4fd8101e40 2024-02-14T13:03:06.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.220+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f4fcc0039d0 con 0x7f4fd8101e40 2024-02-14T13:03:06.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.220+0000 7f4fd57fa700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4fc00a2150 0x7f4fc00a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:06.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.220+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f4fcc0ce120 con 0x7f4fd8101e40 2024-02-14T13:03:06.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.220+0000 7f4fd77fe700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4fc00a2150 0x7f4fc00a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:06.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.221+0000 7f4fd77fe700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4fc00a2150 0x7f4fc00a4610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8101ca0 tx=0x7f4fc8009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:03:06.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.224+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4fcc0981f0 con 0x7f4fd8101e40 2024-02-14T13:03:06.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:06.424+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fd802da20 con 0x7f4fc00a2150 2024-02-14T13:03:06.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:06 smithi103 ceph-mon[36921]: osdmap e36: 5 total, 5 up, 5 in 2024-02-14T13:03:06.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:06 smithi103 ceph-mon[36921]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:06.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:06 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:06.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:06 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:06.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:06 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:06 smithi055 ceph-mon[36853]: osdmap e36: 5 total, 5 up, 5 in 2024-02-14T13:03:06.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:06 smithi055 ceph-mon[36853]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:06.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:06 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:06.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:06 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:06.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:06 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:06.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:06 smithi012 ceph-mon[32370]: osdmap e36: 5 total, 5 up, 5 in 2024-02-14T13:03:06.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:06 smithi012 ceph-mon[32370]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:06.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:06 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:06.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:06 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:06.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:06 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:07.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:07 smithi103 ceph-mon[36921]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:07.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:07 smithi055 ceph-mon[36853]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:07.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:07 smithi012 ceph-mon[32370]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:08 smithi055 ceph-mon[36853]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:08.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:08 smithi012 ceph-mon[32370]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:08.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:08 smithi103 ceph-mon[36921]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:09.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:09 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/500089056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]: dispatch 2024-02-14T13:03:09.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:09 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]: dispatch 2024-02-14T13:03:09.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:09 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]': finished 2024-02-14T13:03:09.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:09 smithi103 ceph-mon[36921]: osdmap e37: 6 total, 5 up, 6 in 2024-02-14T13:03:09.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:09 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:09 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/500089056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]: dispatch 2024-02-14T13:03:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:09 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]: dispatch 2024-02-14T13:03:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:09 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]': finished 2024-02-14T13:03:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:09 smithi055 ceph-mon[36853]: osdmap e37: 6 total, 5 up, 6 in 2024-02-14T13:03:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:09 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:09.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:09 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/500089056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]: dispatch 2024-02-14T13:03:09.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:09 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]: dispatch 2024-02-14T13:03:09.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:09 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04b0e92e-887f-4551-a3b8-a0df3d9de9a6"}]': finished 2024-02-14T13:03:09.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:09 smithi012 ceph-mon[32370]: osdmap e37: 6 total, 5 up, 6 in 2024-02-14T13:03:09.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:09 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:10.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:10 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/3924743930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:03:10.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:10 smithi055 ceph-mon[36853]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:10.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:10 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/3924743930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:03:10.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:10 smithi012 ceph-mon[32370]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:10.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:10 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/3924743930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:03:10.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:10 smithi103 ceph-mon[36921]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:12.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:12 smithi012 ceph-mon[32370]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:12 smithi103 ceph-mon[36921]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:12 smithi055 ceph-mon[36853]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:14.639 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:14 smithi103 ceph-mon[36921]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:14.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:14 smithi055 ceph-mon[36853]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:14 smithi012 ceph-mon[32370]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:16.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:16 smithi012 ceph-mon[32370]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:16.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:16 smithi103 ceph-mon[36921]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:16.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:16 smithi055 ceph-mon[36853]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:17.478 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-14T13:03:17.478 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:17.478 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:17 smithi103 ceph-mon[36921]: Deploying daemon osd.5 on smithi103 2024-02-14T13:03:17.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-14T13:03:17.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:17.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:17 smithi012 ceph-mon[32370]: Deploying daemon osd.5 on smithi103 2024-02-14T13:03:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-14T13:03:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:17.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:17 smithi055 ceph-mon[36853]: Deploying daemon osd.5 on smithi103 2024-02-14T13:03:18.626 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:18 smithi103 ceph-mon[36921]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:18 smithi012 ceph-mon[32370]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:18 smithi055 ceph-mon[36853]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:20.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:20 smithi103 ceph-mon[36921]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:20 smithi012 ceph-mon[32370]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:20.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:20 smithi055 ceph-mon[36853]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:22.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:22.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:22.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:21 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:22.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:22.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:22.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:21 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:21 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:23.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:22 smithi103 ceph-mon[36921]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:23.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:22 smithi055 ceph-mon[36853]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:22 smithi012 ceph-mon[32370]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:24 smithi103 ceph-mon[36921]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:24.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:24 smithi055 ceph-mon[36853]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:24 smithi012 ceph-mon[32370]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:25.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.188+0000 7f4fd57fa700 1 -- 172.21.15.103:0/2542153187 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4fd802da20 con 0x7f4fc00a2150 2024-02-14T13:03:25.191 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 5 on host 'smithi103' 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4fc00a2150 msgr2=0x7f4fc00a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4fc00a2150 0x7f4fc00a4610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8101ca0 tx=0x7f4fc8009040 comp rx=0 tx=0).stop 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 msgr2=0x7f4fd8109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd8109ba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0095c0 tx=0x7f4fcc00f740 comp rx=0 tx=0).stop 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 shutdown_connections 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fd81027e0 0x7f4fd810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4fc00a2150 0x7f4fc00a4610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fd8100c40 0x7f4fd810b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 --2- 172.21.15.103:0/2542153187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fd8101e40 0x7f4fd8109ba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 >> 172.21.15.103:0/2542153187 conn(0x7f4fd80fc1e0 msgr2=0x7f4fd8105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 shutdown_connections 2024-02-14T13:03:25.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:03:25.191+0000 7f4fddcc5700 1 -- 172.21.15.103:0/2542153187 wait complete. 2024-02-14T13:03:25.841 DEBUG:teuthology.orchestra.run.smithi103:osd.5> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.5.service 2024-02-14T13:03:25.843 INFO:tasks.cephadm:Deploying osd.6 on smithi012 with /dev/vg_nvme/lv_2... 2024-02-14T13:03:25.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-14T13:03:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:03:26.458 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.458 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.458 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.458 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.458 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:26 smithi103 ceph-mon[36921]: from='osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-14T13:03:26.458 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:26 smithi103 ceph-mon[36921]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-14T13:03:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:26 smithi012 ceph-mon[32370]: from='osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-14T13:03:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:26 smithi012 ceph-mon[32370]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-14T13:03:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:26 smithi055 ceph-mon[36853]: from='osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-14T13:03:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:26 smithi055 ceph-mon[36853]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-14T13:03:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:27 smithi103 ceph-mon[36921]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:27 smithi103 ceph-mon[36921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-14T13:03:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:27 smithi103 ceph-mon[36921]: osdmap e38: 6 total, 5 up, 6 in 2024-02-14T13:03:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:27 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:27 smithi103 ceph-mon[36921]: from='osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:03:27.395 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:27 smithi103 ceph-mon[36921]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:03:27.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:27 smithi012 ceph-mon[32370]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:27.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:27 smithi012 ceph-mon[32370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-14T13:03:27.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:27 smithi012 ceph-mon[32370]: osdmap e38: 6 total, 5 up, 6 in 2024-02-14T13:03:27.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:27 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:27.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:27 smithi012 ceph-mon[32370]: from='osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:03:27.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:27 smithi012 ceph-mon[32370]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:03:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:27 smithi055 ceph-mon[36853]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:27 smithi055 ceph-mon[36853]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-14T13:03:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:27 smithi055 ceph-mon[36853]: osdmap e38: 6 total, 5 up, 6 in 2024-02-14T13:03:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:27 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:27 smithi055 ceph-mon[36853]: from='osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:03:27.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:27 smithi055 ceph-mon[36853]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:03:28.063 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-14T13:03:28.063 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-14T13:03:28.063 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2024-02-14T13:03:28.063 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2024-02-14T13:03:28.064 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117114 s, 895 MB/s 2024-02-14T13:03:28.064 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2024-02-14T13:03:28.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-mon[36921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:03:28.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-mon[36921]: osdmap e39: 6 total, 5 up, 6 in 2024-02-14T13:03:28.643 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:28.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:28.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-mon[36921]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:28.644 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-mon[36921]: from='osd.5 ' entity='osd.5' 2024-02-14T13:03:28.644 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:03:28.356+0000 7f62938b1700 -1 osd.5 0 waiting for initial osdmap 2024-02-14T13:03:28.644 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:03:28 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:03:28.369+0000 7f628a6a1700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:03:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:28 smithi012 ceph-mon[32370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:03:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:28 smithi012 ceph-mon[32370]: osdmap e39: 6 total, 5 up, 6 in 2024-02-14T13:03:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:28 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:28 smithi012 ceph-mon[32370]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:28 smithi012 ceph-mon[32370]: from='osd.5 ' entity='osd.5' 2024-02-14T13:03:28.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2024-02-14T13:03:28.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:28 smithi055 ceph-mon[36853]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:03:28.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:28 smithi055 ceph-mon[36853]: osdmap e39: 6 total, 5 up, 6 in 2024-02-14T13:03:28.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:28 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:28.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:28 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:28.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:28 smithi055 ceph-mon[36853]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-14T13:03:28.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:28 smithi055 ceph-mon[36853]: from='osd.5 ' entity='osd.5' 2024-02-14T13:03:28.993 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:03:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:03:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:03:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] boot 2024-02-14T13:03:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: osdmap e40: 6 total, 6 up, 6 in 2024-02-14T13:03:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: osdmap e41: 6 total, 6 up, 6 in 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi103 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi103 to 8540M 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:29.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] boot 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: osdmap e40: 6 total, 6 up, 6 in 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: osdmap e41: 6 total, 6 up, 6 in 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi103 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi103 to 8540M 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:29.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:29.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:29.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:29.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: osd.5 [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] boot 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: osdmap e40: 6 total, 6 up, 6 in 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: osdmap e41: 6 total, 6 up, 6 in 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi103 2024-02-14T13:03:29.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi103 to 8540M 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:29.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 -- 172.21.15.12:0/605676366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff470102f50 msgr2=0x7ff4701033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 --2- 172.21.15.12:0/605676366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff470102f50 0x7ff4701033b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4580099c0 tx=0x7ff458009cd0 comp rx=0 tx=0).stop 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 -- 172.21.15.12:0/605676366 shutdown_connections 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 --2- 172.21.15.12:0/605676366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4701038f0 0x7ff47010a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 --2- 172.21.15.12:0/605676366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 0x7ff470102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 --2- 172.21.15.12:0/605676366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff470102f50 0x7ff4701033b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 -- 172.21.15.12:0/605676366 >> 172.21.15.12:0/605676366 conn(0x7ff4700fd330 msgr2=0x7ff4700ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 -- 172.21.15.12:0/605676366 shutdown_connections 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.599+0000 7ff47543f700 1 -- 172.21.15.12:0/605676366 wait complete. 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 Processor -- start 2024-02-14T13:03:30.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 -- start start 2024-02-14T13:03:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 0x7ff470197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff470102f50 0x7ff4701981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 0x7ff47019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47019f830 con 0x7ff4701038f0 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47019f970 con 0x7ff470101d50 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff47543f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47019fb30 con 0x7ff470102f50 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff46f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 0x7ff47019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff46f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 0x7ff47019f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55274/0 (socket says 172.21.15.12:55274) 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.600+0000 7ff46f7fe700 1 -- 172.21.15.12:0/212326781 learned_addr learned my addr 172.21.15.12:0/212326781 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46e7fc700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff470102f50 0x7ff4701981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46effd700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 0x7ff470197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46f7fe700 1 -- 172.21.15.12:0/212326781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff470102f50 msgr2=0x7ff4701981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46f7fe700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff470102f50 0x7ff4701981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46f7fe700 1 -- 172.21.15.12:0/212326781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 msgr2=0x7ff470197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46f7fe700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 0x7ff470197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46f7fe700 1 -- 172.21.15.12:0/212326781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580095f0 con 0x7ff4701038f0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46effd700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 0x7ff470197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff46f7fe700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 0x7ff47019f260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff46800e940 tx=0x7ff46800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680097b0 con 0x7ff4701038f0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff46800ee90 con 0x7ff4701038f0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680055e0 con 0x7ff4701038f0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47019fe10 con 0x7ff4701038f0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.601+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4701a0230 con 0x7ff4701038f0 2024-02-14T13:03:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.602+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff470068a20 con 0x7ff4701038f0 2024-02-14T13:03:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.603+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff46800cc60 con 0x7ff4701038f0 2024-02-14T13:03:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.604+0000 7ff467fff700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff45c0a2150 0x7ff45c0a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.604+0000 7ff46effd700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff45c0a2150 0x7ff45c0a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.604+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4533+0+0 (secure 0 0 0) 0x7ff468014070 con 0x7ff4701038f0 2024-02-14T13:03:30.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.604+0000 7ff46effd700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff45c0a2150 0x7ff45c0a4610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff470198b90 tx=0x7ff460009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:03:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.608+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff468097010 con 0x7ff4701038f0 2024-02-14T13:03:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:30 smithi012 ceph-mon[32370]: osdmap e42: 6 total, 6 up, 6 in 2024-02-14T13:03:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:30 smithi012 ceph-mon[32370]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:30.771 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:30 smithi103 ceph-mon[36921]: osdmap e42: 6 total, 6 up, 6 in 2024-02-14T13:03:30.771 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:30 smithi103 ceph-mon[36921]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:30.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:30 smithi055 ceph-mon[36853]: osdmap e42: 6 total, 6 up, 6 in 2024-02-14T13:03:30.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:30 smithi055 ceph-mon[36853]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:30.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:30.820+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47002d9c0 con 0x7ff45c0a2150 2024-02-14T13:03:31.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:31 smithi012 ceph-mon[32370]: osdmap e43: 6 total, 6 up, 6 in 2024-02-14T13:03:31.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:31 smithi012 ceph-mon[32370]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:31.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:31.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:31.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:31.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:31 smithi055 ceph-mon[36853]: osdmap e43: 6 total, 6 up, 6 in 2024-02-14T13:03:31.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:31 smithi055 ceph-mon[36853]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:31.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:31.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:31.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:31.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:31 smithi103 ceph-mon[36921]: osdmap e43: 6 total, 6 up, 6 in 2024-02-14T13:03:31.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:31 smithi103 ceph-mon[36921]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:31.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:31.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:31.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:32.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:32 smithi012 ceph-mon[32370]: osdmap e44: 6 total, 6 up, 6 in 2024-02-14T13:03:32.649 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:32 smithi012 ceph-mon[32370]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-02-14T13:03:32.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:32 smithi055 ceph-mon[36853]: osdmap e44: 6 total, 6 up, 6 in 2024-02-14T13:03:32.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:32 smithi055 ceph-mon[36853]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-02-14T13:03:32.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:32 smithi103 ceph-mon[36921]: osdmap e44: 6 total, 6 up, 6 in 2024-02-14T13:03:32.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:32 smithi103 ceph-mon[36921]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-02-14T13:03:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:33 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/200687129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6290f434-6daf-4e1f-b599-8478726c0696"}]: dispatch 2024-02-14T13:03:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:33 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/200687129' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6290f434-6daf-4e1f-b599-8478726c0696"}]': finished 2024-02-14T13:03:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:33 smithi055 ceph-mon[36853]: osdmap e45: 7 total, 6 up, 7 in 2024-02-14T13:03:33.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:33 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:33.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:33 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/200687129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6290f434-6daf-4e1f-b599-8478726c0696"}]: dispatch 2024-02-14T13:03:33.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:33 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/200687129' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6290f434-6daf-4e1f-b599-8478726c0696"}]': finished 2024-02-14T13:03:33.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:33 smithi012 ceph-mon[32370]: osdmap e45: 7 total, 6 up, 7 in 2024-02-14T13:03:33.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:33 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:33.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:33 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/200687129' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6290f434-6daf-4e1f-b599-8478726c0696"}]: dispatch 2024-02-14T13:03:33.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:33 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/200687129' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6290f434-6daf-4e1f-b599-8478726c0696"}]': finished 2024-02-14T13:03:33.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:33 smithi103 ceph-mon[36921]: osdmap e45: 7 total, 6 up, 7 in 2024-02-14T13:03:33.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:33 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:34 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1018601819' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:03:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:34 smithi012 ceph-mon[32370]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:03:34.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:34 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1018601819' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:03:34.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:34 smithi103 ceph-mon[36921]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:03:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:34 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1018601819' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:03:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:34 smithi055 ceph-mon[36853]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:03:36.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:36 smithi012 ceph-mon[32370]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-14T13:03:36.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:36 smithi103 ceph-mon[36921]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-14T13:03:36.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:36 smithi055 ceph-mon[36853]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-14T13:03:38.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:38 smithi012 ceph-mon[32370]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-14T13:03:38.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:38 smithi103 ceph-mon[36921]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-14T13:03:38.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:38 smithi055 ceph-mon[36853]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-14T13:03:40.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:40 smithi055 ceph-mon[36853]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-02-14T13:03:40.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:40 smithi012 ceph-mon[32370]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-02-14T13:03:40.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:40 smithi103 ceph-mon[36921]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-02-14T13:03:41.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:41 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-14T13:03:41.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:41 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:41.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:41 smithi103 ceph-mon[36921]: Deploying daemon osd.6 on smithi012 2024-02-14T13:03:41.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:41 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-14T13:03:41.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:41 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:41.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:41 smithi012 ceph-mon[32370]: Deploying daemon osd.6 on smithi012 2024-02-14T13:03:41.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-14T13:03:41.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:41 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:41.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:41 smithi055 ceph-mon[36853]: Deploying daemon osd.6 on smithi012 2024-02-14T13:03:42.697 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:42 smithi012 ceph-mon[32370]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:42.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:42 smithi103 ceph-mon[36921]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:42.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:42 smithi055 ceph-mon[36853]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:44.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:44 smithi055 ceph-mon[36853]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:44.869 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:44 smithi012 ceph-mon[32370]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:44 smithi103 ceph-mon[36921]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:46.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:46 smithi012 ceph-mon[32370]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:46.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:46 smithi103 ceph-mon[36921]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:46.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:46 smithi055 ceph-mon[36853]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:47.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:47.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:47.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:47.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:47.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:47.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:47.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:47.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:47.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:48 smithi012 ceph-mon[32370]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:48.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:48 smithi103 ceph-mon[36921]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:48.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:48 smithi055 ceph-mon[36853]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:50.338 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 6 on host 'smithi012' 2024-02-14T13:03:50.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.336+0000 7ff467fff700 1 -- 172.21.15.12:0/212326781 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff47002d9c0 con 0x7ff45c0a2150 2024-02-14T13:03:50.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff45c0a2150 msgr2=0x7ff45c0a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:50.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff45c0a2150 0x7ff45c0a4610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff470198b90 tx=0x7ff460009040 comp rx=0 tx=0).stop 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 msgr2=0x7ff47019f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 0x7ff47019f260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff46800e940 tx=0x7ff46800ec50 comp rx=0 tx=0).stop 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 shutdown_connections 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff45c0a2150 0x7ff45c0a4610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4701038f0 0x7ff47019f260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff470101d50 0x7ff470197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 --2- 172.21.15.12:0/212326781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff470102f50 0x7ff4701981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 >> 172.21.15.12:0/212326781 conn(0x7ff4700fd330 msgr2=0x7ff470106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 shutdown_connections 2024-02-14T13:03:50.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:03:50.338+0000 7ff47543f700 1 -- 172.21.15.12:0/212326781 wait complete. 2024-02-14T13:03:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:50.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:50.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:50 smithi012 ceph-mon[32370]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:50.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:50 smithi103 ceph-mon[36921]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-14T13:03:50.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:50.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:50.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:50.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:50.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:03:50.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:50 smithi055 ceph-mon[36853]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-14T13:03:51.047 DEBUG:teuthology.orchestra.run.smithi012:osd.6> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.6.service 2024-02-14T13:03:51.049 INFO:tasks.cephadm:Deploying osd.7 on smithi055 with /dev/vg_nvme/lv_2... 2024-02-14T13:03:51.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-14T13:03:51.309 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:03:52.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:52 smithi012 ceph-mon[32370]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-14T13:03:52.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:52 smithi012 ceph-mon[32370]: osdmap e46: 7 total, 6 up, 7 in 2024-02-14T13:03:52.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:52 smithi012 ceph-mon[32370]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:03:52.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:52 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:52.694 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:52 smithi055 ceph-mon[36853]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-14T13:03:52.694 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:52 smithi055 ceph-mon[36853]: osdmap e46: 7 total, 6 up, 7 in 2024-02-14T13:03:52.694 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:52 smithi055 ceph-mon[36853]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:03:52.694 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:52 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:52 smithi103 ceph-mon[36921]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-14T13:03:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:52 smithi103 ceph-mon[36921]: osdmap e46: 7 total, 6 up, 7 in 2024-02-14T13:03:52.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:52 smithi103 ceph-mon[36921]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:03:52.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:52 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.428 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-14T13:03:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-14T13:03:53.429 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-02-14T13:03:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-02-14T13:03:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00717964 s, 1.5 GB/s 2024-02-14T13:03:53.429 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-02-14T13:03:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:03:53.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: osdmap e47: 7 total, 6 up, 7 in 2024-02-14T13:03:53.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' 2024-02-14T13:03:53.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.468 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:03:53.206+0000 7fd11c636700 -1 osd.6 0 waiting for initial osdmap 2024-02-14T13:03:53.468 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:03:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:03:53.220+0000 7fd114c29700 -1 osd.6 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:03:53.738 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:53.738 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:03:53.738 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: osdmap e47: 7 total, 6 up, 7 in 2024-02-14T13:03:53.738 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.739 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.739 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' 2024-02-14T13:03:53.739 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:03:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: osdmap e47: 7 total, 6 up, 7 in 2024-02-14T13:03:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:53.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: from='osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962]' entity='osd.6' 2024-02-14T13:03:53.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:54.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_2 2024-02-14T13:03:54.453 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:03:54.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:03:54.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:03:54.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi012 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi012 to 5697M 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] boot 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: osdmap e48: 7 total, 7 up, 7 in 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:54.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:54 smithi055 ceph-mon[36853]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi012 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi012 to 5697M 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] boot 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: osdmap e48: 7 total, 7 up, 7 in 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:54.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:54 smithi012 ceph-mon[32370]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:54.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:03:54.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi012 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi012 to 5697M 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: osd.6 [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] boot 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: osdmap e48: 7 total, 7 up, 7 in 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-14T13:03:54.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:54 smithi103 ceph-mon[36921]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.100+0000 7fd712569700 1 -- 172.21.15.55:0/205981750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 msgr2=0x7fd70c1075a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.100+0000 7fd712569700 1 --2- 172.21.15.55:0/205981750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1075a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009990 tx=0x7fd6fc009ca0 comp rx=0 tx=0).stop 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- 172.21.15.55:0/205981750 shutdown_connections 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 --2- 172.21.15.55:0/205981750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 0x7fd70c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 --2- 172.21.15.55:0/205981750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd70c102880 0x7fd70c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 --2- 172.21.15.55:0/205981750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1075a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:56.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- 172.21.15.55:0/205981750 >> 172.21.15.55:0/205981750 conn(0x7fd70c0fc2b0 msgr2=0x7fd70c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- 172.21.15.55:0/205981750 shutdown_connections 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- 172.21.15.55:0/205981750 wait complete. 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 Processor -- start 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- start start 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd70c102880 0x7fd70c197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 0x7fd70c19f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19f930 con 0x7fd70c107ae0 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19fa70 con 0x7fd70c1051b0 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.101+0000 7fd712569700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19fc00 con 0x7fd70c102880 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd710b06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 0x7fd70c19f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:56.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd710b06700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 0x7fd70c19f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.55:58024/0 (socket says 172.21.15.55:58024) 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd710b06700 1 -- 172.21.15.55:0/2236421376 learned_addr learned my addr 172.21.15.55:0/2236421376 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70bfff700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd70c102880 0x7fd70c197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 -- 172.21.15.55:0/2236421376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd70c102880 msgr2=0x7fd70c197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd70c102880 0x7fd70c197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 -- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 msgr2=0x7fd70c19f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 0x7fd70c19f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 -- 172.21.15.55:0/2236421376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0095f0 con 0x7fd70c1051b0 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd70b7fe700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1982e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc000c00 tx=0x7fd6fc00f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc01d070 con 0x7fd70c1051b0 2024-02-14T13:03:56.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd6fc022470 con 0x7fd70c1051b0 2024-02-14T13:03:56.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.102+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c19fe80 con 0x7fd70c1051b0 2024-02-14T13:03:56.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.103+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc017650 con 0x7fd70c1051b0 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.103+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c1a02b0 con 0x7fd70c1051b0 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.104+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c0fde30 con 0x7fd70c1051b0 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.105+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mon.2 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fd6fc0225e0 con 0x7fd70c1051b0 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.105+0000 7fd7097fa700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd6f40a2150 0x7fd6f40a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.105+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mon.2 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fd6fc0ce2a0 con 0x7fd70c1051b0 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.106+0000 7fd70bfff700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd6f40a2150 0x7fd6f40a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:03:56.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.106+0000 7fd70bfff700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd6f40a2150 0x7fd6f40a4610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd700009a10 tx=0x7fd700009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:03:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.110+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mon.2 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd6fc098010 con 0x7fd70c1051b0 2024-02-14T13:03:56.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:03:56.322+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd70c02d920 con 0x7fd6f40a2150 2024-02-14T13:03:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:56 smithi012 ceph-mon[32370]: osdmap e49: 7 total, 7 up, 7 in 2024-02-14T13:03:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:56 smithi012 ceph-mon[32370]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:03:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:56 smithi012 ceph-mon[32370]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:56.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:56 smithi103 ceph-mon[36921]: osdmap e49: 7 total, 7 up, 7 in 2024-02-14T13:03:56.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:56 smithi103 ceph-mon[36921]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:03:56.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:56 smithi103 ceph-mon[36921]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:56.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:56.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:56.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:56 smithi055 ceph-mon[36853]: osdmap e49: 7 total, 7 up, 7 in 2024-02-14T13:03:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:56 smithi055 ceph-mon[36853]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:03:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:56 smithi055 ceph-mon[36853]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:03:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:03:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:03:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:03:58.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:58 smithi012 ceph-mon[32370]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:03:58.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:58 smithi103 ceph-mon[36921]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:03:58.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:58 smithi055 ceph-mon[36853]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:03:59.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:59 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/4025751149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]: dispatch 2024-02-14T13:03:59.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:59 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]: dispatch 2024-02-14T13:03:59.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:59 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]': finished 2024-02-14T13:03:59.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:59 smithi055 ceph-mon[36853]: osdmap e50: 8 total, 7 up, 8 in 2024-02-14T13:03:59.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:03:59 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:03:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:59 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/4025751149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]: dispatch 2024-02-14T13:03:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:59 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]: dispatch 2024-02-14T13:03:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:59 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]': finished 2024-02-14T13:03:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:59 smithi012 ceph-mon[32370]: osdmap e50: 8 total, 7 up, 8 in 2024-02-14T13:03:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:03:59 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:03:59.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:59 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/4025751149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]: dispatch 2024-02-14T13:03:59.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:59 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]: dispatch 2024-02-14T13:03:59.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:59 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60c4850a-411e-4fbf-944d-9c9530ae5dcf"}]': finished 2024-02-14T13:03:59.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:59 smithi103 ceph-mon[36921]: osdmap e50: 8 total, 7 up, 8 in 2024-02-14T13:03:59.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:03:59 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:01.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:00 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/1792368597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:01.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:00 smithi012 ceph-mon[32370]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:01.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:00 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/1792368597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:01.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:00 smithi103 ceph-mon[36921]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:01.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:00 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/1792368597' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:01.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:00 smithi055 ceph-mon[36853]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:02 smithi012 ceph-mon[32370]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:02.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:02 smithi103 ceph-mon[36921]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:02.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:02 smithi055 ceph-mon[36853]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:04.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:04 smithi055 ceph-mon[36853]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:04.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:04 smithi012 ceph-mon[32370]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:04.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:04 smithi103 ceph-mon[36921]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:06.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:06 smithi055 ceph-mon[36853]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:06 smithi012 ceph-mon[32370]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:06.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:06 smithi103 ceph-mon[36921]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:07.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:07 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-14T13:04:07.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:07 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:07.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:07 smithi055 ceph-mon[36853]: Deploying daemon osd.7 on smithi055 2024-02-14T13:04:07.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:07 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-14T13:04:07.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:07 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:07.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:07 smithi012 ceph-mon[32370]: Deploying daemon osd.7 on smithi055 2024-02-14T13:04:07.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:07 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-14T13:04:07.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:07 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:07.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:07 smithi103 ceph-mon[36921]: Deploying daemon osd.7 on smithi055 2024-02-14T13:04:08.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:08 smithi055 ceph-mon[36853]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:08.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:08 smithi012 ceph-mon[32370]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:08.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:08 smithi103 ceph-mon[36921]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:10.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:10 smithi012 ceph-mon[32370]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:10.736 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:10 smithi055 ceph-mon[36853]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:10.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:10 smithi103 ceph-mon[36921]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:12.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:12 smithi012 ceph-mon[32370]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:12 smithi103 ceph-mon[36921]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:12.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:12 smithi055 ceph-mon[36853]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:14.740 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:14 smithi055 ceph-mon[36853]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:14 smithi012 ceph-mon[32370]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:14 smithi103 ceph-mon[36921]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.839+0000 7fd7097fa700 1 -- 172.21.15.55:0/2236421376 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd70c02d920 con 0x7fd6f40a2150 2024-02-14T13:04:15.842 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 7 on host 'smithi055' 2024-02-14T13:04:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd6f40a2150 msgr2=0x7fd6f40a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd6f40a2150 0x7fd6f40a4610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd700009a10 tx=0x7fd700009190 comp rx=0 tx=0).stop 2024-02-14T13:04:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 msgr2=0x7fd70c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1982e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc000c00 tx=0x7fd6fc00f670 comp rx=0 tx=0).stop 2024-02-14T13:04:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 shutdown_connections 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd6f40a2150 0x7fd6f40a4610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd70c107ae0 0x7fd70c19f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd70c102880 0x7fd70c197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 --2- 172.21.15.55:0/2236421376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd70c1051b0 0x7fd70c1982e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 >> 172.21.15.55:0/2236421376 conn(0x7fd70c0fc2b0 msgr2=0x7fd70c1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 shutdown_connections 2024-02-14T13:04:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:04:15.843+0000 7fd712569700 1 -- 172.21.15.55:0/2236421376 wait complete. 2024-02-14T13:04:16.454 DEBUG:teuthology.orchestra.run.smithi055:osd.7> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.7.service 2024-02-14T13:04:16.456 INFO:tasks.cephadm:Deploying osd.8 on smithi103 with /dev/vg_nvme/lv_2... 2024-02-14T13:04:16.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-14T13:04:16.704 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:04:17.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:17.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: from='osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-14T13:04:17.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-14T13:04:17.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:16 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:17.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: from='osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-14T13:04:17.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-14T13:04:17.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:16 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: from='osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:17.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:16 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:18.144 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-mon[36853]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-14T13:04:18.144 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-mon[36853]: from='osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:04:18.144 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-mon[36853]: osdmap e51: 8 total, 7 up, 8 in 2024-02-14T13:04:18.144 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:18.145 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-mon[36853]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:04:18.145 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:04:17.820+0000 7f001aed1700 -1 osd.7 0 waiting for initial osdmap 2024-02-14T13:04:18.145 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:04:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:04:17.832+0000 7f00174cc700 -1 osd.7 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:04:18.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:17 smithi103 ceph-mon[36921]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-14T13:04:18.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:17 smithi103 ceph-mon[36921]: from='osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:04:18.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:17 smithi103 ceph-mon[36921]: osdmap e51: 8 total, 7 up, 8 in 2024-02-14T13:04:18.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:18.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:17 smithi103 ceph-mon[36921]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:04:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:17 smithi012 ceph-mon[32370]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-14T13:04:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:17 smithi012 ceph-mon[32370]: from='osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:04:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:17 smithi012 ceph-mon[32370]: osdmap e51: 8 total, 7 up, 8 in 2024-02-14T13:04:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:17 smithi012 ceph-mon[32370]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:04:18.737 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-14T13:04:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-14T13:04:18.738 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-02-14T13:04:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-02-14T13:04:18.738 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127815 s, 820 MB/s 2024-02-14T13:04:18.738 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-02-14T13:04:19.047 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:04:19.047 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: osdmap e52: 8 total, 7 up, 8 in 2024-02-14T13:04:19.047 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.047 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.047 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:19.048 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] boot 2024-02-14T13:04:19.048 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: osdmap e53: 8 total, 8 up, 8 in 2024-02-14T13:04:19.048 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:18 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.181 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:04:19.181 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: osdmap e52: 8 total, 7 up, 8 in 2024-02-14T13:04:19.181 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.181 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.181 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:19.182 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] boot 2024-02-14T13:04:19.182 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: osdmap e53: 8 total, 8 up, 8 in 2024-02-14T13:04:19.182 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:18 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: osdmap e52: 8 total, 7 up, 8 in 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: osd.7 [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] boot 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: osdmap e53: 8 total, 8 up, 8 in 2024-02-14T13:04:19.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:18 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-14T13:04:19.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-02-14T13:04:19.579 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:04:19.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:19 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:04:19.892 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:19 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:04:19.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:19 smithi103 ceph-mon[36921]: osdmap e54: 8 total, 8 up, 8 in 2024-02-14T13:04:20.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:19 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:04:20.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:19 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:04:20.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:19 smithi012 ceph-mon[32370]: osdmap e54: 8 total, 8 up, 8 in 2024-02-14T13:04:20.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:19 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:04:20.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:19 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:04:20.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:19 smithi055 ceph-mon[36853]: osdmap e54: 8 total, 8 up, 8 in 2024-02-14T13:04:21.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.133+0000 7f834b611700 1 -- 172.21.15.103:0/1429726709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 msgr2=0x7f8344101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:21.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.133+0000 7f834b611700 1 --2- 172.21.15.103:0/1429726709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344101070 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8340009990 tx=0x7f8340009ca0 comp rx=0 tx=0).stop 2024-02-14T13:04:21.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- 172.21.15.103:0/1429726709 shutdown_connections 2024-02-14T13:04:21.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 --2- 172.21.15.103:0/1429726709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83441027f0 0x7f83441090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 --2- 172.21.15.103:0/1429726709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344101070 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 --2- 172.21.15.103:0/1429726709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344101e50 0x7f83441022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- 172.21.15.103:0/1429726709 >> 172.21.15.103:0/1429726709 conn(0x7f83440fc210 msgr2=0x7f83440fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- 172.21.15.103:0/1429726709 shutdown_connections 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- 172.21.15.103:0/1429726709 wait complete. 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 Processor -- start 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- start start 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344101e50 0x7f83441981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83441027f0 0x7f834419f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:21.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419f830 con 0x7f8344101e50 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419f970 con 0x7f83441027f0 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f834b611700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834419fb30 con 0x7f8344100c50 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f83493ad700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f83493ad700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34134/0 (socket says 172.21.15.103:34134) 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.134+0000 7f83493ad700 1 -- 172.21.15.103:0/2825126973 learned_addr learned my addr 172.21.15.103:0/2825126973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f8348bac700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344101e50 0x7f83441981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f8349bae700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83441027f0 0x7f834419f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f83493ad700 1 -- 172.21.15.103:0/2825126973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83441027f0 msgr2=0x7f834419f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f83493ad700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83441027f0 0x7f834419f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f83493ad700 1 -- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344101e50 msgr2=0x7f83441981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f83493ad700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344101e50 0x7f83441981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:21.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f83493ad700 1 -- 172.21.15.103:0/2825126973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400095f0 con 0x7f8344100c50 2024-02-14T13:04:21.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f83493ad700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344197cb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8340000c00 tx=0x7f834000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:04:21.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834001d070 con 0x7f8344100c50 2024-02-14T13:04:21.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f834000fc00 con 0x7f8344100c50 2024-02-14T13:04:21.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834419fdb0 con 0x7f8344100c50 2024-02-14T13:04:21.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340017650 con 0x7f8344100c50 2024-02-14T13:04:21.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.135+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83441a01c0 con 0x7f8344100c50 2024-02-14T13:04:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.136+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8344068a10 con 0x7f8344100c50 2024-02-14T13:04:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.137+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f83400177b0 con 0x7f8344100c50 2024-02-14T13:04:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.138+0000 7f833a7fc700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f83300a2150 0x7f83300a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.138+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f83400ce9d0 con 0x7f8344100c50 2024-02-14T13:04:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.138+0000 7f8348bac700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f83300a2150 0x7f83300a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:21.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.138+0000 7f8348bac700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f83300a2150 0x7f83300a4610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83441991c0 tx=0x7f833400a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:04:21.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.141+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8340098570 con 0x7f8344100c50 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi055 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi055 to 5694M 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: pgmap v180: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:20 smithi012 ceph-mon[32370]: osdmap e55: 8 total, 8 up, 8 in 2024-02-14T13:04:21.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi055 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi055 to 5694M 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: pgmap v180: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:21.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:20 smithi103 ceph-mon[36921]: osdmap e55: 8 total, 8 up, 8 in 2024-02-14T13:04:21.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi055 2024-02-14T13:04:21.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi055 to 5694M 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: pgmap v180: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:20 smithi055 ceph-mon[36853]: osdmap e55: 8 total, 8 up, 8 in 2024-02-14T13:04:21.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:21.340+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f83440fe3f0 con 0x7f83300a2150 2024-02-14T13:04:22.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:22 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:04:22.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:22 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:04:22.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:22 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:22.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:22 smithi103 ceph-mon[36921]: osdmap e56: 8 total, 8 up, 8 in 2024-02-14T13:04:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:22 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:04:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:22 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:04:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:22 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:22 smithi012 ceph-mon[32370]: osdmap e56: 8 total, 8 up, 8 in 2024-02-14T13:04:22.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:22 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:04:22.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:22 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:04:22.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:22 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:22.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:22 smithi055 ceph-mon[36853]: osdmap e56: 8 total, 8 up, 8 in 2024-02-14T13:04:23.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:23 smithi103 ceph-mon[36921]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:04:23.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:23 smithi103 ceph-mon[36921]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:23.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:23 smithi103 ceph-mon[36921]: osdmap e57: 8 total, 8 up, 8 in 2024-02-14T13:04:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:23 smithi012 ceph-mon[32370]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:04:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:23 smithi012 ceph-mon[32370]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:23.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:23 smithi012 ceph-mon[32370]: osdmap e57: 8 total, 8 up, 8 in 2024-02-14T13:04:23.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:23 smithi055 ceph-mon[36853]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:04:23.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:23 smithi055 ceph-mon[36853]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:23.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:23 smithi055 ceph-mon[36853]: osdmap e57: 8 total, 8 up, 8 in 2024-02-14T13:04:24.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:24 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/1379606844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]: dispatch 2024-02-14T13:04:24.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:24 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]: dispatch 2024-02-14T13:04:24.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:24 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]': finished 2024-02-14T13:04:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:24 smithi103 ceph-mon[36921]: osdmap e58: 9 total, 8 up, 9 in 2024-02-14T13:04:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:24 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:24 smithi103 ceph-mon[36921]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:24.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:24 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/1379606844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]: dispatch 2024-02-14T13:04:24.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:24 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]: dispatch 2024-02-14T13:04:24.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:24 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]': finished 2024-02-14T13:04:24.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:24 smithi055 ceph-mon[36853]: osdmap e58: 9 total, 8 up, 9 in 2024-02-14T13:04:24.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:24 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:24.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:24 smithi055 ceph-mon[36853]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:24 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/1379606844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]: dispatch 2024-02-14T13:04:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:24 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]: dispatch 2024-02-14T13:04:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:24 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3da844e-9ab0-422d-89da-3d369ed494a5"}]': finished 2024-02-14T13:04:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:24 smithi012 ceph-mon[32370]: osdmap e58: 9 total, 8 up, 9 in 2024-02-14T13:04:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:24 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:24 smithi012 ceph-mon[32370]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:25.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:25 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/520142035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:25 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/520142035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:25.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:25 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/520142035' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:26.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:26 smithi055 ceph-mon[36853]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:26.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:26 smithi012 ceph-mon[32370]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:26.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:26 smithi103 ceph-mon[36921]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:28.665 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:28 smithi103 ceph-mon[36921]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:28.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:28 smithi012 ceph-mon[32370]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:28.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:28 smithi055 ceph-mon[36853]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:30.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:30 smithi103 ceph-mon[36921]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:30.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:30 smithi012 ceph-mon[32370]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:30.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:30 smithi055 ceph-mon[36853]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:31.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-02-14T13:04:31.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:31.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-02-14T13:04:31.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:31.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-02-14T13:04:31.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:32.726 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:32 smithi103 ceph-mon[36921]: Deploying daemon osd.8 on smithi103 2024-02-14T13:04:32.726 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:32 smithi103 ceph-mon[36921]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:32.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:32 smithi055 ceph-mon[36853]: Deploying daemon osd.8 on smithi103 2024-02-14T13:04:32.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:32 smithi055 ceph-mon[36853]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:32 smithi012 ceph-mon[32370]: Deploying daemon osd.8 on smithi103 2024-02-14T13:04:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:32 smithi012 ceph-mon[32370]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:34.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:34 smithi055 ceph-mon[36853]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:34.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:34 smithi103 ceph-mon[36921]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:34 smithi012 ceph-mon[32370]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:36.653 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:36 smithi103 ceph-mon[36921]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:36.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:36 smithi012 ceph-mon[32370]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:36.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:36 smithi055 ceph-mon[36853]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:38.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:38.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:38.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:38.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:38.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:38.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:38.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:38.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:38.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:38 smithi103 ceph-mon[36921]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:39.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:38 smithi012 ceph-mon[32370]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:39.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:38 smithi055 ceph-mon[36853]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:40.458 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 8 on host 'smithi103' 2024-02-14T13:04:40.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.456+0000 7f833a7fc700 1 -- 172.21.15.103:0/2825126973 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f83440fe3f0 con 0x7f83300a2150 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f83300a2150 msgr2=0x7f83300a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f83300a2150 0x7f83300a4610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83441991c0 tx=0x7f833400a380 comp rx=0 tx=0).stop 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 msgr2=0x7f8344197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344197cb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8340000c00 tx=0x7f834000f690 comp rx=0 tx=0).stop 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 shutdown_connections 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83441027f0 0x7f834419f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8344100c50 0x7f8344197cb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f83300a2150 0x7f83300a4610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 --2- 172.21.15.103:0/2825126973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344101e50 0x7f83441981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 >> 172.21.15.103:0/2825126973 conn(0x7f83440fc210 msgr2=0x7f83440fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:04:40.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 shutdown_connections 2024-02-14T13:04:40.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:04:40.459+0000 7f834b611700 1 -- 172.21.15.103:0/2825126973 wait complete. 2024-02-14T13:04:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:40.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:40.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:40.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:04:41.086 DEBUG:teuthology.orchestra.run.smithi103:osd.8> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.8.service 2024-02-14T13:04:41.088 INFO:tasks.cephadm:Deploying osd.9 on smithi012 with /dev/vg_nvme/lv_1... 2024-02-14T13:04:41.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-14T13:04:41.343 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:04:41.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:41 smithi012 ceph-mon[32370]: from='osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-02-14T13:04:41.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:41 smithi012 ceph-mon[32370]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-02-14T13:04:41.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:41 smithi103 ceph-mon[36921]: from='osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-02-14T13:04:41.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:41 smithi103 ceph-mon[36921]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-02-14T13:04:42.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:41 smithi055 ceph-mon[36853]: from='osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-02-14T13:04:42.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:41 smithi055 ceph-mon[36853]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-02-14T13:04:42.730 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-mon[36921]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-02-14T13:04:42.731 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-mon[36921]: osdmap e59: 9 total, 8 up, 9 in 2024-02-14T13:04:42.731 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:42.731 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-mon[36921]: from='osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:04:42.731 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-mon[36921]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:04:42.731 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-mon[36921]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:42.731 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:04:42.714+0000 7fab27a9a700 -1 osd.8 0 waiting for initial osdmap 2024-02-14T13:04:42.731 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:04:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:04:42.728+0000 7fab24095700 -1 osd.8 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:04:42.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:42 smithi012 ceph-mon[32370]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-02-14T13:04:42.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:42 smithi012 ceph-mon[32370]: osdmap e59: 9 total, 8 up, 9 in 2024-02-14T13:04:42.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:42.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:42 smithi012 ceph-mon[32370]: from='osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:04:42.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:42 smithi012 ceph-mon[32370]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:04:42.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:42 smithi012 ceph-mon[32370]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:43.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:42 smithi055 ceph-mon[36853]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-02-14T13:04:43.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:42 smithi055 ceph-mon[36853]: osdmap e59: 9 total, 8 up, 9 in 2024-02-14T13:04:43.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:43.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:42 smithi055 ceph-mon[36853]: from='osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:04:43.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:42 smithi055 ceph-mon[36853]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:04:43.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:42 smithi055 ceph-mon[36853]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-14T13:04:43.386 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-14T13:04:43.386 INFO:teuthology.orchestra.run.smithi012.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-14T13:04:43.386 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10+0 records in 2024-02-14T13:04:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:10+0 records out 2024-02-14T13:04:43.387 INFO:teuthology.orchestra.run.smithi012.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111836 s, 938 MB/s 2024-02-14T13:04:43.387 INFO:teuthology.orchestra.run.smithi012.stderr:--> Zapping successful for: 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: osdmap e60: 9 total, 8 up, 9 in 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] boot 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: osdmap e61: 9 total, 9 up, 9 in 2024-02-14T13:04:43.890 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:43 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: osdmap e60: 9 total, 8 up, 9 in 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] boot 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: osdmap e61: 9 total, 9 up, 9 in 2024-02-14T13:04:43.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:43 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:44.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:04:44.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: osdmap e60: 9 total, 8 up, 9 in 2024-02-14T13:04:44.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:44.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:44.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: osd.8 [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] boot 2024-02-14T13:04:44.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: osdmap e61: 9 total, 9 up, 9 in 2024-02-14T13:04:44.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:43 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-02-14T13:04:44.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2024-02-14T13:04:44.431 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:04:44.876 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi103 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi103 to 5693M 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.877 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:44.878 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:44 smithi012 ceph-mon[32370]: osdmap e62: 9 total, 9 up, 9 in 2024-02-14T13:04:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:04:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:04:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi103 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi103 to 5693M 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:44.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:44 smithi103 ceph-mon[36921]: osdmap e62: 9 total, 9 up, 9 in 2024-02-14T13:04:45.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:04:45.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:04:45.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi103 2024-02-14T13:04:45.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi103 to 5693M 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:45.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:44 smithi055 ceph-mon[36853]: osdmap e62: 9 total, 9 up, 9 in 2024-02-14T13:04:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 -- 172.21.15.12:0/1418456097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd81027f0 msgr2=0x7f4cd81090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/1418456097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd81027f0 0x7f4cd81090a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000b0d0 tx=0x7f4cd000b3e0 comp rx=0 tx=0).stop 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 -- 172.21.15.12:0/1418456097 shutdown_connections 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/1418456097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd81027f0 0x7f4cd81090a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/1418456097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd8100c50 0x7f4cd8101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/1418456097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd8101e50 0x7f4cd81022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 -- 172.21.15.12:0/1418456097 >> 172.21.15.12:0/1418456097 conn(0x7f4cd80fc210 msgr2=0x7f4cd80fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 -- 172.21.15.12:0/1418456097 shutdown_connections 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.007+0000 7f4cdddf9700 1 -- 172.21.15.12:0/1418456097 wait complete. 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 Processor -- start 2024-02-14T13:04:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 -- start start 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd8100c50 0x7f4cd8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 0x7f4cd81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd81027f0 0x7f4cd819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd819fa00 con 0x7f4cd8101e50 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd819fb40 con 0x7f4cd8100c50 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cdddf9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd819fcd0 con 0x7f4cd81027f0 2024-02-14T13:04:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cd6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 0x7f4cd81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cd6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 0x7f4cd81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47852/0 (socket says 172.21.15.12:47852) 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cd6ffd700 1 -- 172.21.15.12:0/2942750792 learned_addr learned my addr 172.21.15.12:0/2942750792 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cd7fff700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd81027f0 0x7f4cd819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.008+0000 7f4cd77fe700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd8100c50 0x7f4cd8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd6ffd700 1 -- 172.21.15.12:0/2942750792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd81027f0 msgr2=0x7f4cd819f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd6ffd700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd81027f0 0x7f4cd819f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd6ffd700 1 -- 172.21.15.12:0/2942750792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd8100c50 msgr2=0x7f4cd8197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd6ffd700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd8100c50 0x7f4cd8197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd6ffd700 1 -- 172.21.15.12:0/2942750792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0009d00 con 0x7f4cd8101e50 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd6ffd700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 0x7f4cd81983b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00d9b0 tx=0x7f4ccc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc004a30 con 0x7f4cd8101e50 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4ccc005500 con 0x7f4cd8101e50 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc009be0 con 0x7f4cd8101e50 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd819ffb0 con 0x7f4cd8101e50 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.009+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd81a04a0 con 0x7f4cd8101e50 2024-02-14T13:04:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.010+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd80689e0 con 0x7f4cd8101e50 2024-02-14T13:04:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.011+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f4ccc009d40 con 0x7f4cd8101e50 2024-02-14T13:04:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.012+0000 7f4cd4ff9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4cc00a21d0 0x7f4cc00a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:04:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.012+0000 7f4cd77fe700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4cc00a21d0 0x7f4cc00a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:04:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.012+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f4ccc0cd3f0 con 0x7f4cd8101e50 2024-02-14T13:04:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.012+0000 7f4cd77fe700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4cc00a21d0 0x7f4cc00a4690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8101cb0 tx=0x7f4cc8009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:04:46.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.016+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4ccc096dd0 con 0x7f4cd8101e50 2024-02-14T13:04:46.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:04:46.229+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cd802d920 con 0x7f4cc00a21d0 2024-02-14T13:04:46.848 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:46 smithi012 ceph-mon[32370]: osdmap e63: 9 total, 9 up, 9 in 2024-02-14T13:04:46.849 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:46 smithi012 ceph-mon[32370]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:04:46.849 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:04:46.849 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:04:46.849 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:46.849 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:46 smithi012 ceph-mon[32370]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:46.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:46 smithi103 ceph-mon[36921]: osdmap e63: 9 total, 9 up, 9 in 2024-02-14T13:04:46.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:46 smithi103 ceph-mon[36921]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:04:46.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:04:46.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:04:46.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:46.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:46 smithi103 ceph-mon[36921]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:46 smithi055 ceph-mon[36853]: osdmap e63: 9 total, 9 up, 9 in 2024-02-14T13:04:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:46 smithi055 ceph-mon[36853]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:04:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:04:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:04:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:46 smithi055 ceph-mon[36853]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:47.868 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:47 smithi012 ceph-mon[32370]: osdmap e64: 9 total, 9 up, 9 in 2024-02-14T13:04:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:47 smithi103 ceph-mon[36921]: osdmap e64: 9 total, 9 up, 9 in 2024-02-14T13:04:48.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:47 smithi055 ceph-mon[36853]: osdmap e64: 9 total, 9 up, 9 in 2024-02-14T13:04:48.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:48 smithi012 ceph-mon[32370]: osdmap e65: 9 total, 9 up, 9 in 2024-02-14T13:04:48.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:48 smithi012 ceph-mon[32370]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:48.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:48 smithi103 ceph-mon[36921]: osdmap e65: 9 total, 9 up, 9 in 2024-02-14T13:04:48.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:48 smithi103 ceph-mon[36921]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:48 smithi055 ceph-mon[36853]: osdmap e65: 9 total, 9 up, 9 in 2024-02-14T13:04:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:48 smithi055 ceph-mon[36853]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:04:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:49 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3546373036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "220ec4cc-7468-4e46-aada-4e4edeb7bcb2"}]: dispatch 2024-02-14T13:04:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:49 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3546373036' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "220ec4cc-7468-4e46-aada-4e4edeb7bcb2"}]': finished 2024-02-14T13:04:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:49 smithi012 ceph-mon[32370]: osdmap e66: 10 total, 9 up, 10 in 2024-02-14T13:04:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:04:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:49 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/470776055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:49 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3546373036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "220ec4cc-7468-4e46-aada-4e4edeb7bcb2"}]: dispatch 2024-02-14T13:04:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:49 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3546373036' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "220ec4cc-7468-4e46-aada-4e4edeb7bcb2"}]': finished 2024-02-14T13:04:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:49 smithi103 ceph-mon[36921]: osdmap e66: 10 total, 9 up, 10 in 2024-02-14T13:04:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:04:49.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:49 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/470776055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:49 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3546373036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "220ec4cc-7468-4e46-aada-4e4edeb7bcb2"}]: dispatch 2024-02-14T13:04:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:49 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3546373036' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "220ec4cc-7468-4e46-aada-4e4edeb7bcb2"}]': finished 2024-02-14T13:04:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:49 smithi055 ceph-mon[36853]: osdmap e66: 10 total, 9 up, 10 in 2024-02-14T13:04:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:04:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:49 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/470776055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:04:50.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:50 smithi012 ceph-mon[32370]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:04:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:50 smithi103 ceph-mon[36921]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:04:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:50 smithi055 ceph-mon[36853]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-02-14T13:04:52.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:52 smithi012 ceph-mon[32370]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-14T13:04:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:52 smithi103 ceph-mon[36921]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-14T13:04:52.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:52 smithi055 ceph-mon[36853]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-14T13:04:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:54 smithi012 ceph-mon[32370]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-14T13:04:54.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:54 smithi103 ceph-mon[36921]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-14T13:04:55.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:54 smithi055 ceph-mon[36853]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-14T13:04:56.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:56 smithi012 ceph-mon[32370]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-02-14T13:04:56.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:56 smithi103 ceph-mon[36921]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-02-14T13:04:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:56 smithi055 ceph-mon[36853]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-02-14T13:04:57.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:57 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-02-14T13:04:57.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:57 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:57.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:57 smithi012 ceph-mon[32370]: Deploying daemon osd.9 on smithi012 2024-02-14T13:04:57.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:57 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-02-14T13:04:57.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:57 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:57.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:57 smithi103 ceph-mon[36921]: Deploying daemon osd.9 on smithi012 2024-02-14T13:04:57.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:57 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-02-14T13:04:57.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:57 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:04:57.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:57 smithi055 ceph-mon[36853]: Deploying daemon osd.9 on smithi012 2024-02-14T13:04:58.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:04:58 smithi012 ceph-mon[32370]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-14T13:04:58.659 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:04:58 smithi103 ceph-mon[36921]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-14T13:04:58.711 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:04:58 smithi055 ceph-mon[36853]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-14T13:05:00.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:00 smithi012 ceph-mon[32370]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:00.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:00 smithi103 ceph-mon[36921]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:00.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:00 smithi055 ceph-mon[36853]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:02 smithi012 ceph-mon[32370]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:02.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:02 smithi103 ceph-mon[36921]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:02.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:02 smithi055 ceph-mon[36853]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:03 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:03.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:03.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:03.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:03 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:03.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:03.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:03.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:03 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:04.660 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:04 smithi012 ceph-mon[32370]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:04.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:04 smithi103 ceph-mon[36921]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:05.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:04 smithi055 ceph-mon[36853]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:06.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.088+0000 7f4cd4ff9700 1 -- 172.21.15.12:0/2942750792 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4cd802d920 con 0x7f4cc00a21d0 2024-02-14T13:05:06.091 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 9 on host 'smithi012' 2024-02-14T13:05:06.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4cc00a21d0 msgr2=0x7f4cc00a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:06.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4cc00a21d0 0x7f4cc00a4690 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8101cb0 tx=0x7f4cc8009190 comp rx=0 tx=0).stop 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 msgr2=0x7f4cd81983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 0x7f4cd81983b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00d9b0 tx=0x7f4ccc00dcc0 comp rx=0 tx=0).stop 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 shutdown_connections 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cd81027f0 0x7f4cd819f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cd8100c50 0x7f4cd8197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4cc00a21d0 0x7f4cc00a4690 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 --2- 172.21.15.12:0/2942750792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cd8101e50 0x7f4cd81983b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.090+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 >> 172.21.15.12:0/2942750792 conn(0x7f4cd80fc210 msgr2=0x7f4cd81050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.091+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 shutdown_connections 2024-02-14T13:05:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:06.091+0000 7f4cdddf9700 1 -- 172.21.15.12:0/2942750792 wait complete. 2024-02-14T13:05:06.735 DEBUG:teuthology.orchestra.run.smithi012:osd.9> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.9.service 2024-02-14T13:05:06.737 INFO:tasks.cephadm:Deploying osd.10 on smithi055 with /dev/vg_nvme/lv_1... 2024-02-14T13:05:06.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-14T13:05:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:05:07.338 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:07 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.338 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:07 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.338 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:07 smithi055 ceph-mon[36853]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-02-14T13:05:07.338 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:07 smithi055 ceph-mon[36853]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:07.338 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:07 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.338 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:07 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:07 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:07 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:07 smithi012 ceph-mon[32370]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-02-14T13:05:07.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:07 smithi012 ceph-mon[32370]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:07.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:07 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:07 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:07 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:07 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:07 smithi103 ceph-mon[36921]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-02-14T13:05:07.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:07 smithi103 ceph-mon[36921]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:07.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:07 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:07.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:07 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:08 smithi012 ceph-mon[32370]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-02-14T13:05:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:08 smithi012 ceph-mon[32370]: osdmap e67: 10 total, 9 up, 10 in 2024-02-14T13:05:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:08 smithi012 ceph-mon[32370]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:05:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:08.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:05:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:05:08.085+0000 7f3324f15700 -1 osd.9 0 waiting for initial osdmap 2024-02-14T13:05:08.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:05:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:05:08.104+0000 7f3321510700 -1 osd.9 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:05:08.359 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:08 smithi055 ceph-mon[36853]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-02-14T13:05:08.359 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:08 smithi055 ceph-mon[36853]: osdmap e67: 10 total, 9 up, 10 in 2024-02-14T13:05:08.359 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:08 smithi055 ceph-mon[36853]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:05:08.359 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:08.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:08 smithi103 ceph-mon[36921]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-02-14T13:05:08.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:08 smithi103 ceph-mon[36921]: osdmap e67: 10 total, 9 up, 10 in 2024-02-14T13:05:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:08 smithi103 ceph-mon[36921]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-02-14T13:05:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-14T13:05:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-14T13:05:09.163 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 10+0 records in 2024-02-14T13:05:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:10+0 records out 2024-02-14T13:05:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00708542 s, 1.5 GB/s 2024-02-14T13:05:09.163 INFO:teuthology.orchestra.run.smithi055.stderr: stderr: 2024-02-14T13:05:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:--> Zapping successful for: 2024-02-14T13:05:09.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:09 smithi012 ceph-mon[32370]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:05:09.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:09 smithi012 ceph-mon[32370]: osdmap e68: 10 total, 9 up, 10 in 2024-02-14T13:05:09.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:09 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:09 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:09 smithi012 ceph-mon[32370]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:09 smithi103 ceph-mon[36921]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:05:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:09 smithi103 ceph-mon[36921]: osdmap e68: 10 total, 9 up, 10 in 2024-02-14T13:05:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:09 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:09 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:09 smithi103 ceph-mon[36921]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:09.473 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:09 smithi055 ceph-mon[36853]: from='osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-02-14T13:05:09.473 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:09 smithi055 ceph-mon[36853]: osdmap e68: 10 total, 9 up, 10 in 2024-02-14T13:05:09.473 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:09 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.473 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:09 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:09.473 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:09 smithi055 ceph-mon[36853]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-02-14T13:05:09.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi055:vg_nvme/lv_1 2024-02-14T13:05:10.081 INFO:teuthology.orchestra.run.smithi055.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.b/config 2024-02-14T13:05:10.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:10 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:05:10.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:10 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:05:10.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:10.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:10 smithi103 ceph-mon[36921]: osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] boot 2024-02-14T13:05:10.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:10 smithi103 ceph-mon[36921]: osdmap e69: 10 total, 10 up, 10 in 2024-02-14T13:05:10.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:10.435 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:10 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:05:10.435 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:10 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:05:10.435 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:10.435 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:10 smithi055 ceph-mon[36853]: osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] boot 2024-02-14T13:05:10.435 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:10 smithi055 ceph-mon[36853]: osdmap e69: 10 total, 10 up, 10 in 2024-02-14T13:05:10.435 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:10.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:10 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:05:10.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:10 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:05:10.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:10.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:10 smithi012 ceph-mon[32370]: osd.9 [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] boot 2024-02-14T13:05:10.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:10 smithi012 ceph-mon[32370]: osdmap e69: 10 total, 10 up, 10 in 2024-02-14T13:05:10.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-02-14T13:05:11.394 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: osdmap e70: 10 total, 10 up, 10 in 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:11.395 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:11.396 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:11.396 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: osdmap e70: 10 total, 10 up, 10 in 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:11.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:11.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:11.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:11.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:11.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: osdmap e70: 10 total, 10 up, 10 in 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:11.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:11.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:11.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.588+0000 7fb604aad700 1 -- 172.21.15.55:0/1472390166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600101d50 msgr2=0x7fb600102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.588+0000 7fb604aad700 1 --2- 172.21.15.55:0/1472390166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600101d50 0x7fb600102170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00099c0 tx=0x7fb5f0009cd0 comp rx=0 tx=0).stop 2024-02-14T13:05:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 -- 172.21.15.55:0/1472390166 shutdown_connections 2024-02-14T13:05:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 --2- 172.21.15.55:0/1472390166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6001038f0 0x7fb60010a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 --2- 172.21.15.55:0/1472390166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600101d50 0x7fb600102170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 --2- 172.21.15.55:0/1472390166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb600102f50 0x7fb6001033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 -- 172.21.15.55:0/1472390166 >> 172.21.15.55:0/1472390166 conn(0x7fb6000fd330 msgr2=0x7fb6000ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 -- 172.21.15.55:0/1472390166 shutdown_connections 2024-02-14T13:05:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 -- 172.21.15.55:0/1472390166 wait complete. 2024-02-14T13:05:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 Processor -- start 2024-02-14T13:05:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.589+0000 7fb604aad700 1 -- start start 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600101d50 0x7fb600197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 0x7fb6001981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6001038f0 0x7fb60019f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60019f7c0 con 0x7fb6001038f0 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60019f900 con 0x7fb600102f50 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60019fac0 con 0x7fb600101d50 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 0x7fb6001981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 0x7fb6001981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59706/0 (socket says 172.21.15.55:59706) 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 -- 172.21.15.55:0/571268918 learned_addr learned my addr 172.21.15.55:0/571268918 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fed9d700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6001038f0 0x7fb60019f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fe59c700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600101d50 0x7fb600197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 -- 172.21.15.55:0/571268918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600101d50 msgr2=0x7fb600197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600101d50 0x7fb600197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 -- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6001038f0 msgr2=0x7fb60019f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6001038f0 0x7fb60019f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 -- 172.21.15.55:0/571268918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00095f0 con 0x7fb600102f50 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fe59c700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600101d50 0x7fb600197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fed9d700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6001038f0 0x7fb60019f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5fdd9b700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 0x7fb6001981b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400c9b0 tx=0x7fb5f400cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4007b00 con 0x7fb600102f50 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fb5f4007c60 con 0x7fb600102f50 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.590+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60019fda0 con 0x7fb600102f50 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.591+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4018730 con 0x7fb600102f50 2024-02-14T13:05:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.591+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6001a01e0 con 0x7fb600102f50 2024-02-14T13:05:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.592+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6001091e0 con 0x7fb600102f50 2024-02-14T13:05:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.593+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mon.2 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fb5f4018890 con 0x7fb600102f50 2024-02-14T13:05:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.594+0000 7fb5ef7fe700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5e80a2150 0x7fb5e80a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.594+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mon.2 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fb5f40cd830 con 0x7fb600102f50 2024-02-14T13:05:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.594+0000 7fb5fe59c700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5e80a2150 0x7fb5e80a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.595+0000 7fb5fe59c700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5e80a2150 0x7fb5e80a4610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000c00 tx=0x7fb5f0003860 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:05:11.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.598+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mon.2 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb5f4097030 con 0x7fb600102f50 2024-02-14T13:05:11.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:11.811+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb60002da30 con 0x7fb5e80a2150 2024-02-14T13:05:12.443 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:12 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi012 2024-02-14T13:05:12.443 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:12 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi012 to 4273M 2024-02-14T13:05:12.443 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:05:12.444 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:05:12.444 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:12 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi012 2024-02-14T13:05:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:12 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi012 to 4273M 2024-02-14T13:05:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:05:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:05:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:12 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi012 2024-02-14T13:05:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:12 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi012 to 4273M 2024-02-14T13:05:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:05:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:05:12.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:13.382 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:13 smithi055 ceph-mon[36853]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:05:13.382 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:13 smithi055 ceph-mon[36853]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:13 smithi012 ceph-mon[32370]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:05:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:13 smithi012 ceph-mon[32370]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:13.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:13 smithi103 ceph-mon[36921]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi055:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:05:13.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:13 smithi103 ceph-mon[36921]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:14.854 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:14 smithi055 ceph-mon[36853]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:14.854 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:14 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/808380697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]: dispatch 2024-02-14T13:05:14.854 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:14 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]: dispatch 2024-02-14T13:05:14.854 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:14 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]': finished 2024-02-14T13:05:14.854 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:14 smithi055 ceph-mon[36853]: osdmap e71: 11 total, 10 up, 11 in 2024-02-14T13:05:14.854 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:14 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:14 smithi012 ceph-mon[32370]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:14 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/808380697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]: dispatch 2024-02-14T13:05:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:14 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]: dispatch 2024-02-14T13:05:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:14 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]': finished 2024-02-14T13:05:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:14 smithi012 ceph-mon[32370]: osdmap e71: 11 total, 10 up, 11 in 2024-02-14T13:05:14.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:14 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:14 smithi103 ceph-mon[36921]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:14 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/808380697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]: dispatch 2024-02-14T13:05:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:14 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]: dispatch 2024-02-14T13:05:14.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:14 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c9ebf61-379a-4730-a7da-9f031671d4af"}]': finished 2024-02-14T13:05:14.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:14 smithi103 ceph-mon[36921]: osdmap e71: 11 total, 10 up, 11 in 2024-02-14T13:05:14.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:14 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:15.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:15 smithi012 ceph-mon[32370]: from='client.? 172.21.15.55:0/2579241265' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:05:15.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:15 smithi103 ceph-mon[36921]: from='client.? 172.21.15.55:0/2579241265' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:05:16.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:15 smithi055 ceph-mon[36853]: from='client.? 172.21.15.55:0/2579241265' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:05:16.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:16 smithi012 ceph-mon[32370]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:16.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:16 smithi103 ceph-mon[36921]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:17.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:16 smithi055 ceph-mon[36853]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:18 smithi012 ceph-mon[32370]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:18.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:18 smithi103 ceph-mon[36921]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:18.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:18 smithi055 ceph-mon[36853]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:20.523 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:20 smithi055 ceph-mon[36853]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:20.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:20 smithi012 ceph-mon[32370]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:20.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:20 smithi103 ceph-mon[36921]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:22.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:22 smithi055 ceph-mon[36853]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:22.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:22 smithi012 ceph-mon[32370]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:22.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:22 smithi103 ceph-mon[36921]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:23.692 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-02-14T13:05:23.692 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:23.692 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:23 smithi055 ceph-mon[36853]: Deploying daemon osd.10 on smithi055 2024-02-14T13:05:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-02-14T13:05:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:23 smithi012 ceph-mon[32370]: Deploying daemon osd.10 on smithi055 2024-02-14T13:05:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-02-14T13:05:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:23 smithi103 ceph-mon[36921]: Deploying daemon osd.10 on smithi055 2024-02-14T13:05:24.914 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:24 smithi055 ceph-mon[36853]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:24.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:24 smithi012 ceph-mon[32370]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:24.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:24 smithi103 ceph-mon[36921]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:26.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:26 smithi055 ceph-mon[36853]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:26.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:26 smithi012 ceph-mon[32370]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:26.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:26 smithi103 ceph-mon[36921]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:29.716 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:29 smithi103 ceph-mon[36921]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:29.716 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:29.717 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:29.717 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:29 smithi012 ceph-mon[32370]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:29.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:29.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:29 smithi055 ceph-mon[36853]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:29.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:29.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:29.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:31.631 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:31 smithi055 ceph-mon[36853]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:31.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.677+0000 7fb5ef7fe700 1 -- 172.21.15.55:0/571268918 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fb60002da30 con 0x7fb5e80a2150 2024-02-14T13:05:31.679 INFO:teuthology.orchestra.run.smithi055.stdout:Created osd(s) 10 on host 'smithi055' 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5e80a2150 msgr2=0x7fb5e80a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5e80a2150 0x7fb5e80a4610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000c00 tx=0x7fb5f0003860 comp rx=0 tx=0).stop 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 msgr2=0x7fb6001981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 0x7fb6001981b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400c9b0 tx=0x7fb5f400cd70 comp rx=0 tx=0).stop 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 shutdown_connections 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5e80a2150 0x7fb5e80a4610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6001038f0 0x7fb60019f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600101d50 0x7fb600197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:31.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 --2- 172.21.15.55:0/571268918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb600102f50 0x7fb6001981b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:31.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 >> 172.21.15.55:0/571268918 conn(0x7fb6000fd330 msgr2=0x7fb600106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:31.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 shutdown_connections 2024-02-14T13:05:31.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-02-14T13:05:31.679+0000 7fb604aad700 1 -- 172.21.15.55:0/571268918 wait complete. 2024-02-14T13:05:31.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:31 smithi012 ceph-mon[32370]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:31.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:31 smithi103 ceph-mon[36921]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:32.274 DEBUG:teuthology.orchestra.run.smithi055:osd.10> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.10.service 2024-02-14T13:05:32.276 INFO:tasks.cephadm:Deploying osd.11 on smithi103 with /dev/vg_nvme/lv_1... 2024-02-14T13:05:32.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-14T13:05:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:05:32.926 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.926 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.926 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: from='osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-02-14T13:05:32.927 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-02-14T13:05:32.927 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:32.927 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.927 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: from='osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:32.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:32 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:33.052 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:33.053 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:33.053 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: from='osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-02-14T13:05:33.053 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-02-14T13:05:33.053 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:33.053 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:33.053 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:32 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:33.884 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:33 smithi103 ceph-mon[36921]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-02-14T13:05:33.884 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:33 smithi103 ceph-mon[36921]: osdmap e72: 11 total, 10 up, 11 in 2024-02-14T13:05:33.884 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:33 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:33.884 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:33 smithi103 ceph-mon[36921]: from='osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:05:33.884 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:33 smithi103 ceph-mon[36921]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:05:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:33 smithi012 ceph-mon[32370]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-02-14T13:05:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:33 smithi012 ceph-mon[32370]: osdmap e72: 11 total, 10 up, 11 in 2024-02-14T13:05:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:33 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:33 smithi012 ceph-mon[32370]: from='osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:05:33.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:33 smithi012 ceph-mon[32370]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:05:33.974 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-mon[36853]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-02-14T13:05:33.974 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-mon[36853]: osdmap e72: 11 total, 10 up, 11 in 2024-02-14T13:05:33.974 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:33.974 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-mon[36853]: from='osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:05:33.975 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-mon[36853]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]: dispatch 2024-02-14T13:05:33.975 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:05:33.686+0000 7f739ea18700 -1 osd.10 0 waiting for initial osdmap 2024-02-14T13:05:33.975 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:05:33 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:05:33.700+0000 7f739b013700 -1 osd.10 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:05:34.418 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-14T13:05:34.418 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-14T13:05:34.418 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-02-14T13:05:34.418 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-02-14T13:05:34.419 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112582 s, 931 MB/s 2024-02-14T13:05:34.419 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-02-14T13:05:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:34 smithi012 ceph-mon[32370]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:05:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:34 smithi012 ceph-mon[32370]: osdmap e73: 11 total, 10 up, 11 in 2024-02-14T13:05:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:34 smithi012 ceph-mon[32370]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:34.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:34 smithi103 ceph-mon[36921]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:05:34.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:34 smithi103 ceph-mon[36921]: osdmap e73: 11 total, 10 up, 11 in 2024-02-14T13:05:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:34 smithi103 ceph-mon[36921]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:34 smithi055 ceph-mon[36853]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi055", "root=default"]}]': finished 2024-02-14T13:05:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:34 smithi055 ceph-mon[36853]: osdmap e73: 11 total, 10 up, 11 in 2024-02-14T13:05:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:34 smithi055 ceph-mon[36853]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 894 GiB / 894 GiB avail 2024-02-14T13:05:35.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2024-02-14T13:05:35.416 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:05:35.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:35 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:05:35.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:35 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:05:35.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:35 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:35.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:35 smithi103 ceph-mon[36921]: osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] boot 2024-02-14T13:05:35.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:35 smithi103 ceph-mon[36921]: osdmap e74: 11 total, 11 up, 11 in 2024-02-14T13:05:35.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:35 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:35.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:35 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:05:35.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:35 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:05:35.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:35 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:35.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:35 smithi012 ceph-mon[32370]: osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] boot 2024-02-14T13:05:35.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:35 smithi012 ceph-mon[32370]: osdmap e74: 11 total, 11 up, 11 in 2024-02-14T13:05:35.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:35 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:35 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:05:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:35 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:05:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:35 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:35 smithi055 ceph-mon[36853]: osd.10 [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] boot 2024-02-14T13:05:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:35 smithi055 ceph-mon[36853]: osdmap e74: 11 total, 11 up, 11 in 2024-02-14T13:05:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:35 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-02-14T13:05:36.898 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: osdmap e75: 11 total, 11 up, 11 in 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi055 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi055 to 4271M 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:36.899 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:36.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:36.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.900 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:36 smithi103 ceph-mon[36921]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:36.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: osdmap e75: 11 total, 11 up, 11 in 2024-02-14T13:05:36.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi055 2024-02-14T13:05:36.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi055 to 4271M 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:36.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:36 smithi012 ceph-mon[32370]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 -- 172.21.15.103:0/646178376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc105140 msgr2=0x7f47bc107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 --2- 172.21.15.103:0/646178376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc105140 0x7f47bc107530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009990 tx=0x7f47ac009ca0 comp rx=0 tx=0).stop 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 -- 172.21.15.103:0/646178376 shutdown_connections 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 --2- 172.21.15.103:0/646178376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47bc107a70 0x7f47bc109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 --2- 172.21.15.103:0/646178376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc102810 0x7f47bc104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 --2- 172.21.15.103:0/646178376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc105140 0x7f47bc107530 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 -- 172.21.15.103:0/646178376 >> 172.21.15.103:0/646178376 conn(0x7f47bc0fc240 msgr2=0x7f47bc0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:37.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.998+0000 7f47c46a1700 1 -- 172.21.15.103:0/646178376 shutdown_connections 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 -- 172.21.15.103:0/646178376 wait complete. 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 Processor -- start 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 -- start start 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47bc102810 0x7f47bc197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc105140 0x7f47bc1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 0x7f47bc19f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc19f810 con 0x7f47bc102810 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc19f950 con 0x7f47bc105140 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:36.999+0000 7f47c46a1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc19fb10 con 0x7f47bc107a70 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 0x7f47bc19f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 0x7f47bc19f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49346/0 (socket says 172.21.15.103:49346) 2024-02-14T13:05:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 -- 172.21.15.103:0/3133847358 learned_addr learned my addr 172.21.15.103:0/3133847358 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c243d700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47bc102810 0x7f47bc197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c1c3c700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc105140 0x7f47bc1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 -- 172.21.15.103:0/3133847358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc105140 msgr2=0x7f47bc1981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc105140 0x7f47bc1981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 -- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47bc102810 msgr2=0x7f47bc197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47bc102810 0x7f47bc197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 -- 172.21.15.103:0/3133847358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac0095f0 con 0x7f47bc107a70 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c2c3e700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 0x7f47bc19f240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b9e0 tx=0x7f47b400bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400c930 con 0x7f47bc107a70 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f47b4014440 con 0x7f47bc107a70 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc19fdf0 con 0x7f47bc107a70 2024-02-14T13:05:37.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40125a0 con 0x7f47bc107a70 2024-02-14T13:05:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.000+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc1a02c0 con 0x7f47bc107a70 2024-02-14T13:05:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.001+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0fddc0 con 0x7f47bc107a70 2024-02-14T13:05:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.002+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f47b4014960 con 0x7f47bc107a70 2024-02-14T13:05:37.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.003+0000 7f47b37fe700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47a80a21d0 0x7f47a80a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.003+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f47b4006e40 con 0x7f47bc107a70 2024-02-14T13:05:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.004+0000 7f47c243d700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47a80a21d0 0x7f47a80a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.004+0000 7f47c243d700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47a80a21d0 0x7f47a80a4690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47bc198b70 tx=0x7f47b800a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:05:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.007+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f47b4096a20 con 0x7f47bc107a70 2024-02-14T13:05:37.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: osdmap e75: 11 total, 11 up, 11 in 2024-02-14T13:05:37.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi055 2024-02-14T13:05:37.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi055 to 4271M 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:37.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:36 smithi055 ceph-mon[36853]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:37.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:37.210+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f47bc02d8e0 con 0x7f47a80a21d0 2024-02-14T13:05:37.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:37 smithi012 ceph-mon[32370]: osdmap e76: 11 total, 11 up, 11 in 2024-02-14T13:05:37.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:37 smithi012 ceph-mon[32370]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:05:37.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:05:37.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:05:37.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:37 smithi103 ceph-mon[36921]: osdmap e76: 11 total, 11 up, 11 in 2024-02-14T13:05:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:37 smithi103 ceph-mon[36921]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:05:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:05:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:05:37.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:37 smithi055 ceph-mon[36853]: osdmap e76: 11 total, 11 up, 11 in 2024-02-14T13:05:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:37 smithi055 ceph-mon[36853]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:05:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-14T13:05:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-14T13:05:38.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:38.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:38 smithi103 ceph-mon[36921]: osdmap e77: 11 total, 11 up, 11 in 2024-02-14T13:05:38.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:38 smithi103 ceph-mon[36921]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:39.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:38 smithi055 ceph-mon[36853]: osdmap e77: 11 total, 11 up, 11 in 2024-02-14T13:05:39.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:38 smithi055 ceph-mon[36853]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:39.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:38 smithi012 ceph-mon[32370]: osdmap e77: 11 total, 11 up, 11 in 2024-02-14T13:05:39.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:38 smithi012 ceph-mon[32370]: pgmap v242: 1 pgs: 1 peering; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:39.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:39 smithi103 ceph-mon[36921]: osdmap e78: 11 total, 11 up, 11 in 2024-02-14T13:05:40.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:39 smithi055 ceph-mon[36853]: osdmap e78: 11 total, 11 up, 11 in 2024-02-14T13:05:40.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:39 smithi012 ceph-mon[32370]: osdmap e78: 11 total, 11 up, 11 in 2024-02-14T13:05:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/1333299591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]: dispatch 2024-02-14T13:05:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]: dispatch 2024-02-14T13:05:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]': finished 2024-02-14T13:05:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: osdmap e79: 12 total, 11 up, 12 in 2024-02-14T13:05:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-14T13:05:41.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:40 smithi055 ceph-mon[36853]: from='client.? 172.21.15.103:0/3192053250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:05:41.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/1333299591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]: dispatch 2024-02-14T13:05:41.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]: dispatch 2024-02-14T13:05:41.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]': finished 2024-02-14T13:05:41.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: osdmap e79: 12 total, 11 up, 12 in 2024-02-14T13:05:41.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:41.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-14T13:05:41.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.103:0/3192053250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/1333299591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]: dispatch 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]: dispatch 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5bc702e3-9dd4-469c-8d35-1addfce5dbf3"}]': finished 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: osdmap e79: 12 total, 11 up, 12 in 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-14T13:05:41.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.103:0/3192053250' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-14T13:05:42.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:42 smithi012 ceph-mon[32370]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-02-14T13:05:42.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:42 smithi103 ceph-mon[36921]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-02-14T13:05:42.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:42 smithi055 ceph-mon[36853]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-02-14T13:05:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:44 smithi012 ceph-mon[32370]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-02-14T13:05:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:44 smithi103 ceph-mon[36921]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-02-14T13:05:45.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:44 smithi055 ceph-mon[36853]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-02-14T13:05:46.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:46 smithi103 ceph-mon[36921]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-14T13:05:46.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:46 smithi012 ceph-mon[32370]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-14T13:05:46.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:46 smithi055 ceph-mon[36853]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-14T13:05:47.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-02-14T13:05:47.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:47.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:47 smithi012 ceph-mon[32370]: Deploying daemon osd.11 on smithi103 2024-02-14T13:05:47.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-02-14T13:05:47.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:47.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:47 smithi103 ceph-mon[36921]: Deploying daemon osd.11 on smithi103 2024-02-14T13:05:47.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-02-14T13:05:47.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:47.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:47 smithi055 ceph-mon[36853]: Deploying daemon osd.11 on smithi103 2024-02-14T13:05:48.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:48 smithi012 ceph-mon[32370]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-02-14T13:05:48.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:48 smithi103 ceph-mon[36921]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-02-14T13:05:48.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:48 smithi055 ceph-mon[36853]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-02-14T13:05:50.669 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:50 smithi103 ceph-mon[36921]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:50.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:50 smithi012 ceph-mon[32370]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:50.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:50 smithi055 ceph-mon[36853]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:52.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:52 smithi103 ceph-mon[36921]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:52.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:52 smithi012 ceph-mon[32370]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:52.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:52 smithi055 ceph-mon[36853]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:53.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:53.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:53.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:53 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:54.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:54.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:54.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:53 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:53 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:54.989 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:54 smithi103 ceph-mon[36921]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:55.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:54 smithi055 ceph-mon[36853]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:55.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:54 smithi012 ceph-mon[32370]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:56.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.626+0000 7f47b37fe700 1 -- 172.21.15.103:0/3133847358 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f47bc02d8e0 con 0x7f47a80a21d0 2024-02-14T13:05:56.629 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 11 on host 'smithi103' 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.628+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47a80a21d0 msgr2=0x7f47a80a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.628+0000 7f47c46a1700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47a80a21d0 0x7f47a80a4690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47bc198b70 tx=0x7f47b800a380 comp rx=0 tx=0).stop 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.628+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 msgr2=0x7f47bc19f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.628+0000 7f47c46a1700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 0x7f47bc19f240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b9e0 tx=0x7f47b400bcf0 comp rx=0 tx=0).stop 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 shutdown_connections 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47bc107a70 0x7f47bc19f240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47a80a21d0 0x7f47a80a4690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47bc102810 0x7f47bc197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 --2- 172.21.15.103:0/3133847358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc105140 0x7f47bc1981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 >> 172.21.15.103:0/3133847358 conn(0x7f47bc0fc240 msgr2=0x7f47bc103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:56.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 shutdown_connections 2024-02-14T13:05:56.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:05:56.629+0000 7f47c46a1700 1 -- 172.21.15.103:0/3133847358 wait complete. 2024-02-14T13:05:56.944 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-02-14T13:05:56.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:56 smithi103 ceph-mon[36921]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-02-14T13:05:57.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:57.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-02-14T13:05:57.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:56 smithi055 ceph-mon[36853]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-02-14T13:05:57.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-02-14T13:05:57.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:56 smithi012 ceph-mon[32370]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-02-14T13:05:57.295 DEBUG:teuthology.orchestra.run.smithi103:osd.11> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.11.service 2024-02-14T13:05:57.299 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-02-14T13:05:57.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd stat -f json 2024-02-14T13:05:57.550 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:05:58.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:58 smithi103 ceph-mon[36921]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-02-14T13:05:58.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:58 smithi103 ceph-mon[36921]: osdmap e80: 12 total, 11 up, 12 in 2024-02-14T13:05:58.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:58 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:58.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:58 smithi103 ceph-mon[36921]: from='osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:05:58.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:58 smithi103 ceph-mon[36921]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:05:58.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:58 smithi103 ceph-mon[36921]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:58.862 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:58 smithi055 ceph-mon[36853]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-02-14T13:05:58.863 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:58 smithi055 ceph-mon[36853]: osdmap e80: 12 total, 11 up, 12 in 2024-02-14T13:05:58.863 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:58 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:58.863 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:58 smithi055 ceph-mon[36853]: from='osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:05:58.863 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:58 smithi055 ceph-mon[36853]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:05:58.863 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:58 smithi055 ceph-mon[36853]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:58.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:58 smithi012 ceph-mon[32370]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-02-14T13:05:58.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:58 smithi012 ceph-mon[32370]: osdmap e80: 12 total, 11 up, 12 in 2024-02-14T13:05:58.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:58 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:58.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:58 smithi012 ceph-mon[32370]: from='osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:05:58.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:58 smithi012 ceph-mon[32370]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-02-14T13:05:58.883 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:58 smithi012 ceph-mon[32370]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 -- 172.21.15.12:0/3266813285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594101d80 msgr2=0x7fe5941021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3266813285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594101d80 0x7fe5941021e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5880099c0 tx=0x7fe588009cd0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 -- 172.21.15.12:0/3266813285 shutdown_connections 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3266813285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe594102720 0x7fe594108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3266813285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe594100b80 0x7fe594100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3266813285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594101d80 0x7fe5941021e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 -- 172.21.15.12:0/3266813285 >> 172.21.15.12:0/3266813285 conn(0x7fe5940fc100 msgr2=0x7fe5940fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:59.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 -- 172.21.15.12:0/3266813285 shutdown_connections 2024-02-14T13:05:59.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 -- 172.21.15.12:0/3266813285 wait complete. 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 Processor -- start 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.094+0000 7fe599fa0700 1 -- start start 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe599fa0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe594100b80 0x7fe594197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe599fa0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe594101d80 0x7fe594198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe599fa0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 0x7fe59419f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe599fa0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59419f7a0 con 0x7fe594102720 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe599fa0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59419f8e0 con 0x7fe594100b80 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe599fa0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59419faa0 con 0x7fe594101d80 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 0x7fe59419f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 0x7fe59419f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59022/0 (socket says 172.21.15.12:59022) 2024-02-14T13:05:59.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 -- 172.21.15.12:0/3069527398 learned_addr learned my addr 172.21.15.12:0/3069527398 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe593fff700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe594101d80 0x7fe594198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe598f9e700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe594100b80 0x7fe594197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 -- 172.21.15.12:0/3069527398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe594101d80 msgr2=0x7fe594198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe594101d80 0x7fe594198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 -- 172.21.15.12:0/3069527398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe594100b80 msgr2=0x7fe594197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe594100b80 0x7fe594197c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 -- 172.21.15.12:0/3069527398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880095f0 con 0x7fe594102720 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe59979f700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 0x7fe59419f1d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe58c007ee0 tx=0x7fe58c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.095+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00dd20 con 0x7fe594102720 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.096+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59410d110 con 0x7fe594102720 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.096+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fe58c00f040 con 0x7fe594102720 2024-02-14T13:05:59.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.096+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0048e0 con 0x7fe594102720 2024-02-14T13:05:59.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.096+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59410d610 con 0x7fe594102720 2024-02-14T13:05:59.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.097+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59410cea0 con 0x7fe594102720 2024-02-14T13:05:59.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.098+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fe58c003a00 con 0x7fe594102720 2024-02-14T13:05:59.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.098+0000 7fe591ffb700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe57c0a21d0 0x7fe57c0a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:05:59.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.098+0000 7fe598f9e700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe57c0a21d0 0x7fe57c0a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:05:59.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.098+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fe58c0ccf70 con 0x7fe594102720 2024-02-14T13:05:59.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.099+0000 7fe598f9e700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe57c0a21d0 0x7fe57c0a4690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe594199130 tx=0x7fe584009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:05:59.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.103+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe58c04fd20 con 0x7fe594102720 2024-02-14T13:05:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.307+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe59410c7b0 con 0x7fe594102720 2024-02-14T13:05:59.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.308+0000 7fe591ffb700 1 -- 172.21.15.12:0/3069527398 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7fe58c096500 con 0x7fe594102720 2024-02-14T13:05:59.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe57c0a21d0 msgr2=0x7fe57c0a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe57c0a21d0 0x7fe57c0a4690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe594199130 tx=0x7fe584009190 comp rx=0 tx=0).stop 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 msgr2=0x7fe59419f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 0x7fe59419f1d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe58c007ee0 tx=0x7fe58c00d3b0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 shutdown_connections 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe57c0a21d0 0x7fe57c0a4690 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe594102720 0x7fe59419f1d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe594100b80 0x7fe594197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 --2- 172.21.15.12:0/3069527398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe594101d80 0x7fe594198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 >> 172.21.15.12:0/3069527398 conn(0x7fe5940fc100 msgr2=0x7fe5940fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 shutdown_connections 2024-02-14T13:05:59.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:05:59.310+0000 7fe599fa0700 1 -- 172.21.15.12:0/3069527398 wait complete. 2024-02-14T13:05:59.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-mon[36921]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:05:59.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-mon[36921]: osdmap e81: 12 total, 11 up, 12 in 2024-02-14T13:05:59.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:59.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:59.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3069527398' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-14T13:05:59.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-mon[36921]: from='osd.11 ' entity='osd.11' 2024-02-14T13:05:59.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:05:59.431+0000 7f1c82c61700 -1 osd.11 0 waiting for initial osdmap 2024-02-14T13:05:59.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:05:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:05:59.450+0000 7f1c7b254700 -1 osd.11 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-14T13:05:59.876 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:59 smithi055 ceph-mon[36853]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:05:59.876 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:59 smithi055 ceph-mon[36853]: osdmap e81: 12 total, 11 up, 12 in 2024-02-14T13:05:59.876 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:59 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:59.876 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:59 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:59.876 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:59 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3069527398' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-14T13:05:59.876 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:05:59 smithi055 ceph-mon[36853]: from='osd.11 ' entity='osd.11' 2024-02-14T13:05:59.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:59 smithi012 ceph-mon[32370]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-02-14T13:05:59.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:59 smithi012 ceph-mon[32370]: osdmap e81: 12 total, 11 up, 12 in 2024-02-14T13:05:59.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:59 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:59.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:59 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:05:59.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:59 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3069527398' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-14T13:05:59.957 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:05:59 smithi012 ceph-mon[32370]: from='osd.11 ' entity='osd.11' 2024-02-14T13:05:59.986 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"num_osds":12,"num_up_osds":11,"osd_up_since":1707915934,"num_in_osds":12,"osd_in_since":1707915939,"num_remapped_pgs":0} 2024-02-14T13:06:00.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: purged_snaps scrub starts 2024-02-14T13:06:00.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: purged_snaps scrub ok 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: Detected new or changed devices on smithi103 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: Adjusting osd_memory_target on smithi103 to 4270M 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:06:00.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] boot 2024-02-14T13:06:00.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: osdmap e82: 12 total, 12 up, 12 in 2024-02-14T13:06:00.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:00 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:06:00.987 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd stat -f json 2024-02-14T13:06:00.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: purged_snaps scrub starts 2024-02-14T13:06:00.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: purged_snaps scrub ok 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: Detected new or changed devices on smithi103 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: Adjusting osd_memory_target on smithi103 to 4270M 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:00.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:00.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:06:00.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] boot 2024-02-14T13:06:00.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: osdmap e82: 12 total, 12 up, 12 in 2024-02-14T13:06:00.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:00 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:06:01.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: purged_snaps scrub starts 2024-02-14T13:06:01.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: purged_snaps scrub ok 2024-02-14T13:06:01.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:06:01.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: Detected new or changed devices on smithi103 2024-02-14T13:06:01.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: Adjusting osd_memory_target on smithi103 to 4270M 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 321 MiB used, 983 GiB / 983 GiB avail 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: osd.11 [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] boot 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: osdmap e82: 12 total, 12 up, 12 in 2024-02-14T13:06:01.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:00 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-02-14T13:06:01.242 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:06:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:02 smithi012 ceph-mon[32370]: osdmap e83: 12 total, 12 up, 12 in 2024-02-14T13:06:02.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:02 smithi012 ceph-mon[32370]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:02.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.953+0000 7f385bf07700 1 -- 172.21.15.12:0/3991580477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38541038f0 msgr2=0x7f385410a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:02.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.953+0000 7f385bf07700 1 --2- 172.21.15.12:0/3991580477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38541038f0 0x7f385410a1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f384c00b0d0 tx=0x7f384c00b3e0 comp rx=0 tx=0).stop 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.953+0000 7f385bf07700 1 -- 172.21.15.12:0/3991580477 shutdown_connections 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.953+0000 7f385bf07700 1 --2- 172.21.15.12:0/3991580477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38541038f0 0x7f385410a1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.953+0000 7f385bf07700 1 --2- 172.21.15.12:0/3991580477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101d50 0x7f3854102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.953+0000 7f385bf07700 1 --2- 172.21.15.12:0/3991580477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3854102f50 0x7f38541033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- 172.21.15.12:0/3991580477 >> 172.21.15.12:0/3991580477 conn(0x7f38540fd330 msgr2=0x7f38540ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- 172.21.15.12:0/3991580477 shutdown_connections 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- 172.21.15.12:0/3991580477 wait complete. 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 Processor -- start 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- start start 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101d50 0x7f3854197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 0x7f3854198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38541038f0 0x7f385419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:02.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385419f990 con 0x7f3854102f50 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385419fad0 con 0x7f38541038f0 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.954+0000 7f385bf07700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385419fc60 con 0x7f3854101d50 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 0x7f3854198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 0x7f3854198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59046/0 (socket says 172.21.15.12:59046) 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 -- 172.21.15.12:0/2269696056 learned_addr learned my addr 172.21.15.12:0/2269696056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f3859ca3700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101d50 0x7f3854197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f385a4a4700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38541038f0 0x7f385419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 -- 172.21.15.12:0/2269696056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101d50 msgr2=0x7f3854197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101d50 0x7f3854197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 -- 172.21.15.12:0/2269696056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38541038f0 msgr2=0x7f385419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38541038f0 0x7f385419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 -- 172.21.15.12:0/2269696056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009d00 con 0x7f3854102f50 2024-02-14T13:06:02.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f38594a2700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 0x7f3854198340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f384400d980 tx=0x7f384400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:02.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844009b40 con 0x7f3854102f50 2024-02-14T13:06:02.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f384400b6e0 con 0x7f3854102f50 2024-02-14T13:06:02.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385419ff40 con 0x7f3854102f50 2024-02-14T13:06:02.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400f620 con 0x7f3854102f50 2024-02-14T13:06:02.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.955+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38541a03b0 con 0x7f3854102f50 2024-02-14T13:06:02.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.956+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38541090b0 con 0x7f3854102f50 2024-02-14T13:06:02.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.957+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f3844010460 con 0x7f3854102f50 2024-02-14T13:06:02.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.958+0000 7f384affd700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f38400a2150 0x7f38400a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:02.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.958+0000 7f3859ca3700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f38400a2150 0x7f38400a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:02.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.958+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f38440cd5d0 con 0x7f3854102f50 2024-02-14T13:06:02.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.959+0000 7f3859ca3700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f38400a2150 0x7f38400a4610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3854102db0 tx=0x7f3850009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:02.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:02.962+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3844096a40 con 0x7f3854102f50 2024-02-14T13:06:02.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:02 smithi103 ceph-mon[36921]: osdmap e83: 12 total, 12 up, 12 in 2024-02-14T13:06:02.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:02 smithi103 ceph-mon[36921]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:03.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:02 smithi055 ceph-mon[36853]: osdmap e83: 12 total, 12 up, 12 in 2024-02-14T13:06:03.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:02 smithi055 ceph-mon[36853]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:03.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.161+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f385410d760 con 0x7f3854102f50 2024-02-14T13:06:03.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.162+0000 7f384affd700 1 -- 172.21.15.12:0/2269696056 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v83) v1 ==== 74+0+133 (secure 0 0 0) 0x7f384409a100 con 0x7f3854102f50 2024-02-14T13:06:03.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f38400a2150 msgr2=0x7f38400a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f38400a2150 0x7f38400a4610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3854102db0 tx=0x7f3850009260 comp rx=0 tx=0).stop 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 msgr2=0x7f3854198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 0x7f3854198340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f384400d980 tx=0x7f384400dc90 comp rx=0 tx=0).stop 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 shutdown_connections 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38541038f0 0x7f385419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101d50 0x7f3854197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f38400a2150 0x7f38400a4610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 --2- 172.21.15.12:0/2269696056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102f50 0x7f3854198340 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 >> 172.21.15.12:0/2269696056 conn(0x7f38540fd330 msgr2=0x7f38541061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 shutdown_connections 2024-02-14T13:06:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:03.164+0000 7f385bf07700 1 -- 172.21.15.12:0/2269696056 wait complete. 2024-02-14T13:06:03.826 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:03 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2269696056' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-14T13:06:03.853 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"num_osds":12,"num_up_osds":12,"osd_up_since":1707915960,"num_in_osds":12,"osd_in_since":1707915939,"num_remapped_pgs":0} 2024-02-14T13:06:03.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-14T13:06:03.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:03 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2269696056' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-14T13:06:04.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:03 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2269696056' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-14T13:06:04.097 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:06:04.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:04 smithi012 ceph-mon[32370]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:04.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:04 smithi103 ceph-mon[36921]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:05.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:04 smithi055 ceph-mon[36853]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 -- 172.21.15.12:0/250455702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80102730 msgr2=0x7f3b8010eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 --2- 172.21.15.12:0/250455702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80102730 0x7f3b8010eb70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800b0d0 tx=0x7f3b7800b3e0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 -- 172.21.15.12:0/250455702 shutdown_connections 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 --2- 172.21.15.12:0/250455702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80102730 0x7f3b8010eb70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 --2- 172.21.15.12:0/250455702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 0x7f3b80108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 --2- 172.21.15.12:0/250455702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b80101d70 0x7f3b801021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 -- 172.21.15.12:0/250455702 >> 172.21.15.12:0/250455702 conn(0x7f3b80078e50 msgr2=0x7f3b80079260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 -- 172.21.15.12:0/250455702 shutdown_connections 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 -- 172.21.15.12:0/250455702 wait complete. 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 Processor -- start 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.688+0000 7f3b87868700 1 -- start start 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 0x7f3b80074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b80102730 0x7f3b80074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 0x7f3b80074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801a6620 con 0x7f3b80101d70 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801a6790 con 0x7f3b80102730 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801a6950 con 0x7f3b80107d50 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 0x7f3b80074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 0x7f3b80074020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53928/0 (socket says 172.21.15.12:53928) 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 -- 172.21.15.12:0/4019362034 learned_addr learned my addr 172.21.15.12:0/4019362034 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85e05700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 0x7f3b80074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 -- 172.21.15.12:0/4019362034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 msgr2=0x7f3b80074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 0x7f3b80074aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 -- 172.21.15.12:0/4019362034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b80102730 msgr2=0x7f3b80074560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b80102730 0x7f3b80074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 -- 172.21.15.12:0/4019362034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009d00 con 0x7f3b80101d70 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85e05700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 0x7f3b80074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b85604700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 0x7f3b80074020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c9b0 tx=0x7f3b7c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c007b00 con 0x7f3b80101d70 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3b7c007c60 con 0x7f3b80101d70 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b801a6c30 con 0x7f3b80101d70 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.689+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c018730 con 0x7f3b80101d70 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.690+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b801a7130 con 0x7f3b80101d70 2024-02-14T13:06:05.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.690+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8010a230 con 0x7f3b80101d70 2024-02-14T13:06:05.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.692+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f3b7c018890 con 0x7f3b80101d70 2024-02-14T13:06:05.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.692+0000 7f3b767fc700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3b6c0a2150 0x7f3b6c0a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:05.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.692+0000 7f3b84e03700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3b6c0a2150 0x7f3b6c0a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:05.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.692+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3b7c0cdb70 con 0x7f3b80101d70 2024-02-14T13:06:05.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.693+0000 7f3b84e03700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3b6c0a2150 0x7f3b6c0a4610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b800793c0 tx=0x7f3b70005c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.696+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3b7c096fe0 con 0x7f3b80101d70 2024-02-14T13:06:05.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.897+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b800689e0 con 0x7f3b80101d70 2024-02-14T13:06:05.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.898+0000 7f3b767fc700 1 -- 172.21.15.12:0/4019362034 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f3b7c09a6a0 con 0x7f3b80101d70 2024-02-14T13:06:05.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:05.901 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:01.593958+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:06:05.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3b6c0a2150 msgr2=0x7f3b6c0a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:05.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3b6c0a2150 0x7f3b6c0a4610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b800793c0 tx=0x7f3b70005c80 comp rx=0 tx=0).stop 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 msgr2=0x7f3b80074020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 0x7f3b80074020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c9b0 tx=0x7f3b7c00cd70 comp rx=0 tx=0).stop 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 shutdown_connections 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b80107d50 0x7f3b80074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3b6c0a2150 0x7f3b6c0a4610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b80101d70 0x7f3b80074020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 --2- 172.21.15.12:0/4019362034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b80102730 0x7f3b80074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 >> 172.21.15.12:0/4019362034 conn(0x7f3b80078e50 msgr2=0x7f3b80100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 shutdown_connections 2024-02-14T13:06:05.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:05.900+0000 7f3b87868700 1 -- 172.21.15.12:0/4019362034 wait complete. 2024-02-14T13:06:06.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:05 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/4019362034' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:06.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:05 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/4019362034' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:06.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:05 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/4019362034' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:06.470 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:06:06.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-14T13:06:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:06:07.130 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:06 smithi012 ceph-mon[32370]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:07.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:06 smithi103 ceph-mon[36921]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:07.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:06 smithi055 ceph-mon[36853]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 -- 172.21.15.12:0/2283353146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0107d50 msgr2=0x7f4ae0108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/2283353146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0107d50 0x7f4ae0108130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0099c0 tx=0x7f4adc009cd0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 -- 172.21.15.12:0/2283353146 shutdown_connections 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/2283353146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0102730 0x7f4ae010eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/2283353146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0107d50 0x7f4ae0108130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/2283353146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0101d70 0x7f4ae01021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 -- 172.21.15.12:0/2283353146 >> 172.21.15.12:0/2283353146 conn(0x7f4ae0078e50 msgr2=0x7f4ae0079260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 -- 172.21.15.12:0/2283353146 shutdown_connections 2024-02-14T13:06:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.231+0000 7f4ae81d9700 1 -- 172.21.15.12:0/2283353146 wait complete. 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 Processor -- start 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 -- start start 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 0x7f4ae01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0102730 0x7f4ae0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0107d50 0x7f4ae019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae019d1c0 con 0x7f4ae0101d70 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae019d330 con 0x7f4ae0107d50 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae81d9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae019d4f0 con 0x7f4ae0102730 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae5f75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 0x7f4ae01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae5f75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 0x7f4ae01982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53938/0 (socket says 172.21.15.12:53938) 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae5f75700 1 -- 172.21.15.12:0/3271756130 learned_addr learned my addr 172.21.15.12:0/3271756130 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae6776700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0107d50 0x7f4ae019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.232+0000 7f4ae5774700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0102730 0x7f4ae0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae5f75700 1 -- 172.21.15.12:0/3271756130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0102730 msgr2=0x7f4ae0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae5f75700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0102730 0x7f4ae0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae5f75700 1 -- 172.21.15.12:0/3271756130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0107d50 msgr2=0x7f4ae019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae5f75700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0107d50 0x7f4ae019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae5f75700 1 -- 172.21.15.12:0/3271756130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0095f0 con 0x7f4ae0101d70 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae6776700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0107d50 0x7f4ae019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae5f75700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 0x7f4ae01982e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00b580 tx=0x7f4adc003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc01d070 con 0x7f4ae0101d70 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4adc0040d0 con 0x7f4ae0101d70 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00f460 con 0x7f4ae0101d70 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae019d770 con 0x7f4ae0101d70 2024-02-14T13:06:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.233+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae01a5030 con 0x7f4ae0101d70 2024-02-14T13:06:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.234+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae010a230 con 0x7f4ae0101d70 2024-02-14T13:06:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.235+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f4adc022720 con 0x7f4ae0101d70 2024-02-14T13:06:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.235+0000 7f4ad6ffd700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4acc0a21d0 0x7f4acc0a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.236+0000 7f4ae5774700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4acc0a21d0 0x7f4acc0a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.236+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4adc0cecc0 con 0x7f4ae0101d70 2024-02-14T13:06:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.236+0000 7f4ae5774700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4acc0a21d0 0x7f4acc0a4690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0006fd0 tx=0x7f4ad0008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.239+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4adc0981c0 con 0x7f4ae0101d70 2024-02-14T13:06:08.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.440+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ae0199640 con 0x7f4ae0101d70 2024-02-14T13:06:08.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.441+0000 7f4ad6ffd700 1 -- 172.21.15.12:0/3271756130 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4adc09b880 con 0x7f4ae0101d70 2024-02-14T13:06:08.443 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4acc0a21d0 msgr2=0x7f4acc0a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4acc0a21d0 0x7f4acc0a4690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0006fd0 tx=0x7f4ad0008040 comp rx=0 tx=0).stop 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 msgr2=0x7f4ae01982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 0x7f4ae01982e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00b580 tx=0x7f4adc003710 comp rx=0 tx=0).stop 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 shutdown_connections 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ae0107d50 0x7f4ae019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4acc0a21d0 0x7f4acc0a4690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0101d70 0x7f4ae01982e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 --2- 172.21.15.12:0/3271756130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0102730 0x7f4ae0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 >> 172.21.15.12:0/3271756130 conn(0x7f4ae0078e50 msgr2=0x7f4ae0100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 shutdown_connections 2024-02-14T13:06:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:08.443+0000 7f4ae81d9700 1 -- 172.21.15.12:0/3271756130 wait complete. 2024-02-14T13:06:08.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:08 smithi012 ceph-mon[32370]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:08.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:08 smithi103 ceph-mon[36921]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:08.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:08 smithi055 ceph-mon[36853]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.a on smithi012 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.d on smithi012 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.g on smithi012 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.j on smithi012 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.b on smithi055 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.e on smithi055 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.h on smithi055 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.k on smithi055 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.c on smithi103 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.f on smithi103 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.i on smithi103 2024-02-14T13:06:09.004 INFO:tasks.cephadm:Adding mds.l on smithi103 2024-02-14T13:06:09.005 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph orch apply mds all '12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l' 2024-02-14T13:06:09.256 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.c/config 2024-02-14T13:06:09.679 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:09 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3271756130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:09.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:09 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3271756130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:09.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:09 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3271756130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:10.561 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:10 smithi103 ceph-mon[36921]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:10.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:10 smithi012 ceph-mon[32370]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 -- 172.21.15.103:0/3165025458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8100080 msgr2=0x7f1bf81004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/3165025458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8100080 0x7f1bf81004a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009990 tx=0x7f1be8009ca0 comp rx=0 tx=0).stop 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 -- 172.21.15.103:0/3165025458 shutdown_connections 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/3165025458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8103aa0 0x7f1bf810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/3165025458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8100080 0x7f1bf81004a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/3165025458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf8103100 0x7f1bf8103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 -- 172.21.15.103:0/3165025458 >> 172.21.15.103:0/3165025458 conn(0x7f1bf80fb9c0 msgr2=0x7f1bf80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 -- 172.21.15.103:0/3165025458 shutdown_connections 2024-02-14T13:06:10.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 -- 172.21.15.103:0/3165025458 wait complete. 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.780+0000 7f1bfdd46700 1 Processor -- start 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 -- start start 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf8100080 0x7f1bf8102a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8103100 0x7f1bf81010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 0x7f1bf81015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8101d70 con 0x7f1bf8103100 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf8101ee0 con 0x7f1bf8100080 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bfdd46700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf81a1e10 con 0x7f1bf8103aa0 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 0x7f1bf81015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 0x7f1bf81015f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:32874/0 (socket says 172.21.15.103:32874) 2024-02-14T13:06:10.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 -- 172.21.15.103:0/2146504215 learned_addr learned my addr 172.21.15.103:0/2146504215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf77fe700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf8100080 0x7f1bf8102a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf6ffd700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8103100 0x7f1bf81010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 -- 172.21.15.103:0/2146504215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf8100080 msgr2=0x7f1bf8102a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf8100080 0x7f1bf8102a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 -- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8103100 msgr2=0x7f1bf81010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8103100 0x7f1bf81010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.781+0000 7f1bf7fff700 1 -- 172.21.15.103:0/2146504215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80095f0 con 0x7f1bf8103aa0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.782+0000 7f1bf7fff700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 0x7f1bf81015f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000b970 tx=0x7f1bf000bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.782+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000d860 con 0x7f1bf8103aa0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.782+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf81a20f0 con 0x7f1bf8103aa0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.782+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1bf000e430 con 0x7f1bf8103aa0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.782+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000dea0 con 0x7f1bf8103aa0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.782+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf81a25a0 con 0x7f1bf8103aa0 2024-02-14T13:06:10.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.783+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf81092c0 con 0x7f1bf8103aa0 2024-02-14T13:06:10.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.784+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f1bf000e910 con 0x7f1bf8103aa0 2024-02-14T13:06:10.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.784+0000 7f1bf4ff9700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1be00a2150 0x7f1be00a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:10.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.784+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1bf0006e40 con 0x7f1bf8103aa0 2024-02-14T13:06:10.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.785+0000 7f1bf77fe700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1be00a2150 0x7f1be00a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:10.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.785+0000 7f1bf77fe700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1be00a2150 0x7f1be00a4610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1be8003790 tx=0x7f1be8005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.789+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1bf0096950 con 0x7f1bf8103aa0 2024-02-14T13:06:10.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:10 smithi055 ceph-mon[36853]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:10.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.991+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bf802d8e0 con 0x7f1be00a2150 2024-02-14T13:06:11.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:10.999+0000 7f1bf4ff9700 1 -- 172.21.15.103:0/2146504215 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f1bf802d8e0 con 0x7f1be00a2150 2024-02-14T13:06:11.001 INFO:teuthology.orchestra.run.smithi103.stdout:Scheduled mds.all update... 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.001+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1be00a2150 msgr2=0x7f1be00a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.001+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1be00a2150 0x7f1be00a4610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1be8003790 tx=0x7f1be8005fd0 comp rx=0 tx=0).stop 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.001+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 msgr2=0x7f1bf81015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.001+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 0x7f1bf81015f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000b970 tx=0x7f1bf000bc80 comp rx=0 tx=0).stop 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 shutdown_connections 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bf8103aa0 0x7f1bf81015f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf8100080 0x7f1bf8102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1be00a2150 0x7f1be00a4610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 --2- 172.21.15.103:0/2146504215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8103100 0x7f1bf81010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 >> 172.21.15.103:0/2146504215 conn(0x7f1bf80fb9c0 msgr2=0x7f1bf8106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 shutdown_connections 2024-02-14T13:06:11.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-02-14T13:06:11.002+0000 7f1bfdd46700 1 -- 172.21.15.103:0/2146504215 wait complete. 2024-02-14T13:06:11.587 DEBUG:teuthology.orchestra.run.smithi012:mds.a> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.a.service 2024-02-14T13:06:11.590 DEBUG:teuthology.orchestra.run.smithi012:mds.d> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.d.service 2024-02-14T13:06:11.632 DEBUG:teuthology.orchestra.run.smithi012:mds.g> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.g.service 2024-02-14T13:06:11.675 DEBUG:teuthology.orchestra.run.smithi012:mds.j> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.j.service 2024-02-14T13:06:11.718 DEBUG:teuthology.orchestra.run.smithi055:mds.b> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.b.service 2024-02-14T13:06:11.721 DEBUG:teuthology.orchestra.run.smithi055:mds.e> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.e.service 2024-02-14T13:06:11.764 DEBUG:teuthology.orchestra.run.smithi055:mds.h> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.h.service 2024-02-14T13:06:11.807 DEBUG:teuthology.orchestra.run.smithi055:mds.k> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.k.service 2024-02-14T13:06:11.850 DEBUG:teuthology.orchestra.run.smithi103:mds.c> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.c.service 2024-02-14T13:06:11.852 DEBUG:teuthology.orchestra.run.smithi103:mds.f> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.f.service 2024-02-14T13:06:11.894 DEBUG:teuthology.orchestra.run.smithi103:mds.i> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.i.service 2024-02-14T13:06:11.937 DEBUG:teuthology.orchestra.run.smithi103:mds.l> sudo journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.l.service 2024-02-14T13:06:11.980 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-02-14T13:06:11.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 -- 172.21.15.12:0/1725434241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c0fffc0 msgr2=0x7f529c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 --2- 172.21.15.12:0/1725434241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c0fffc0 0x7f529c1003e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5294009900 tx=0x7f529402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 -- 172.21.15.12:0/1725434241 shutdown_connections 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 --2- 172.21.15.12:0/1725434241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529c101b70 0x7f529c108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 --2- 172.21.15.12:0/1725434241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f529c1011b0 0x7f529c101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 --2- 172.21.15.12:0/1725434241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c0fffc0 0x7f529c1003e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 -- 172.21.15.12:0/1725434241 >> 172.21.15.12:0/1725434241 conn(0x7f529c0fb510 msgr2=0x7f529c0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 -- 172.21.15.12:0/1725434241 shutdown_connections 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 -- 172.21.15.12:0/1725434241 wait complete. 2024-02-14T13:06:12.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.119+0000 7f52a1002640 1 Processor -- start 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 -- start start 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529c0fffc0 0x7f529c196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 0x7f529c1965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f529c101b70 0x7f529c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19db80 con 0x7f529c1011b0 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19dcf0 con 0x7f529c0fffc0 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f52a1002640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c19deb0 con 0x7f529c101b70 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 0x7f529c1965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 0x7f529c1965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53962/0 (socket says 172.21.15.12:53962) 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 -- 172.21.15.12:0/2283882527 learned_addr learned my addr 172.21.15.12:0/2283882527 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529b59e640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f529c101b70 0x7f529c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529ad9d640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529c0fffc0 0x7f529c196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 -- 172.21.15.12:0/2283882527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f529c101b70 msgr2=0x7f529c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f529c101b70 0x7f529c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 -- 172.21.15.12:0/2283882527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529c0fffc0 msgr2=0x7f529c196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529c0fffc0 0x7f529c196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 -- 172.21.15.12:0/2283882527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294009560 con 0x7f529c1011b0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.120+0000 7f529a59c640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 0x7f529c1965d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f529000e9f0 tx=0x7f529000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.121+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290009720 con 0x7f529c1011b0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.121+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c19e190 con 0x7f529c1011b0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.121+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f529000cd80 con 0x7f529c1011b0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.121+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290010690 con 0x7f529c1011b0 2024-02-14T13:06:12.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.121+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c19e6a0 con 0x7f529c1011b0 2024-02-14T13:06:12.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.122+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529c107400 con 0x7f529c1011b0 2024-02-14T13:06:12.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.123+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f52900046c0 con 0x7f529c1011b0 2024-02-14T13:06:12.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.123+0000 7f5283fff640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52840a20c0 0x7f52840a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.124+0000 7f529ad9d640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52840a20c0 0x7f52840a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.124+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5290014070 con 0x7f529c1011b0 2024-02-14T13:06:12.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.124+0000 7f529ad9d640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52840a20c0 0x7f52840a4580 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5294005ab0 tx=0x7f5294005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:12.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.127+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f52900971d0 con 0x7f529c1011b0 2024-02-14T13:06:12.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:12.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l;count:12 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:12.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:11 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l;count:12 2024-02-14T13:06:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:12.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:12.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:12.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:12.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:12.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:12.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:11 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:12.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.311+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f529c10bbb0 con 0x7f529c1011b0 2024-02-14T13:06:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.312+0000 7f5283fff640 1 -- 172.21.15.12:0/2283882527 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f529009a890 con 0x7f529c1011b0 2024-02-14T13:06:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:01.593958+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52840a20c0 msgr2=0x7f52840a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52840a20c0 0x7f52840a4580 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5294005ab0 tx=0x7f5294005fd0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 msgr2=0x7f529c1965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 0x7f529c1965d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f529000e9f0 tx=0x7f529000edf0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 shutdown_connections 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52840a20c0 0x7f52840a4580 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f529c101b70 0x7f529c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f529c1011b0 0x7f529c1965d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 --2- 172.21.15.12:0/2283882527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f529c0fffc0 0x7f529c196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 >> 172.21.15.12:0/2283882527 conn(0x7f529c0fb510 msgr2=0x7f529c1045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 shutdown_connections 2024-02-14T13:06:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.314+0000 7f52a1002640 1 -- 172.21.15.12:0/2283882527 wait complete. 2024-02-14T13:06:12.326 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:12.326 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l;count:12 2024-02-14T13:06:12.326 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:12.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:11 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:12.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:06:12.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 -- 172.21.15.12:0/1705936095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58200ff2c0 msgr2=0x7f58200ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 --2- 172.21.15.12:0/1705936095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58200ff2c0 0x7f58200ff740 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5814009900 tx=0x7f581402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 -- 172.21.15.12:0/1705936095 shutdown_connections 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 --2- 172.21.15.12:0/1705936095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ffc80 0x7f5820109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 --2- 172.21.15.12:0/1705936095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58200ff2c0 0x7f58200ff740 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 --2- 172.21.15.12:0/1705936095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5820102850 0x7f5820102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 -- 172.21.15.12:0/1705936095 >> 172.21.15.12:0/1705936095 conn(0x7f58200fae60 msgr2=0x7f58200fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 -- 172.21.15.12:0/1705936095 shutdown_connections 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.432+0000 7f58263d6640 1 -- 172.21.15.12:0/1705936095 wait complete. 2024-02-14T13:06:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 Processor -- start 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 -- start start 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ff2c0 0x7f5820197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58200ffc80 0x7f5820197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 0x7f582019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582019ed30 con 0x7f5820102850 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582019eea0 con 0x7f58200ffc80 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f58263d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582019f060 con 0x7f58200ff2c0 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 0x7f582019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 0x7f582019e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53970/0 (socket says 172.21.15.12:53970) 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 -- 172.21.15.12:0/944454395 learned_addr learned my addr 172.21.15.12:0/944454395 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f581f7fe640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58200ffc80 0x7f5820197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f581ffff640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ff2c0 0x7f5820197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 -- 172.21.15.12:0/944454395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ff2c0 msgr2=0x7f5820197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ff2c0 0x7f5820197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 -- 172.21.15.12:0/944454395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58200ffc80 msgr2=0x7f5820197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58200ffc80 0x7f5820197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f5824973640 1 -- 172.21.15.12:0/944454395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814009560 con 0x7f5820102850 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.433+0000 7f581ffff640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ff2c0 0x7f5820197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.434+0000 7f5824973640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 0x7f582019e7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f581800eaa0 tx=0x7f581800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.434+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800cdb0 con 0x7f5820102850 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.434+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5818005020 con 0x7f5820102850 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.434+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180116b0 con 0x7f5820102850 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.434+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582019f340 con 0x7f5820102850 2024-02-14T13:06:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.434+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582019f870 con 0x7f5820102850 2024-02-14T13:06:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.435+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58201086b0 con 0x7f5820102850 2024-02-14T13:06:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.436+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f5818005520 con 0x7f5820102850 2024-02-14T13:06:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.436+0000 7f581d7fa640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f58080a2140 0x7f58080a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.437+0000 7f581ffff640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f58080a2140 0x7f58080a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.437+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58180cddc0 con 0x7f5820102850 2024-02-14T13:06:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.437+0000 7f581ffff640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f58080a2140 0x7f58080a4600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5820069580 tx=0x7f581000a5e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:12.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.440+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5818097210 con 0x7f5820102850 2024-02-14T13:06:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.621+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f582002ce50 con 0x7f5820102850 2024-02-14T13:06:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.621+0000 7f581d7fa640 1 -- 172.21.15.12:0/944454395 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f581801f020 con 0x7f5820102850 2024-02-14T13:06:12.623 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:06:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f58080a2140 msgr2=0x7f58080a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f58080a2140 0x7f58080a4600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5820069580 tx=0x7f581000a5e0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 msgr2=0x7f582019e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 0x7f582019e7f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f581800eaa0 tx=0x7f581800ef60 comp rx=0 tx=0).stop 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 shutdown_connections 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f58080a2140 0x7f58080a4600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5820102850 0x7f582019e7f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58200ffc80 0x7f5820197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 --2- 172.21.15.12:0/944454395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58200ff2c0 0x7f5820197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.623+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 >> 172.21.15.12:0/944454395 conn(0x7f58200fae60 msgr2=0x7f5820105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.624+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 shutdown_connections 2024-02-14T13:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.624+0000 7f58263d6640 1 -- 172.21.15.12:0/944454395 wait complete. 2024-02-14T13:06:12.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:12.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/2867931099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101d00 msgr2=0x7f2b84108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/2867931099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101d00 0x7f2b84108590 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009ca0 tx=0x7f2b8002c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/2867931099 shutdown_connections 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/2867931099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101d00 0x7f2b84108590 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/2867931099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b84101340 0x7f2b841017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/2867931099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84100150 0x7f2b84100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.736+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/2867931099 >> 172.21.15.12:0/2867931099 conn(0x7f2b840fb6c0 msgr2=0x7f2b840fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/2867931099 shutdown_connections 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/2867931099 wait complete. 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 Processor -- start 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 -- start start 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b84100150 0x7f2b841972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 0x7f2b84197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84101d00 0x7f2b8419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8419ede0 con 0x7f2b84101340 2024-02-14T13:06:12.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8419ef50 con 0x7f2b84101d00 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b8c1d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8419f110 con 0x7f2b84100150 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b89771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 0x7f2b84197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b89771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 0x7f2b84197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53982/0 (socket says 172.21.15.12:53982) 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.737+0000 7f2b89771640 1 -- 172.21.15.12:0/1808689708 learned_addr learned my addr 172.21.15.12:0/1808689708 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b8a773640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84101d00 0x7f2b8419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89f72640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b84100150 0x7f2b841972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89771640 1 -- 172.21.15.12:0/1808689708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b84100150 msgr2=0x7f2b841972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89771640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b84100150 0x7f2b841972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89771640 1 -- 172.21.15.12:0/1808689708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84101d00 msgr2=0x7f2b8419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89771640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84101d00 0x7f2b8419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89771640 1 -- 172.21.15.12:0/1808689708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80009900 con 0x7f2b84101340 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b8a773640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84101d00 0x7f2b8419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b89771640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 0x7f2b84197830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c970 tx=0x7f2b7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74007bb0 con 0x7f2b84101340 2024-02-14T13:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2b74007d10 con 0x7f2b84101340 2024-02-14T13:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8419f3f0 con 0x7f2b84101340 2024-02-14T13:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400f450 con 0x7f2b84101340 2024-02-14T13:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.738+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8419f900 con 0x7f2b84101340 2024-02-14T13:06:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.739+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b84107410 con 0x7f2b84101340 2024-02-14T13:06:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.740+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f2b74004f50 con 0x7f2b84101340 2024-02-14T13:06:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.741+0000 7f2b7affd640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2b700a2140 0x7f2b700a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.741+0000 7f2b89f72640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2b700a2140 0x7f2b700a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.741+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2b740cda00 con 0x7f2b84101340 2024-02-14T13:06:12.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.741+0000 7f2b89f72640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2b700a2140 0x7f2b700a4600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b841011a0 tx=0x7f2b7c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:12.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.744+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b74096e50 con 0x7f2b84101340 2024-02-14T13:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.964+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b8410cc60 con 0x7f2b84101340 2024-02-14T13:06:12.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.964+0000 7f2b7affd640 1 -- 172.21.15.12:0/1808689708 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f2b7401d090 con 0x7f2b84101340 2024-02-14T13:06:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-02-14T13:06:12.967 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2b700a2140 msgr2=0x7f2b700a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2b700a2140 0x7f2b700a4600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b841011a0 tx=0x7f2b7c005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 msgr2=0x7f2b84197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 0x7f2b84197830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c970 tx=0x7f2b7400ce30 comp rx=0 tx=0).stop 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 shutdown_connections 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f2b700a2140 0x7f2b700a4600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b84101d00 0x7f2b8419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b84101340 0x7f2b84197830 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 --2- 172.21.15.12:0/1808689708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b84100150 0x7f2b841972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 >> 172.21.15.12:0/1808689708 conn(0x7f2b840fb6c0 msgr2=0x7f2b841045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 shutdown_connections 2024-02-14T13:06:12.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:12.967+0000 7f2b8c1d6640 1 -- 172.21.15.12:0/1808689708 wait complete. 2024-02-14T13:06:13.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:13 smithi103 ceph-mon[36921]: Deploying daemon mds.l on smithi103 2024-02-14T13:06:13.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:13 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2283882527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:13.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:13 smithi103 ceph-mon[36921]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:13.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:13 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/944454395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:13.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:13 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1808689708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:13.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:13 smithi055 ceph-mon[36853]: Deploying daemon mds.l on smithi103 2024-02-14T13:06:13.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:13 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2283882527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:13.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:13 smithi055 ceph-mon[36853]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:13.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:13 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/944454395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:13.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:13 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1808689708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:13 smithi012 ceph-mon[32370]: Deploying daemon mds.l on smithi103 2024-02-14T13:06:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:13 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2283882527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:13 smithi012 ceph-mon[32370]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:13 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/944454395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:13.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:13 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1808689708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:13.932 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:13 smithi103 systemd[1]: Starting Ceph mds.l for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:14.210 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:13 smithi103 podman[66767]: 2024-02-14 13:06:13.930920389 +0000 UTC m=+0.106095478 container create 3d198de0754567ae93ddc3f6b2effbe90e668ea4f9ca7aacdaf936beac0181af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2) 2024-02-14T13:06:14.210 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:13 smithi103 podman[66767]: 2024-02-14 13:06:13.84250887 +0000 UTC m=+0.017683980 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:14.210 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:14 smithi103 podman[66767]: 2024-02-14 13:06:14.125132638 +0000 UTC m=+0.300307732 container init 3d198de0754567ae93ddc3f6b2effbe90e668ea4f9ca7aacdaf936beac0181af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-14T13:06:14.211 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:14 smithi103 podman[66767]: 2024-02-14 13:06:14.12784922 +0000 UTC m=+0.303024313 container start 3d198de0754567ae93ddc3f6b2effbe90e668ea4f9ca7aacdaf936beac0181af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:06:14.211 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:14 smithi103 ceph-mds[66786]: -- 172.21.15.103:0/4043072996 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5596c0c6f520 con 0x5596c0c44800 2024-02-14T13:06:14.211 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l[66782]: starting mds.l at 2024-02-14T13:06:14.211 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:14 smithi103 bash[66767]: 3d198de0754567ae93ddc3f6b2effbe90e668ea4f9ca7aacdaf936beac0181af 2024-02-14T13:06:14.491 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:06:14 smithi103 systemd[1]: Started Ceph mds.l for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:14.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 -- 172.21.15.12:0/899032407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102e00 msgr2=0x7f9540109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 --2- 172.21.15.12:0/899032407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102e00 0x7f9540109690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9538009ca0 tx=0x7f953802c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 -- 172.21.15.12:0/899032407 shutdown_connections 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 --2- 172.21.15.12:0/899032407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102e00 0x7f9540109690 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 --2- 172.21.15.12:0/899032407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9540102440 0x7f95401028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 --2- 172.21.15.12:0/899032407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 0x7f9540101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 -- 172.21.15.12:0/899032407 >> 172.21.15.12:0/899032407 conn(0x7f95400fc7e0 msgr2=0x7f95400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 -- 172.21.15.12:0/899032407 shutdown_connections 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.093+0000 7f9546815640 1 -- 172.21.15.12:0/899032407 wait complete. 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 Processor -- start 2024-02-14T13:06:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 -- start start 2024-02-14T13:06:15.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 0x7f9540197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 0x7f95401977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9540102e00 0x7f954019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954019ed70 con 0x7f9540102440 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954019eee0 con 0x7f9540101250 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9546815640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954019f0a0 con 0x7f9540102e00 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 0x7f95401977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 0x7f95401977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34128/0 (socket says 172.21.15.12:34128) 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 -- 172.21.15.12:0/3767896096 learned_addr learned my addr 172.21.15.12:0/3767896096 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:15.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f9544db2640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9540102e00 0x7f954019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953ffff640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 0x7f9540197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 -- 172.21.15.12:0/3767896096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9540102e00 msgr2=0x7f954019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9540102e00 0x7f954019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 -- 172.21.15.12:0/3767896096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 msgr2=0x7f9540197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.094+0000 7f953f7fe640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 0x7f9540197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f953f7fe640 1 -- 172.21.15.12:0/3767896096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538009900 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f953ffff640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 0x7f9540197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f953f7fe640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 0x7f95401977c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f953400d770 tx=0x7f953400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534009c30 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f953400de80 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954019f380 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534004e80 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.095+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954019f840 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.096+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9540108640 con 0x7f9540102440 2024-02-14T13:06:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.097+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f9534005020 con 0x7f9540102440 2024-02-14T13:06:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.097+0000 7f953d7fa640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f95280a20c0 0x7f95280a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.098+0000 7f953ffff640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f95280a20c0 0x7f95280a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.098+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f95340cd2e0 con 0x7f9540102440 2024-02-14T13:06:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.098+0000 7f953ffff640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f95280a20c0 0x7f95280a4580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95300058c0 tx=0x7f9530005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:15.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.102+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f95340966b0 con 0x7f9540102440 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.103:6832/11363714,v1:172.21.15.103:6833/11363714] up:boot 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: fsmap 1 up:standby 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:15.242 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:15.243 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: Deploying daemon mds.k on smithi055 2024-02-14T13:06:15.243 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:15 smithi055 ceph-mon[36853]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:15.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.328+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f954002ce50 con 0x7f9540102440 2024-02-14T13:06:15.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.329+0000 7f953d7fa640 1 -- 172.21.15.12:0/3767896096 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1322 (secure 0 0 0) 0x7f9534099d70 con 0x7f9540102440 2024-02-14T13:06:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:15.331 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-14T13:06:15.331 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f95280a20c0 msgr2=0x7f95280a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f95280a20c0 0x7f95280a4580 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95300058c0 tx=0x7f9530005850 comp rx=0 tx=0).stop 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 msgr2=0x7f95401977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 0x7f95401977c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f953400d770 tx=0x7f953400dc30 comp rx=0 tx=0).stop 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 shutdown_connections 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f95280a20c0 0x7f95280a4580 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9540102e00 0x7f954019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9540102440 0x7f95401977c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 --2- 172.21.15.12:0/3767896096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9540101250 0x7f9540197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 >> 172.21.15.12:0/3767896096 conn(0x7f95400fc7e0 msgr2=0x7f9540105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 shutdown_connections 2024-02-14T13:06:15.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:15.331+0000 7f9546815640 1 -- 172.21.15.12:0/3767896096 wait complete. 2024-02-14T13:06:15.342 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.103:6832/11363714,v1:172.21.15.103:6833/11363714] up:boot 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: fsmap 1 up:standby 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: Deploying daemon mds.k on smithi055 2024-02-14T13:06:15.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:15 smithi012 ceph-mon[32370]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.103:6832/11363714,v1:172.21.15.103:6833/11363714] up:boot 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: fsmap 1 up:standby 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:15.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: Deploying daemon mds.k on smithi055 2024-02-14T13:06:15.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:15 smithi103 ceph-mon[36921]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:16.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:16 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3767896096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:16.561 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 systemd[1]: Starting Ceph mds.k for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:16.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:16 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3767896096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:16.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:16 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3767896096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:16.969 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 podman[67011]: 2024-02-14 13:06:16.614035636 +0000 UTC m=+0.017874123 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:16.969 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 podman[67011]: 2024-02-14 13:06:16.738394263 +0000 UTC m=+0.142232787 container create 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-14T13:06:16.969 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 podman[67011]: 2024-02-14 13:06:16.94095557 +0000 UTC m=+0.344794056 container init 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-14T13:06:16.969 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 podman[67011]: 2024-02-14 13:06:16.943581214 +0000 UTC m=+0.347419692 container start 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240131) 2024-02-14T13:06:16.969 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 ceph-mds[67031]: -- 172.21.15.55:0/1542410899 <== mon.2 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557fb8663520 con 0x557fb8638800 2024-02-14T13:06:17.309 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k[67027]: starting mds.k at 2024-02-14T13:06:17.309 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:17 smithi055 bash[67011]: 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f 2024-02-14T13:06:17.309 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:06:17 smithi055 systemd[1]: Started Ceph mds.k for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:17.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 -- 172.21.15.12:0/1808191699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 msgr2=0x7f96341017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 --2- 172.21.15.12:0/1808191699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f96341017c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9620009980 tx=0x7f962002de60 comp rx=0 tx=0).stop 2024-02-14T13:06:17.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 -- 172.21.15.12:0/1808191699 shutdown_connections 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 --2- 172.21.15.12:0/1808191699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9634101d00 0x7f9634108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 --2- 172.21.15.12:0/1808191699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f96341017c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 --2- 172.21.15.12:0/1808191699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 0x7f9634100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 -- 172.21.15.12:0/1808191699 >> 172.21.15.12:0/1808191699 conn(0x7f96340fb6c0 msgr2=0x7f96340fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 -- 172.21.15.12:0/1808191699 shutdown_connections 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.447+0000 7f963b01c640 1 -- 172.21.15.12:0/1808191699 wait complete. 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 Processor -- start 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 -- start start 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 0x7f96341994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f9634199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9634101d00 0x7f96341a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96341a0fb0 con 0x7f9634101340 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96341a1120 con 0x7f9634100150 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f963b01c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96341a12e0 con 0x7f9634101d00 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f9634199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f9634199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34152/0 (socket says 172.21.15.12:34152) 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 -- 172.21.15.12:0/2850584859 learned_addr learned my addr 172.21.15.12:0/2850584859 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f96395b9640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9634101d00 0x7f96341a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9638db8640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 0x7f96341994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 -- 172.21.15.12:0/2850584859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9634101d00 msgr2=0x7f96341a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:17.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9634101d00 0x7f96341a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 -- 172.21.15.12:0/2850584859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 msgr2=0x7f96341994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 0x7f96341994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9633fff640 1 -- 172.21.15.12:0/2850584859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9620009560 con 0x7f9634101340 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.448+0000 7f9638db8640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 0x7f96341994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.449+0000 7f9633fff640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f9634199a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9620009230 tx=0x7f9620004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.449+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620003a00 con 0x7f9634101340 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.449+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f9620003b60 con 0x7f9634101340 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.449+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96341a1560 con 0x7f9634101340 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.449+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620040710 con 0x7f9634101340 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.449+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96341a1a60 con 0x7f9634101340 2024-02-14T13:06:17.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.450+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96341074f0 con 0x7f9634101340 2024-02-14T13:06:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.452+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f9620003cd0 con 0x7f9634101340 2024-02-14T13:06:17.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.453+0000 7f9631ffb640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f96240a2140 0x7f96240a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.453+0000 7f9638db8640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f96240a2140 0x7f96240a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.453+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f96200efd50 con 0x7f9634101340 2024-02-14T13:06:17.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.453+0000 7f9638db8640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f96240a2140 0x7f96240a4600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96280058c0 tx=0x7f9628005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:17.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.457+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9620123d20 con 0x7f9634101340 2024-02-14T13:06:17.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:17.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:17.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:17.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:17 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:17.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.680+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f963410aa50 con 0x7f9634101340 2024-02-14T13:06:17.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.680+0000 7f9631ffb640 1 -- 172.21.15.12:0/2850584859 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2113 (secure 0 0 0) 0x7f96200b9120 con 0x7f9634101340 2024-02-14T13:06:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:17.683 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-14T13:06:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-02-14T13:06:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f96240a2140 msgr2=0x7f96240a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f96240a2140 0x7f96240a4600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96280058c0 tx=0x7f9628005850 comp rx=0 tx=0).stop 2024-02-14T13:06:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 msgr2=0x7f9634199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f9634199a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9620009230 tx=0x7f9620004430 comp rx=0 tx=0).stop 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 shutdown_connections 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f96240a2140 0x7f96240a4600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9634101d00 0x7f96341a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9634101340 0x7f9634199a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 --2- 172.21.15.12:0/2850584859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9634100150 0x7f96341994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 >> 172.21.15.12:0/2850584859 conn(0x7f96340fb6c0 msgr2=0x7f96341046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 shutdown_connections 2024-02-14T13:06:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:17.683+0000 7f963b01c640 1 -- 172.21.15.12:0/2850584859 wait complete. 2024-02-14T13:06:17.695 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:17.695 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.695 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.695 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.696 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:17.696 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:17.696 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:17 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:17.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:17.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:17 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:18.358 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:18 smithi055 ceph-mon[36853]: Deploying daemon mds.j on smithi012 2024-02-14T13:06:18.358 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:18 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.55:6832/3784712131,v1:172.21.15.55:6833/3784712131] up:boot 2024-02-14T13:06:18.358 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:18 smithi055 ceph-mon[36853]: fsmap 2 up:standby 2024-02-14T13:06:18.358 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:18 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-02-14T13:06:18.358 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:18 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2850584859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:18 smithi012 ceph-mon[32370]: Deploying daemon mds.j on smithi012 2024-02-14T13:06:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:18 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.55:6832/3784712131,v1:172.21.15.55:6833/3784712131] up:boot 2024-02-14T13:06:18.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:18 smithi012 ceph-mon[32370]: fsmap 2 up:standby 2024-02-14T13:06:18.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:18 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-02-14T13:06:18.718 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:18 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2850584859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:18.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:18 smithi103 ceph-mon[36921]: Deploying daemon mds.j on smithi012 2024-02-14T13:06:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:18 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.55:6832/3784712131,v1:172.21.15.55:6833/3784712131] up:boot 2024-02-14T13:06:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:18 smithi103 ceph-mon[36921]: fsmap 2 up:standby 2024-02-14T13:06:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:18 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-02-14T13:06:18.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:18 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2850584859' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:19.316 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 systemd[1]: Starting Ceph mds.j for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:19.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:19 smithi012 ceph-mon[32370]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:19.591 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 podman[72906]: 2024-02-14 13:06:19.474554186 +0000 UTC m=+0.112762087 container create 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-14T13:06:19.591 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 podman[72906]: 2024-02-14 13:06:19.380536692 +0000 UTC m=+0.018744609 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:19.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:19.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:19 smithi103 ceph-mon[36921]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.807+0000 7fc856a4e640 1 -- 172.21.15.12:0/1212090368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850075210 msgr2=0x7fc850073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.807+0000 7fc856a4e640 1 --2- 172.21.15.12:0/1212090368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850075210 0x7fc850073660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc840009900 tx=0x7fc84002bcd0 comp rx=0 tx=0).stop 2024-02-14T13:06:19.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.807+0000 7fc856a4e640 1 -- 172.21.15.12:0/1212090368 shutdown_connections 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.807+0000 7fc856a4e640 1 --2- 172.21.15.12:0/1212090368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8501090e0 0x7fc85010b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 --2- 172.21.15.12:0/1212090368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850073c30 0x7fc850074090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 --2- 172.21.15.12:0/1212090368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850075210 0x7fc850073660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 -- 172.21.15.12:0/1212090368 >> 172.21.15.12:0/1212090368 conn(0x7fc8500fc7e0 msgr2=0x7fc8500fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 -- 172.21.15.12:0/1212090368 shutdown_connections 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 -- 172.21.15.12:0/1212090368 wait complete. 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 Processor -- start 2024-02-14T13:06:19.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.808+0000 7fc856a4e640 1 -- start start 2024-02-14T13:06:19.812 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:19 smithi055 ceph-mon[36853]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc856a4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 0x7fc85019d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc856a4e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850075210 0x7fc85019de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc856a4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8501090e0 0x7fc8501a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc856a4e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501a53b0 con 0x7fc850073c30 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc856a4e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501a5520 con 0x7fc850075210 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc856a4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501a56e0 con 0x7fc8501090e0 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 0x7fc85019d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:19.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 0x7fc85019d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34196/0 (socket says 172.21.15.12:34196) 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 -- 172.21.15.12:0/615320788 learned_addr learned my addr 172.21.15.12:0/615320788 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84f7fe640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850075210 0x7fc85019de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 -- 172.21.15.12:0/615320788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8501090e0 msgr2=0x7fc8501a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc854feb640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8501090e0 0x7fc8501a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8501090e0 0x7fc8501a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 -- 172.21.15.12:0/615320788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850075210 msgr2=0x7fc85019de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850075210 0x7fc85019de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:19.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.809+0000 7fc84ffff640 1 -- 172.21.15.12:0/615320788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840009560 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.810+0000 7fc84ffff640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 0x7fc85019d8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc840006010 tx=0x7fc8400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.810+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400044e0 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.810+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8501a5960 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.810+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc8400054e0 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.810+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84003e450 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.810+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8501a5ec0 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.811+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc850104b40 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.813+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fc8400035f0 con 0x7fc850073c30 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.813+0000 7fc84d7fa640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8380a20c0 0x7fc8380a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:19.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.814+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc8400f09c0 con 0x7fc850073c30 2024-02-14T13:06:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.814+0000 7fc84f7fe640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8380a20c0 0x7fc8380a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.814+0000 7fc84f7fe640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8380a20c0 0x7fc8380a4580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc844005d00 tx=0x7fc844005c50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:19.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:19.817+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc8400b9d90 con 0x7fc850073c30 2024-02-14T13:06:19.967 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 podman[72906]: 2024-02-14 13:06:19.702196757 +0000 UTC m=+0.340404671 container init 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=) 2024-02-14T13:06:19.967 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 podman[72906]: 2024-02-14 13:06:19.704968909 +0000 UTC m=+0.343176811 container start 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-14T13:06:19.968 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 ceph-mds[72938]: -- 172.21.15.12:0/2655229417 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555e2eb91520 con 0x555e2eb67000 2024-02-14T13:06:19.968 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j[72928]: starting mds.j at 2024-02-14T13:06:19.968 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 bash[72906]: 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 2024-02-14T13:06:19.968 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:06:19 smithi012 systemd[1]: Started Ceph mds.j for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:20.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.044+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8501a5af0 con 0x7fc850073c30 2024-02-14T13:06:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.044+0000 7fc84d7fa640 1 -- 172.21.15.12:0/615320788 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2113 (secure 0 0 0) 0x7fc8501a5af0 con 0x7fc850073c30 2024-02-14T13:06:20.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:20.047 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-14T13:06:20.047 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8380a20c0 msgr2=0x7fc8380a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8380a20c0 0x7fc8380a4580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc844005d00 tx=0x7fc844005c50 comp rx=0 tx=0).stop 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 msgr2=0x7fc85019d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 0x7fc85019d8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc840006010 tx=0x7fc8400042f0 comp rx=0 tx=0).stop 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 shutdown_connections 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8380a20c0 0x7fc8380a4580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8501090e0 0x7fc8501a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:20.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc850075210 0x7fc85019de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 --2- 172.21.15.12:0/615320788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc850073c30 0x7fc85019d8c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.046+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 >> 172.21.15.12:0/615320788 conn(0x7fc8500fc7e0 msgr2=0x7fc850101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.047+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 shutdown_connections 2024-02-14T13:06:20.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:20.047+0000 7fc856a4e640 1 -- 172.21.15.12:0/615320788 wait complete. 2024-02-14T13:06:21.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:21.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:21.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:21.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: Deploying daemon mds.d on smithi012 2024-02-14T13:06:21.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/615320788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:21.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.12:6834/4009779912,v1:172.21.15.12:6835/4009779912] up:boot 2024-02-14T13:06:21.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: fsmap 3 up:standby 2024-02-14T13:06:21.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-02-14T13:06:21.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:20 smithi103 ceph-mon[36921]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:21.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: Deploying daemon mds.d on smithi012 2024-02-14T13:06:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/615320788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.12:6834/4009779912,v1:172.21.15.12:6835/4009779912] up:boot 2024-02-14T13:06:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: fsmap 3 up:standby 2024-02-14T13:06:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-02-14T13:06:21.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:20 smithi012 ceph-mon[32370]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:21.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: Deploying daemon mds.d on smithi012 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/615320788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.12:6834/4009779912,v1:172.21.15.12:6835/4009779912] up:boot 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: fsmap 3 up:standby 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-02-14T13:06:21.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:20 smithi055 ceph-mon[36853]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:22.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:22.145 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 systemd[1]: Starting Ceph mds.d for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:22.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/2968879781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 msgr2=0x7f6b581017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:22.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/2968879781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b581017e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009900 tx=0x7f6b4802bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:22.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/2968879781 shutdown_connections 2024-02-14T13:06:22.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/2968879781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b58101d20 0x7f6b581085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/2968879781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b581017e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/2968879781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58100170 0x7f6b58100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/2968879781 >> 172.21.15.12:0/2968879781 conn(0x7f6b580fb6e0 msgr2=0x7f6b580fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:22.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/2968879781 shutdown_connections 2024-02-14T13:06:22.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.204+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/2968879781 wait complete. 2024-02-14T13:06:22.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 Processor -- start 2024-02-14T13:06:22.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 -- start start 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58100170 0x7f6b5806a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b5819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b58101d20 0x7f6b5819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5819ee70 con 0x7f6b58101360 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5819efe0 con 0x7f6b58100170 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5ffe2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5819f1a0 con 0x7f6b58101d20 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5d57d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b5819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.205+0000 7f6b5d57d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b5819c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34228/0 (socket says 172.21.15.12:34228) 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 -- 172.21.15.12:0/315132180 learned_addr learned my addr 172.21.15.12:0/315132180 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5dd7e640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58100170 0x7f6b5806a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5e57f640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b58101d20 0x7f6b5819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 -- 172.21.15.12:0/315132180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b58101d20 msgr2=0x7f6b5819e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:22.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b58101d20 0x7f6b5819e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 -- 172.21.15.12:0/315132180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58100170 msgr2=0x7f6b5806a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58100170 0x7f6b5806a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 -- 172.21.15.12:0/315132180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48009560 con 0x7f6b58101360 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5d57d640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b5819c070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b48006010 tx=0x7f6b480040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480044c0 con 0x7f6b58101360 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5819f3c0 con 0x7f6b58101360 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5819f920 con 0x7f6b58101360 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6b48003ad0 con 0x7f6b58101360 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.206+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480054f0 con 0x7f6b58101360 2024-02-14T13:06:22.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.207+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c0052c0 con 0x7f6b58101360 2024-02-14T13:06:22.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.209+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f6b48003c40 con 0x7f6b58101360 2024-02-14T13:06:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.210+0000 7f6b4effd640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6b440a20c0 0x7f6b440a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.210+0000 7f6b5dd7e640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6b440a20c0 0x7f6b440a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.210+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6b480ef9f0 con 0x7f6b58101360 2024-02-14T13:06:22.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.210+0000 7f6b5dd7e640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6b440a20c0 0x7f6b440a4580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b54005fd0 tx=0x7f6b5400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:22.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.213+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6b480b8dc0 con 0x7f6b58101360 2024-02-14T13:06:22.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.443+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b3c005920 con 0x7f6b58101360 2024-02-14T13:06:22.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.443+0000 7f6b4effd640 1 -- 172.21.15.12:0/315132180 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2904 (secure 0 0 0) 0x7f6b48043b70 con 0x7f6b58101360 2024-02-14T13:06:22.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:22.445 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-14T13:06:22.445 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 4 2024-02-14T13:06:22.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6b440a20c0 msgr2=0x7f6b440a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:22.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6b440a20c0 0x7f6b440a4580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b54005fd0 tx=0x7f6b5400b410 comp rx=0 tx=0).stop 2024-02-14T13:06:22.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 msgr2=0x7f6b5819c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:22.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b5819c070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b48006010 tx=0x7f6b480040c0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 shutdown_connections 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6b440a20c0 0x7f6b440a4580 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b58101d20 0x7f6b5819e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b58101360 0x7f6b5819c070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 --2- 172.21.15.12:0/315132180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b58100170 0x7f6b5806a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 >> 172.21.15.12:0/315132180 conn(0x7f6b580fb6e0 msgr2=0x7f6b581046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 shutdown_connections 2024-02-14T13:06:22.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:22.445+0000 7f6b5ffe2640 1 -- 172.21.15.12:0/315132180 wait complete. 2024-02-14T13:06:22.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:22 smithi012 ceph-mon[32370]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:22.624 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 podman[73302]: 2024-02-14 13:06:22.353644917 +0000 UTC m=+0.107147232 container create 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:06:22.625 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 podman[73302]: 2024-02-14 13:06:22.266401148 +0000 UTC m=+0.019903487 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:22.625 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 podman[73302]: 2024-02-14 13:06:22.59826784 +0000 UTC m=+0.351770158 container init 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True) 2024-02-14T13:06:22.625 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 podman[73302]: 2024-02-14 13:06:22.600902527 +0000 UTC m=+0.354404842 container start 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-14T13:06:22.625 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 ceph-mds[73323]: -- 172.21.15.12:0/2946514642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fcc78fd520 con 0x55fcc78d3000 2024-02-14T13:06:22.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:22 smithi103 ceph-mon[36921]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:22.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:22 smithi055 ceph-mon[36853]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:22.967 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d[73319]: starting mds.d at 2024-02-14T13:06:22.967 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 bash[73302]: 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd 2024-02-14T13:06:22.967 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:06:22 smithi012 systemd[1]: Started Ceph mds.d for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/315132180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:23.712 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:23 smithi055 ceph-mon[36853]: Deploying daemon mds.e on smithi055 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/315132180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:23.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:23 smithi012 ceph-mon[32370]: Deploying daemon mds.e on smithi055 2024-02-14T13:06:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/315132180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:23.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:23.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:23.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:23.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:23 smithi103 ceph-mon[36921]: Deploying daemon mds.e on smithi055 2024-02-14T13:06:24.459 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/286367372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 msgr2=0x7f9ecc100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/286367372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc100570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009900 tx=0x7f9ec402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/286367372 shutdown_connections 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/286367372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ecc101d00 0x7f9ecc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/286367372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ecc101340 0x7f9ecc1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/286367372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc100570 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/286367372 >> 172.21.15.12:0/286367372 conn(0x7f9ecc0fb6c0 msgr2=0x7f9ecc0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/286367372 shutdown_connections 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.574+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/286367372 wait complete. 2024-02-14T13:06:24.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 Processor -- start 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 -- start start 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc1040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ecc101340 0x7f9ecc102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ecc101d00 0x7f9ecc102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1033c0 con 0x7f9ecc100150 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc103530 con 0x7f9ecc101d00 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed3f3a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1a1330 con 0x7f9ecc101340 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed1cd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc1040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed1cd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc1040e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58536/0 (socket says 172.21.15.12:58536) 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed1cd6640 1 -- 172.21.15.12:0/3978370242 learned_addr learned my addr 172.21.15.12:0/3978370242 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed24d7640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ecc101d00 0x7f9ecc102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.575+0000 7f9ed14d5640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ecc101340 0x7f9ecc102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.576+0000 7f9ed1cd6640 1 -- 172.21.15.12:0/3978370242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ecc101340 msgr2=0x7f9ecc102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.576+0000 7f9ed1cd6640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ecc101340 0x7f9ecc102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.576+0000 7f9ed1cd6640 1 -- 172.21.15.12:0/3978370242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ecc101d00 msgr2=0x7f9ecc102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.576+0000 7f9ed1cd6640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ecc101d00 0x7f9ecc102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.576+0000 7f9ed1cd6640 1 -- 172.21.15.12:0/3978370242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009560 con 0x7f9ecc100150 2024-02-14T13:06:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.576+0000 7f9ed1cd6640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc1040e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4000c00 tx=0x7f9ec4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.578+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4004aa0 con 0x7f9ecc100150 2024-02-14T13:06:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.578+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f9ec40052d0 con 0x7f9ecc100150 2024-02-14T13:06:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.578+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc1a1580 con 0x7f9ecc100150 2024-02-14T13:06:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.578+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4003e60 con 0x7f9ecc100150 2024-02-14T13:06:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.578+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1a1ae0 con 0x7f9ecc100150 2024-02-14T13:06:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.579+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc10bb60 con 0x7f9ecc100150 2024-02-14T13:06:24.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.580+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f9ec4005440 con 0x7f9ecc100150 2024-02-14T13:06:24.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.581+0000 7f9ec2ffd640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9eb80a2140 0x7f9eb80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:24.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.581+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9ec40f0200 con 0x7f9ecc100150 2024-02-14T13:06:24.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.581+0000 7f9ed14d5640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9eb80a2140 0x7f9eb80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:24.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.581+0000 7f9ed14d5640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9eb80a2140 0x7f9eb80a4600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc103e50 tx=0x7f9ebc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.585+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ec40b9670 con 0x7f9ecc100150 2024-02-14T13:06:24.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:24 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.12:6836/186215076,v1:172.21.15.12:6837/186215076] up:boot 2024-02-14T13:06:24.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:24 smithi012 ceph-mon[32370]: fsmap 4 up:standby 2024-02-14T13:06:24.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:24 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-02-14T13:06:24.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:24 smithi012 ceph-mon[32370]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:24.732 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:24 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.12:6836/186215076,v1:172.21.15.12:6837/186215076] up:boot 2024-02-14T13:06:24.732 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:24 smithi055 ceph-mon[36853]: fsmap 4 up:standby 2024-02-14T13:06:24.732 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:24 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-02-14T13:06:24.732 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:24 smithi055 ceph-mon[36853]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:24 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.12:6836/186215076,v1:172.21.15.12:6837/186215076] up:boot 2024-02-14T13:06:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:24 smithi103 ceph-mon[36921]: fsmap 4 up:standby 2024-02-14T13:06:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:24 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-02-14T13:06:24.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:24 smithi103 ceph-mon[36921]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.807+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ecc10bd40 con 0x7f9ecc100150 2024-02-14T13:06:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.808+0000 7f9ec2ffd640 1 -- 172.21.15.12:0/3978370242 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f9ec40bcd30 con 0x7f9ecc100150 2024-02-14T13:06:24.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:24.810 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-14T13:06:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 5 2024-02-14T13:06:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9eb80a2140 msgr2=0x7f9eb80a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9eb80a2140 0x7f9eb80a4600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc103e50 tx=0x7f9ebc005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 msgr2=0x7f9ecc1040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc1040e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4000c00 tx=0x7f9ec4004270 comp rx=0 tx=0).stop 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 shutdown_connections 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9eb80a2140 0x7f9eb80a4600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ecc101d00 0x7f9ecc102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9ecc101340 0x7f9ecc102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 --2- 172.21.15.12:0/3978370242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ecc100150 0x7f9ecc1040e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 >> 172.21.15.12:0/3978370242 conn(0x7f9ecc0fb6c0 msgr2=0x7f9ecc0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 shutdown_connections 2024-02-14T13:06:24.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:24.810+0000 7f9ed3f3a640 1 -- 172.21.15.12:0/3978370242 wait complete. 2024-02-14T13:06:25.060 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:24 smithi055 systemd[1]: Starting Ceph mds.e for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:25.390 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 podman[67332]: 2024-02-14 13:06:25.040257134 +0000 UTC m=+0.018638087 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:25.390 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 podman[67332]: 2024-02-14 13:06:25.141777976 +0000 UTC m=+0.120158912 container create ebb61be33b7c26c4636388bef8e42890f3a5137540424c3d937e660de5221678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-14T13:06:25.390 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 podman[67332]: 2024-02-14 13:06:25.385938487 +0000 UTC m=+0.364319423 container init ebb61be33b7c26c4636388bef8e42890f3a5137540424c3d937e660de5221678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131) 2024-02-14T13:06:25.390 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 podman[67332]: 2024-02-14 13:06:25.388620795 +0000 UTC m=+0.367001738 container start ebb61be33b7c26c4636388bef8e42890f3a5137540424c3d937e660de5221678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3978370242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-mds[67351]: -- 172.21.15.55:0/54947491 <== mon.2 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55594a3a5520 con 0x55594a37ac00 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e[67347]: starting mds.e at 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 bash[67332]: ebb61be33b7c26c4636388bef8e42890f3a5137540424c3d937e660de5221678 2024-02-14T13:06:25.811 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:06:25 smithi055 systemd[1]: Started Ceph mds.e for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:25 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3978370242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:25 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:25.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:25 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3978370242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:25.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:25.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:25 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:26.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: Deploying daemon mds.f on smithi103 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.55:6834/403501220,v1:172.21.15.55:6835/403501220] up:boot 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: fsmap 5 up:standby 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-02-14T13:06:26.853 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:26 smithi012 ceph-mon[32370]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:26.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/2072338556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101d00 msgr2=0x7fa4b8108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:26.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/2072338556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101d00 0x7fa4b8108590 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8009ca0 tx=0x7fa4a802c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/2072338556 shutdown_connections 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/2072338556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101d00 0x7fa4b8108590 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/2072338556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101340 0x7fa4b81017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/2072338556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 0x7fa4b8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/2072338556 >> 172.21.15.12:0/2072338556 conn(0x7fa4b80fb6c0 msgr2=0x7fa4b80fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.937+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/2072338556 shutdown_connections 2024-02-14T13:06:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.938+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/2072338556 wait complete. 2024-02-14T13:06:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.938+0000 7fa4bd1e2640 1 Processor -- start 2024-02-14T13:06:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.938+0000 7fa4bd1e2640 1 -- start start 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4bd1e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 0x7fa4b81994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4bd1e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 0x7fa4b81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4bd1e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101d00 0x7fa4b81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4bd1e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a0f90 con 0x7fa4b8101340 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4bd1e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a1100 con 0x7fa4b8101d00 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4bd1e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b81a12c0 con 0x7fa4b8100150 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 0x7fa4b81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 0x7fa4b81994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 0x7fa4b81994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:48412/0 (socket says 172.21.15.12:48412) 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 0x7fa4b81999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58548/0 (socket says 172.21.15.12:58548) 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b6d9d640 1 -- 172.21.15.12:0/78928491 learned_addr learned my addr 172.21.15.12:0/78928491 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b759e640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101d00 0x7fa4b81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 -- 172.21.15.12:0/78928491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 msgr2=0x7fa4b81994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 0x7fa4b81994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 -- 172.21.15.12:0/78928491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101d00 msgr2=0x7fa4b81a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101d00 0x7fa4b81a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 -- 172.21.15.12:0/78928491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8009900 con 0x7fa4b8101340 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b759e640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101d00 0x7fa4b81a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa4b659c640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 0x7fa4b81999e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00c970 tx=0x7fa4ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.939+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac007bb0 con 0x7fa4b8101340 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.940+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa4ac007d10 con 0x7fa4b8101340 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.940+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b81a15a0 con 0x7fa4b8101340 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.940+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00f450 con 0x7fa4b8101340 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.940+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b81a1ab0 con 0x7fa4b8101340 2024-02-14T13:06:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.940+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b810cc60 con 0x7fa4b8101340 2024-02-14T13:06:26.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.942+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fa4ac004ee0 con 0x7fa4b8101340 2024-02-14T13:06:26.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.942+0000 7fa49ffff640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa4a00a20c0 0x7fa4a00a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:26.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.942+0000 7fa4b6d9d640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa4a00a20c0 0x7fa4a00a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:26.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.942+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa4ac0cd7d0 con 0x7fa4b8101340 2024-02-14T13:06:26.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.943+0000 7fa4b6d9d640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa4a00a20c0 0x7fa4a00a4580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000bc80 tx=0x7fa4b000b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:26.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:26.947+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa4ac096c40 con 0x7fa4b8101340 2024-02-14T13:06:26.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:26.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:26.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: Deploying daemon mds.f on smithi103 2024-02-14T13:06:26.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.55:6834/403501220,v1:172.21.15.55:6835/403501220] up:boot 2024-02-14T13:06:26.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: fsmap 5 up:standby 2024-02-14T13:06:26.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-02-14T13:06:26.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:26 smithi103 ceph-mon[36921]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: Deploying daemon mds.f on smithi103 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.55:6834/403501220,v1:172.21.15.55:6835/403501220] up:boot 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: fsmap 5 up:standby 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-02-14T13:06:27.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:26 smithi055 ceph-mon[36853]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.165+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4b81a1d30 con 0x7fa4b8101340 2024-02-14T13:06:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.166+0000 7fa49ffff640 1 -- 172.21.15.12:0/78928491 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4480 (secure 0 0 0) 0x7fa4ac09a300 con 0x7fa4b8101340 2024-02-14T13:06:27.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:27.168 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-02-14T13:06:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 6 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa4a00a20c0 msgr2=0x7fa4a00a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa4a00a20c0 0x7fa4a00a4580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000bc80 tx=0x7fa4b000b410 comp rx=0 tx=0).stop 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 msgr2=0x7fa4b81999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 0x7fa4b81999e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00c970 tx=0x7fa4ac00ce30 comp rx=0 tx=0).stop 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 shutdown_connections 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa4a00a20c0 0x7fa4a00a4580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4b8101d00 0x7fa4b81a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4b8101340 0x7fa4b81999e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 --2- 172.21.15.12:0/78928491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4b8100150 0x7fa4b81994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 >> 172.21.15.12:0/78928491 conn(0x7fa4b80fb6c0 msgr2=0x7fa4b8108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 shutdown_connections 2024-02-14T13:06:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:27.168+0000 7fa4bd1e2640 1 -- 172.21.15.12:0/78928491 wait complete. 2024-02-14T13:06:27.591 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 systemd[1]: Starting Ceph mds.f for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:27.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:27 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/78928491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:27.846 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 podman[67077]: 2024-02-14 13:06:27.595680591 +0000 UTC m=+0.018016552 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:27.846 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 podman[67077]: 2024-02-14 13:06:27.701022977 +0000 UTC m=+0.123358926 container create 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-14T13:06:27.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:27 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/78928491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:28.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:27 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/78928491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:28.242 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 podman[67077]: 2024-02-14 13:06:27.962401353 +0000 UTC m=+0.384737307 container init 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:06:28.242 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 podman[67077]: 2024-02-14 13:06:27.965046327 +0000 UTC m=+0.387382279 container start 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-14T13:06:28.242 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 ceph-mds[67096]: -- 172.21.15.103:0/3077707164 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec5e0d5520 con 0x55ec5e0aa800 2024-02-14T13:06:28.242 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:27 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f[67092]: starting mds.f at 2024-02-14T13:06:28.242 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:28 smithi103 bash[67077]: 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 2024-02-14T13:06:28.242 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:06:28 smithi103 systemd[1]: Started Ceph mds.f for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:29.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 -- 172.21.15.12:0/4254635903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 msgr2=0x7f99d01028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 --2- 172.21.15.12:0/4254635903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01028c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009900 tx=0x7f99c002bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 -- 172.21.15.12:0/4254635903 shutdown_connections 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 --2- 172.21.15.12:0/4254635903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d0102e00 0x7f99d0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 --2- 172.21.15.12:0/4254635903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01028c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 --2- 172.21.15.12:0/4254635903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d0101250 0x7f99d0101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 -- 172.21.15.12:0/4254635903 >> 172.21.15.12:0/4254635903 conn(0x7f99d00fc7e0 msgr2=0x7f99d00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 -- 172.21.15.12:0/4254635903 shutdown_connections 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.296+0000 7f99d76ae640 1 -- 172.21.15.12:0/4254635903 wait complete. 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 Processor -- start 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 -- start start 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d0101250 0x7f99d01972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d0102e00 0x7f99d019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019ed90 con 0x7f99d0102440 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019ef00 con 0x7f99d0102e00 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d76ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019f0c0 con 0x7f99d0101250 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58580/0 (socket says 172.21.15.12:58580) 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 -- 172.21.15.12:0/1528287195 learned_addr learned my addr 172.21.15.12:0/1528287195 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d544a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d0101250 0x7f99d01972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d5c4b640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d0102e00 0x7f99d019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 -- 172.21.15.12:0/1528287195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d0101250 msgr2=0x7f99d01972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d0101250 0x7f99d01972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 -- 172.21.15.12:0/1528287195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d0102e00 msgr2=0x7f99d019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d0102e00 0x7f99d019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 -- 172.21.15.12:0/1528287195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0009560 con 0x7f99d0102440 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.297+0000 7f99d4c49640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01977e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99c0006010 tx=0x7f99c0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.298+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00043d0 con 0x7f99d0102440 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.298+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f99c00052d0 con 0x7f99d0102440 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.298+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d019f340 con 0x7f99d0102440 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.298+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0003cc0 con 0x7f99d0102440 2024-02-14T13:06:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.298+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d019f850 con 0x7f99d0102440 2024-02-14T13:06:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.299+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d0108570 con 0x7f99d0102440 2024-02-14T13:06:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.300+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f99c0005440 con 0x7f99d0102440 2024-02-14T13:06:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.301+0000 7f99c67fc640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f99bc0a20c0 0x7f99bc0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.301+0000 7f99d544a640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f99bc0a20c0 0x7f99bc0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.301+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f99c00effc0 con 0x7f99d0102440 2024-02-14T13:06:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.301+0000 7f99d544a640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f99bc0a20c0 0x7f99bc0a4580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99d01022a0 tx=0x7f99cc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.305+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f99c00b9430 con 0x7f99d0102440 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: Deploying daemon mds.c on smithi103 2024-02-14T13:06:29.378 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:29.379 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.103:6834/3937333390,v1:172.21.15.103:6835/3937333390] up:boot 2024-02-14T13:06:29.379 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: fsmap 6 up:standby 2024-02-14T13:06:29.379 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:29 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-02-14T13:06:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:29.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: Deploying daemon mds.c on smithi103 2024-02-14T13:06:29.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:29.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.103:6834/3937333390,v1:172.21.15.103:6835/3937333390] up:boot 2024-02-14T13:06:29.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: fsmap 6 up:standby 2024-02-14T13:06:29.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:29 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-02-14T13:06:29.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.527+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99d010cc60 con 0x7f99d0102440 2024-02-14T13:06:29.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.528+0000 7f99c67fc640 1 -- 172.21.15.12:0/1528287195 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5274 (secure 0 0 0) 0x7f99c00bcaf0 con 0x7f99d0102440 2024-02-14T13:06:29.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:29.530 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2024-02-14T13:06:29.530 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f99bc0a20c0 msgr2=0x7f99bc0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f99bc0a20c0 0x7f99bc0a4580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99d01022a0 tx=0x7f99cc005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 msgr2=0x7f99d01977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01977e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99c0006010 tx=0x7f99c0005e80 comp rx=0 tx=0).stop 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 shutdown_connections 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f99bc0a20c0 0x7f99bc0a4580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99d0102e00 0x7f99d019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99d0102440 0x7f99d01977e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 --2- 172.21.15.12:0/1528287195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99d0101250 0x7f99d01972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:29.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 >> 172.21.15.12:0/1528287195 conn(0x7f99d00fc7e0 msgr2=0x7f99d0105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:29.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 shutdown_connections 2024-02-14T13:06:29.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:29.530+0000 7f99d76ae640 1 -- 172.21.15.12:0/1528287195 wait complete. 2024-02-14T13:06:29.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: Deploying daemon mds.c on smithi103 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.103:6834/3937333390,v1:172.21.15.103:6835/3937333390] up:boot 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: fsmap 6 up:standby 2024-02-14T13:06:29.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:29 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-02-14T13:06:30.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:30 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1528287195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:30.242 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 systemd[1]: Starting Ceph mds.c for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:30.399 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:30 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1528287195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:30.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:30 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1528287195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:30.617 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 podman[67386]: 2024-02-14 13:06:30.355186555 +0000 UTC m=+0.115131609 container create 8b7df7fb93322138bdd5dcec5404ab9b5d88dbb24f98312c1e2801c0023cbe30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-14T13:06:30.617 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 podman[67386]: 2024-02-14 13:06:30.258293633 +0000 UTC m=+0.018238686 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:30.617 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 podman[67386]: 2024-02-14 13:06:30.590971465 +0000 UTC m=+0.350916519 container init 8b7df7fb93322138bdd5dcec5404ab9b5d88dbb24f98312c1e2801c0023cbe30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:06:30.617 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 podman[67386]: 2024-02-14 13:06:30.593478038 +0000 UTC m=+0.353423083 container start 8b7df7fb93322138bdd5dcec5404ab9b5d88dbb24f98312c1e2801c0023cbe30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:06:30.991 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 ceph-mds[67406]: -- 172.21.15.103:0/783639447 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5580520a3520 con 0x558052078800 2024-02-14T13:06:30.992 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c[67402]: starting mds.c at 2024-02-14T13:06:30.992 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 bash[67386]: 8b7df7fb93322138bdd5dcec5404ab9b5d88dbb24f98312c1e2801c0023cbe30 2024-02-14T13:06:30.992 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:06:30 smithi103 systemd[1]: Started Ceph mds.c for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:31.438 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:31.438 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:31.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:31.439 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:31 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:31.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:31.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:31.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:31.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:31 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:31.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:31 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:31.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 -- 172.21.15.12:0/3278657980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 msgr2=0x7fc84c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:31.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 --2- 172.21.15.12:0/3278657980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c108590 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc844009ca0 tx=0x7fc84402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 -- 172.21.15.12:0/3278657980 shutdown_connections 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 --2- 172.21.15.12:0/3278657980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c108590 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 --2- 172.21.15.12:0/3278657980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c101340 0x7fc84c1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 --2- 172.21.15.12:0/3278657980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc84c100150 0x7fc84c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 -- 172.21.15.12:0/3278657980 >> 172.21.15.12:0/3278657980 conn(0x7fc84c0fb6c0 msgr2=0x7fc84c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 -- 172.21.15.12:0/3278657980 shutdown_connections 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.657+0000 7fc850e81640 1 -- 172.21.15.12:0/3278657980 wait complete. 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 Processor -- start 2024-02-14T13:06:31.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 -- start start 2024-02-14T13:06:31.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c100150 0x7fc84c1040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:31.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc84c101340 0x7fc84c102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:31.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:31.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1033c0 con 0x7fc84c101d00 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c103530 con 0x7fc84c101340 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc850e81640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1a1360 con 0x7fc84c100150 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc84ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc849d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc84c101340 0x7fc84c102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc84ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58594/0 (socket says 172.21.15.12:58594) 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc84ad9d640 1 -- 172.21.15.12:0/120215172 learned_addr learned my addr 172.21.15.12:0/120215172 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc84a59c640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c100150 0x7fc84c1040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:31.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc84ad9d640 1 -- 172.21.15.12:0/120215172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c100150 msgr2=0x7fc84c1040e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.658+0000 7fc84ad9d640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c100150 0x7fc84c1040e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc84ad9d640 1 -- 172.21.15.12:0/120215172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc84c101340 msgr2=0x7fc84c102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc84ad9d640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc84c101340 0x7fc84c102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc84ad9d640 1 -- 172.21.15.12:0/120215172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844009900 con 0x7fc84c101d00 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc84a59c640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c100150 0x7fc84c1040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc84ad9d640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c102c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc844033000 tx=0x7fc844034a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8440329b0 con 0x7fc84c101d00 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc844003e50 con 0x7fc84c101d00 2024-02-14T13:06:31.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c1a15b0 con 0x7fc84c101d00 2024-02-14T13:06:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844040450 con 0x7fc84c101d00 2024-02-14T13:06:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.659+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c1a1a60 con 0x7fc84c101d00 2024-02-14T13:06:31.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.660+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c10bba0 con 0x7fc84c101d00 2024-02-14T13:06:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.661+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fc84400a040 con 0x7fc84c101d00 2024-02-14T13:06:31.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.661+0000 7fc83b7fe640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8340a20c0 0x7fc8340a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.662+0000 7fc84a59c640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8340a20c0 0x7fc8340a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.662+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc8440f0730 con 0x7fc84c101d00 2024-02-14T13:06:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.662+0000 7fc84a59c640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8340a20c0 0x7fc8340a4580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc84c1011a0 tx=0x7fc840005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:31.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.666+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc8440b9ba0 con 0x7fc84c101d00 2024-02-14T13:06:31.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.885+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc84c1a1f00 con 0x7fc84c101d00 2024-02-14T13:06:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.885+0000 7fc83b7fe640 1 -- 172.21.15.12:0/120215172 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6068 (secure 0 0 0) 0x7fc8440bd260 con 0x7fc84c101d00 2024-02-14T13:06:31.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:31.888 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-02-14T13:06:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.887+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8340a20c0 msgr2=0x7fc8340a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.887+0000 7fc850e81640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8340a20c0 0x7fc8340a4580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc84c1011a0 tx=0x7fc840005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.887+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 msgr2=0x7fc84c102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.887+0000 7fc850e81640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c102c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc844033000 tx=0x7fc844034a90 comp rx=0 tx=0).stop 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 shutdown_connections 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc8340a20c0 0x7fc8340a4580 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc84c101d00 0x7fc84c102c60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc84c101340 0x7fc84c102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 --2- 172.21.15.12:0/120215172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c100150 0x7fc84c1040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 >> 172.21.15.12:0/120215172 conn(0x7fc84c0fb6c0 msgr2=0x7fc84c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 shutdown_connections 2024-02-14T13:06:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:31.888+0000 7fc850e81640 1 -- 172.21.15.12:0/120215172 wait complete. 2024-02-14T13:06:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:32 smithi012 ceph-mon[32370]: Deploying daemon mds.h on smithi055 2024-02-14T13:06:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:32 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.103:6836/2795037448,v1:172.21.15.103:6837/2795037448] up:boot 2024-02-14T13:06:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:32 smithi012 ceph-mon[32370]: fsmap 7 up:standby 2024-02-14T13:06:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:32 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-02-14T13:06:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:32 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/120215172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:32.449 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:32 smithi055 ceph-mon[36853]: Deploying daemon mds.h on smithi055 2024-02-14T13:06:32.449 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:32 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.103:6836/2795037448,v1:172.21.15.103:6837/2795037448] up:boot 2024-02-14T13:06:32.449 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:32 smithi055 ceph-mon[36853]: fsmap 7 up:standby 2024-02-14T13:06:32.449 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:32 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-02-14T13:06:32.449 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:32 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/120215172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:32 smithi103 ceph-mon[36921]: Deploying daemon mds.h on smithi055 2024-02-14T13:06:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:32 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.103:6836/2795037448,v1:172.21.15.103:6837/2795037448] up:boot 2024-02-14T13:06:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:32 smithi103 ceph-mon[36921]: fsmap 7 up:standby 2024-02-14T13:06:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:32 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-02-14T13:06:32.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:32 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/120215172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:33.128 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 systemd[1]: Starting Ceph mds.h for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:33.393 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:33 smithi055 ceph-mon[36853]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:33.393 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 podman[67642]: 2024-02-14 13:06:33.159403608 +0000 UTC m=+0.018191276 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:33.393 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 podman[67642]: 2024-02-14 13:06:33.287026597 +0000 UTC m=+0.145814249 container create 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-14T13:06:33.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:33 smithi012 ceph-mon[32370]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:33.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:33 smithi103 ceph-mon[36921]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:33.810 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 podman[67642]: 2024-02-14 13:06:33.506105297 +0000 UTC m=+0.364892951 container init 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:06:33.811 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 podman[67642]: 2024-02-14 13:06:33.50898975 +0000 UTC m=+0.367777405 container start 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-02-14T13:06:33.811 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 ceph-mds[67661]: -- 172.21.15.55:0/1050074471 <== mon.2 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562982b79520 con 0x562982b4f000 2024-02-14T13:06:33.811 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h[67657]: starting mds.h at 2024-02-14T13:06:33.811 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 bash[67642]: 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 2024-02-14T13:06:33.811 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:06:33 smithi055 systemd[1]: Started Ceph mds.h for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:33.902 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 -- 172.21.15.12:0/3707682920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4101250 msgr2=0x7fbbe4101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 --2- 172.21.15.12:0/3707682920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4101250 0x7fbbe4101670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009900 tx=0x7fbbe002bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 -- 172.21.15.12:0/3707682920 shutdown_connections 2024-02-14T13:06:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 --2- 172.21.15.12:0/3707682920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4102e00 0x7fbbe4109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 --2- 172.21.15.12:0/3707682920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbe4102440 0x7fbbe41028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 --2- 172.21.15.12:0/3707682920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4101250 0x7fbbe4101670 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 -- 172.21.15.12:0/3707682920 >> 172.21.15.12:0/3707682920 conn(0x7fbbe40fc7e0 msgr2=0x7fbbe40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 -- 172.21.15.12:0/3707682920 shutdown_connections 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.015+0000 7fbbec77a640 1 -- 172.21.15.12:0/3707682920 wait complete. 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 Processor -- start 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 -- start start 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4101250 0x7fbbe4197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 0x7fbbe4197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbe4102e00 0x7fbbe419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe419ee20 con 0x7fbbe4102440 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe419ef90 con 0x7fbbe4102e00 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbec77a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe419f150 con 0x7fbbe4101250 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbe9d15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 0x7fbbe4197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:34.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbe9d15640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 0x7fbbe4197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58622/0 (socket says 172.21.15.12:58622) 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbe9d15640 1 -- 172.21.15.12:0/1830538601 learned_addr learned my addr 172.21.15.12:0/1830538601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbea516640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4101250 0x7fbbe4197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.016+0000 7fbbead17640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbe4102e00 0x7fbbe419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbe9d15640 1 -- 172.21.15.12:0/1830538601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4101250 msgr2=0x7fbbe4197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbe9d15640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4101250 0x7fbbe4197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbe9d15640 1 -- 172.21.15.12:0/1830538601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbe4102e00 msgr2=0x7fbbe419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbe9d15640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbe4102e00 0x7fbbe419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbe9d15640 1 -- 172.21.15.12:0/1830538601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0009560 con 0x7fbbe4102440 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbe9d15640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 0x7fbbe4197870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400e9f0 tx=0x7fbbd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4009700 con 0x7fbbe4102440 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fbbd400cd80 con 0x7fbbe4102440 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe419f430 con 0x7fbbe4102440 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4018920 con 0x7fbbe4102440 2024-02-14T13:06:34.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.017+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe419f940 con 0x7fbbe4102440 2024-02-14T13:06:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.018+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4108610 con 0x7fbbe4102440 2024-02-14T13:06:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.019+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fbbd4018a80 con 0x7fbbe4102440 2024-02-14T13:06:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.020+0000 7fbbdb7fe640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbbd00a20c0 0x7fbbd00a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.020+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbbd4014070 con 0x7fbbe4102440 2024-02-14T13:06:34.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.020+0000 7fbbea516640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbbd00a20c0 0x7fbbd00a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:34.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.020+0000 7fbbea516640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbbd00a20c0 0x7fbbd00a4580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005ab0 tx=0x7fbbe0005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:34.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.024+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbbd4052d20 con 0x7fbbe4102440 2024-02-14T13:06:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.244+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbe410ce80 con 0x7fbbe4102440 2024-02-14T13:06:34.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.245+0000 7fbbdb7fe640 1 -- 172.21.15.12:0/1830538601 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6859 (secure 0 0 0) 0x7fbbd4097070 con 0x7fbbe4102440 2024-02-14T13:06:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:34.247 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-02-14T13:06:34.247 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbbd00a20c0 msgr2=0x7fbbd00a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbbd00a20c0 0x7fbbd00a4580 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005ab0 tx=0x7fbbe0005fd0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 msgr2=0x7fbbe4197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 0x7fbbe4197870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400e9f0 tx=0x7fbbd400eeb0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 shutdown_connections 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbbd00a20c0 0x7fbbd00a4580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbe4102e00 0x7fbbe419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbe4102440 0x7fbbe4197870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 --2- 172.21.15.12:0/1830538601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbe4101250 0x7fbbe4197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 >> 172.21.15.12:0/1830538601 conn(0x7fbbe40fc7e0 msgr2=0x7fbbe41057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 shutdown_connections 2024-02-14T13:06:34.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:34.247+0000 7fbbec77a640 1 -- 172.21.15.12:0/1830538601 wait complete. 2024-02-14T13:06:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:34.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: Deploying daemon mds.i on smithi103 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.55:6836/3553342942,v1:172.21.15.55:6837/3553342942] up:boot 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: fsmap 8 up:standby 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1830538601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:34.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:34 smithi012 ceph-mon[32370]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: Deploying daemon mds.i on smithi103 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.55:6836/3553342942,v1:172.21.15.55:6837/3553342942] up:boot 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: fsmap 8 up:standby 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-02-14T13:06:34.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1830538601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:34.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:34 smithi103 ceph-mon[36921]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:35.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: Deploying daemon mds.i on smithi103 2024-02-14T13:06:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.55:6836/3553342942,v1:172.21.15.55:6837/3553342942] up:boot 2024-02-14T13:06:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: fsmap 8 up:standby 2024-02-14T13:06:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-02-14T13:06:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1830538601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:35.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:34 smithi055 ceph-mon[36853]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:35.742 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:35 smithi103 systemd[1]: Starting Ceph mds.i for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:06:36.079 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:35 smithi103 podman[67695]: 2024-02-14 13:06:35.72217785 +0000 UTC m=+0.018023313 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:36.079 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:35 smithi103 podman[67695]: 2024-02-14 13:06:35.825445415 +0000 UTC m=+0.121290865 container create 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-14T13:06:36.079 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:36 smithi103 podman[67695]: 2024-02-14 13:06:36.003253461 +0000 UTC m=+0.299098926 container init 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:06:36.079 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:36 smithi103 podman[67695]: 2024-02-14 13:06:36.005827292 +0000 UTC m=+0.301672747 container start 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:06:36.079 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:36 smithi103 ceph-mds[67715]: -- 172.21.15.103:0/3240877197 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560d64eb5520 con 0x560d64e8ac00 2024-02-14T13:06:36.080 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: starting mds.i at 2024-02-14T13:06:36.080 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:36 smithi103 bash[67695]: 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 2024-02-14T13:06:36.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:36.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.367+0000 7efdd44a4640 1 -- 172.21.15.12:0/3505761286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 msgr2=0x7efdcc1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.367+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3505761286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 0x7efdcc1040c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009860 tx=0x7efdc802bb70 comp rx=0 tx=0).stop 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- 172.21.15.12:0/3505761286 shutdown_connections 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3505761286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdcc106f30 0x7efdcc109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3505761286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc104600 0x7efdcc1069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3505761286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 0x7efdcc1040c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- 172.21.15.12:0/3505761286 >> 172.21.15.12:0/3505761286 conn(0x7efdcc0fb6c0 msgr2=0x7efdcc0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- 172.21.15.12:0/3505761286 shutdown_connections 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- 172.21.15.12:0/3505761286 wait complete. 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 Processor -- start 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- start start 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 0x7efdcc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:36.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdcc104600 0x7efdcc1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 0x7efdcc19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19eda0 con 0x7efdcc106f30 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19ef10 con 0x7efdcc104600 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.368+0000 7efdd44a4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19f0d0 con 0x7efdcc101cd0 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 0x7efdcc19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 0x7efdcc19e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39484/0 (socket says 172.21.15.12:39484) 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 -- 172.21.15.12:0/3678261963 learned_addr learned my addr 172.21.15.12:0/3678261963 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2240640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 0x7efdcc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd1a3f640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdcc104600 0x7efdcc1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 -- 172.21.15.12:0/3678261963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 msgr2=0x7efdcc1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 0x7efdcc1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 -- 172.21.15.12:0/3678261963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdcc104600 msgr2=0x7efdcc1977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdcc104600 0x7efdcc1977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 -- 172.21.15.12:0/3678261963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc009560 con 0x7efdcc106f30 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd2a41640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 0x7efdcc19e860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdc400eaa0 tx=0x7efdc400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:36.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc400cdb0 con 0x7efdcc106f30 2024-02-14T13:06:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc8009490 con 0x7efdcc106f30 2024-02-14T13:06:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7efdc4005020 con 0x7efdcc106f30 2024-02-14T13:06:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc19f780 con 0x7efdcc106f30 2024-02-14T13:06:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.369+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40116d0 con 0x7efdcc106f30 2024-02-14T13:06:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.370+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc0fd1b0 con 0x7efdcc106f30 2024-02-14T13:06:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.372+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7efdc4005490 con 0x7efdcc106f30 2024-02-14T13:06:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.372+0000 7efdc37fe640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efdb80a20c0 0x7efdb80a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.373+0000 7efdd2240640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efdb80a20c0 0x7efdb80a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.373+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efdc40cda00 con 0x7efdcc106f30 2024-02-14T13:06:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.373+0000 7efdd2240640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efdb80a20c0 0x7efdb80a4580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009830 tx=0x7efdc8034be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.377+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efdc4096dd0 con 0x7efdcc106f30 2024-02-14T13:06:36.491 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:36 smithi103 systemd[1]: Started Ceph mds.i for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.600+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdcc0fcc20 con 0x7efdcc106f30 2024-02-14T13:06:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.601+0000 7efdc37fe640 1 -- 172.21.15.12:0/3678261963 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7efdc409a490 con 0x7efdcc106f30 2024-02-14T13:06:36.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:36.603 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-02-14T13:06:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 10 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efdb80a20c0 msgr2=0x7efdb80a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efdb80a20c0 0x7efdb80a4580 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009830 tx=0x7efdc8034be0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 msgr2=0x7efdcc19e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 0x7efdcc19e860 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efdc400eaa0 tx=0x7efdc400ef60 comp rx=0 tx=0).stop 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 shutdown_connections 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efdb80a20c0 0x7efdb80a4580 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdcc106f30 0x7efdcc19e860 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdcc104600 0x7efdcc1977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 --2- 172.21.15.12:0/3678261963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efdcc101cd0 0x7efdcc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 >> 172.21.15.12:0/3678261963 conn(0x7efdcc0fb6c0 msgr2=0x7efdcc102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 shutdown_connections 2024-02-14T13:06:36.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:36.603+0000 7efdd44a4640 1 -- 172.21.15.12:0/3678261963 wait complete. 2024-02-14T13:06:37.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] up:boot 2024-02-14T13:06:37.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: fsmap 9 up:standby 2024-02-14T13:06:37.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-02-14T13:06:37.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: Deploying daemon mds.g on smithi012 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:37.294 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:37 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3678261963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:37.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] up:boot 2024-02-14T13:06:37.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: fsmap 9 up:standby 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: Deploying daemon mds.g on smithi012 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:37.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:37 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3678261963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:37.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] up:boot 2024-02-14T13:06:37.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: fsmap 9 up:standby 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: Deploying daemon mds.g on smithi012 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:37.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:37 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3678261963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:38.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:38.706 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:38 smithi012 ceph-mon[32370]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 -- 172.21.15.12:0/985709196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0100150 msgr2=0x7fdcc0100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:38.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 --2- 172.21.15.12:0/985709196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0100150 0x7fdcc0100570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009900 tx=0x7fdcb002bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 -- 172.21.15.12:0/985709196 shutdown_connections 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 --2- 172.21.15.12:0/985709196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcc0101d00 0x7fdcc0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 --2- 172.21.15.12:0/985709196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc0101340 0x7fdcc01017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 --2- 172.21.15.12:0/985709196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0100150 0x7fdcc0100570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 -- 172.21.15.12:0/985709196 >> 172.21.15.12:0/985709196 conn(0x7fdcc00fb6e0 msgr2=0x7fdcc00fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 -- 172.21.15.12:0/985709196 shutdown_connections 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.722+0000 7fdcc6120640 1 -- 172.21.15.12:0/985709196 wait complete. 2024-02-14T13:06:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 Processor -- start 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 -- start start 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc0100150 0x7fdcc0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 0x7fdcc01977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcc0101d00 0x7fdcc019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc019ed80 con 0x7fdcc0101340 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc019eef0 con 0x7fdcc0100150 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcc6120640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc019f0b0 con 0x7fdcc0101d00 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcbeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 0x7fdcc01977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcbeffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 0x7fdcc01977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39506/0 (socket says 172.21.15.12:39506) 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.723+0000 7fdcbeffd640 1 -- 172.21.15.12:0/2791959233 learned_addr learned my addr 172.21.15.12:0/2791959233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbffff640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcc0101d00 0x7fdcc019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbf7fe640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc0100150 0x7fdcc0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbeffd640 1 -- 172.21.15.12:0/2791959233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcc0101d00 msgr2=0x7fdcc019e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbeffd640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcc0101d00 0x7fdcc019e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbeffd640 1 -- 172.21.15.12:0/2791959233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc0100150 msgr2=0x7fdcc0197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbeffd640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc0100150 0x7fdcc0197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbeffd640 1 -- 172.21.15.12:0/2791959233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0009560 con 0x7fdcc0101340 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbeffd640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 0x7fdcc01977d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c920 tx=0x7fdcb400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4007c70 con 0x7fdcc0101340 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fdcb4007dd0 con 0x7fdcc0101340 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc019f390 con 0x7fdcc0101340 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4018860 con 0x7fdcc0101340 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.724+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc019f8a0 con 0x7fdcc0101340 2024-02-14T13:06:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.725+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc0107470 con 0x7fdcc0101340 2024-02-14T13:06:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.726+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fdcb400fac0 con 0x7fdcc0101340 2024-02-14T13:06:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.727+0000 7fdcbcff9640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdca80a2140 0x7fdca80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.727+0000 7fdcbf7fe640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdca80a2140 0x7fdca80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.727+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdcb40cdcf0 con 0x7fdcc0101340 2024-02-14T13:06:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.727+0000 7fdcbf7fe640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdca80a2140 0x7fdca80a4600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdcb002c6a0 tx=0x7fdcb0005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.730+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdcb4097150 con 0x7fdcc0101340 2024-02-14T13:06:38.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:38 smithi103 ceph-mon[36921]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:38.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:38 smithi055 ceph-mon[36853]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:38.956 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:06:38 smithi012 podman[73856]: 2024-02-14 13:06:38.952156027 +0000 UTC m=+0.362983076 container init a8d6fda58bb7a39219c4e093419dfd1c71ebcafaa9e72119e7682a26f5043694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-14T13:06:38.957 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:06:38 smithi012 podman[73856]: 2024-02-14 13:06:38.955660751 +0000 UTC m=+0.366487793 container start a8d6fda58bb7a39219c4e093419dfd1c71ebcafaa9e72119e7682a26f5043694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:06:38.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.955+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcc010cc60 con 0x7fdcc0101340 2024-02-14T13:06:38.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.955+0000 7fdcbcff9640 1 -- 172.21.15.12:0/2791959233 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7fdcb409a810 con 0x7fdcc0101340 2024-02-14T13:06:38.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:38.958 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-02-14T13:06:38.958 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 10 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.957+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdca80a2140 msgr2=0x7fdca80a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.957+0000 7fdcc6120640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdca80a2140 0x7fdca80a4600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdcb002c6a0 tx=0x7fdcb0005fd0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.957+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 msgr2=0x7fdcc01977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.957+0000 7fdcc6120640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 0x7fdcc01977d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c920 tx=0x7fdcb400cde0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 shutdown_connections 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdca80a2140 0x7fdca80a4600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcc0101d00 0x7fdcc019e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc0101340 0x7fdcc01977d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 --2- 172.21.15.12:0/2791959233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcc0100150 0x7fdcc0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 >> 172.21.15.12:0/2791959233 conn(0x7fdcc00fb6e0 msgr2=0x7fdcc0104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 shutdown_connections 2024-02-14T13:06:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:38.958+0000 7fdcc6120640 1 -- 172.21.15.12:0/2791959233 wait complete. 2024-02-14T13:06:39.217 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:06:38 smithi012 ceph-mds[73915]: -- 172.21.15.12:0/2701076189 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b619b65520 con 0x55b619b3ac00 2024-02-14T13:06:39.217 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:06:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g[73910]: starting mds.g at 2024-02-14T13:06:39.217 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:06:39 smithi012 bash[73856]: a8d6fda58bb7a39219c4e093419dfd1c71ebcafaa9e72119e7682a26f5043694 2024-02-14T13:06:39.217 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:06:39 smithi012 systemd[1]: Started Ceph mds.g for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:39.857 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2791959233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:39.858 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:39 smithi055 ceph-mon[36853]: Deploying daemon mds.a on smithi012 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2791959233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:39.922 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:39 smithi012 ceph-mon[32370]: Deploying daemon mds.a on smithi012 2024-02-14T13:06:39.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2791959233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:39.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:39 smithi103 ceph-mon[36921]: Deploying daemon mds.a on smithi012 2024-02-14T13:06:40.892 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:40 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.12:6838/1039817926,v1:172.21.15.12:6839/1039817926] up:boot 2024-02-14T13:06:40.892 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:40 smithi012 ceph-mon[32370]: fsmap 10 up:standby 2024-02-14T13:06:40.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:40 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-02-14T13:06:40.893 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:40 smithi012 ceph-mon[32370]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:40.972 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:40 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.12:6838/1039817926,v1:172.21.15.12:6839/1039817926] up:boot 2024-02-14T13:06:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:40 smithi103 ceph-mon[36921]: fsmap 10 up:standby 2024-02-14T13:06:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:40 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-02-14T13:06:40.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:40 smithi103 ceph-mon[36921]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:40 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.12:6838/1039817926,v1:172.21.15.12:6839/1039817926] up:boot 2024-02-14T13:06:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:40 smithi055 ceph-mon[36853]: fsmap 10 up:standby 2024-02-14T13:06:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:40 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-02-14T13:06:41.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:40 smithi055 ceph-mon[36853]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 -- 172.21.15.12:0/3092087213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4107030 msgr2=0x7fdbc4109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 --2- 172.21.15.12:0/3092087213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4107030 0x7fdbc4109420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc009ca0 tx=0x7fdbbc02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 -- 172.21.15.12:0/3092087213 shutdown_connections 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 --2- 172.21.15.12:0/3092087213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4107030 0x7fdbc4109420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 --2- 172.21.15.12:0/3092087213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc4104700 0x7fdbc4106af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 --2- 172.21.15.12:0/3092087213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbc4101dd0 0x7fdbc41041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 -- 172.21.15.12:0/3092087213 >> 172.21.15.12:0/3092087213 conn(0x7fdbc40fb780 msgr2=0x7fdbc40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:41.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 -- 172.21.15.12:0/3092087213 shutdown_connections 2024-02-14T13:06:41.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.139+0000 7fdbcb365640 1 -- 172.21.15.12:0/3092087213 wait complete. 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 Processor -- start 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 -- start start 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 0x7fdbc4197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc4104700 0x7fdbc41977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbc4107030 0x7fdbc419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc419ed60 con 0x7fdbc4101dd0 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc419eed0 con 0x7fdbc4104700 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbcb365640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc419f090 con 0x7fdbc4107030 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 0x7fdbc4197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 0x7fdbc4197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39552/0 (socket says 172.21.15.12:39552) 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 -- 172.21.15.12:0/1121735498 learned_addr learned my addr 172.21.15.12:0/1121735498 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:41.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc8900640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc4104700 0x7fdbc41977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 -- 172.21.15.12:0/1121735498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbc4107030 msgr2=0x7fdbc419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbc4107030 0x7fdbc419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 -- 172.21.15.12:0/1121735498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc4104700 msgr2=0x7fdbc41977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc4104700 0x7fdbc41977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.140+0000 7fdbc9101640 1 -- 172.21.15.12:0/1121735498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc009900 con 0x7fdbc4101dd0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.141+0000 7fdbc9101640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 0x7fdbc4197270 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000e9f0 tx=0x7fdbc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.141+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009700 con 0x7fdbc4101dd0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.141+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc419f370 con 0x7fdbc4101dd0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.141+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fdbc000cd80 con 0x7fdbc4101dd0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.141+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0018920 con 0x7fdbc4101dd0 2024-02-14T13:06:41.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.141+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc419f880 con 0x7fdbc4101dd0 2024-02-14T13:06:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.142+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40fd270 con 0x7fdbc4101dd0 2024-02-14T13:06:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.144+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fdbc0018a80 con 0x7fdbc4101dd0 2024-02-14T13:06:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.144+0000 7fdbba7fc640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdbb00a20c0 0x7fdbb00a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.145+0000 7fdbc8900640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdbb00a20c0 0x7fdbb00a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.145+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdbc0014070 con 0x7fdbc4101dd0 2024-02-14T13:06:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.145+0000 7fdbc8900640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdbb00a20c0 0x7fdbb00a4580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4198780 tx=0x7fdbb4005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.149+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdbc0052d20 con 0x7fdbc4101dd0 2024-02-14T13:06:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.397+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbc410cc70 con 0x7fdbc4101dd0 2024-02-14T13:06:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.398+0000 7fdbba7fc640 1 -- 172.21.15.12:0/1121735498 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8447 (secure 0 0 0) 0x7fdbc0097160 con 0x7fdbc4101dd0 2024-02-14T13:06:41.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:41.400 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-02-14T13:06:41.400 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 11 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdbb00a20c0 msgr2=0x7fdbb00a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdbb00a20c0 0x7fdbb00a4580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4198780 tx=0x7fdbb4005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 msgr2=0x7fdbc4197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 0x7fdbc4197270 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000e9f0 tx=0x7fdbc000eeb0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 shutdown_connections 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdbb00a20c0 0x7fdbb00a4580 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbc4107030 0x7fdbc419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbc4104700 0x7fdbc41977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 --2- 172.21.15.12:0/1121735498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbc4101dd0 0x7fdbc4197270 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 >> 172.21.15.12:0/1121735498 conn(0x7fdbc40fb780 msgr2=0x7fdbc4102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 shutdown_connections 2024-02-14T13:06:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:41.400+0000 7fdbcb365640 1 -- 172.21.15.12:0/1121735498 wait complete. 2024-02-14T13:06:41.529 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 podman[74258]: 2024-02-14 13:06:41.413687322 +0000 UTC m=+0.020699957 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:06:41.530 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 podman[74258]: 2024-02-14 13:06:41.52854371 +0000 UTC m=+0.135556380 container create f898943ab558fd97ffa12258f031ccd84c4c35f1487adbfd8d5f246a6b4636fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-14T13:06:41.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:41 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1121735498' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:41.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:41 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1121735498' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:42.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1121735498' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:42.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 podman[74258]: 2024-02-14 13:06:41.789663238 +0000 UTC m=+0.396675865 container init f898943ab558fd97ffa12258f031ccd84c4c35f1487adbfd8d5f246a6b4636fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-14T13:06:42.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 podman[74258]: 2024-02-14 13:06:41.79232656 +0000 UTC m=+0.399339175 container start f898943ab558fd97ffa12258f031ccd84c4c35f1487adbfd8d5f246a6b4636fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:06:42.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 ceph-mds[74279]: -- 172.21.15.12:0/2074922759 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f4f5799520 con 0x55f4f576f000 2024-02-14T13:06:42.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a[74275]: starting mds.a at 2024-02-14T13:06:42.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 bash[74258]: f898943ab558fd97ffa12258f031ccd84c4c35f1487adbfd8d5f246a6b4636fc 2024-02-14T13:06:42.218 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:06:41 smithi012 systemd[1]: Started Ceph mds.a for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:43.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: Deploying daemon mds.b on smithi055 2024-02-14T13:06:43.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:43.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.12:6840/2782336879,v1:172.21.15.12:6841/2782336879] up:boot 2024-02-14T13:06:43.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: fsmap 11 up:standby 2024-02-14T13:06:43.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:42 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-02-14T13:06:43.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: Deploying daemon mds.b on smithi055 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.12:6840/2782336879,v1:172.21.15.12:6841/2782336879] up:boot 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: fsmap 11 up:standby 2024-02-14T13:06:43.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:42 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-02-14T13:06:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-14T13:06:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-14T13:06:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:43.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: Deploying daemon mds.b on smithi055 2024-02-14T13:06:43.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:43.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.12:6840/2782336879,v1:172.21.15.12:6841/2782336879] up:boot 2024-02-14T13:06:43.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: fsmap 11 up:standby 2024-02-14T13:06:43.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:42 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-02-14T13:06:43.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:43.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1266325952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac101cd0 msgr2=0x7ff3ac1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:43.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1266325952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac101cd0 0x7ff3ac1040c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009900 tx=0x7ff39c02bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:43.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1266325952 shutdown_connections 2024-02-14T13:06:43.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1266325952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3ac106f30 0x7ff3ac109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1266325952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac104600 0x7ff3ac1069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1266325952 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac101cd0 0x7ff3ac1040c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1266325952 >> 172.21.15.12:0/1266325952 conn(0x7ff3ac0fb6c0 msgr2=0x7ff3ac0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1266325952 shutdown_connections 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.532+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1266325952 wait complete. 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 Processor -- start 2024-02-14T13:06:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 -- start start 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3ac101cd0 0x7ff3ac197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 0x7ff3ac1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac106f30 0x7ff3ac19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac19ee70 con 0x7ff3ac104600 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac19efe0 con 0x7ff3ac101cd0 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3b1b9a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac19f1a0 con 0x7ff3ac106f30 2024-02-14T13:06:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 0x7ff3ac1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 0x7ff3ac1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39598/0 (socket says 172.21.15.12:39598) 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 -- 172.21.15.12:0/1450957915 learned_addr learned my addr 172.21.15.12:0/1450957915 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3ab7fe640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3ac101cd0 0x7ff3ac197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3abfff640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac106f30 0x7ff3ac19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 -- 172.21.15.12:0/1450957915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac106f30 msgr2=0x7ff3ac19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac106f30 0x7ff3ac19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 -- 172.21.15.12:0/1450957915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3ac101cd0 msgr2=0x7ff3ac197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3ac101cd0 0x7ff3ac197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3a2ffd640 1 -- 172.21.15.12:0/1450957915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c009560 con 0x7ff3ac104600 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.533+0000 7ff3abfff640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac106f30 0x7ff3ac19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.534+0000 7ff3a2ffd640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 0x7ff3ac1978c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff39400d740 tx=0x7ff39400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.534+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394009c30 con 0x7ff3ac104600 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.534+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff39400de50 con 0x7ff3ac104600 2024-02-14T13:06:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.534+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac19f480 con 0x7ff3ac104600 2024-02-14T13:06:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.534+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394010460 con 0x7ff3ac104600 2024-02-14T13:06:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.534+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac19f940 con 0x7ff3ac104600 2024-02-14T13:06:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.535+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac0fd1b0 con 0x7ff3ac104600 2024-02-14T13:06:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.536+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff394004f10 con 0x7ff3ac104600 2024-02-14T13:06:43.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.537+0000 7ff3a97fa640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3980a20c0 0x7ff3980a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:43.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.537+0000 7ff3ab7fe640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3980a20c0 0x7ff3980a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:43.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.537+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3940cd6a0 con 0x7ff3ac104600 2024-02-14T13:06:43.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.537+0000 7ff3ab7fe640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3980a20c0 0x7ff3980a4580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff39c02c840 tx=0x7ff39c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:43.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.540+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff394096b10 con 0x7ff3ac104600 2024-02-14T13:06:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.761+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3ac10cc60 con 0x7ff3ac104600 2024-02-14T13:06:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.761+0000 7ff3a97fa640 1 -- 172.21.15.12:0/1450957915 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9239 (secure 0 0 0) 0x7ff39409a1d0 con 0x7ff3ac104600 2024-02-14T13:06:43.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:43.763 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-02-14T13:06:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2024-02-14T13:06:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3980a20c0 msgr2=0x7ff3980a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3980a20c0 0x7ff3980a4580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff39c02c840 tx=0x7ff39c000bc0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 msgr2=0x7ff3ac1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 0x7ff3ac1978c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff39400d740 tx=0x7ff39400dc00 comp rx=0 tx=0).stop 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 shutdown_connections 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3980a20c0 0x7ff3980a4580 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ac106f30 0x7ff3ac19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3ac104600 0x7ff3ac1978c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 --2- 172.21.15.12:0/1450957915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3ac101cd0 0x7ff3ac197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.763+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 >> 172.21.15.12:0/1450957915 conn(0x7ff3ac0fb6c0 msgr2=0x7ff3ac102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.764+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 shutdown_connections 2024-02-14T13:06:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:43.764+0000 7ff3b1b9a640 1 -- 172.21.15.12:0/1450957915 wait complete. 2024-02-14T13:06:44.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:44 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1450957915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:44.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:44 smithi055 ceph-mon[36853]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:44.811 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:06:44 smithi055 systemd[1]: Started Ceph mds.b for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:06:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:44 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1450957915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:44.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:44 smithi012 ceph-mon[32370]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:44 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1450957915' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:44.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:44 smithi103 ceph-mon[36921]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:45.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 -- 172.21.15.12:0/1761451939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101340 msgr2=0x7ff3341017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/1761451939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101340 0x7ff3341017c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff328009900 tx=0x7ff32802bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 -- 172.21.15.12:0/1761451939 shutdown_connections 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/1761451939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101d00 0x7ff334108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/1761451939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101340 0x7ff3341017c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/1761451939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff334100150 0x7ff334100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.882+0000 7ff33aa4e640 1 -- 172.21.15.12:0/1761451939 >> 172.21.15.12:0/1761451939 conn(0x7ff3340fb6e0 msgr2=0x7ff3340fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 -- 172.21.15.12:0/1761451939 shutdown_connections 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 -- 172.21.15.12:0/1761451939 wait complete. 2024-02-14T13:06:45.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 Processor -- start 2024-02-14T13:06:45.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 -- start start 2024-02-14T13:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff334100150 0x7ff334104020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 0x7ff334102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101d00 0x7ff334102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334103300 con 0x7ff334101340 2024-02-14T13:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334103470 con 0x7ff334101d00 2024-02-14T13:06:45.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.883+0000 7ff33aa4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341a1430 con 0x7ff334100150 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 0x7ff334102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 0x7ff334102720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46514/0 (socket says 172.21.15.12:46514) 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff333fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff334100150 0x7ff334104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 -- 172.21.15.12:0/833117086 learned_addr learned my addr 172.21.15.12:0/833117086 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff338feb640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101d00 0x7ff334102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 -- 172.21.15.12:0/833117086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff334100150 msgr2=0x7ff334104020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff334100150 0x7ff334104020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 -- 172.21.15.12:0/833117086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101d00 msgr2=0x7ff334102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101d00 0x7ff334102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 -- 172.21.15.12:0/833117086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328009560 con 0x7ff334101340 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3337fe640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 0x7ff334102720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff328006010 tx=0x7ff328005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280043d0 con 0x7ff334101340 2024-02-14T13:06:45.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3341a15d0 con 0x7ff334101340 2024-02-14T13:06:45.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff3280052d0 con 0x7ff334101340 2024-02-14T13:06:45.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328003cc0 con 0x7ff334101340 2024-02-14T13:06:45.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.884+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3341a1ae0 con 0x7ff334101340 2024-02-14T13:06:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.886+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33410bb60 con 0x7ff334101340 2024-02-14T13:06:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.886+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff328005440 con 0x7ff334101340 2024-02-14T13:06:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.887+0000 7ff3317fa640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff31c0a20c0 0x7ff31c0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.887+0000 7ff333fff640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff31c0a20c0 0x7ff31c0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.887+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3280efa70 con 0x7ff334101340 2024-02-14T13:06:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.888+0000 7ff333fff640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff31c0a20c0 0x7ff31c0a4580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3341011a0 tx=0x7ff324005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:45.892+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff3280f1e60 con 0x7ff334101340 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.55:6838/3549809563,v1:172.21.15.55:6839/3549809563] up:boot 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: fsmap 12 up:standby 2024-02-14T13:06:46.055 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:45 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.55:6838/3549809563,v1:172.21.15.55:6839/3549809563] up:boot 2024-02-14T13:06:46.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: fsmap 12 up:standby 2024-02-14T13:06:46.061 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:45 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-02-14T13:06:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.116+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3341a1e40 con 0x7ff334101340 2024-02-14T13:06:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.117+0000 7ff3317fa640 1 -- 172.21.15.12:0/833117086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10031 (secure 0 0 0) 0x7ff3280b8ec0 con 0x7ff334101340 2024-02-14T13:06:46.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:46.119 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-02-14T13:06:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff31c0a20c0 msgr2=0x7ff31c0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff31c0a20c0 0x7ff31c0a4580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff3341011a0 tx=0x7ff324005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 msgr2=0x7ff334102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 0x7ff334102720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff328006010 tx=0x7ff328005e80 comp rx=0 tx=0).stop 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 shutdown_connections 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff31c0a20c0 0x7ff31c0a4580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff334101d00 0x7ff334102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334101340 0x7ff334102720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 --2- 172.21.15.12:0/833117086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff334100150 0x7ff334104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 >> 172.21.15.12:0/833117086 conn(0x7ff3340fb6e0 msgr2=0x7ff3340fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 shutdown_connections 2024-02-14T13:06:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.119+0000 7ff33aa4e640 1 -- 172.21.15.12:0/833117086 wait complete. 2024-02-14T13:06:46.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:06:46.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.233+0000 7f5f6dc40640 1 -- 172.21.15.12:0/3108163046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102e00 msgr2=0x7f5f68109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.233+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/3108163046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102e00 0x7f5f68109690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009900 tx=0x7f5f6002bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.233+0000 7f5f6dc40640 1 -- 172.21.15.12:0/3108163046 shutdown_connections 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.233+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/3108163046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102e00 0x7f5f68109690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.233+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/3108163046 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f68102440 0x7f5f681028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.233+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/3108163046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 0x7f5f68101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- 172.21.15.12:0/3108163046 >> 172.21.15.12:0/3108163046 conn(0x7f5f680fc7e0 msgr2=0x7f5f680fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- 172.21.15.12:0/3108163046 shutdown_connections 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- 172.21.15.12:0/3108163046 wait complete. 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 Processor -- start 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- start start 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 0x7f5f68197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 0x7f5f681977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f68102e00 0x7f5f6819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6819ed50 con 0x7f5f68102440 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6819eec0 con 0x7f5f68102e00 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f6dc40640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6819f080 con 0x7f5f68101250 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 0x7f5f681977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 0x7f5f68197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.234+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 0x7f5f681977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46538/0 (socket says 172.21.15.12:46538) 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 0x7f5f68197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:35482/0 (socket says 172.21.15.12:35482) 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f67fff640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f68102e00 0x7f5f6819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 -- 172.21.15.12:0/812776540 learned_addr learned my addr 172.21.15.12:0/812776540 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 -- 172.21.15.12:0/812776540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 msgr2=0x7f5f68197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 0x7f5f68197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 -- 172.21.15.12:0/812776540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f68102e00 msgr2=0x7f5f6819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f68102e00 0x7f5f6819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 -- 172.21.15.12:0/812776540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f60009560 con 0x7f5f68102440 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f66ffd640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 0x7f5f681977a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000e9f0 tx=0x7f5f5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50009700 con 0x7f5f68102440 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6819f360 con 0x7f5f68102440 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5f5000cd80 con 0x7f5f68102440 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50018920 con 0x7f5f68102440 2024-02-14T13:06:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.235+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6819f870 con 0x7f5f68102440 2024-02-14T13:06:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.236+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f68108570 con 0x7f5f68102440 2024-02-14T13:06:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.237+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f5f50018a80 con 0x7f5f68102440 2024-02-14T13:06:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.238+0000 7f5f64ff9640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5f540a20c0 0x7f5f540a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.238+0000 7f5f677fe640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5f540a20c0 0x7f5f540a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.238+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5f50014070 con 0x7f5f68102440 2024-02-14T13:06:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.238+0000 7f5f677fe640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5f540a20c0 0x7f5f540a4580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f681022a0 tx=0x7f5f58009720 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.55:6838/3549809563,v1:172.21.15.55:6839/3549809563] up:boot 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: fsmap 12 up:standby 2024-02-14T13:06:46.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:45 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-02-14T13:06:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.241+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5f50097400 con 0x7f5f68102440 2024-02-14T13:06:46.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.433+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f6810cc30 con 0x7f5f68102440 2024-02-14T13:06:46.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.434+0000 7f5f64ff9640 1 -- 172.21.15.12:0/812776540 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f5f5009aac0 con 0x7f5f68102440 2024-02-14T13:06:46.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:46.437 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:01.593958+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5f540a20c0 msgr2=0x7f5f540a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5f540a20c0 0x7f5f540a4580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f681022a0 tx=0x7f5f58009720 comp rx=0 tx=0).stop 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 msgr2=0x7f5f681977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 0x7f5f681977a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000e9f0 tx=0x7f5f5000eeb0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 shutdown_connections 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5f540a20c0 0x7f5f540a4580 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f68102e00 0x7f5f6819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f68102440 0x7f5f681977a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 --2- 172.21.15.12:0/812776540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f68101250 0x7f5f68197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 >> 172.21.15.12:0/812776540 conn(0x7f5f680fc7e0 msgr2=0x7f5f68105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 shutdown_connections 2024-02-14T13:06:46.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.437+0000 7f5f6dc40640 1 -- 172.21.15.12:0/812776540 wait complete. 2024-02-14T13:06:46.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:06:46.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.570+0000 7f9f7d15c640 1 -- 172.21.15.12:0/2718004769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78102430 msgr2=0x7f9f781028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.570+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/2718004769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78102430 0x7f9f781028b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009860 tx=0x7f9f6802bb70 comp rx=0 tx=0).stop 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 -- 172.21.15.12:0/2718004769 shutdown_connections 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/2718004769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102df0 0x7f9f78109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/2718004769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78102430 0x7f9f781028b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/2718004769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78101240 0x7f9f78101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 -- 172.21.15.12:0/2718004769 >> 172.21.15.12:0/2718004769 conn(0x7f9f780fc7d0 msgr2=0x7f9f780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 -- 172.21.15.12:0/2718004769 shutdown_connections 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 -- 172.21.15.12:0/2718004769 wait complete. 2024-02-14T13:06:46.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 Processor -- start 2024-02-14T13:06:46.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.571+0000 7f9f7d15c640 1 -- start start 2024-02-14T13:06:46.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7d15c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 0x7f9f781972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7d15c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 0x7f9f781977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7d15c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78102df0 0x7f9f7819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7d15c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7819eda0 con 0x7f9f78102430 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7d15c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7819ef10 con 0x7f9f78101240 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7d15c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7819f0d0 con 0x7f9f78102df0 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 0x7f9f781977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 0x7f9f781972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 0x7f9f781977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46554/0 (socket says 172.21.15.12:46554) 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 -- 172.21.15.12:0/1523118324 learned_addr learned my addr 172.21.15.12:0/1523118324 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f76d9d640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 0x7f9f781972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.12:43566/0 (socket says 172.21.15.12:43566) 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7759e640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78102df0 0x7f9f7819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 -- 172.21.15.12:0/1523118324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78102df0 msgr2=0x7f9f7819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78102df0 0x7f9f7819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 -- 172.21.15.12:0/1523118324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 msgr2=0x7f9f781972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 0x7f9f781972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 -- 172.21.15.12:0/1523118324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009840 con 0x7f9f78102430 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7759e640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78102df0 0x7f9f7819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f76d9d640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 0x7f9f781972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.572+0000 7f9f7659c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 0x7f9f781977f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f68034b10 tx=0x7f9f680045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.573+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68005020 con 0x7f9f78102430 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.573+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f68009490 con 0x7f9f78102430 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.573+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f9f6802c510 con 0x7f9f78102430 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.573+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f680049d0 con 0x7f9f78102430 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.573+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7819f530 con 0x7f9f78102430 2024-02-14T13:06:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.574+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f781085e0 con 0x7f9f78102430 2024-02-14T13:06:46.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.575+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f9f6803b040 con 0x7f9f78102430 2024-02-14T13:06:46.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.575+0000 7f9f5ffff640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9f600a20c0 0x7f9f600a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.575+0000 7f9f76d9d640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9f600a20c0 0x7f9f600a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.575+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9f680ef500 con 0x7f9f78102430 2024-02-14T13:06:46.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.576+0000 7f9f76d9d640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9f600a20c0 0x7f9f600a4580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f78102290 tx=0x7f9f6c009260 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:46.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.579+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9f680b8970 con 0x7f9f78102430 2024-02-14T13:06:46.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.782+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f7802cdb0 con 0x7f9f78102430 2024-02-14T13:06:46.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.783+0000 7f9f5ffff640 1 -- 172.21.15.12:0/1523118324 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f680bc030 con 0x7f9f78102430 2024-02-14T13:06:46.785 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9f600a20c0 msgr2=0x7f9f600a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9f600a20c0 0x7f9f600a4580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f78102290 tx=0x7f9f6c009260 comp rx=0 tx=0).stop 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 msgr2=0x7f9f781977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 0x7f9f781977f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f68034b10 tx=0x7f9f680045c0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 shutdown_connections 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f9f600a20c0 0x7f9f600a4580 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f78102df0 0x7f9f7819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f78102430 0x7f9f781977f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 --2- 172.21.15.12:0/1523118324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f78101240 0x7f9f781972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 >> 172.21.15.12:0/1523118324 conn(0x7f9f780fc7d0 msgr2=0x7f9f781057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 shutdown_connections 2024-02-14T13:06:46.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.785+0000 7f9f7d15c640 1 -- 172.21.15.12:0/1523118324 wait complete. 2024-02-14T13:06:46.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.900+0000 7f69da3d0640 1 -- 172.21.15.12:0/748004519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102e30 msgr2=0x7f69d41096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.900+0000 7f69da3d0640 1 --2- 172.21.15.12:0/748004519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102e30 0x7f69d41096c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009ca0 tx=0x7f69cc02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 -- 172.21.15.12:0/748004519 shutdown_connections 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 --2- 172.21.15.12:0/748004519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102e30 0x7f69d41096c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 --2- 172.21.15.12:0/748004519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102470 0x7f69d41028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 --2- 172.21.15.12:0/748004519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d4101280 0x7f69d41016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 -- 172.21.15.12:0/748004519 >> 172.21.15.12:0/748004519 conn(0x7f69d40fc7d0 msgr2=0x7f69d40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 -- 172.21.15.12:0/748004519 shutdown_connections 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 -- 172.21.15.12:0/748004519 wait complete. 2024-02-14T13:06:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 Processor -- start 2024-02-14T13:06:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 -- start start 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.901+0000 7f69da3d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d4101280 0x7f69d4197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69da3d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 0x7f69d4197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69da3d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102e30 0x7f69d419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69da3d0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419ee10 con 0x7f69d4102470 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69da3d0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419ef80 con 0x7f69d4101280 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69da3d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d419f140 con 0x7f69d4102e30 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 0x7f69d4197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d896d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102e30 0x7f69d419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 0x7f69d4197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46562/0 (socket says 172.21.15.12:46562) 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 -- 172.21.15.12:0/2728758753 learned_addr learned my addr 172.21.15.12:0/2728758753 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d896d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102e30 0x7f69d419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:35528/0 (socket says 172.21.15.12:35528) 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d3fff640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d4101280 0x7f69d4197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 -- 172.21.15.12:0/2728758753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102e30 msgr2=0x7f69d419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102e30 0x7f69d419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 -- 172.21.15.12:0/2728758753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d4101280 msgr2=0x7f69d4197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d4101280 0x7f69d4197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 -- 172.21.15.12:0/2728758753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009490 con 0x7f69d4102470 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d37fe640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 0x7f69d4197860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69c400d770 tx=0x7f69c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4009c30 con 0x7f69d4102470 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f69c400de80 con 0x7f69d4102470 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc009900 con 0x7f69d4102470 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.902+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4004e80 con 0x7f69d4102470 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.903+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d419f750 con 0x7f69d4102470 2024-02-14T13:06:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.904+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d4108540 con 0x7f69d4102470 2024-02-14T13:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.905+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f69c4005020 con 0x7f69d4102470 2024-02-14T13:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.906+0000 7f69d17fa640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f69c00a20c0 0x7f69c00a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.906+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f69c40cd170 con 0x7f69d4102470 2024-02-14T13:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.906+0000 7f69d3fff640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f69c00a20c0 0x7f69c00a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.907+0000 7f69d3fff640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f69c00a20c0 0x7f69c00a4580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69d41022d0 tx=0x7f69bc005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:46.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:46.911+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f69c4096690 con 0x7f69d4102470 2024-02-14T13:06:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/833117086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/812776540' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:47.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:46 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.097+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f69d402cdb0 con 0x7f69d4102470 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.097+0000 7f69d17fa640 1 -- 172.21.15.12:0/2728758753 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+65 (secure 0 0 0) 0x7f69c4099d50 con 0x7f69d4102470 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-02-14T13:06:47.099 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-02-14T13:06:47.100 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:06:47.100 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-02-14T13:06:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f69c00a20c0 msgr2=0x7f69c00a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f69c00a20c0 0x7f69c00a4580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69d41022d0 tx=0x7f69bc005f90 comp rx=0 tx=0).stop 2024-02-14T13:06:47.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 msgr2=0x7f69d4197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 0x7f69d4197860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f69c400d770 tx=0x7f69c400dc30 comp rx=0 tx=0).stop 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 shutdown_connections 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f69c00a20c0 0x7f69c00a4580 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69d4102e30 0x7f69d419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69d4102470 0x7f69d4197860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 --2- 172.21.15.12:0/2728758753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d4101280 0x7f69d4197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.099+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 >> 172.21.15.12:0/2728758753 conn(0x7f69d40fc7d0 msgr2=0x7f69d4105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.100+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 shutdown_connections 2024-02-14T13:06:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.100+0000 7f69da3d0640 1 -- 172.21.15.12:0/2728758753 wait complete. 2024-02-14T13:06:47.111 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/833117086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.111 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:47.111 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/812776540' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:47.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:46 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.113 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-14T13:06:47.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-14T13:06:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.219+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/3119477677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4100130 msgr2=0x7ff4c4100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.219+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/3119477677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4100130 0x7ff4c4100550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009900 tx=0x7ff4b402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/3119477677 shutdown_connections 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/3119477677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4101ce0 0x7ff4c4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/3119477677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4c4101320 0x7ff4c41017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/3119477677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4100130 0x7ff4c4100550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/3119477677 >> 172.21.15.12:0/3119477677 conn(0x7ff4c40fb6c0 msgr2=0x7ff4c40fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/3119477677 shutdown_connections 2024-02-14T13:06:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/3119477677 wait complete. 2024-02-14T13:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 Processor -- start 2024-02-14T13:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.220+0000 7ff4ca9e2640 1 -- start start 2024-02-14T13:06:47.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4ca9e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4100130 0x7ff4c4196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4ca9e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4c4101320 0x7ff4c4196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4ca9e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 0x7ff4c419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4ca9e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c419dd00 con 0x7ff4c4101ce0 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4ca9e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c419de70 con 0x7ff4c4100130 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4ca9e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c419e030 con 0x7ff4c4101320 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 0x7ff4c419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4100130 0x7ff4c4196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 0x7ff4c419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46588/0 (socket says 172.21.15.12:46588) 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 -- 172.21.15.12:0/2475431405 learned_addr learned my addr 172.21.15.12:0/2475431405 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c37fe640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4c4101320 0x7ff4c4196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 -- 172.21.15.12:0/2475431405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4c4101320 msgr2=0x7ff4c4196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4c4101320 0x7ff4c4196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 -- 172.21.15.12:0/2475431405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4100130 msgr2=0x7ff4c4196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4100130 0x7ff4c4196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 -- 172.21.15.12:0/2475431405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009560 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c3fff640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4100130 0x7ff4c4196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.221+0000 7ff4c8f7f640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 0x7ff4c419d7c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00eb10 tx=0x7ff4bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.222+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc004b20 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.222+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff4bc004c80 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.222+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc010650 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.222+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c419e310 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.222+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c419e820 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.223+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c41074c0 con 0x7ff4c4101ce0 2024-02-14T13:06:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.225+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff4bc010810 con 0x7ff4c4101ce0 2024-02-14T13:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.225+0000 7ff4c17fa640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4b00a2140 0x7ff4b00a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.225+0000 7ff4c3fff640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4b00a2140 0x7ff4b00a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.226+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff4bc014070 con 0x7ff4c4101ce0 2024-02-14T13:06:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.226+0000 7ff4c3fff640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4b00a2140 0x7ff4b00a4600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4b402c240 tx=0x7ff4b402c7e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:47.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.229+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff4bc097350 con 0x7ff4c4101ce0 2024-02-14T13:06:47.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/833117086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:47.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/812776540' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:47.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:46 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:47.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.418+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff4c410bb90 con 0x7ff4c4101ce0 2024-02-14T13:06:47.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.777+0000 7ff4c17fa640 1 -- 172.21.15.12:0/2475431405 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff4bc09aa10 con 0x7ff4c4101ce0 2024-02-14T13:06:47.779 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-02-14T13:06:47.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4b00a2140 msgr2=0x7ff4b00a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4b00a2140 0x7ff4b00a4600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4b402c240 tx=0x7ff4b402c7e0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 msgr2=0x7ff4c419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 0x7ff4c419d7c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00eb10 tx=0x7ff4bc00c2d0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 shutdown_connections 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4b00a2140 0x7ff4b00a4600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c4101ce0 0x7ff4c419d7c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4c4101320 0x7ff4c4196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 --2- 172.21.15.12:0/2475431405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4c4100130 0x7ff4c4196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 >> 172.21.15.12:0/2475431405 conn(0x7ff4c40fb6c0 msgr2=0x7ff4c4104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.780+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 shutdown_connections 2024-02-14T13:06:47.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.781+0000 7ff4ca9e2640 1 -- 172.21.15.12:0/2475431405 wait complete. 2024-02-14T13:06:47.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 -- 172.21.15.12:0/756163025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4100130 msgr2=0x7f91a4100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 --2- 172.21.15.12:0/756163025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4100130 0x7f91a4100550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9194009ca0 tx=0x7f919402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 -- 172.21.15.12:0/756163025 shutdown_connections 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 --2- 172.21.15.12:0/756163025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a4101ce0 0x7f91a4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 --2- 172.21.15.12:0/756163025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a4101320 0x7f91a41017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 --2- 172.21.15.12:0/756163025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4100130 0x7f91a4100550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 -- 172.21.15.12:0/756163025 >> 172.21.15.12:0/756163025 conn(0x7f91a40fb6a0 msgr2=0x7f91a40fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.904+0000 7f91a8884640 1 -- 172.21.15.12:0/756163025 shutdown_connections 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 -- 172.21.15.12:0/756163025 wait complete. 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 Processor -- start 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 -- start start 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a4100130 0x7f91a4068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 0x7f91a419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a4101ce0 0x7f91a419e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a419ee40 con 0x7f91a4101320 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a419efb0 con 0x7f91a4101ce0 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a8884640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a419f170 con 0x7f91a4100130 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 0x7f91a419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.905+0000 7f91a1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 0x7f91a419c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46604/0 (socket says 172.21.15.12:46604) 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 -- 172.21.15.12:0/1724464015 learned_addr learned my addr 172.21.15.12:0/1724464015 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a259c640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a4100130 0x7f91a4068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a2d9d640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a4101ce0 0x7f91a419e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 -- 172.21.15.12:0/1724464015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a4100130 msgr2=0x7f91a4068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a4100130 0x7f91a4068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 -- 172.21.15.12:0/1724464015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a4101ce0 msgr2=0x7f91a419e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a4101ce0 0x7f91a419e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 -- 172.21.15.12:0/1724464015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009900 con 0x7f91a4101320 2024-02-14T13:06:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a1d9b640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 0x7f91a419c040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f918c00d950 tx=0x7f918c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c009c30 con 0x7f91a4101320 2024-02-14T13:06:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f918c009d90 con 0x7f91a4101320 2024-02-14T13:06:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a419f3f0 con 0x7f91a4101320 2024-02-14T13:06:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00f7e0 con 0x7f91a4101320 2024-02-14T13:06:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.906+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a419f900 con 0x7f91a4101320 2024-02-14T13:06:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.907+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a4107450 con 0x7f91a4101320 2024-02-14T13:06:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.908+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f918c010ad0 con 0x7f91a4101320 2024-02-14T13:06:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.909+0000 7f919b7fe640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f91900a20c0 0x7f91900a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.909+0000 7f91a259c640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f91900a20c0 0x7f91900a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.909+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f918c0cd560 con 0x7f91a4101320 2024-02-14T13:06:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.909+0000 7f91a259c640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f91900a20c0 0x7f91900a4580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f919402c700 tx=0x7f91940326b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:47.913+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f918c096870 con 0x7f91a4101320 2024-02-14T13:06:47.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:47 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1523118324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:47.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:47 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:47 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2728758753' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-02-14T13:06:47.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:47 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2475431405' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-02-14T13:06:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:47 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1523118324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:47 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:47 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2728758753' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-02-14T13:06:47.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:47 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2475431405' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-02-14T13:06:48.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:47 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1523118324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:06:48.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:47 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:06:48.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:47 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2728758753' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-02-14T13:06:48.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:47 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2475431405' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-02-14T13:06:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.097+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f91a410bb40 con 0x7f91a4101320 2024-02-14T13:06:48.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.786+0000 7f919b7fe640 1 -- 172.21.15.12:0/1724464015 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) v1 ==== 170+0+0 (secure 0 0 0) 0x7f918c099f30 con 0x7f91a4101320 2024-02-14T13:06:48.789 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-02-14T13:06:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f91900a20c0 msgr2=0x7f91900a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f91900a20c0 0x7f91900a4580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f919402c700 tx=0x7f91940326b0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 msgr2=0x7f91a419c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 0x7f91a419c040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f918c00d950 tx=0x7f918c00de10 comp rx=0 tx=0).stop 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 shutdown_connections 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f91900a20c0 0x7f91900a4580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a4101ce0 0x7f91a419e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91a4101320 0x7f91a419c040 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 --2- 172.21.15.12:0/1724464015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a4100130 0x7f91a4068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 >> 172.21.15.12:0/1724464015 conn(0x7f91a40fb6a0 msgr2=0x7f91a4104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 shutdown_connections 2024-02-14T13:06:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.789+0000 7f91a8884640 1 -- 172.21.15.12:0/1724464015 wait complete. 2024-02-14T13:06:48.809 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-14T13:06:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- 172.21.15.12:0/2042395640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 msgr2=0x7f90781017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- 172.21.15.12:0/2042395640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781017b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9064009900 tx=0x7f906402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- 172.21.15.12:0/2042395640 shutdown_connections 2024-02-14T13:06:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- 172.21.15.12:0/2042395640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9078101cf0 0x7f9078108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- 172.21.15.12:0/2042395640 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781017b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- 172.21.15.12:0/2042395640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 0x7f9078100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- 172.21.15.12:0/2042395640 >> 172.21.15.12:0/2042395640 conn(0x7f90780fb6d0 msgr2=0x7f90780fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- 172.21.15.12:0/2042395640 shutdown_connections 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- 172.21.15.12:0/2042395640 wait complete. 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 Processor -- start 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- start start 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 0x7f90781972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9078101cf0 0x7f907819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907819eda0 con 0x7f9078101330 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907819ef10 con 0x7f9078101cf0 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.914+0000 7f907eee0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907819f0d0 con 0x7f9078100140 2024-02-14T13:06:48.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f907cc7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 0x7f90781972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46620/0 (socket says 172.21.15.12:46620) 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 -- 172.21.15.12:0/741129093 learned_addr learned my addr 172.21.15.12:0/741129093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f907cc7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 0x7f90781972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:35588/0 (socket says 172.21.15.12:35588) 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f907d47d640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9078101cf0 0x7f907819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 -- 172.21.15.12:0/741129093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 msgr2=0x7f90781972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 0x7f90781972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 -- 172.21.15.12:0/741129093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9078101cf0 msgr2=0x7f907819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9078101cf0 0x7f907819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 -- 172.21.15.12:0/741129093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064009560 con 0x7f9078101330 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9077fff640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781977f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9064006010 tx=0x7f90640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:48.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90640044e0 con 0x7f9078101330 2024-02-14T13:06:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907819f350 con 0x7f9078101330 2024-02-14T13:06:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f90640054e0 con 0x7f9078101330 2024-02-14T13:06:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906403e450 con 0x7f9078101330 2024-02-14T13:06:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.915+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907819f8b0 con 0x7f9078101330 2024-02-14T13:06:48.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.916+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078107460 con 0x7f9078101330 2024-02-14T13:06:48.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.918+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f90640035f0 con 0x7f9078101330 2024-02-14T13:06:48.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.918+0000 7f9075ffb640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f90680a20c0 0x7f90680a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:48.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.918+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f90640f03b0 con 0x7f9078101330 2024-02-14T13:06:48.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.918+0000 7f907cc7c640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f90680a20c0 0x7f90680a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:48.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.919+0000 7f907cc7c640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f90680a20c0 0x7f90680a4580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f906c005fd0 tx=0x7f906c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:48.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:48.922+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f90640b9530 con 0x7f9078101330 2024-02-14T13:06:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2475431405' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-02-14T13:06:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: osdmap e84: 12 total, 12 up, 12 in 2024-02-14T13:06:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1724464015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-02-14T13:06:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: pgmap v284: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:49.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:49.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.140+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f907810cc50 con 0x7f9078101330 2024-02-14T13:06:49.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2475431405' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-02-14T13:06:49.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: osdmap e84: 12 total, 12 up, 12 in 2024-02-14T13:06:49.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1724464015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: pgmap v284: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2475431405' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: osdmap e84: 12 total, 12 up, 12 in 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1724464015' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: pgmap v284: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:06:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:06:49.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.788+0000 7f9075ffb640 1 -- 172.21.15.12:0/741129093 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f90640bcbf0 con 0x7f9078101330 2024-02-14T13:06:49.791 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-02-14T13:06:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f90680a20c0 msgr2=0x7f90680a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f90680a20c0 0x7f90680a4580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f906c005fd0 tx=0x7f906c00b410 comp rx=0 tx=0).stop 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 msgr2=0x7f90781977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781977f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9064006010 tx=0x7f90640042f0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 shutdown_connections 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f90680a20c0 0x7f90680a4580 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9078101cf0 0x7f907819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9078101330 0x7f90781977f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 --2- 172.21.15.12:0/741129093 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9078100140 0x7f90781972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.792+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 >> 172.21.15.12:0/741129093 conn(0x7f90780fb6d0 msgr2=0x7f9078104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.793+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 shutdown_connections 2024-02-14T13:06:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.793+0000 7f907eee0640 1 -- 172.21.15.12:0/741129093 wait complete. 2024-02-14T13:06:49.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 -- 172.21.15.12:0/333461660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 msgr2=0x7fd41c1093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 --2- 172.21.15.12:0/333461660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c1093a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd414009ca0 tx=0x7fd41402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 -- 172.21.15.12:0/333461660 shutdown_connections 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 --2- 172.21.15.12:0/333461660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c1093a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 --2- 172.21.15.12:0/333461660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd41c104620 0x7fd41c106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 --2- 172.21.15.12:0/333461660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 0x7fd41c1040e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 -- 172.21.15.12:0/333461660 >> 172.21.15.12:0/333461660 conn(0x7fd41c0fb6e0 msgr2=0x7fd41c0fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 -- 172.21.15.12:0/333461660 shutdown_connections 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.924+0000 7fd424640640 1 -- 172.21.15.12:0/333461660 wait complete. 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 Processor -- start 2024-02-14T13:06:49.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 -- start start 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 0x7fd41c197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd41c104620 0x7fd41c1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c19ec80 con 0x7fd41c106f50 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c19edf0 con 0x7fd41c101cf0 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd424640640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c19efb0 con 0x7fd41c104620 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c19e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46644/0 (socket says 172.21.15.12:46644) 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 -- 172.21.15.12:0/3243470604 learned_addr learned my addr 172.21.15.12:0/3243470604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd4223dc640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 0x7fd41c197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 -- 172.21.15.12:0/3243470604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd41c104620 msgr2=0x7fd41c1976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd421bdb640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd41c104620 0x7fd41c1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd41c104620 0x7fd41c1976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 -- 172.21.15.12:0/3243470604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 msgr2=0x7fd41c197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.925+0000 7fd422bdd640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 0x7fd41c197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd422bdd640 1 -- 172.21.15.12:0/3243470604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009900 con 0x7fd41c106f50 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd4223dc640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 0x7fd41c197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd422bdd640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c19e740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd414037040 tx=0x7fd414034d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414003970 con 0x7fd41c106f50 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd414004040 con 0x7fd41c106f50 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c19f230 con 0x7fd41c106f50 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140406b0 con 0x7fd41c106f50 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.926+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c19f6e0 con 0x7fd41c106f50 2024-02-14T13:06:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.927+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c0fd1d0 con 0x7fd41c106f50 2024-02-14T13:06:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.928+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fd41400a040 con 0x7fd41c106f50 2024-02-14T13:06:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.928+0000 7fd4137fe640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd4080a20c0 0x7fd4080a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.928+0000 7fd4223dc640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd4080a20c0 0x7fd4080a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.928+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4140f1190 con 0x7fd41c106f50 2024-02-14T13:06:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.929+0000 7fd4223dc640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd4080a20c0 0x7fd4080a4580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd41800abe0 tx=0x7fd41800a5c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:49.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:49.932+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd4140ba2b0 con 0x7fd41c106f50 2024-02-14T13:06:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:49 smithi055 ceph-mon[36853]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-14T13:06:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:49 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1724464015' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-02-14T13:06:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:49 smithi055 ceph-mon[36853]: osdmap e85: 12 total, 12 up, 12 in 2024-02-14T13:06:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:49 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/741129093' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-02-14T13:06:50.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:49 smithi055 ceph-mon[36853]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-02-14T13:06:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.114+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd41c02ce50 con 0x7fd41c106f50 2024-02-14T13:06:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.115+0000 7fd4137fe640 1 -- 172.21.15.12:0/3243470604 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22123 (secure 0 0 0) 0x7fd4140bd970 con 0x7fd41c106f50 2024-02-14T13:06:50.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:50.118 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:49.141897+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:06:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd4080a20c0 msgr2=0x7fd4080a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd4080a20c0 0x7fd4080a4580 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd41800abe0 tx=0x7fd41800a5c0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 msgr2=0x7fd41c19e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c19e740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd414037040 tx=0x7fd414034d20 comp rx=0 tx=0).stop 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 shutdown_connections 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd4080a20c0 0x7fd4080a4580 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd41c106f50 0x7fd41c19e740 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd41c104620 0x7fd41c1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 --2- 172.21.15.12:0/3243470604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41c101cf0 0x7fd41c197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 >> 172.21.15.12:0/3243470604 conn(0x7fd41c0fb6e0 msgr2=0x7fd41c102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.117+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 shutdown_connections 2024-02-14T13:06:50.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.118+0000 7fd424640640 1 -- 172.21.15.12:0/3243470604 wait complete. 2024-02-14T13:06:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:49 smithi012 ceph-mon[32370]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-14T13:06:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:49 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1724464015' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-02-14T13:06:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:49 smithi012 ceph-mon[32370]: osdmap e85: 12 total, 12 up, 12 in 2024-02-14T13:06:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:49 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/741129093' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-02-14T13:06:50.129 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:49 smithi012 ceph-mon[32370]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-02-14T13:06:50.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:06:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.231+0000 7f431335c640 1 -- 172.21.15.12:0/2548983337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101d00 msgr2=0x7f430c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.231+0000 7f431335c640 1 --2- 172.21.15.12:0/2548983337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101d00 0x7f430c108590 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009ca0 tx=0x7f42fc02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.231+0000 7f431335c640 1 -- 172.21.15.12:0/2548983337 shutdown_connections 2024-02-14T13:06:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.231+0000 7f431335c640 1 --2- 172.21.15.12:0/2548983337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101d00 0x7f430c108590 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.231+0000 7f431335c640 1 --2- 172.21.15.12:0/2548983337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f430c101340 0x7f430c1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.231+0000 7f431335c640 1 --2- 172.21.15.12:0/2548983337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c100150 0x7f430c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- 172.21.15.12:0/2548983337 >> 172.21.15.12:0/2548983337 conn(0x7f430c0fb6c0 msgr2=0x7f430c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- 172.21.15.12:0/2548983337 shutdown_connections 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- 172.21.15.12:0/2548983337 wait complete. 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 Processor -- start 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- start start 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f430c100150 0x7f430c068f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 0x7f430c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c101d00 0x7f430c19e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c19ee10 con 0x7f430c101340 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c19ef80 con 0x7f430c100150 2024-02-14T13:06:50.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f431335c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c19f140 con 0x7f430c101d00 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f43108f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 0x7f430c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f43108f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 0x7f430c19c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46672/0 (socket says 172.21.15.12:46672) 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f43108f7640 1 -- 172.21.15.12:0/2817493007 learned_addr learned my addr 172.21.15.12:0/2817493007 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.232+0000 7f43110f8640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f430c100150 0x7f430c068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43118f9640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c101d00 0x7f430c19e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43108f7640 1 -- 172.21.15.12:0/2817493007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c101d00 msgr2=0x7f430c19e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43108f7640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c101d00 0x7f430c19e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43108f7640 1 -- 172.21.15.12:0/2817493007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f430c100150 msgr2=0x7f430c068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43108f7640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f430c100150 0x7f430c068f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43108f7640 1 -- 172.21.15.12:0/2817493007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009900 con 0x7f430c101340 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43118f9640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c101d00 0x7f430c19e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f43108f7640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 0x7f430c19c040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f430000d950 tx=0x7f430000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:50.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300009c30 con 0x7f430c101340 2024-02-14T13:06:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f430000de80 con 0x7f430c101340 2024-02-14T13:06:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000f700 con 0x7f430c101340 2024-02-14T13:06:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c19f420 con 0x7f430c101340 2024-02-14T13:06:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.233+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c19f930 con 0x7f430c101340 2024-02-14T13:06:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.234+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c1073a0 con 0x7f430c101340 2024-02-14T13:06:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.235+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f4300010460 con 0x7f430c101340 2024-02-14T13:06:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.236+0000 7f430a7fc640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f42f40a20c0 0x7f42f40a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.236+0000 7f43110f8640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f42f40a20c0 0x7f42f40a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.236+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f43000cd710 con 0x7f430c101340 2024-02-14T13:06:50.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.236+0000 7f43110f8640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f42f40a20c0 0x7f42f40a4580 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f430c1011a0 tx=0x7f4304009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.240+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4300096830 con 0x7f430c101340 2024-02-14T13:06:50.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:49 smithi103 ceph-mon[36921]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-14T13:06:50.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:49 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1724464015' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-02-14T13:06:50.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:49 smithi103 ceph-mon[36921]: osdmap e85: 12 total, 12 up, 12 in 2024-02-14T13:06:50.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:49 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/741129093' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-02-14T13:06:50.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:49 smithi103 ceph-mon[36921]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-02-14T13:06:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.422+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f430c10be10 con 0x7f430c101340 2024-02-14T13:06:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.423+0000 7f430a7fc640 1 -- 172.21.15.12:0/2817493007 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22123 (secure 0 0 0) 0x7f4300020090 con 0x7f430c101340 2024-02-14T13:06:50.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:50.426 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:49.141897+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:06:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f42f40a20c0 msgr2=0x7f42f40a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f42f40a20c0 0x7f42f40a4580 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f430c1011a0 tx=0x7f4304009110 comp rx=0 tx=0).stop 2024-02-14T13:06:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 msgr2=0x7f430c19c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 0x7f430c19c040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f430000d950 tx=0x7f430000dd50 comp rx=0 tx=0).stop 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 shutdown_connections 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f42f40a20c0 0x7f42f40a4580 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f430c101d00 0x7f430c19e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f430c101340 0x7f430c19c040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 --2- 172.21.15.12:0/2817493007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f430c100150 0x7f430c068f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 >> 172.21.15.12:0/2817493007 conn(0x7f430c0fb6c0 msgr2=0x7f430c104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 shutdown_connections 2024-02-14T13:06:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.425+0000 7f431335c640 1 -- 172.21.15.12:0/2817493007 wait complete. 2024-02-14T13:06:50.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-14T13:06:50.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 -- 172.21.15.12:0/349409988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0106f10 msgr2=0x7f89e0109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 --2- 172.21.15.12:0/349409988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0106f10 0x7f89e0109360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009ca0 tx=0x7f89d802c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 -- 172.21.15.12:0/349409988 shutdown_connections 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 --2- 172.21.15.12:0/349409988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0106f10 0x7f89e0109360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 --2- 172.21.15.12:0/349409988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e01045e0 0x7f89e01069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 --2- 172.21.15.12:0/349409988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e0101cb0 0x7f89e01040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 -- 172.21.15.12:0/349409988 >> 172.21.15.12:0/349409988 conn(0x7f89e00fb6c0 msgr2=0x7f89e00fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 -- 172.21.15.12:0/349409988 shutdown_connections 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 -- 172.21.15.12:0/349409988 wait complete. 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 Processor -- start 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.542+0000 7f89e4f02640 1 -- start start 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 0x7f89e01972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e01045e0 0x7f89e0197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e0106f10 0x7f89e019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e019edb0 con 0x7f89e0101cb0 2024-02-14T13:06:50.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e019ef20 con 0x7f89e01045e0 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e019f0e0 con 0x7f89e0106f10 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 0x7f89e01972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 0x7f89e01972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46680/0 (socket says 172.21.15.12:46680) 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 -- 172.21.15.12:0/3132504538 learned_addr learned my addr 172.21.15.12:0/3132504538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89ded9d640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e0106f10 0x7f89e019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 -- 172.21.15.12:0/3132504538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e0106f10 msgr2=0x7f89e019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89d7fff640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e01045e0 0x7f89e0197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e0106f10 0x7f89e019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 -- 172.21.15.12:0/3132504538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e01045e0 msgr2=0x7f89e0197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e01045e0 0x7f89e0197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 -- 172.21.15.12:0/3132504538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009900 con 0x7f89e0101cb0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89ded9d640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e0106f10 0x7f89e019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89de59c640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 0x7f89e01972c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89d000d950 tx=0x7f89d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0009a30 con 0x7f89e0101cb0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f89d0009b90 con 0x7f89e0101cb0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e019f3c0 con 0x7f89e0101cb0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0004a00 con 0x7f89e0101cb0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.543+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e019f8d0 con 0x7f89e0101cb0 2024-02-14T13:06:50.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.544+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e00fd1b0 con 0x7f89e0101cb0 2024-02-14T13:06:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.546+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f89d0009d00 con 0x7f89e0101cb0 2024-02-14T13:06:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.546+0000 7f89d77fe640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f89cc0a20c0 0x7f89cc0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.546+0000 7f89d7fff640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f89cc0a20c0 0x7f89cc0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.546+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f89d00cd690 con 0x7f89e0101cb0 2024-02-14T13:06:50.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.547+0000 7f89d7fff640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f89cc0a20c0 0x7f89cc0a4580 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c8005d80 tx=0x7f89c8005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:50.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.551+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f89d00967b0 con 0x7f89e0101cb0 2024-02-14T13:06:50.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.770+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f89e002ce50 con 0x7f89e0101cb0 2024-02-14T13:06:50.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.805+0000 7f89d77fe640 1 -- 172.21.15.12:0/3132504538 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f89d0099e70 con 0x7f89e0101cb0 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f89cc0a20c0 msgr2=0x7f89cc0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f89cc0a20c0 0x7f89cc0a4580 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89c8005d80 tx=0x7f89c8005c90 comp rx=0 tx=0).stop 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 msgr2=0x7f89e01972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 0x7f89e01972c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f89d000d950 tx=0x7f89d000de10 comp rx=0 tx=0).stop 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 shutdown_connections 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f89cc0a20c0 0x7f89cc0a4580 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89e0106f10 0x7f89e019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e01045e0 0x7f89e0197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 --2- 172.21.15.12:0/3132504538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89e0101cb0 0x7f89e01972c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 >> 172.21.15.12:0/3132504538 conn(0x7f89e00fb6c0 msgr2=0x7f89e0102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 shutdown_connections 2024-02-14T13:06:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.808+0000 7f89e4f02640 1 -- 172.21.15.12:0/3132504538 wait complete. 2024-02-14T13:06:50.821 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-02-14T13:06:50.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 -- 172.21.15.12:0/2615443253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c101320 msgr2=0x7f494c1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 --2- 172.21.15.12:0/2615443253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c101320 0x7f494c1017a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4940009900 tx=0x7f494002bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 -- 172.21.15.12:0/2615443253 shutdown_connections 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 --2- 172.21.15.12:0/2615443253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f494c101ce0 0x7f494c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 --2- 172.21.15.12:0/2615443253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c101320 0x7f494c1017a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 --2- 172.21.15.12:0/2615443253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c100130 0x7f494c100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 -- 172.21.15.12:0/2615443253 >> 172.21.15.12:0/2615443253 conn(0x7f494c0fb6c0 msgr2=0x7f494c0fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.927+0000 7f4951fbc640 1 -- 172.21.15.12:0/2615443253 shutdown_connections 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 -- 172.21.15.12:0/2615443253 wait complete. 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 Processor -- start 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 -- start start 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 0x7f494c10a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c101320 0x7f494c109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f494c101ce0 0x7f494c109570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c109cd0 con 0x7f494c100130 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c109e40 con 0x7f494c101ce0 2024-02-14T13:06:50.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f4951fbc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1a1340 con 0x7f494c101320 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f494b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 0x7f494c10a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f494b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 0x7f494c10a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46706/0 (socket says 172.21.15.12:46706) 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.928+0000 7f494b7fe640 1 -- 172.21.15.12:0/1142055379 learned_addr learned my addr 172.21.15.12:0/1142055379 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494bfff640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f494c101ce0 0x7f494c109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494affd640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c101320 0x7f494c109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494b7fe640 1 -- 172.21.15.12:0/1142055379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c101320 msgr2=0x7f494c109030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494b7fe640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c101320 0x7f494c109030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494b7fe640 1 -- 172.21.15.12:0/1142055379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f494c101ce0 msgr2=0x7f494c109570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494b7fe640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f494c101ce0 0x7f494c109570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494b7fe640 1 -- 172.21.15.12:0/1142055379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940009560 con 0x7f494c100130 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494affd640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c101320 0x7f494c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f494b7fe640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 0x7f494c10a9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c9a0 tx=0x7f493c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:50.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c004220 con 0x7f494c100130 2024-02-14T13:06:50.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f493c007e90 con 0x7f494c100130 2024-02-14T13:06:50.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c1a15f0 con 0x7f494c100130 2024-02-14T13:06:50.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00f450 con 0x7f494c100130 2024-02-14T13:06:50.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.929+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c1a1b00 con 0x7f494c100130 2024-02-14T13:06:50.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.930+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c107470 con 0x7f494c100130 2024-02-14T13:06:50.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.931+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f493c004380 con 0x7f494c100130 2024-02-14T13:06:50.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.931+0000 7f4948ff9640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f49340a20c0 0x7f49340a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:50.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.932+0000 7f494affd640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f49340a20c0 0x7f49340a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:50.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.932+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f493c0cdb80 con 0x7f494c100130 2024-02-14T13:06:50.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.932+0000 7f494affd640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f49340a20c0 0x7f49340a4580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f494c10a760 tx=0x7f4940005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:50.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:50.936+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f493c096ca0 con 0x7f494c100130 2024-02-14T13:06:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/741129093' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-02-14T13:06:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: osdmap e86: 12 total, 12 up, 12 in 2024-02-14T13:06:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-02-14T13:06:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-02-14T13:06:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3243470604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: pgmap v287: 97 pgs: 32 active+clean, 25 creating+peering, 40 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-02-14T13:06:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2817493007' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:51.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:50 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3132504538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-02-14T13:06:51.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/741129093' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: osdmap e86: 12 total, 12 up, 12 in 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3243470604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: pgmap v287: 97 pgs: 32 active+clean, 25 creating+peering, 40 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2817493007' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:51.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:50 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3132504538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-02-14T13:06:51.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.157+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f494c02cde0 con 0x7f494c100130 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/741129093' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: osdmap e86: 12 total, 12 up, 12 in 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3243470604' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: pgmap v287: 97 pgs: 32 active+clean, 25 creating+peering, 40 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2817493007' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:51.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:50 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3132504538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-02-14T13:06:51.491 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: 2024-02-14T13:06:51.136+0000 7fcb96255700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-14T13:06:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.816+0000 7f4948ff9640 1 -- 172.21.15.12:0/1142055379 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7f493c0ba070 con 0x7f494c100130 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f49340a20c0 msgr2=0x7f49340a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f49340a20c0 0x7f49340a4580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f494c10a760 tx=0x7f4940005be0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 msgr2=0x7f494c10a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 0x7f494c10a9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f493c00c9a0 tx=0x7f493c00ce60 comp rx=0 tx=0).stop 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 shutdown_connections 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f49340a20c0 0x7f49340a4580 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f494c101ce0 0x7f494c109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c101320 0x7f494c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 --2- 172.21.15.12:0/1142055379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f494c100130 0x7f494c10a9f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 >> 172.21.15.12:0/1142055379 conn(0x7f494c0fb6c0 msgr2=0x7f494c104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 shutdown_connections 2024-02-14T13:06:51.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.819+0000 7f4951fbc640 1 -- 172.21.15.12:0/1142055379 wait complete. 2024-02-14T13:06:51.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-02-14T13:06:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 -- 172.21.15.12:0/2999765042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 msgr2=0x7f37901017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 --2- 172.21.15.12:0/2999765042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901017b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3784009900 tx=0x7f378402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 -- 172.21.15.12:0/2999765042 shutdown_connections 2024-02-14T13:06:51.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 --2- 172.21.15.12:0/2999765042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 0x7f3790108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 --2- 172.21.15.12:0/2999765042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901017b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 --2- 172.21.15.12:0/2999765042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3790100140 0x7f3790100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 -- 172.21.15.12:0/2999765042 >> 172.21.15.12:0/2999765042 conn(0x7f37900fb6d0 msgr2=0x7f37900fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 -- 172.21.15.12:0/2999765042 shutdown_connections 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.946+0000 7f37979ba640 1 -- 172.21.15.12:0/2999765042 wait complete. 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 Processor -- start 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 -- start start 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3790100140 0x7f37901041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 0x7f3790102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790103480 con 0x7f3790101330 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37901035f0 con 0x7f3790101cf0 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f37979ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37901a12f0 con 0x7f3790100140 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46718/0 (socket says 172.21.15.12:46718) 2024-02-14T13:06:51.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 -- 172.21.15.12:0/3871894581 learned_addr learned my addr 172.21.15.12:0/3871894581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3795f57640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 0x7f3790102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 -- 172.21.15.12:0/3871894581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3790100140 msgr2=0x7f37901041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3790100140 0x7f37901041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 -- 172.21.15.12:0/3871894581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 msgr2=0x7f3790102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 0x7f3790102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3794f55640 1 -- 172.21.15.12:0/3871894581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784009560 con 0x7f3790101330 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.947+0000 7f3795f57640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 0x7f3790102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.948+0000 7f3794f55640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901027e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3784036040 tx=0x7f37840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.948+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840044e0 con 0x7f3790101330 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.948+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f37840054e0 con 0x7f3790101330 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.948+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37901a1540 con 0x7f3790101330 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.948+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784003ec0 con 0x7f3790101330 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.948+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37901a1a50 con 0x7f3790101330 2024-02-14T13:06:51.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.949+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379010bb50 con 0x7f3790101330 2024-02-14T13:06:51.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.950+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f37840035f0 con 0x7f3790101330 2024-02-14T13:06:51.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.951+0000 7f378e7fc640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f37780a20c0 0x7f37780a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:51.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.951+0000 7f3795756640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f37780a20c0 0x7f37780a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:51.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.951+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f37840effa0 con 0x7f3790101330 2024-02-14T13:06:51.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.951+0000 7f3795756640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f37780a20c0 0x7f37780a4580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3790101190 tx=0x7f3788005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:51.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:51.955+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f37840b90c0 con 0x7f3790101330 2024-02-14T13:06:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-14T13:06:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: Cluster is now healthy 2024-02-14T13:06:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3132504538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-02-14T13:06:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: osdmap e87: 12 total, 12 up, 12 in 2024-02-14T13:06:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] up:active 2024-02-14T13:06:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-02-14T13:06:52.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:51 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1142055379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-14T13:06:52.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.176+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f379010bce0 con 0x7f3790101330 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: Cluster is now healthy 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3132504538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: osdmap e87: 12 total, 12 up, 12 in 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] up:active 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-02-14T13:06:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:51 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1142055379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-14T13:06:52.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-14T13:06:52.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: Cluster is now healthy 2024-02-14T13:06:52.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3132504538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-02-14T13:06:52.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: osdmap e87: 12 total, 12 up, 12 in 2024-02-14T13:06:52.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] up:active 2024-02-14T13:06:52.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-02-14T13:06:52.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:51 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1142055379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-14T13:06:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.834+0000 7f378e7fc640 1 -- 172.21.15.12:0/3871894581 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v18) v1 ==== 115+0+0 (secure 0 0 0) 0x7f37840bc780 con 0x7f3790101330 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f37780a20c0 msgr2=0x7f37780a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f37780a20c0 0x7f37780a4580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3790101190 tx=0x7f3788005c90 comp rx=0 tx=0).stop 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 msgr2=0x7f37901027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901027e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3784036040 tx=0x7f37840042f0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 shutdown_connections 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f37780a20c0 0x7f37780a4580 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790101cf0 0x7f3790102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3790101330 0x7f37901027e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 --2- 172.21.15.12:0/3871894581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3790100140 0x7f37901041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 >> 172.21.15.12:0/3871894581 conn(0x7f37900fb6d0 msgr2=0x7f3790069800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 shutdown_connections 2024-02-14T13:06:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.837+0000 7f37979ba640 1 -- 172.21.15.12:0/3871894581 wait complete. 2024-02-14T13:06:52.852 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-02-14T13:06:52.852 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 -- 172.21.15.12:0/257997305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 msgr2=0x7fb55c109380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 --2- 172.21.15.12:0/257997305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c109380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb554009ca0 tx=0x7fb55402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 -- 172.21.15.12:0/257997305 shutdown_connections 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 --2- 172.21.15.12:0/257997305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c109380 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 --2- 172.21.15.12:0/257997305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c104600 0x7fb55c1069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 --2- 172.21.15.12:0/257997305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb55c101cd0 0x7fb55c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 -- 172.21.15.12:0/257997305 >> 172.21.15.12:0/257997305 conn(0x7fb55c0fb6e0 msgr2=0x7fb55c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 -- 172.21.15.12:0/257997305 shutdown_connections 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.962+0000 7fb5645e2640 1 -- 172.21.15.12:0/257997305 wait complete. 2024-02-14T13:06:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 Processor -- start 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 -- start start 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb55c101cd0 0x7fb55c1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c104600 0x7fb55c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19ede0 con 0x7fb55c106f30 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19ef50 con 0x7fb55c104600 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb5645e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c19f110 con 0x7fb55c101cd0 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c19e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46728/0 (socket says 172.21.15.12:46728) 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 -- 172.21.15.12:0/555692784 learned_addr learned my addr 172.21.15.12:0/555692784 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb56237e640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb55c101cd0 0x7fb55c1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb561b7d640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c104600 0x7fb55c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 -- 172.21.15.12:0/555692784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb55c101cd0 msgr2=0x7fb55c1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb55c101cd0 0x7fb55c1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 -- 172.21.15.12:0/555692784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c104600 msgr2=0x7fb55c197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c104600 0x7fb55c197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 -- 172.21.15.12:0/555692784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554009900 con 0x7fb55c106f30 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.963+0000 7fb562b7f640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c19e8a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb554037040 tx=0x7fb554034d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.964+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554032eb0 con 0x7fb55c106f30 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.964+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c19f390 con 0x7fb55c106f30 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.964+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fb554003e50 con 0x7fb55c106f30 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.964+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554040450 con 0x7fb55c106f30 2024-02-14T13:06:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.964+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c19f840 con 0x7fb55c106f30 2024-02-14T13:06:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.965+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0fd1d0 con 0x7fb55c106f30 2024-02-14T13:06:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.966+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fb55400a040 con 0x7fb55c106f30 2024-02-14T13:06:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.966+0000 7fb5537fe640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5480a20c0 0x7fb5480a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.966+0000 7fb56237e640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5480a20c0 0x7fb5480a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.966+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb5540f0f20 con 0x7fb55c106f30 2024-02-14T13:06:52.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.967+0000 7fb56237e640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5480a20c0 0x7fb5480a4580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb558009990 tx=0x7fb558009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:52.970+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb5540ba040 con 0x7fb55c106f30 2024-02-14T13:06:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.177+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fb55c02cec0 con 0x7fb5480a20c0 2024-02-14T13:06:53.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:52 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1142055379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-14T13:06:53.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:52 smithi012 ceph-mon[32370]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-02-14T13:06:53.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:52 smithi012 ceph-mon[32370]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-02-14T13:06:53.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:52 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3871894581' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-02-14T13:06:53.185 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:52 smithi012 ceph-mon[32370]: pgmap v289: 97 pgs: 68 active+clean, 25 creating+peering, 4 unknown; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2024-02-14T13:06:53.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.196+0000 7fb5537fe640 1 -- 172.21.15.12:0/555692784 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb55c02cec0 con 0x7fb5480a20c0 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5480a20c0 msgr2=0x7fb5480a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5480a20c0 0x7fb5480a4580 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb558009990 tx=0x7fb558009110 comp rx=0 tx=0).stop 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 msgr2=0x7fb55c19e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c19e8a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb554037040 tx=0x7fb554034d40 comp rx=0 tx=0).stop 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 shutdown_connections 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb5480a20c0 0x7fb5480a4580 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb55c106f30 0x7fb55c19e8a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb55c104600 0x7fb55c197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 --2- 172.21.15.12:0/555692784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb55c101cd0 0x7fb55c1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 >> 172.21.15.12:0/555692784 conn(0x7fb55c0fb6e0 msgr2=0x7fb55c102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 shutdown_connections 2024-02-14T13:06:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.198+0000 7fb5645e2640 1 -- 172.21.15.12:0/555692784 wait complete. 2024-02-14T13:06:53.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-02-14T13:06:53.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:52 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1142055379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-14T13:06:53.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:52 smithi103 ceph-mon[36921]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-02-14T13:06:53.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:52 smithi103 ceph-mon[36921]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-02-14T13:06:53.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:52 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3871894581' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-02-14T13:06:53.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:52 smithi103 ceph-mon[36921]: pgmap v289: 97 pgs: 68 active+clean, 25 creating+peering, 4 unknown; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2024-02-14T13:06:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:52 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1142055379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-14T13:06:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:52 smithi055 ceph-mon[36853]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-02-14T13:06:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:52 smithi055 ceph-mon[36853]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-02-14T13:06:53.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:52 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3871894581' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-02-14T13:06:53.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:52 smithi055 ceph-mon[36853]: pgmap v289: 97 pgs: 68 active+clean, 25 creating+peering, 4 unknown; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 -- 172.21.15.12:0/3220240147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 msgr2=0x7feaa41017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 --2- 172.21.15.12:0/3220240147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41017a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009900 tx=0x7fea8c02bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 -- 172.21.15.12:0/3220240147 shutdown_connections 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 --2- 172.21.15.12:0/3220240147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaa4101ce0 0x7feaa4108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 --2- 172.21.15.12:0/3220240147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41017a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 --2- 172.21.15.12:0/3220240147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 0x7feaa4100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 -- 172.21.15.12:0/3220240147 >> 172.21.15.12:0/3220240147 conn(0x7feaa40fb6a0 msgr2=0x7feaa40fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 -- 172.21.15.12:0/3220240147 shutdown_connections 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 -- 172.21.15.12:0/3220240147 wait complete. 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.317+0000 7feaa9640640 1 Processor -- start 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 -- start start 2024-02-14T13:06:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 0x7feaa41961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaa4101ce0 0x7feaa419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa419dc90 con 0x7feaa4101320 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa419de00 con 0x7feaa4100130 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa419dfc0 con 0x7feaa4101ce0 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46752/0 (socket says 172.21.15.12:46752) 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 -- 172.21.15.12:0/2664687161 learned_addr learned my addr 172.21.15.12:0/2664687161 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa2ffd640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 0x7feaa41961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa37fe640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaa4101ce0 0x7feaa419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 -- 172.21.15.12:0/2664687161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaa4101ce0 msgr2=0x7feaa419d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaa4101ce0 0x7feaa419d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 -- 172.21.15.12:0/2664687161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 msgr2=0x7feaa41961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 0x7feaa41961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 -- 172.21.15.12:0/2664687161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009560 con 0x7feaa4101320 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa2ffd640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 0x7feaa41961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7fea9bfff640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41966e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006010 tx=0x7fea8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0044e0 con 0x7feaa4101320 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa419e240 con 0x7feaa4101320 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fea8c0054e0 con 0x7feaa4101320 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c03e450 con 0x7feaa4101320 2024-02-14T13:06:53.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.318+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa419e7a0 con 0x7feaa4101320 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.320+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa4107450 con 0x7feaa4101320 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.321+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fea8c0035f0 con 0x7feaa4101320 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.321+0000 7feaa0ff9640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fea900a20c0 0x7fea900a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.321+0000 7feaa2ffd640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fea900a20c0 0x7fea900a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.322+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fea8c0effd0 con 0x7feaa4101320 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.322+0000 7feaa2ffd640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fea900a20c0 0x7fea900a4580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fea94005d00 tx=0x7fea94005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.326+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea8c0b90f0 con 0x7feaa4101320 2024-02-14T13:06:53.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:06:53.182+0000 7fc8f2fe3700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-14T13:06:53.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:06:53.182+0000 7fc8f2fe3700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-14T13:06:53.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:06:53.182+0000 7fc8f2fe3700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-14T13:06:53.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:06:53.182+0000 7fc8f2fe3700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-14T13:06:53.467 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:06:53.182+0000 7fc8f2fe3700 -1 client.0 error registering admin socket command: (17) File exists 2024-02-14T13:06:53.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.535+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7feaa402ce20 con 0x7fea900a20c0 2024-02-14T13:06:53.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.556+0000 7feaa0ff9640 1 -- 172.21.15.12:0/2664687161 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feaa402ce20 con 0x7fea900a20c0 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fea900a20c0 msgr2=0x7fea900a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fea900a20c0 0x7fea900a4580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fea94005d00 tx=0x7fea94005c90 comp rx=0 tx=0).stop 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 msgr2=0x7feaa41966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41966e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006010 tx=0x7fea8c0042f0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 shutdown_connections 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fea900a20c0 0x7fea900a4580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feaa4101ce0 0x7feaa419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feaa4101320 0x7feaa41966e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 --2- 172.21.15.12:0/2664687161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaa4100130 0x7feaa41961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 >> 172.21.15.12:0/2664687161 conn(0x7feaa40fb6a0 msgr2=0x7feaa4104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:53.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 shutdown_connections 2024-02-14T13:06:53.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.558+0000 7feaa9640640 1 -- 172.21.15.12:0/2664687161 wait complete. 2024-02-14T13:06:53.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-02-14T13:06:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- 172.21.15.12:0/1464736250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 msgr2=0x7f0b101017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/1464736250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b101017c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009900 tx=0x7f0afc02bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- 172.21.15.12:0/1464736250 shutdown_connections 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/1464736250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b10101d00 0x7f0b10108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/1464736250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b101017c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/1464736250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b10100150 0x7f0b10100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- 172.21.15.12:0/1464736250 >> 172.21.15.12:0/1464736250 conn(0x7f0b100fb6e0 msgr2=0x7f0b100fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- 172.21.15.12:0/1464736250 shutdown_connections 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- 172.21.15.12:0/1464736250 wait complete. 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 Processor -- start 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- start start 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b10100150 0x7f0b10197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b10197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b10101d00 0x7f0b1019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1019ede0 con 0x7f0b10101340 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1019ef50 con 0x7f0b10101d00 2024-02-14T13:06:53.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b16b3e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1019f110 con 0x7f0b10100150 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b10197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b10197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46772/0 (socket says 172.21.15.12:46772) 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.677+0000 7f0b0ffff640 1 -- 172.21.15.12:0/3341358971 learned_addr learned my addr 172.21.15.12:0/3341358971 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b148da640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b10100150 0x7f0b10197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0ffff640 1 -- 172.21.15.12:0/3341358971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b10100150 msgr2=0x7f0b10197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0ffff640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b10100150 0x7f0b10197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0ffff640 1 -- 172.21.15.12:0/3341358971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b10101d00 msgr2=0x7f0b1019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0ffff640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b10101d00 0x7f0b1019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0ffff640 1 -- 172.21.15.12:0/3341358971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc009560 con 0x7f0b10101340 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0ffff640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b10197880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0afc006010 tx=0x7f0afc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc0044e0 con 0x7f0b10101340 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f0afc0054e0 con 0x7f0b10101340 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1019f390 con 0x7f0b10101340 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc03e450 con 0x7f0b10101340 2024-02-14T13:06:53.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.678+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1019f920 con 0x7f0b10101340 2024-02-14T13:06:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.679+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1010bba0 con 0x7f0b10101340 2024-02-14T13:06:53.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.680+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f0afc0035f0 con 0x7f0b10101340 2024-02-14T13:06:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.681+0000 7f0b0dffb640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0b000a20c0 0x7f0b000a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.681+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0afc0efee0 con 0x7f0b10101340 2024-02-14T13:06:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.681+0000 7f0b148da640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0b000a20c0 0x7f0b000a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.681+0000 7f0b148da640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0b000a20c0 0x7f0b000a4580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b101011a0 tx=0x7f0b0400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:53.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.685+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0afc0b9000 con 0x7f0b10101340 2024-02-14T13:06:53.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.901+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b100fd8d0 con 0x7f0b000a20c0 2024-02-14T13:06:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.906+0000 7f0b0dffb640 1 -- 172.21.15.12:0/3341358971 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f0b100fd8d0 con 0x7f0b000a20c0 2024-02-14T13:06:53.907 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_0/d8ada444-2458-4598-a9aa-638b9c8b1ed4 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0b000a20c0 msgr2=0x7f0b000a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0b000a20c0 0x7f0b000a4580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b101011a0 tx=0x7f0b0400b390 comp rx=0 tx=0).stop 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 msgr2=0x7f0b10197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b10197880 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0afc006010 tx=0x7f0afc0042f0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 shutdown_connections 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0b000a20c0 0x7f0b000a4580 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b10101d00 0x7f0b1019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b10101340 0x7f0b10197880 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 --2- 172.21.15.12:0/3341358971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b10100150 0x7f0b10197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:53.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 >> 172.21.15.12:0/3341358971 conn(0x7f0b100fb6e0 msgr2=0x7f0b100fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 shutdown_connections 2024-02-14T13:06:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:53.908+0000 7f0b16b3e640 1 -- 172.21.15.12:0/3341358971 wait complete. 2024-02-14T13:06:53.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1292459972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 msgr2=0x7f7ad41017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1292459972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad41017b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009900 tx=0x7f7ac802bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1292459972 shutdown_connections 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1292459972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ad4101cf0 0x7f7ad4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1292459972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad41017b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1292459972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad4100140 0x7f7ad4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1292459972 >> 172.21.15.12:0/1292459972 conn(0x7f7ad40fb6d0 msgr2=0x7f7ad40fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1292459972 shutdown_connections 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1292459972 wait complete. 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 Processor -- start 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.026+0000 7f7ad96f4640 1 -- start start 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad4100140 0x7f7ad4199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad4199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ad4101cf0 0x7f7ad41a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41a1040 con 0x7f7ad4101330 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41a11b0 con 0x7f7ad4100140 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad41a1370 con 0x7f7ad4101cf0 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad4199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad4199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46790/0 (socket says 172.21.15.12:46790) 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 -- 172.21.15.12:0/1646681280 learned_addr learned my addr 172.21.15.12:0/1646681280 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 -- 172.21.15.12:0/1646681280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ad4101cf0 msgr2=0x7f7ad41a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad37fe640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ad4101cf0 0x7f7ad41a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad2ffd640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad4100140 0x7f7ad4199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ad4101cf0 0x7f7ad41a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 -- 172.21.15.12:0/1646681280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad4100140 msgr2=0x7f7ad4199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad4100140 0x7f7ad4199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 -- 172.21.15.12:0/1646681280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009560 con 0x7f7ad4101330 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad27fc640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad4199a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006010 tx=0x7f7ac80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80044e0 con 0x7f7ad4101330 2024-02-14T13:06:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad41a15f0 con 0x7f7ad4101330 2024-02-14T13:06:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f7ac80054e0 con 0x7f7ad4101330 2024-02-14T13:06:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac803e450 con 0x7f7ad4101330 2024-02-14T13:06:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.027+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad41a1bd0 con 0x7f7ad4101330 2024-02-14T13:06:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.028+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad410bb90 con 0x7f7ad4101330 2024-02-14T13:06:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.030+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f7ac80035f0 con 0x7f7ad4101330 2024-02-14T13:06:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.030+0000 7f7abbfff640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7abc0a20c0 0x7f7abc0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.030+0000 7f7ad2ffd640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7abc0a20c0 0x7f7abc0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.030+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7ac80f05b0 con 0x7f7ad4101330 2024-02-14T13:06:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.031+0000 7f7ad2ffd640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7abc0a20c0 0x7f7abc0a4580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4005fd0 tx=0x7f7ac4005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:54.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.033+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ac80b96d0 con 0x7f7ad4101330 2024-02-14T13:06:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3871894581' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-02-14T13:06:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-mon[32370]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-02-14T13:06:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:53 smithi012 ceph-mon[32370]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:54.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:53 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3871894581' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-02-14T13:06:54.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:53 smithi103 ceph-mon[36921]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-02-14T13:06:54.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:53 smithi103 ceph-mon[36921]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:54.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.242+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ad40fd860 con 0x7f7abc0a20c0 2024-02-14T13:06:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.265+0000 7f7abbfff640 1 -- 172.21.15.12:0/1646681280 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7ad40fd860 con 0x7f7abc0a20c0 2024-02-14T13:06:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7abc0a20c0 msgr2=0x7f7abc0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7abc0a20c0 0x7f7abc0a4580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4005fd0 tx=0x7f7ac4005850 comp rx=0 tx=0).stop 2024-02-14T13:06:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 msgr2=0x7f7ad4199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad4199a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006010 tx=0x7f7ac80042f0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 shutdown_connections 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7abc0a20c0 0x7f7abc0a4580 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ad4101cf0 0x7f7ad41a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4101330 0x7f7ad4199a90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 --2- 172.21.15.12:0/1646681280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad4100140 0x7f7ad4199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 >> 172.21.15.12:0/1646681280 conn(0x7f7ad40fb6d0 msgr2=0x7f7ad40fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.267+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 shutdown_connections 2024-02-14T13:06:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.268+0000 7f7ad96f4640 1 -- 172.21.15.12:0/1646681280 wait complete. 2024-02-14T13:06:54.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-02-14T13:06:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:53 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3871894581' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-02-14T13:06:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:53 smithi055 ceph-mon[36853]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-02-14T13:06:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:53 smithi055 ceph-mon[36853]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 -- 172.21.15.12:0/2937450288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101d00 msgr2=0x7f0c88108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/2937450288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101d00 0x7f0c88108590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009ca0 tx=0x7f0c8002c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 -- 172.21.15.12:0/2937450288 shutdown_connections 2024-02-14T13:06:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/2937450288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101d00 0x7f0c88108590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/2937450288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88101340 0x7f0c881017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/2937450288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88100150 0x7f0c88100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 -- 172.21.15.12:0/2937450288 >> 172.21.15.12:0/2937450288 conn(0x7f0c880fb6e0 msgr2=0x7f0c880fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 -- 172.21.15.12:0/2937450288 shutdown_connections 2024-02-14T13:06:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 -- 172.21.15.12:0/2937450288 wait complete. 2024-02-14T13:06:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.386+0000 7f0c8e38c640 1 Processor -- start 2024-02-14T13:06:54.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 -- start start 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88100150 0x7f0c88196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 0x7f0c88196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88101d00 0x7f0c8819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8819dc40 con 0x7f0c88101340 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8819ddb0 con 0x7f0c88100150 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8e38c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8819df70 con 0x7f0c88101d00 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 0x7f0c88196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 0x7f0c88196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47314/0 (socket says 172.21.15.12:47314) 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 -- 172.21.15.12:0/1541160188 learned_addr learned my addr 172.21.15.12:0/1541160188 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c87fff640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88100150 0x7f0c88196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c8c929640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88101d00 0x7f0c8819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 -- 172.21.15.12:0/1541160188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88101d00 msgr2=0x7f0c8819d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88101d00 0x7f0c8819d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 -- 172.21.15.12:0/1541160188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88100150 msgr2=0x7f0c88196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88100150 0x7f0c88196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 -- 172.21.15.12:0/1541160188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009900 con 0x7f0c88101340 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c87fff640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88100150 0x7f0c88196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.387+0000 7f0c877fe640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 0x7f0c88196690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b4a0 tx=0x7f0c7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.388+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c010610 con 0x7f0c88101340 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.388+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8819e250 con 0x7f0c88101340 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.388+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f0c7c010c50 con 0x7f0c88101340 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.388+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c017e20 con 0x7f0c88101340 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.388+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8819e760 con 0x7f0c88101340 2024-02-14T13:06:54.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.389+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c88107410 con 0x7f0c88101340 2024-02-14T13:06:54.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.390+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f0c7c017480 con 0x7f0c88101340 2024-02-14T13:06:54.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.390+0000 7f0c857fa640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0c700a20c0 0x7f0c700a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.390+0000 7f0c87fff640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0c700a20c0 0x7f0c700a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.390+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0c7c0cd240 con 0x7f0c88101340 2024-02-14T13:06:54.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.391+0000 7f0c87fff640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0c700a20c0 0x7f0c700a4580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c881011a0 tx=0x7f0c7800a5e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:54.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.395+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c7c096360 con 0x7f0c88101340 2024-02-14T13:06:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.605+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c8802cec0 con 0x7f0c700a20c0 2024-02-14T13:06:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.609+0000 7f0c857fa640 1 -- 172.21.15.12:0/1541160188 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f0c8802cec0 con 0x7f0c700a20c0 2024-02-14T13:06:54.611 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_1/682b67f3-11e4-4b9e-8737-fd8c68c6bf89 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0c700a20c0 msgr2=0x7f0c700a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0c700a20c0 0x7f0c700a4580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c881011a0 tx=0x7f0c7800a5e0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 msgr2=0x7f0c88196690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 0x7f0c88196690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00b4a0 tx=0x7f0c7c00b960 comp rx=0 tx=0).stop 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 shutdown_connections 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f0c700a20c0 0x7f0c700a4580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c88101d00 0x7f0c8819d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c88101340 0x7f0c88196690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 --2- 172.21.15.12:0/1541160188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c88100150 0x7f0c88196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 >> 172.21.15.12:0/1541160188 conn(0x7f0c880fb6e0 msgr2=0x7f0c881045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 shutdown_connections 2024-02-14T13:06:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.611+0000 7f0c8e38c640 1 -- 172.21.15.12:0/1541160188 wait complete. 2024-02-14T13:06:54.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:06:54.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1512417527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c0ff2d0 msgr2=0x7f7c6c0ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1512417527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c0ff2d0 0x7f7c6c0ff750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009900 tx=0x7f7c6002bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:54.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1512417527 shutdown_connections 2024-02-14T13:06:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1512417527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 0x7f7c6c109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1512417527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c0ff2d0 0x7f7c6c0ff750 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1512417527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c6c102860 0x7f7c6c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1512417527 >> 172.21.15.12:0/1512417527 conn(0x7f7c6c0fae50 msgr2=0x7f7c6c0fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1512417527 shutdown_connections 2024-02-14T13:06:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.724+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1512417527 wait complete. 2024-02-14T13:06:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 Processor -- start 2024-02-14T13:06:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 -- start start 2024-02-14T13:06:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c6c0ff2d0 0x7f7c6c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 0x7f7c6c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 0x7f7c6c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c19ef30 con 0x7f7c6c102860 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c19f0a0 con 0x7f7c6c0ffc90 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c70e1c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c19f260 con 0x7f7c6c0ff2d0 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c6ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 0x7f7c6c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c6ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 0x7f7c6c19e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47334/0 (socket says 172.21.15.12:47334) 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c6ad9d640 1 -- 172.21.15.12:0/1785653083 learned_addr learned my addr 172.21.15.12:0/1785653083 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.725+0000 7f7c69d9b640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 0x7f7c6c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c6ad9d640 1 -- 172.21.15.12:0/1785653083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c6c0ff2d0 msgr2=0x7f7c6c197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c6ad9d640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c6c0ff2d0 0x7f7c6c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c6ad9d640 1 -- 172.21.15.12:0/1785653083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 msgr2=0x7f7c6c197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c6ad9d640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 0x7f7c6c197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c6ad9d640 1 -- 172.21.15.12:0/1785653083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60009560 con 0x7f7c6c102860 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c69d9b640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 0x7f7c6c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c6ad9d640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 0x7f7c6c19e9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00b970 tx=0x7f7c5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00cb40 con 0x7f7c6c102860 2024-02-14T13:06:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c00cca0 con 0x7f7c6c102860 2024-02-14T13:06:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c19f540 con 0x7f7c6c102860 2024-02-14T13:06:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0077d0 con 0x7f7c6c102860 2024-02-14T13:06:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.726+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c19fad0 con 0x7f7c6c102860 2024-02-14T13:06:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.727+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c108720 con 0x7f7c6c102860 2024-02-14T13:06:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.728+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f7c5c014440 con 0x7f7c6c102860 2024-02-14T13:06:54.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.729+0000 7f7c5b7fe640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7c540a2140 0x7f7c540a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:54.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.729+0000 7f7c6a59c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7c540a2140 0x7f7c540a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:54.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.729+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7c5c0cd990 con 0x7f7c6c102860 2024-02-14T13:06:54.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.729+0000 7f7c6a59c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7c540a2140 0x7f7c540a4600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0695e0 tx=0x7f7c64006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:54.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.732+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7c5c096a10 con 0x7f7c6c102860 2024-02-14T13:06:54.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.857+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f7c5c0146f0 con 0x7f7c6c102860 2024-02-14T13:06:54.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.960+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c6c10cd60 con 0x7f7c6c102860 2024-02-14T13:06:54.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.960+0000 7f7c5b7fe640 1 -- 172.21.15.12:0/1785653083 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7f7c5c0c7860 con 0x7f7c6c102860 2024-02-14T13:06:54.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:54.963 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:06:54.963 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:06:54.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7c540a2140 msgr2=0x7f7c540a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7c540a2140 0x7f7c540a4600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0695e0 tx=0x7f7c64006c90 comp rx=0 tx=0).stop 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 msgr2=0x7f7c6c19e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 0x7f7c6c19e9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00b970 tx=0x7f7c5c00be30 comp rx=0 tx=0).stop 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 shutdown_connections 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7c540a2140 0x7f7c540a4600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c6c102860 0x7f7c6c19e9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c6c0ffc90 0x7f7c6c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 --2- 172.21.15.12:0/1785653083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c6c0ff2d0 0x7f7c6c197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 >> 172.21.15.12:0/1785653083 conn(0x7f7c6c0fae50 msgr2=0x7f7c6c1058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 shutdown_connections 2024-02-14T13:06:54.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:54.963+0000 7f7c70e1c640 1 -- 172.21.15.12:0/1785653083 wait complete. 2024-02-14T13:06:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:54 smithi012 ceph-mon[32370]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:54 smithi012 ceph-mon[32370]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:54 smithi012 ceph-mon[32370]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:54.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:54 smithi012 ceph-mon[32370]: pgmap v290: 97 pgs: 92 active+clean, 5 creating+peering; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-14T13:06:54.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 -- 172.21.15.12:0/987487213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101d20 msgr2=0x7f64041085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 --2- 172.21.15.12:0/987487213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101d20 0x7f64041085b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009ca0 tx=0x7f63f402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 -- 172.21.15.12:0/987487213 shutdown_connections 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 --2- 172.21.15.12:0/987487213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101d20 0x7f64041085b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 --2- 172.21.15.12:0/987487213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404101360 0x7f64041017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 --2- 172.21.15.12:0/987487213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404100170 0x7f6404100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 -- 172.21.15.12:0/987487213 >> 172.21.15.12:0/987487213 conn(0x7f64040fb6e0 msgr2=0x7f64040fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:55.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 -- 172.21.15.12:0/987487213 shutdown_connections 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 -- 172.21.15.12:0/987487213 wait complete. 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.077+0000 7f6408b02640 1 Processor -- start 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 -- start start 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404100170 0x7f64041961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 0x7f6404196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404101d20 0x7f640419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640419dcc0 con 0x7f6404101360 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640419de30 con 0x7f6404100170 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640419dff0 con 0x7f6404101d20 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 0x7f6404196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 0x7f6404196710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47366/0 (socket says 172.21.15.12:47366) 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 -- 172.21.15.12:0/973031616 learned_addr learned my addr 172.21.15.12:0/973031616 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6402d9d640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404101d20 0x7f640419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f640259c640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404100170 0x7f64041961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 -- 172.21.15.12:0/973031616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404101d20 msgr2=0x7f640419d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404101d20 0x7f640419d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 -- 172.21.15.12:0/973031616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404100170 msgr2=0x7f64041961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404100170 0x7f64041961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 -- 172.21.15.12:0/973031616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4009900 con 0x7f6404101360 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6402d9d640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404101d20 0x7f640419d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f640259c640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404100170 0x7f64041961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6401d9b640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 0x7f6404196710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00e9f0 tx=0x7f63ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec009700 con 0x7f6404101360 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f63ec00cd80 con 0x7f6404101360 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640419e2d0 con 0x7f6404101360 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.078+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec018920 con 0x7f6404101360 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.079+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640419e7e0 con 0x7f6404101360 2024-02-14T13:06:55.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.079+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404107430 con 0x7f6404101360 2024-02-14T13:06:55.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.080+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f63ec018a80 con 0x7f6404101360 2024-02-14T13:06:55.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.081+0000 7f63fb7fe640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f63f00a2150 0x7f63f00a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.081+0000 7f640259c640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f63f00a2150 0x7f63f00a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.081+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f63ec014070 con 0x7f6404101360 2024-02-14T13:06:55.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.082+0000 7f640259c640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f63f00a2150 0x7f63f00a4610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0058c0 tx=0x7f63fc005d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:55.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.086+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f63ec052d20 con 0x7f6404101360 2024-02-14T13:06:55.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:54 smithi103 ceph-mon[36921]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:55.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:54 smithi103 ceph-mon[36921]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:55.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:54 smithi103 ceph-mon[36921]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:55.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:54 smithi103 ceph-mon[36921]: pgmap v290: 97 pgs: 92 active+clean, 5 creating+peering; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-14T13:06:55.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.268+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f640402ce50 con 0x7f6404101360 2024-02-14T13:06:55.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.270+0000 7f63fb7fe640 1 -- 172.21.15.12:0/973031616 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22110 (secure 0 0 0) 0x7f63ec0971a0 con 0x7f6404101360 2024-02-14T13:06:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:55.272 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:50.799671+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:06:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f63f00a2150 msgr2=0x7f63f00a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f63f00a2150 0x7f63f00a4610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0058c0 tx=0x7f63fc005d50 comp rx=0 tx=0).stop 2024-02-14T13:06:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 msgr2=0x7f6404196710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 0x7f6404196710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00e9f0 tx=0x7f63ec00eeb0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 shutdown_connections 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f63f00a2150 0x7f63f00a4610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6404101d20 0x7f640419d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6404101360 0x7f6404196710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 --2- 172.21.15.12:0/973031616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6404100170 0x7f64041961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 >> 172.21.15.12:0/973031616 conn(0x7f64040fb6e0 msgr2=0x7f6404104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 shutdown_connections 2024-02-14T13:06:55.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.272+0000 7f6408b02640 1 -- 172.21.15.12:0/973031616 wait complete. 2024-02-14T13:06:55.285 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-14T13:06:55.286 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-14T13:06:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:54 smithi055 ceph-mon[36853]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:54 smithi055 ceph-mon[36853]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:54 smithi055 ceph-mon[36853]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:55.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:54 smithi055 ceph-mon[36853]: pgmap v290: 97 pgs: 92 active+clean, 5 creating+peering; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-14T13:06:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 -- 172.21.15.12:0/454436727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258101d00 msgr2=0x7fa258108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 --2- 172.21.15.12:0/454436727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258101d00 0x7fa258108590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa250009ca0 tx=0x7fa25002c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 -- 172.21.15.12:0/454436727 shutdown_connections 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 --2- 172.21.15.12:0/454436727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258101d00 0x7fa258108590 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 --2- 172.21.15.12:0/454436727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 0x7fa2581017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 --2- 172.21.15.12:0/454436727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa258100150 0x7fa258100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 -- 172.21.15.12:0/454436727 >> 172.21.15.12:0/454436727 conn(0x7fa2580fb6c0 msgr2=0x7fa2580fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 -- 172.21.15.12:0/454436727 shutdown_connections 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.386+0000 7fa25e902640 1 -- 172.21.15.12:0/454436727 wait complete. 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 Processor -- start 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 -- start start 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 0x7fa2581040e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 0x7fa258102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa258101d00 0x7fa258102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25819b110 con 0x7fa258100150 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2581031a0 con 0x7fa258101d00 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa25e902640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258103360 con 0x7fa258101340 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa257fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 0x7fa2581040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa257fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 0x7fa2581040e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47380/0 (socket says 172.21.15.12:47380) 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa257fff640 1 -- 172.21.15.12:0/3343382206 learned_addr learned my addr 172.21.15.12:0/3343382206 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.387+0000 7fa2577fe640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 0x7fa258102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa257fff640 1 -- 172.21.15.12:0/3343382206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 msgr2=0x7fa258102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa257fff640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 0x7fa258102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa257fff640 1 -- 172.21.15.12:0/3343382206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa258101d00 msgr2=0x7fa258102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa25ce9f640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa258101d00 0x7fa258102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa257fff640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa258101d00 0x7fa258102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa257fff640 1 -- 172.21.15.12:0/3343382206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250009900 con 0x7fa258100150 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa2577fe640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 0x7fa258102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa257fff640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 0x7fa2581040e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa24800d950 tx=0x7fa24800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248009c30 con 0x7fa258100150 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa248009d90 con 0x7fa258100150 2024-02-14T13:06:55.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2581a5b00 con 0x7fa258100150 2024-02-14T13:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800f850 con 0x7fa258100150 2024-02-14T13:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.388+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2581a5ec0 con 0x7fa258100150 2024-02-14T13:06:55.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.389+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa258068020 con 0x7fa258100150 2024-02-14T13:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.390+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fa24800f9b0 con 0x7fa258100150 2024-02-14T13:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.391+0000 7fa2557fa640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa2400a2150 0x7fa2400a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.391+0000 7fa2577fe640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa2400a2150 0x7fa2400a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.391+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa2480cd9f0 con 0x7fa258100150 2024-02-14T13:06:55.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.391+0000 7fa2577fe640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa2400a2150 0x7fa2400a4610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005e00 tx=0x7fa24c005c70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:55.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.396+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa2480cfe60 con 0x7fa258100150 2024-02-14T13:06:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.572+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2580fd850 con 0x7fa2400a2150 2024-02-14T13:06:55.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.583+0000 7fa2557fa640 1 -- 172.21.15.12:0/3343382206 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334976 (secure 0 0 0) 0x7fa2580fd850 con 0x7fa2400a2150 2024-02-14T13:06:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:55.591 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:06:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa2400a2150 msgr2=0x7fa2400a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa2400a2150 0x7fa2400a4610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005e00 tx=0x7fa24c005c70 comp rx=0 tx=0).stop 2024-02-14T13:06:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 msgr2=0x7fa2581040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 0x7fa2581040e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa24800d950 tx=0x7fa24800de10 comp rx=0 tx=0).stop 2024-02-14T13:06:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 shutdown_connections 2024-02-14T13:06:55.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa2400a2150 0x7fa2400a4610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa258101d00 0x7fa258102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa258101340 0x7fa258102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 --2- 172.21.15.12:0/3343382206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa258100150 0x7fa2581040e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 >> 172.21.15.12:0/3343382206 conn(0x7fa2580fb6c0 msgr2=0x7fa2580fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.586+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 shutdown_connections 2024-02-14T13:06:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.587+0000 7fa25e902640 1 -- 172.21.15.12:0/3343382206 wait complete. 2024-02-14T13:06:55.599 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-02-14T13:06:54.351595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":129,"num_read_kb":112,"num_write":220,"num_write_kb":2950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361792,"kb_used_data":12572,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580032,"statfs":{"total":1151940427776,"available":1151569952768,"internally_reserved":0,"allocated":12873728,"data_stored":7019787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812053+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:06:49.812053+0000","last_peered":"2024-02-14T13:06:49.812053+0000","last_clean":"2024-02-14T13:06:49.812053+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:06:49.812053+0000","last_undegraded":"2024-02-14T13:06:49.812053+0000","last_fullsized":"2024-02-14T13:06:49.812053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:13:58.218901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809005+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:06:50.809005+0000","last_peered":"2024-02-14T13:06:50.809005+0000","last_clean":"2024-02-14T13:06:50.809005+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:06:50.809005+0000","last_undegraded":"2024-02-14T13:06:50.809005+0000","last_fullsized":"2024-02-14T13:06:50.809005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808797+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:06:50.808797+0000","last_peered":"2024-02-14T13:06:50.808797+0000","last_clean":"2024-02-14T13:06:50.808797+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:06:50.808797+0000","last_undegraded":"2024-02-14T13:06:50.808797+0000","last_fullsized":"2024-02-14T13:06:50.808797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822590+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:06:49.822590+0000","last_peered":"2024-02-14T13:06:49.822590+0000","last_clean":"2024-02-14T13:06:49.822590+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:06:49.822590+0000","last_undegraded":"2024-02-14T13:06:49.822590+0000","last_fullsized":"2024-02-14T13:06:49.822590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:50:36.640645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809253+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:06:50.809253+0000","last_peered":"2024-02-14T13:06:50.809253+0000","last_clean":"2024-02-14T13:06:50.809253+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:06:50.809253+0000","last_undegraded":"2024-02-14T13:06:50.809253+0000","last_fullsized":"2024-02-14T13:06:50.809253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822805+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:06:49.822805+0000","last_peered":"2024-02-14T13:06:49.822805+0000","last_clean":"2024-02-14T13:06:49.822805+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:06:49.822805+0000","last_undegraded":"2024-02-14T13:06:49.822805+0000","last_fullsized":"2024-02-14T13:06:49.822805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:31:51.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813081+0000","last_change":"2024-02-14T13:06:49.816529+0000","last_active":"2024-02-14T13:06:50.813081+0000","last_peered":"2024-02-14T13:06:50.813081+0000","last_clean":"2024-02-14T13:06:50.813081+0000","last_became_active":"2024-02-14T13:06:49.816153+0000","last_became_peered":"2024-02-14T13:06:49.816153+0000","last_unstale":"2024-02-14T13:06:50.813081+0000","last_undegraded":"2024-02-14T13:06:50.813081+0000","last_fullsized":"2024-02-14T13:06:50.813081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:03:10.291658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824426+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:06:49.824426+0000","last_peered":"2024-02-14T13:06:49.824426+0000","last_clean":"2024-02-14T13:06:49.824426+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:06:49.824426+0000","last_undegraded":"2024-02-14T13:06:49.824426+0000","last_fullsized":"2024-02-14T13:06:49.824426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:04:23.822784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832644+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:06:50.832644+0000","last_peered":"2024-02-14T13:06:50.832644+0000","last_clean":"2024-02-14T13:06:50.832644+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:06:50.832644+0000","last_undegraded":"2024-02-14T13:06:50.832644+0000","last_fullsized":"2024-02-14T13:06:50.832644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.823871+0000","last_change":"2024-02-14T13:06:49.820207+0000","last_active":"2024-02-14T13:06:49.823871+0000","last_peered":"2024-02-14T13:06:49.823871+0000","last_clean":"2024-02-14T13:06:49.823871+0000","last_became_active":"2024-02-14T13:06:49.819829+0000","last_became_peered":"2024-02-14T13:06:49.819829+0000","last_unstale":"2024-02-14T13:06:49.823871+0000","last_undegraded":"2024-02-14T13:06:49.823871+0000","last_fullsized":"2024-02-14T13:06:49.823871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:53:14.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813526+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:06:50.813526+0000","last_peered":"2024-02-14T13:06:50.813526+0000","last_clean":"2024-02-14T13:06:50.813526+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:06:50.813526+0000","last_undegraded":"2024-02-14T13:06:50.813526+0000","last_fullsized":"2024-02-14T13:06:50.813526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.814699+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:06:49.814699+0000","last_peered":"2024-02-14T13:06:49.814699+0000","last_clean":"2024-02-14T13:06:49.814699+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:06:49.814699+0000","last_undegraded":"2024-02-14T13:06:49.814699+0000","last_fullsized":"2024-02-14T13:06:49.814699+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:06:59.776439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878215+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:06:50.878215+0000","last_peered":"2024-02-14T13:06:50.878215+0000","last_clean":"2024-02-14T13:06:50.878215+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:06:50.878215+0000","last_undegraded":"2024-02-14T13:06:50.878215+0000","last_fullsized":"2024-02-14T13:06:50.878215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808595+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:06:50.808595+0000","last_peered":"2024-02-14T13:06:50.808595+0000","last_clean":"2024-02-14T13:06:50.808595+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:06:50.808595+0000","last_undegraded":"2024-02-14T13:06:50.808595+0000","last_fullsized":"2024-02-14T13:06:50.808595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808546+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:06:50.808546+0000","last_peered":"2024-02-14T13:06:50.808546+0000","last_clean":"2024-02-14T13:06:50.808546+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:06:50.808546+0000","last_undegraded":"2024-02-14T13:06:50.808546+0000","last_fullsized":"2024-02-14T13:06:50.808546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832106+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:06:50.832106+0000","last_peered":"2024-02-14T13:06:50.832106+0000","last_clean":"2024-02-14T13:06:50.832106+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:06:50.832106+0000","last_undegraded":"2024-02-14T13:06:50.832106+0000","last_fullsized":"2024-02-14T13:06:50.832106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815917+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:06:49.815917+0000","last_peered":"2024-02-14T13:06:49.815917+0000","last_clean":"2024-02-14T13:06:49.815917+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:06:49.815917+0000","last_undegraded":"2024-02-14T13:06:49.815917+0000","last_fullsized":"2024-02-14T13:06:49.815917+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:56:21.643596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812072+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:06:49.812072+0000","last_peered":"2024-02-14T13:06:49.812072+0000","last_clean":"2024-02-14T13:06:49.812072+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:06:49.812072+0000","last_undegraded":"2024-02-14T13:06:49.812072+0000","last_fullsized":"2024-02-14T13:06:49.812072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:39:06.773096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.825195+0000","last_change":"2024-02-14T13:06:49.823862+0000","last_active":"2024-02-14T13:06:49.825195+0000","last_peered":"2024-02-14T13:06:49.825195+0000","last_clean":"2024-02-14T13:06:49.825195+0000","last_became_active":"2024-02-14T13:06:49.822726+0000","last_became_peered":"2024-02-14T13:06:49.822726+0000","last_unstale":"2024-02-14T13:06:49.825195+0000","last_undegraded":"2024-02-14T13:06:49.825195+0000","last_fullsized":"2024-02-14T13:06:49.825195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:43:29.397696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816953+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:06:49.816953+0000","last_peered":"2024-02-14T13:06:49.816953+0000","last_clean":"2024-02-14T13:06:49.816953+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:06:49.816953+0000","last_undegraded":"2024-02-14T13:06:49.816953+0000","last_fullsized":"2024-02-14T13:06:49.816953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824391+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:06:49.824391+0000","last_peered":"2024-02-14T13:06:49.824391+0000","last_clean":"2024-02-14T13:06:49.824391+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:06:49.824391+0000","last_undegraded":"2024-02-14T13:06:49.824391+0000","last_fullsized":"2024-02-14T13:06:49.824391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:55:05.999626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.826178+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:06:49.826178+0000","last_peered":"2024-02-14T13:06:49.826178+0000","last_clean":"2024-02-14T13:06:49.826178+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:06:49.826178+0000","last_undegraded":"2024-02-14T13:06:49.826178+0000","last_fullsized":"2024-02-14T13:06:49.826178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808994+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:06:50.808994+0000","last_peered":"2024-02-14T13:06:50.808994+0000","last_clean":"2024-02-14T13:06:50.808994+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:06:50.808994+0000","last_undegraded":"2024-02-14T13:06:50.808994+0000","last_fullsized":"2024-02-14T13:06:50.808994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809630+0000","last_change":"2024-02-14T13:06:48.808351+0000","last_active":"2024-02-14T13:06:50.809630+0000","last_peered":"2024-02-14T13:06:50.809630+0000","last_clean":"2024-02-14T13:06:50.809630+0000","last_became_active":"2024-02-14T13:06:48.808059+0000","last_became_peered":"2024-02-14T13:06:48.808059+0000","last_unstale":"2024-02-14T13:06:50.809630+0000","last_undegraded":"2024-02-14T13:06:50.809630+0000","last_fullsized":"2024-02-14T13:06:50.809630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:24:45.902193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832310+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:06:50.832310+0000","last_peered":"2024-02-14T13:06:50.832310+0000","last_clean":"2024-02-14T13:06:50.832310+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:06:50.832310+0000","last_undegraded":"2024-02-14T13:06:50.832310+0000","last_fullsized":"2024-02-14T13:06:50.832310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809388+0000","last_change":"2024-02-14T13:06:48.803897+0000","last_active":"2024-02-14T13:06:50.809388+0000","last_peered":"2024-02-14T13:06:50.809388+0000","last_clean":"2024-02-14T13:06:50.809388+0000","last_became_active":"2024-02-14T13:06:48.803533+0000","last_became_peered":"2024-02-14T13:06:48.803533+0000","last_unstale":"2024-02-14T13:06:50.809388+0000","last_undegraded":"2024-02-14T13:06:50.809388+0000","last_fullsized":"2024-02-14T13:06:50.809388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:51:56.000004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.795340+0000","last_change":"2024-02-14T13:06:48.795340+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.795340+0000","last_undegraded":"2024-02-14T13:06:48.795340+0000","last_fullsized":"2024-02-14T13:06:48.795340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806994+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:06:48.806994+0000","last_peered":"2024-02-14T13:06:48.806994+0000","last_clean":"2024-02-14T13:06:48.806994+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:06:48.806994+0000","last_undegraded":"2024-02-14T13:06:48.806994+0000","last_fullsized":"2024-02-14T13:06:48.806994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:25:37.533263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809268+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:06:50.809268+0000","last_peered":"2024-02-14T13:06:50.809268+0000","last_clean":"2024-02-14T13:06:50.809268+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:06:50.809268+0000","last_undegraded":"2024-02-14T13:06:50.809268+0000","last_fullsized":"2024-02-14T13:06:50.809268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822712+0000","last_change":"2024-02-14T13:06:48.810464+0000","last_active":"2024-02-14T13:06:49.822712+0000","last_peered":"2024-02-14T13:06:49.822712+0000","last_clean":"2024-02-14T13:06:49.822712+0000","last_became_active":"2024-02-14T13:06:48.810159+0000","last_became_peered":"2024-02-14T13:06:48.810159+0000","last_unstale":"2024-02-14T13:06:49.822712+0000","last_undegraded":"2024-02-14T13:06:49.822712+0000","last_fullsized":"2024-02-14T13:06:49.822712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:00.546934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794518+0000","last_change":"2024-02-14T13:06:48.794518+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794518+0000","last_undegraded":"2024-02-14T13:06:48.794518+0000","last_fullsized":"2024-02-14T13:06:48.794518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877891+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:06:50.877891+0000","last_peered":"2024-02-14T13:06:50.877891+0000","last_clean":"2024-02-14T13:06:50.877891+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:06:50.877891+0000","last_undegraded":"2024-02-14T13:06:50.877891+0000","last_fullsized":"2024-02-14T13:06:50.877891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812759+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:06:49.812759+0000","last_peered":"2024-02-14T13:06:49.812759+0000","last_clean":"2024-02-14T13:06:49.812759+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:06:49.812759+0000","last_undegraded":"2024-02-14T13:06:49.812759+0000","last_fullsized":"2024-02-14T13:06:49.812759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:18:26.025809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.808127+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:06:48.808127+0000","last_peered":"2024-02-14T13:06:48.808127+0000","last_clean":"2024-02-14T13:06:48.808127+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:06:48.808127+0000","last_undegraded":"2024-02-14T13:06:48.808127+0000","last_fullsized":"2024-02-14T13:06:48.808127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:57.998957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815082+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:06:49.815082+0000","last_peered":"2024-02-14T13:06:49.815082+0000","last_clean":"2024-02-14T13:06:49.815082+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:06:49.815082+0000","last_undegraded":"2024-02-14T13:06:49.815082+0000","last_fullsized":"2024-02-14T13:06:49.815082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:38:27.382191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.799054+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:06:49.799054+0000","last_peered":"2024-02-14T13:06:49.799054+0000","last_clean":"2024-02-14T13:06:49.799054+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:06:49.799054+0000","last_undegraded":"2024-02-14T13:06:49.799054+0000","last_fullsized":"2024-02-14T13:06:49.799054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832560+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:06:50.832560+0000","last_peered":"2024-02-14T13:06:50.832560+0000","last_clean":"2024-02-14T13:06:50.832560+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:06:50.832560+0000","last_undegraded":"2024-02-14T13:06:50.832560+0000","last_fullsized":"2024-02-14T13:06:50.832560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813368+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:06:50.813368+0000","last_peered":"2024-02-14T13:06:50.813368+0000","last_clean":"2024-02-14T13:06:50.813368+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:06:50.813368+0000","last_undegraded":"2024-02-14T13:06:50.813368+0000","last_fullsized":"2024-02-14T13:06:50.813368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808949+0000","last_change":"2024-02-14T13:06:49.813126+0000","last_active":"2024-02-14T13:06:50.808949+0000","last_peered":"2024-02-14T13:06:50.808949+0000","last_clean":"2024-02-14T13:06:50.808949+0000","last_became_active":"2024-02-14T13:06:49.812790+0000","last_became_peered":"2024-02-14T13:06:49.812790+0000","last_unstale":"2024-02-14T13:06:50.808949+0000","last_undegraded":"2024-02-14T13:06:50.808949+0000","last_fullsized":"2024-02-14T13:06:50.808949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:10:56.354605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.808124+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:06:48.808124+0000","last_peered":"2024-02-14T13:06:48.808124+0000","last_clean":"2024-02-14T13:06:48.808124+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:06:48.808124+0000","last_undegraded":"2024-02-14T13:06:48.808124+0000","last_fullsized":"2024-02-14T13:06:48.808124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.181317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832394+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:06:50.832394+0000","last_peered":"2024-02-14T13:06:50.832394+0000","last_clean":"2024-02-14T13:06:50.832394+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:06:50.832394+0000","last_undegraded":"2024-02-14T13:06:50.832394+0000","last_fullsized":"2024-02-14T13:06:50.832394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.828953+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:06:49.828953+0000","last_peered":"2024-02-14T13:06:49.828953+0000","last_clean":"2024-02-14T13:06:49.828953+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:06:49.828953+0000","last_undegraded":"2024-02-14T13:06:49.828953+0000","last_fullsized":"2024-02-14T13:06:49.828953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809571+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:06:50.809571+0000","last_peered":"2024-02-14T13:06:50.809571+0000","last_clean":"2024-02-14T13:06:50.809571+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:06:50.809571+0000","last_undegraded":"2024-02-14T13:06:50.809571+0000","last_fullsized":"2024-02-14T13:06:50.809571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.826772+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:06:49.826772+0000","last_peered":"2024-02-14T13:06:49.826772+0000","last_clean":"2024-02-14T13:06:49.826772+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:06:49.826772+0000","last_undegraded":"2024-02-14T13:06:49.826772+0000","last_fullsized":"2024-02-14T13:06:49.826772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878225+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:06:50.878225+0000","last_peered":"2024-02-14T13:06:50.878225+0000","last_clean":"2024-02-14T13:06:50.878225+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:06:50.878225+0000","last_undegraded":"2024-02-14T13:06:50.878225+0000","last_fullsized":"2024-02-14T13:06:50.878225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806305+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:06:48.806305+0000","last_peered":"2024-02-14T13:06:48.806305+0000","last_clean":"2024-02-14T13:06:48.806305+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:06:48.806305+0000","last_undegraded":"2024-02-14T13:06:48.806305+0000","last_fullsized":"2024-02-14T13:06:48.806305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:31.587944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813427+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:06:50.813427+0000","last_peered":"2024-02-14T13:06:50.813427+0000","last_clean":"2024-02-14T13:06:50.813427+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:06:50.813427+0000","last_undegraded":"2024-02-14T13:06:50.813427+0000","last_fullsized":"2024-02-14T13:06:50.813427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.796142+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:06:49.796142+0000","last_peered":"2024-02-14T13:06:49.796142+0000","last_clean":"2024-02-14T13:06:49.796142+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:06:49.796142+0000","last_undegraded":"2024-02-14T13:06:49.796142+0000","last_fullsized":"2024-02-14T13:06:49.796142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813169+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:06:50.813169+0000","last_peered":"2024-02-14T13:06:50.813169+0000","last_clean":"2024-02-14T13:06:50.813169+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:06:50.813169+0000","last_undegraded":"2024-02-14T13:06:50.813169+0000","last_fullsized":"2024-02-14T13:06:50.813169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808973+0000","last_change":"2024-02-14T13:06:48.803956+0000","last_active":"2024-02-14T13:06:50.808973+0000","last_peered":"2024-02-14T13:06:50.808973+0000","last_clean":"2024-02-14T13:06:50.808973+0000","last_became_active":"2024-02-14T13:06:48.803671+0000","last_became_peered":"2024-02-14T13:06:48.803671+0000","last_unstale":"2024-02-14T13:06:50.808973+0000","last_undegraded":"2024-02-14T13:06:50.808973+0000","last_fullsized":"2024-02-14T13:06:50.808973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:28:48.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794153+0000","last_change":"2024-02-14T13:06:48.794153+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794153+0000","last_undegraded":"2024-02-14T13:06:48.794153+0000","last_fullsized":"2024-02-14T13:06:48.794153+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809613+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:06:50.809613+0000","last_peered":"2024-02-14T13:06:50.809613+0000","last_clean":"2024-02-14T13:06:50.809613+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:06:50.809613+0000","last_undegraded":"2024-02-14T13:06:50.809613+0000","last_fullsized":"2024-02-14T13:06:50.809613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.811836+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:06:49.811836+0000","last_peered":"2024-02-14T13:06:49.811836+0000","last_clean":"2024-02-14T13:06:49.811836+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:06:49.811836+0000","last_undegraded":"2024-02-14T13:06:49.811836+0000","last_fullsized":"2024-02-14T13:06:49.811836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:41:55.808724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.795929+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:06:49.795929+0000","last_peered":"2024-02-14T13:06:49.795929+0000","last_clean":"2024-02-14T13:06:49.795929+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:06:49.795929+0000","last_undegraded":"2024-02-14T13:06:49.795929+0000","last_fullsized":"2024-02-14T13:06:49.795929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.827294+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:06:49.827294+0000","last_peered":"2024-02-14T13:06:49.827294+0000","last_clean":"2024-02-14T13:06:49.827294+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:06:49.827294+0000","last_undegraded":"2024-02-14T13:06:49.827294+0000","last_fullsized":"2024-02-14T13:06:49.827294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:19:32.507781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813446+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:06:50.813446+0000","last_peered":"2024-02-14T13:06:50.813446+0000","last_clean":"2024-02-14T13:06:50.813446+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:06:50.813446+0000","last_undegraded":"2024-02-14T13:06:50.813446+0000","last_fullsized":"2024-02-14T13:06:50.813446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822844+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:06:49.822844+0000","last_peered":"2024-02-14T13:06:49.822844+0000","last_clean":"2024-02-14T13:06:49.822844+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:06:49.822844+0000","last_undegraded":"2024-02-14T13:06:49.822844+0000","last_fullsized":"2024-02-14T13:06:49.822844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:55:35.065612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.795281+0000","last_change":"2024-02-14T13:06:48.795281+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.795281+0000","last_undegraded":"2024-02-14T13:06:48.795281+0000","last_fullsized":"2024-02-14T13:06:48.795281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877771+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:06:50.877771+0000","last_peered":"2024-02-14T13:06:50.877771+0000","last_clean":"2024-02-14T13:06:50.877771+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:06:50.877771+0000","last_undegraded":"2024-02-14T13:06:50.877771+0000","last_fullsized":"2024-02-14T13:06:50.877771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.809105+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:06:49.809105+0000","last_peered":"2024-02-14T13:06:49.809105+0000","last_clean":"2024-02-14T13:06:49.809105+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:06:49.809105+0000","last_undegraded":"2024-02-14T13:06:49.809105+0000","last_fullsized":"2024-02-14T13:06:49.809105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:16:50.101289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.795981+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:06:49.795981+0000","last_peered":"2024-02-14T13:06:49.795981+0000","last_clean":"2024-02-14T13:06:49.795981+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:06:49.795981+0000","last_undegraded":"2024-02-14T13:06:49.795981+0000","last_fullsized":"2024-02-14T13:06:49.795981+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813026+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:06:50.813026+0000","last_peered":"2024-02-14T13:06:50.813026+0000","last_clean":"2024-02-14T13:06:50.813026+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:06:50.813026+0000","last_undegraded":"2024-02-14T13:06:50.813026+0000","last_fullsized":"2024-02-14T13:06:50.813026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877819+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:06:50.877819+0000","last_peered":"2024-02-14T13:06:50.877819+0000","last_clean":"2024-02-14T13:06:50.877819+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:06:50.877819+0000","last_undegraded":"2024-02-14T13:06:50.877819+0000","last_fullsized":"2024-02-14T13:06:50.877819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.812936+0000","last_change":"2024-02-14T13:06:48.812095+0000","last_active":"2024-02-14T13:06:50.812936+0000","last_peered":"2024-02-14T13:06:50.812936+0000","last_clean":"2024-02-14T13:06:50.812936+0000","last_became_active":"2024-02-14T13:06:48.811567+0000","last_became_peered":"2024-02-14T13:06:48.811567+0000","last_unstale":"2024-02-14T13:06:50.812936+0000","last_undegraded":"2024-02-14T13:06:50.812936+0000","last_fullsized":"2024-02-14T13:06:50.812936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:31:53.462420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809512+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:06:50.809512+0000","last_peered":"2024-02-14T13:06:50.809512+0000","last_clean":"2024-02-14T13:06:50.809512+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:06:50.809512+0000","last_undegraded":"2024-02-14T13:06:50.809512+0000","last_fullsized":"2024-02-14T13:06:50.809512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878268+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:06:50.878268+0000","last_peered":"2024-02-14T13:06:50.878268+0000","last_clean":"2024-02-14T13:06:50.878268+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:06:50.878268+0000","last_undegraded":"2024-02-14T13:06:50.878268+0000","last_fullsized":"2024-02-14T13:06:50.878268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.800853+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:06:49.800853+0000","last_peered":"2024-02-14T13:06:49.800853+0000","last_clean":"2024-02-14T13:06:49.800853+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:06:49.800853+0000","last_undegraded":"2024-02-14T13:06:49.800853+0000","last_fullsized":"2024-02-14T13:06:49.800853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824789+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:06:49.824789+0000","last_peered":"2024-02-14T13:06:49.824789+0000","last_clean":"2024-02-14T13:06:49.824789+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:06:49.824789+0000","last_undegraded":"2024-02-14T13:06:49.824789+0000","last_fullsized":"2024-02-14T13:06:49.824789+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:27:39.218470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818324+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:06:49.818324+0000","last_peered":"2024-02-14T13:06:49.818324+0000","last_clean":"2024-02-14T13:06:49.818324+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:06:49.818324+0000","last_undegraded":"2024-02-14T13:06:49.818324+0000","last_fullsized":"2024-02-14T13:06:49.818324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809096+0000","last_change":"2024-02-14T13:06:49.810268+0000","last_active":"2024-02-14T13:06:50.809096+0000","last_peered":"2024-02-14T13:06:50.809096+0000","last_clean":"2024-02-14T13:06:50.809096+0000","last_became_active":"2024-02-14T13:06:49.809434+0000","last_became_peered":"2024-02-14T13:06:49.809434+0000","last_unstale":"2024-02-14T13:06:50.809096+0000","last_undegraded":"2024-02-14T13:06:50.809096+0000","last_fullsized":"2024-02-14T13:06:50.809096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:46:18.599259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832095+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:06:50.832095+0000","last_peered":"2024-02-14T13:06:50.832095+0000","last_clean":"2024-02-14T13:06:50.832095+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:06:50.832095+0000","last_undegraded":"2024-02-14T13:06:50.832095+0000","last_fullsized":"2024-02-14T13:06:50.832095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809169+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:06:50.809169+0000","last_peered":"2024-02-14T13:06:50.809169+0000","last_clean":"2024-02-14T13:06:50.809169+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:06:50.809169+0000","last_undegraded":"2024-02-14T13:06:50.809169+0000","last_fullsized":"2024-02-14T13:06:50.809169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.792193+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:06:49.792193+0000","last_peered":"2024-02-14T13:06:49.792193+0000","last_clean":"2024-02-14T13:06:49.792193+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:06:49.792193+0000","last_undegraded":"2024-02-14T13:06:49.792193+0000","last_fullsized":"2024-02-14T13:06:49.792193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.820685+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:06:49.820685+0000","last_peered":"2024-02-14T13:06:49.820685+0000","last_clean":"2024-02-14T13:06:49.820685+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:06:49.820685+0000","last_undegraded":"2024-02-14T13:06:49.820685+0000","last_fullsized":"2024-02-14T13:06:49.820685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:16.168235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815789+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:06:49.815789+0000","last_peered":"2024-02-14T13:06:49.815789+0000","last_clean":"2024-02-14T13:06:49.815789+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:06:49.815789+0000","last_undegraded":"2024-02-14T13:06:49.815789+0000","last_fullsized":"2024-02-14T13:06:49.815789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824499+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:06:49.824499+0000","last_peered":"2024-02-14T13:06:49.824499+0000","last_clean":"2024-02-14T13:06:49.824499+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:06:49.824499+0000","last_undegraded":"2024-02-14T13:06:49.824499+0000","last_fullsized":"2024-02-14T13:06:49.824499+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:57:57.403268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809235+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:06:50.809235+0000","last_peered":"2024-02-14T13:06:50.809235+0000","last_clean":"2024-02-14T13:06:50.809235+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:06:50.809235+0000","last_undegraded":"2024-02-14T13:06:50.809235+0000","last_fullsized":"2024-02-14T13:06:50.809235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813309+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:06:50.813309+0000","last_peered":"2024-02-14T13:06:50.813309+0000","last_clean":"2024-02-14T13:06:50.813309+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:06:50.813309+0000","last_undegraded":"2024-02-14T13:06:50.813309+0000","last_fullsized":"2024-02-14T13:06:50.813309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.817406+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:06:49.817406+0000","last_peered":"2024-02-14T13:06:49.817406+0000","last_clean":"2024-02-14T13:06:49.817406+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:06:49.817406+0000","last_undegraded":"2024-02-14T13:06:49.817406+0000","last_fullsized":"2024-02-14T13:06:49.817406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813695+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:06:50.813695+0000","last_peered":"2024-02-14T13:06:50.813695+0000","last_clean":"2024-02-14T13:06:50.813695+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:06:50.813695+0000","last_undegraded":"2024-02-14T13:06:50.813695+0000","last_fullsized":"2024-02-14T13:06:50.813695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806420+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:06:48.806420+0000","last_peered":"2024-02-14T13:06:48.806420+0000","last_clean":"2024-02-14T13:06:48.806420+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:06:48.806420+0000","last_undegraded":"2024-02-14T13:06:48.806420+0000","last_fullsized":"2024-02-14T13:06:48.806420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:26.079907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813273+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:06:50.813273+0000","last_peered":"2024-02-14T13:06:50.813273+0000","last_clean":"2024-02-14T13:06:50.813273+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:06:50.813273+0000","last_undegraded":"2024-02-14T13:06:50.813273+0000","last_fullsized":"2024-02-14T13:06:50.813273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878539+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:06:50.878539+0000","last_peered":"2024-02-14T13:06:50.878539+0000","last_clean":"2024-02-14T13:06:50.878539+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:06:50.878539+0000","last_undegraded":"2024-02-14T13:06:50.878539+0000","last_fullsized":"2024-02-14T13:06:50.878539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813522+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:06:50.813522+0000","last_peered":"2024-02-14T13:06:50.813522+0000","last_clean":"2024-02-14T13:06:50.813522+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:06:50.813522+0000","last_undegraded":"2024-02-14T13:06:50.813522+0000","last_fullsized":"2024-02-14T13:06:50.813522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822708+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:06:49.822708+0000","last_peered":"2024-02-14T13:06:49.822708+0000","last_clean":"2024-02-14T13:06:49.822708+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:06:49.822708+0000","last_undegraded":"2024-02-14T13:06:49.822708+0000","last_fullsized":"2024-02-14T13:06:49.822708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:14:01.429780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815989+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:06:49.815989+0000","last_peered":"2024-02-14T13:06:49.815989+0000","last_clean":"2024-02-14T13:06:49.815989+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:06:49.815989+0000","last_undegraded":"2024-02-14T13:06:49.815989+0000","last_fullsized":"2024-02-14T13:06:49.815989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:11.506567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818763+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:06:49.818763+0000","last_peered":"2024-02-14T13:06:49.818763+0000","last_clean":"2024-02-14T13:06:49.818763+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:06:49.818763+0000","last_undegraded":"2024-02-14T13:06:49.818763+0000","last_fullsized":"2024-02-14T13:06:49.818763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:42:15.473826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808856+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:06:50.808856+0000","last_peered":"2024-02-14T13:06:50.808856+0000","last_clean":"2024-02-14T13:06:50.808856+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:06:50.808856+0000","last_undegraded":"2024-02-14T13:06:50.808856+0000","last_fullsized":"2024-02-14T13:06:50.808856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878412+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:06:50.878412+0000","last_peered":"2024-02-14T13:06:50.878412+0000","last_clean":"2024-02-14T13:06:50.878412+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:06:50.878412+0000","last_undegraded":"2024-02-14T13:06:50.878412+0000","last_fullsized":"2024-02-14T13:06:50.878412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824974+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:06:49.824974+0000","last_peered":"2024-02-14T13:06:49.824974+0000","last_clean":"2024-02-14T13:06:49.824974+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:06:49.824974+0000","last_undegraded":"2024-02-14T13:06:49.824974+0000","last_fullsized":"2024-02-14T13:06:49.824974+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:50:04.831632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818466+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:06:49.818466+0000","last_peered":"2024-02-14T13:06:49.818466+0000","last_clean":"2024-02-14T13:06:49.818466+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:06:49.818466+0000","last_undegraded":"2024-02-14T13:06:49.818466+0000","last_fullsized":"2024-02-14T13:06:49.818466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:20:20.760868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815561+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:06:49.815561+0000","last_peered":"2024-02-14T13:06:49.815561+0000","last_clean":"2024-02-14T13:06:49.815561+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:06:49.815561+0000","last_undegraded":"2024-02-14T13:06:49.815561+0000","last_fullsized":"2024-02-14T13:06:49.815561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:37:35.096694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794828+0000","last_change":"2024-02-14T13:06:48.794828+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794828+0000","last_undegraded":"2024-02-14T13:06:48.794828+0000","last_fullsized":"2024-02-14T13:06:48.794828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816237+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:06:49.816237+0000","last_peered":"2024-02-14T13:06:49.816237+0000","last_clean":"2024-02-14T13:06:49.816237+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:06:49.816237+0000","last_undegraded":"2024-02-14T13:06:49.816237+0000","last_fullsized":"2024-02-14T13:06:49.816237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:16:48.356409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832216+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:06:50.832216+0000","last_peered":"2024-02-14T13:06:50.832216+0000","last_clean":"2024-02-14T13:06:50.832216+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:06:50.832216+0000","last_undegraded":"2024-02-14T13:06:50.832216+0000","last_fullsized":"2024-02-14T13:06:50.832216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878378+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:06:50.878378+0000","last_peered":"2024-02-14T13:06:50.878378+0000","last_clean":"2024-02-14T13:06:50.878378+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:06:50.878378+0000","last_undegraded":"2024-02-14T13:06:50.878378+0000","last_fullsized":"2024-02-14T13:06:50.878378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816375+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:06:49.816375+0000","last_peered":"2024-02-14T13:06:49.816375+0000","last_clean":"2024-02-14T13:06:49.816375+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:06:49.816375+0000","last_undegraded":"2024-02-14T13:06:49.816375+0000","last_fullsized":"2024-02-14T13:06:49.816375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:52:02.123233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":7048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":10,"up_from":74,"seq":317827579922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1536000,"data_stored":1028606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.747},{"interface":"front","average":{"1min":1.841,"5min":1.841,"15min":1.841},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":16.844999999999999,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.73699999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":9,"up_from":69,"seq":296352743447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498}]},{"osd":2,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70099999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.40999999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.623}]},{"osd":8,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71599999999999997}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65000000000000002}]}]},{"osd":8,"up_from":61,"seq":261993005084,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":445606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68799999999999994,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.038},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.435,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75800000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.879},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":1.1020000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97399999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.85299999999999998,"5min":0.872,"15min":0.872},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.86399999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.1659999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.115}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":1.3620000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":7,"up_from":53,"seq":227633266721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1035952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.89200000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32400000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39900000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.745},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":48,"seq":206158430247,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":445119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.3080000000000001,"15min":1.423},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93000000000000005,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95799999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.3660000000000001,"15min":1.4810000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0169999999999999,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:06:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.56000000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67500000000000004}]},{"osd":8,"last update":"Wed Feb 14 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0209999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.622},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.64200000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":942080,"data_stored":446614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.34000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51700000000000002,"15min":0.48099999999999998},"min":{"1min":0.435,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.378,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.497},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.69799999999999995}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68100000000000005}]},{"osd":9,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78900000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:05:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.624}]},{"osd":2,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54000000000000004,"15min":0.498},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.79200000000000004,"15min":0.89200000000000002},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Feb 14 13:06:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.42599999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92100000000000004,"5min":1.224,"15min":1.224},"last":0.56599999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63600000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":436556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.623}]},{"osd":1,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.495},{"interface":"front","average":{"1min":0.621,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.751}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33500000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.622,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64900000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":3,"up_from":27,"seq":115964117045,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.318},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.173,"5min":0.52300000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":16.736999999999998,"5min":16.736999999999998,"15min":16.736999999999998},"last":16.736999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.54100000000000004},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":5.1159999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":4.8170000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":0.72499999999999998,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":20.550000000000001,"5min":20.550000000000001,"15min":20.550000000000001},"last":20.550000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.59899999999999998,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0540000000000003,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":6.0540000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:06:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":3.6000000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":13.26},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.56699999999999995,"15min":0.53600000000000003},"min":{"1min":0.46800000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":22.808}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":16.702999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53100000000000003,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.7669999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":13.172000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":16.648},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":5.048}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":3.9409999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":16.771000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.504999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":436454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.26200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.443},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.89100000000000001},"min":{"1min":0.439,"5min":0.314,"15min":0.314},"max":{"1min":3.718,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.36199999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.56100000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0429999999999999,"5min":6.327,"15min":6.327},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.58799999999999997,"15min":0.57099999999999995},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.621},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.57999999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.46000000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.627,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66600000000000004}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51300000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.60199999999999998}]}]},{"osd":5,"up_from":40,"seq":171798691883,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1017723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.34300000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Wed Feb 14 13:06:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82399999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41499999999999998}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.39300000000000002}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998}]},{"osd":10,"last update":"Wed Feb 14 13:06:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:06:55.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/510257108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38101360 msgr2=0x7f5d381017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/510257108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38101360 0x7f5d381017e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009900 tx=0x7f5d3402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/510257108 shutdown_connections 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/510257108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d38101d20 0x7f5d381085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/510257108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38101360 0x7f5d381017e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/510257108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38100170 0x7f5d38100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/510257108 >> 172.21.15.12:0/510257108 conn(0x7f5d380fb6e0 msgr2=0x7f5d380fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/510257108 shutdown_connections 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/510257108 wait complete. 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 Processor -- start 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.742+0000 7f5d3ffbc640 1 -- start start 2024-02-14T13:06:55.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 0x7f5d3806a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38101360 0x7f5d3819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d38101d20 0x7f5d3819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3819ef60 con 0x7f5d38100170 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3819f0d0 con 0x7f5d38101d20 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3819f290 con 0x7f5d38101360 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 0x7f5d3806a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 0x7f5d3806a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47392/0 (socket says 172.21.15.12:47392) 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 -- 172.21.15.12:0/3730266174 learned_addr learned my addr 172.21.15.12:0/3730266174 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3e559640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d38101d20 0x7f5d3819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3d557640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38101360 0x7f5d3819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 -- 172.21.15.12:0/3730266174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38101360 msgr2=0x7f5d3819c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38101360 0x7f5d3819c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 -- 172.21.15.12:0/3730266174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d38101d20 msgr2=0x7f5d3819e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d38101d20 0x7f5d3819e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 -- 172.21.15.12:0/3730266174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009560 con 0x7f5d38100170 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3d557640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38101360 0x7f5d3819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3dd58640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 0x7f5d3806a3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b450 tx=0x7f5d2800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28011890 con 0x7f5d38100170 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5d280103e0 con 0x7f5d38100170 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3819f570 con 0x7f5d38100170 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f580 con 0x7f5d38100170 2024-02-14T13:06:55.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.743+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3819fab0 con 0x7f5d38100170 2024-02-14T13:06:55.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.744+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38107530 con 0x7f5d38100170 2024-02-14T13:06:55.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.745+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f5d280108e0 con 0x7f5d38100170 2024-02-14T13:06:55.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.746+0000 7f5d2effd640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d240a21d0 0x7f5d240a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:55.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.746+0000 7f5d3d557640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d240a21d0 0x7f5d240a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:55.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.746+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5d280cda80 con 0x7f5d38100170 2024-02-14T13:06:55.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.747+0000 7f5d3d557640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d240a21d0 0x7f5d240a4690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d3806a160 tx=0x7f5d3402c800 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:55.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.751+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5d28096ab0 con 0x7f5d38100170 2024-02-14T13:06:55.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.929+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d3802ce20 con 0x7f5d240a21d0 2024-02-14T13:06:55.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.939+0000 7f5d2effd640 1 -- 172.21.15.12:0/3730266174 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334976 (secure 0 0 0) 0x7f5d3802ce20 con 0x7f5d240a21d0 2024-02-14T13:06:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:55.946 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d240a21d0 msgr2=0x7f5d240a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d240a21d0 0x7f5d240a4690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5d3806a160 tx=0x7f5d3402c800 comp rx=0 tx=0).stop 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 msgr2=0x7f5d3806a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 0x7f5d3806a3f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b450 tx=0x7f5d2800b910 comp rx=0 tx=0).stop 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 shutdown_connections 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d240a21d0 0x7f5d240a4690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d38101d20 0x7f5d3819e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38101360 0x7f5d3819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 --2- 172.21.15.12:0/3730266174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d38100170 0x7f5d3806a3f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 >> 172.21.15.12:0/3730266174 conn(0x7f5d380fb6e0 msgr2=0x7f5d38104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 shutdown_connections 2024-02-14T13:06:55.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:55.942+0000 7f5d3ffbc640 1 -- 172.21.15.12:0/3730266174 wait complete. 2024-02-14T13:06:55.955 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-02-14T13:06:54.351595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":129,"num_read_kb":112,"num_write":220,"num_write_kb":2950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361792,"kb_used_data":12572,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580032,"statfs":{"total":1151940427776,"available":1151569952768,"internally_reserved":0,"allocated":12873728,"data_stored":7019787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812053+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:06:49.812053+0000","last_peered":"2024-02-14T13:06:49.812053+0000","last_clean":"2024-02-14T13:06:49.812053+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:06:49.812053+0000","last_undegraded":"2024-02-14T13:06:49.812053+0000","last_fullsized":"2024-02-14T13:06:49.812053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:13:58.218901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809005+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:06:50.809005+0000","last_peered":"2024-02-14T13:06:50.809005+0000","last_clean":"2024-02-14T13:06:50.809005+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:06:50.809005+0000","last_undegraded":"2024-02-14T13:06:50.809005+0000","last_fullsized":"2024-02-14T13:06:50.809005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808797+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:06:50.808797+0000","last_peered":"2024-02-14T13:06:50.808797+0000","last_clean":"2024-02-14T13:06:50.808797+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:06:50.808797+0000","last_undegraded":"2024-02-14T13:06:50.808797+0000","last_fullsized":"2024-02-14T13:06:50.808797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822590+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:06:49.822590+0000","last_peered":"2024-02-14T13:06:49.822590+0000","last_clean":"2024-02-14T13:06:49.822590+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:06:49.822590+0000","last_undegraded":"2024-02-14T13:06:49.822590+0000","last_fullsized":"2024-02-14T13:06:49.822590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:50:36.640645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809253+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:06:50.809253+0000","last_peered":"2024-02-14T13:06:50.809253+0000","last_clean":"2024-02-14T13:06:50.809253+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:06:50.809253+0000","last_undegraded":"2024-02-14T13:06:50.809253+0000","last_fullsized":"2024-02-14T13:06:50.809253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822805+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:06:49.822805+0000","last_peered":"2024-02-14T13:06:49.822805+0000","last_clean":"2024-02-14T13:06:49.822805+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:06:49.822805+0000","last_undegraded":"2024-02-14T13:06:49.822805+0000","last_fullsized":"2024-02-14T13:06:49.822805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:31:51.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813081+0000","last_change":"2024-02-14T13:06:49.816529+0000","last_active":"2024-02-14T13:06:50.813081+0000","last_peered":"2024-02-14T13:06:50.813081+0000","last_clean":"2024-02-14T13:06:50.813081+0000","last_became_active":"2024-02-14T13:06:49.816153+0000","last_became_peered":"2024-02-14T13:06:49.816153+0000","last_unstale":"2024-02-14T13:06:50.813081+0000","last_undegraded":"2024-02-14T13:06:50.813081+0000","last_fullsized":"2024-02-14T13:06:50.813081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:03:10.291658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824426+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:06:49.824426+0000","last_peered":"2024-02-14T13:06:49.824426+0000","last_clean":"2024-02-14T13:06:49.824426+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:06:49.824426+0000","last_undegraded":"2024-02-14T13:06:49.824426+0000","last_fullsized":"2024-02-14T13:06:49.824426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:04:23.822784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832644+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:06:50.832644+0000","last_peered":"2024-02-14T13:06:50.832644+0000","last_clean":"2024-02-14T13:06:50.832644+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:06:50.832644+0000","last_undegraded":"2024-02-14T13:06:50.832644+0000","last_fullsized":"2024-02-14T13:06:50.832644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.823871+0000","last_change":"2024-02-14T13:06:49.820207+0000","last_active":"2024-02-14T13:06:49.823871+0000","last_peered":"2024-02-14T13:06:49.823871+0000","last_clean":"2024-02-14T13:06:49.823871+0000","last_became_active":"2024-02-14T13:06:49.819829+0000","last_became_peered":"2024-02-14T13:06:49.819829+0000","last_unstale":"2024-02-14T13:06:49.823871+0000","last_undegraded":"2024-02-14T13:06:49.823871+0000","last_fullsized":"2024-02-14T13:06:49.823871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:53:14.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813526+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:06:50.813526+0000","last_peered":"2024-02-14T13:06:50.813526+0000","last_clean":"2024-02-14T13:06:50.813526+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:06:50.813526+0000","last_undegraded":"2024-02-14T13:06:50.813526+0000","last_fullsized":"2024-02-14T13:06:50.813526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.814699+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:06:49.814699+0000","last_peered":"2024-02-14T13:06:49.814699+0000","last_clean":"2024-02-14T13:06:49.814699+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:06:49.814699+0000","last_undegraded":"2024-02-14T13:06:49.814699+0000","last_fullsized":"2024-02-14T13:06:49.814699+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:06:59.776439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878215+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:06:50.878215+0000","last_peered":"2024-02-14T13:06:50.878215+0000","last_clean":"2024-02-14T13:06:50.878215+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:06:50.878215+0000","last_undegraded":"2024-02-14T13:06:50.878215+0000","last_fullsized":"2024-02-14T13:06:50.878215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808595+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:06:50.808595+0000","last_peered":"2024-02-14T13:06:50.808595+0000","last_clean":"2024-02-14T13:06:50.808595+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:06:50.808595+0000","last_undegraded":"2024-02-14T13:06:50.808595+0000","last_fullsized":"2024-02-14T13:06:50.808595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808546+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:06:50.808546+0000","last_peered":"2024-02-14T13:06:50.808546+0000","last_clean":"2024-02-14T13:06:50.808546+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:06:50.808546+0000","last_undegraded":"2024-02-14T13:06:50.808546+0000","last_fullsized":"2024-02-14T13:06:50.808546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832106+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:06:50.832106+0000","last_peered":"2024-02-14T13:06:50.832106+0000","last_clean":"2024-02-14T13:06:50.832106+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:06:50.832106+0000","last_undegraded":"2024-02-14T13:06:50.832106+0000","last_fullsized":"2024-02-14T13:06:50.832106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815917+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:06:49.815917+0000","last_peered":"2024-02-14T13:06:49.815917+0000","last_clean":"2024-02-14T13:06:49.815917+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:06:49.815917+0000","last_undegraded":"2024-02-14T13:06:49.815917+0000","last_fullsized":"2024-02-14T13:06:49.815917+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:56:21.643596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812072+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:06:49.812072+0000","last_peered":"2024-02-14T13:06:49.812072+0000","last_clean":"2024-02-14T13:06:49.812072+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:06:49.812072+0000","last_undegraded":"2024-02-14T13:06:49.812072+0000","last_fullsized":"2024-02-14T13:06:49.812072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:39:06.773096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.825195+0000","last_change":"2024-02-14T13:06:49.823862+0000","last_active":"2024-02-14T13:06:49.825195+0000","last_peered":"2024-02-14T13:06:49.825195+0000","last_clean":"2024-02-14T13:06:49.825195+0000","last_became_active":"2024-02-14T13:06:49.822726+0000","last_became_peered":"2024-02-14T13:06:49.822726+0000","last_unstale":"2024-02-14T13:06:49.825195+0000","last_undegraded":"2024-02-14T13:06:49.825195+0000","last_fullsized":"2024-02-14T13:06:49.825195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:43:29.397696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816953+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:06:49.816953+0000","last_peered":"2024-02-14T13:06:49.816953+0000","last_clean":"2024-02-14T13:06:49.816953+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:06:49.816953+0000","last_undegraded":"2024-02-14T13:06:49.816953+0000","last_fullsized":"2024-02-14T13:06:49.816953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824391+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:06:49.824391+0000","last_peered":"2024-02-14T13:06:49.824391+0000","last_clean":"2024-02-14T13:06:49.824391+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:06:49.824391+0000","last_undegraded":"2024-02-14T13:06:49.824391+0000","last_fullsized":"2024-02-14T13:06:49.824391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:55:05.999626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.826178+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:06:49.826178+0000","last_peered":"2024-02-14T13:06:49.826178+0000","last_clean":"2024-02-14T13:06:49.826178+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:06:49.826178+0000","last_undegraded":"2024-02-14T13:06:49.826178+0000","last_fullsized":"2024-02-14T13:06:49.826178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808994+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:06:50.808994+0000","last_peered":"2024-02-14T13:06:50.808994+0000","last_clean":"2024-02-14T13:06:50.808994+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:06:50.808994+0000","last_undegraded":"2024-02-14T13:06:50.808994+0000","last_fullsized":"2024-02-14T13:06:50.808994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809630+0000","last_change":"2024-02-14T13:06:48.808351+0000","last_active":"2024-02-14T13:06:50.809630+0000","last_peered":"2024-02-14T13:06:50.809630+0000","last_clean":"2024-02-14T13:06:50.809630+0000","last_became_active":"2024-02-14T13:06:48.808059+0000","last_became_peered":"2024-02-14T13:06:48.808059+0000","last_unstale":"2024-02-14T13:06:50.809630+0000","last_undegraded":"2024-02-14T13:06:50.809630+0000","last_fullsized":"2024-02-14T13:06:50.809630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:24:45.902193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832310+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:06:50.832310+0000","last_peered":"2024-02-14T13:06:50.832310+0000","last_clean":"2024-02-14T13:06:50.832310+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:06:50.832310+0000","last_undegraded":"2024-02-14T13:06:50.832310+0000","last_fullsized":"2024-02-14T13:06:50.832310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809388+0000","last_change":"2024-02-14T13:06:48.803897+0000","last_active":"2024-02-14T13:06:50.809388+0000","last_peered":"2024-02-14T13:06:50.809388+0000","last_clean":"2024-02-14T13:06:50.809388+0000","last_became_active":"2024-02-14T13:06:48.803533+0000","last_became_peered":"2024-02-14T13:06:48.803533+0000","last_unstale":"2024-02-14T13:06:50.809388+0000","last_undegraded":"2024-02-14T13:06:50.809388+0000","last_fullsized":"2024-02-14T13:06:50.809388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:51:56.000004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.795340+0000","last_change":"2024-02-14T13:06:48.795340+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.795340+0000","last_undegraded":"2024-02-14T13:06:48.795340+0000","last_fullsized":"2024-02-14T13:06:48.795340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806994+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:06:48.806994+0000","last_peered":"2024-02-14T13:06:48.806994+0000","last_clean":"2024-02-14T13:06:48.806994+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:06:48.806994+0000","last_undegraded":"2024-02-14T13:06:48.806994+0000","last_fullsized":"2024-02-14T13:06:48.806994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:25:37.533263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809268+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:06:50.809268+0000","last_peered":"2024-02-14T13:06:50.809268+0000","last_clean":"2024-02-14T13:06:50.809268+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:06:50.809268+0000","last_undegraded":"2024-02-14T13:06:50.809268+0000","last_fullsized":"2024-02-14T13:06:50.809268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822712+0000","last_change":"2024-02-14T13:06:48.810464+0000","last_active":"2024-02-14T13:06:49.822712+0000","last_peered":"2024-02-14T13:06:49.822712+0000","last_clean":"2024-02-14T13:06:49.822712+0000","last_became_active":"2024-02-14T13:06:48.810159+0000","last_became_peered":"2024-02-14T13:06:48.810159+0000","last_unstale":"2024-02-14T13:06:49.822712+0000","last_undegraded":"2024-02-14T13:06:49.822712+0000","last_fullsized":"2024-02-14T13:06:49.822712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:00.546934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794518+0000","last_change":"2024-02-14T13:06:48.794518+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794518+0000","last_undegraded":"2024-02-14T13:06:48.794518+0000","last_fullsized":"2024-02-14T13:06:48.794518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877891+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:06:50.877891+0000","last_peered":"2024-02-14T13:06:50.877891+0000","last_clean":"2024-02-14T13:06:50.877891+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:06:50.877891+0000","last_undegraded":"2024-02-14T13:06:50.877891+0000","last_fullsized":"2024-02-14T13:06:50.877891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812759+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:06:49.812759+0000","last_peered":"2024-02-14T13:06:49.812759+0000","last_clean":"2024-02-14T13:06:49.812759+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:06:49.812759+0000","last_undegraded":"2024-02-14T13:06:49.812759+0000","last_fullsized":"2024-02-14T13:06:49.812759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:18:26.025809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.808127+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:06:48.808127+0000","last_peered":"2024-02-14T13:06:48.808127+0000","last_clean":"2024-02-14T13:06:48.808127+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:06:48.808127+0000","last_undegraded":"2024-02-14T13:06:48.808127+0000","last_fullsized":"2024-02-14T13:06:48.808127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:57.998957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815082+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:06:49.815082+0000","last_peered":"2024-02-14T13:06:49.815082+0000","last_clean":"2024-02-14T13:06:49.815082+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:06:49.815082+0000","last_undegraded":"2024-02-14T13:06:49.815082+0000","last_fullsized":"2024-02-14T13:06:49.815082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:38:27.382191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.799054+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:06:49.799054+0000","last_peered":"2024-02-14T13:06:49.799054+0000","last_clean":"2024-02-14T13:06:49.799054+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:06:49.799054+0000","last_undegraded":"2024-02-14T13:06:49.799054+0000","last_fullsized":"2024-02-14T13:06:49.799054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832560+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:06:50.832560+0000","last_peered":"2024-02-14T13:06:50.832560+0000","last_clean":"2024-02-14T13:06:50.832560+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:06:50.832560+0000","last_undegraded":"2024-02-14T13:06:50.832560+0000","last_fullsized":"2024-02-14T13:06:50.832560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813368+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:06:50.813368+0000","last_peered":"2024-02-14T13:06:50.813368+0000","last_clean":"2024-02-14T13:06:50.813368+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:06:50.813368+0000","last_undegraded":"2024-02-14T13:06:50.813368+0000","last_fullsized":"2024-02-14T13:06:50.813368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808949+0000","last_change":"2024-02-14T13:06:49.813126+0000","last_active":"2024-02-14T13:06:50.808949+0000","last_peered":"2024-02-14T13:06:50.808949+0000","last_clean":"2024-02-14T13:06:50.808949+0000","last_became_active":"2024-02-14T13:06:49.812790+0000","last_became_peered":"2024-02-14T13:06:49.812790+0000","last_unstale":"2024-02-14T13:06:50.808949+0000","last_undegraded":"2024-02-14T13:06:50.808949+0000","last_fullsized":"2024-02-14T13:06:50.808949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:10:56.354605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.808124+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:06:48.808124+0000","last_peered":"2024-02-14T13:06:48.808124+0000","last_clean":"2024-02-14T13:06:48.808124+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:06:48.808124+0000","last_undegraded":"2024-02-14T13:06:48.808124+0000","last_fullsized":"2024-02-14T13:06:48.808124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.181317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832394+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:06:50.832394+0000","last_peered":"2024-02-14T13:06:50.832394+0000","last_clean":"2024-02-14T13:06:50.832394+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:06:50.832394+0000","last_undegraded":"2024-02-14T13:06:50.832394+0000","last_fullsized":"2024-02-14T13:06:50.832394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.828953+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:06:49.828953+0000","last_peered":"2024-02-14T13:06:49.828953+0000","last_clean":"2024-02-14T13:06:49.828953+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:06:49.828953+0000","last_undegraded":"2024-02-14T13:06:49.828953+0000","last_fullsized":"2024-02-14T13:06:49.828953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809571+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:06:50.809571+0000","last_peered":"2024-02-14T13:06:50.809571+0000","last_clean":"2024-02-14T13:06:50.809571+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:06:50.809571+0000","last_undegraded":"2024-02-14T13:06:50.809571+0000","last_fullsized":"2024-02-14T13:06:50.809571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.826772+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:06:49.826772+0000","last_peered":"2024-02-14T13:06:49.826772+0000","last_clean":"2024-02-14T13:06:49.826772+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:06:49.826772+0000","last_undegraded":"2024-02-14T13:06:49.826772+0000","last_fullsized":"2024-02-14T13:06:49.826772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878225+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:06:50.878225+0000","last_peered":"2024-02-14T13:06:50.878225+0000","last_clean":"2024-02-14T13:06:50.878225+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:06:50.878225+0000","last_undegraded":"2024-02-14T13:06:50.878225+0000","last_fullsized":"2024-02-14T13:06:50.878225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806305+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:06:48.806305+0000","last_peered":"2024-02-14T13:06:48.806305+0000","last_clean":"2024-02-14T13:06:48.806305+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:06:48.806305+0000","last_undegraded":"2024-02-14T13:06:48.806305+0000","last_fullsized":"2024-02-14T13:06:48.806305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:31.587944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813427+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:06:50.813427+0000","last_peered":"2024-02-14T13:06:50.813427+0000","last_clean":"2024-02-14T13:06:50.813427+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:06:50.813427+0000","last_undegraded":"2024-02-14T13:06:50.813427+0000","last_fullsized":"2024-02-14T13:06:50.813427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.796142+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:06:49.796142+0000","last_peered":"2024-02-14T13:06:49.796142+0000","last_clean":"2024-02-14T13:06:49.796142+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:06:49.796142+0000","last_undegraded":"2024-02-14T13:06:49.796142+0000","last_fullsized":"2024-02-14T13:06:49.796142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813169+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:06:50.813169+0000","last_peered":"2024-02-14T13:06:50.813169+0000","last_clean":"2024-02-14T13:06:50.813169+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:06:50.813169+0000","last_undegraded":"2024-02-14T13:06:50.813169+0000","last_fullsized":"2024-02-14T13:06:50.813169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808973+0000","last_change":"2024-02-14T13:06:48.803956+0000","last_active":"2024-02-14T13:06:50.808973+0000","last_peered":"2024-02-14T13:06:50.808973+0000","last_clean":"2024-02-14T13:06:50.808973+0000","last_became_active":"2024-02-14T13:06:48.803671+0000","last_became_peered":"2024-02-14T13:06:48.803671+0000","last_unstale":"2024-02-14T13:06:50.808973+0000","last_undegraded":"2024-02-14T13:06:50.808973+0000","last_fullsized":"2024-02-14T13:06:50.808973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:28:48.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794153+0000","last_change":"2024-02-14T13:06:48.794153+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794153+0000","last_undegraded":"2024-02-14T13:06:48.794153+0000","last_fullsized":"2024-02-14T13:06:48.794153+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809613+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:06:50.809613+0000","last_peered":"2024-02-14T13:06:50.809613+0000","last_clean":"2024-02-14T13:06:50.809613+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:06:50.809613+0000","last_undegraded":"2024-02-14T13:06:50.809613+0000","last_fullsized":"2024-02-14T13:06:50.809613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.811836+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:06:49.811836+0000","last_peered":"2024-02-14T13:06:49.811836+0000","last_clean":"2024-02-14T13:06:49.811836+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:06:49.811836+0000","last_undegraded":"2024-02-14T13:06:49.811836+0000","last_fullsized":"2024-02-14T13:06:49.811836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:41:55.808724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.795929+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:06:49.795929+0000","last_peered":"2024-02-14T13:06:49.795929+0000","last_clean":"2024-02-14T13:06:49.795929+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:06:49.795929+0000","last_undegraded":"2024-02-14T13:06:49.795929+0000","last_fullsized":"2024-02-14T13:06:49.795929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.827294+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:06:49.827294+0000","last_peered":"2024-02-14T13:06:49.827294+0000","last_clean":"2024-02-14T13:06:49.827294+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:06:49.827294+0000","last_undegraded":"2024-02-14T13:06:49.827294+0000","last_fullsized":"2024-02-14T13:06:49.827294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:19:32.507781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813446+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:06:50.813446+0000","last_peered":"2024-02-14T13:06:50.813446+0000","last_clean":"2024-02-14T13:06:50.813446+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:06:50.813446+0000","last_undegraded":"2024-02-14T13:06:50.813446+0000","last_fullsized":"2024-02-14T13:06:50.813446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822844+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:06:49.822844+0000","last_peered":"2024-02-14T13:06:49.822844+0000","last_clean":"2024-02-14T13:06:49.822844+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:06:49.822844+0000","last_undegraded":"2024-02-14T13:06:49.822844+0000","last_fullsized":"2024-02-14T13:06:49.822844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:55:35.065612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.795281+0000","last_change":"2024-02-14T13:06:48.795281+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.795281+0000","last_undegraded":"2024-02-14T13:06:48.795281+0000","last_fullsized":"2024-02-14T13:06:48.795281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877771+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:06:50.877771+0000","last_peered":"2024-02-14T13:06:50.877771+0000","last_clean":"2024-02-14T13:06:50.877771+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:06:50.877771+0000","last_undegraded":"2024-02-14T13:06:50.877771+0000","last_fullsized":"2024-02-14T13:06:50.877771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.809105+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:06:49.809105+0000","last_peered":"2024-02-14T13:06:49.809105+0000","last_clean":"2024-02-14T13:06:49.809105+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:06:49.809105+0000","last_undegraded":"2024-02-14T13:06:49.809105+0000","last_fullsized":"2024-02-14T13:06:49.809105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:16:50.101289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.795981+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:06:49.795981+0000","last_peered":"2024-02-14T13:06:49.795981+0000","last_clean":"2024-02-14T13:06:49.795981+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:06:49.795981+0000","last_undegraded":"2024-02-14T13:06:49.795981+0000","last_fullsized":"2024-02-14T13:06:49.795981+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813026+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:06:50.813026+0000","last_peered":"2024-02-14T13:06:50.813026+0000","last_clean":"2024-02-14T13:06:50.813026+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:06:50.813026+0000","last_undegraded":"2024-02-14T13:06:50.813026+0000","last_fullsized":"2024-02-14T13:06:50.813026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877819+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:06:50.877819+0000","last_peered":"2024-02-14T13:06:50.877819+0000","last_clean":"2024-02-14T13:06:50.877819+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:06:50.877819+0000","last_undegraded":"2024-02-14T13:06:50.877819+0000","last_fullsized":"2024-02-14T13:06:50.877819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.812936+0000","last_change":"2024-02-14T13:06:48.812095+0000","last_active":"2024-02-14T13:06:50.812936+0000","last_peered":"2024-02-14T13:06:50.812936+0000","last_clean":"2024-02-14T13:06:50.812936+0000","last_became_active":"2024-02-14T13:06:48.811567+0000","last_became_peered":"2024-02-14T13:06:48.811567+0000","last_unstale":"2024-02-14T13:06:50.812936+0000","last_undegraded":"2024-02-14T13:06:50.812936+0000","last_fullsized":"2024-02-14T13:06:50.812936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:31:53.462420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809512+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:06:50.809512+0000","last_peered":"2024-02-14T13:06:50.809512+0000","last_clean":"2024-02-14T13:06:50.809512+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:06:50.809512+0000","last_undegraded":"2024-02-14T13:06:50.809512+0000","last_fullsized":"2024-02-14T13:06:50.809512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878268+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:06:50.878268+0000","last_peered":"2024-02-14T13:06:50.878268+0000","last_clean":"2024-02-14T13:06:50.878268+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:06:50.878268+0000","last_undegraded":"2024-02-14T13:06:50.878268+0000","last_fullsized":"2024-02-14T13:06:50.878268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.800853+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:06:49.800853+0000","last_peered":"2024-02-14T13:06:49.800853+0000","last_clean":"2024-02-14T13:06:49.800853+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:06:49.800853+0000","last_undegraded":"2024-02-14T13:06:49.800853+0000","last_fullsized":"2024-02-14T13:06:49.800853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824789+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:06:49.824789+0000","last_peered":"2024-02-14T13:06:49.824789+0000","last_clean":"2024-02-14T13:06:49.824789+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:06:49.824789+0000","last_undegraded":"2024-02-14T13:06:49.824789+0000","last_fullsized":"2024-02-14T13:06:49.824789+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:27:39.218470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818324+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:06:49.818324+0000","last_peered":"2024-02-14T13:06:49.818324+0000","last_clean":"2024-02-14T13:06:49.818324+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:06:49.818324+0000","last_undegraded":"2024-02-14T13:06:49.818324+0000","last_fullsized":"2024-02-14T13:06:49.818324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809096+0000","last_change":"2024-02-14T13:06:49.810268+0000","last_active":"2024-02-14T13:06:50.809096+0000","last_peered":"2024-02-14T13:06:50.809096+0000","last_clean":"2024-02-14T13:06:50.809096+0000","last_became_active":"2024-02-14T13:06:49.809434+0000","last_became_peered":"2024-02-14T13:06:49.809434+0000","last_unstale":"2024-02-14T13:06:50.809096+0000","last_undegraded":"2024-02-14T13:06:50.809096+0000","last_fullsized":"2024-02-14T13:06:50.809096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:46:18.599259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832095+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:06:50.832095+0000","last_peered":"2024-02-14T13:06:50.832095+0000","last_clean":"2024-02-14T13:06:50.832095+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:06:50.832095+0000","last_undegraded":"2024-02-14T13:06:50.832095+0000","last_fullsized":"2024-02-14T13:06:50.832095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809169+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:06:50.809169+0000","last_peered":"2024-02-14T13:06:50.809169+0000","last_clean":"2024-02-14T13:06:50.809169+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:06:50.809169+0000","last_undegraded":"2024-02-14T13:06:50.809169+0000","last_fullsized":"2024-02-14T13:06:50.809169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.792193+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:06:49.792193+0000","last_peered":"2024-02-14T13:06:49.792193+0000","last_clean":"2024-02-14T13:06:49.792193+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:06:49.792193+0000","last_undegraded":"2024-02-14T13:06:49.792193+0000","last_fullsized":"2024-02-14T13:06:49.792193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.820685+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:06:49.820685+0000","last_peered":"2024-02-14T13:06:49.820685+0000","last_clean":"2024-02-14T13:06:49.820685+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:06:49.820685+0000","last_undegraded":"2024-02-14T13:06:49.820685+0000","last_fullsized":"2024-02-14T13:06:49.820685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:16.168235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815789+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:06:49.815789+0000","last_peered":"2024-02-14T13:06:49.815789+0000","last_clean":"2024-02-14T13:06:49.815789+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:06:49.815789+0000","last_undegraded":"2024-02-14T13:06:49.815789+0000","last_fullsized":"2024-02-14T13:06:49.815789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824499+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:06:49.824499+0000","last_peered":"2024-02-14T13:06:49.824499+0000","last_clean":"2024-02-14T13:06:49.824499+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:06:49.824499+0000","last_undegraded":"2024-02-14T13:06:49.824499+0000","last_fullsized":"2024-02-14T13:06:49.824499+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:57:57.403268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809235+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:06:50.809235+0000","last_peered":"2024-02-14T13:06:50.809235+0000","last_clean":"2024-02-14T13:06:50.809235+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:06:50.809235+0000","last_undegraded":"2024-02-14T13:06:50.809235+0000","last_fullsized":"2024-02-14T13:06:50.809235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813309+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:06:50.813309+0000","last_peered":"2024-02-14T13:06:50.813309+0000","last_clean":"2024-02-14T13:06:50.813309+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:06:50.813309+0000","last_undegraded":"2024-02-14T13:06:50.813309+0000","last_fullsized":"2024-02-14T13:06:50.813309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.817406+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:06:49.817406+0000","last_peered":"2024-02-14T13:06:49.817406+0000","last_clean":"2024-02-14T13:06:49.817406+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:06:49.817406+0000","last_undegraded":"2024-02-14T13:06:49.817406+0000","last_fullsized":"2024-02-14T13:06:49.817406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813695+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:06:50.813695+0000","last_peered":"2024-02-14T13:06:50.813695+0000","last_clean":"2024-02-14T13:06:50.813695+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:06:50.813695+0000","last_undegraded":"2024-02-14T13:06:50.813695+0000","last_fullsized":"2024-02-14T13:06:50.813695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806420+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:06:48.806420+0000","last_peered":"2024-02-14T13:06:48.806420+0000","last_clean":"2024-02-14T13:06:48.806420+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:06:48.806420+0000","last_undegraded":"2024-02-14T13:06:48.806420+0000","last_fullsized":"2024-02-14T13:06:48.806420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:26.079907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813273+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:06:50.813273+0000","last_peered":"2024-02-14T13:06:50.813273+0000","last_clean":"2024-02-14T13:06:50.813273+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:06:50.813273+0000","last_undegraded":"2024-02-14T13:06:50.813273+0000","last_fullsized":"2024-02-14T13:06:50.813273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878539+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:06:50.878539+0000","last_peered":"2024-02-14T13:06:50.878539+0000","last_clean":"2024-02-14T13:06:50.878539+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:06:50.878539+0000","last_undegraded":"2024-02-14T13:06:50.878539+0000","last_fullsized":"2024-02-14T13:06:50.878539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813522+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:06:50.813522+0000","last_peered":"2024-02-14T13:06:50.813522+0000","last_clean":"2024-02-14T13:06:50.813522+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:06:50.813522+0000","last_undegraded":"2024-02-14T13:06:50.813522+0000","last_fullsized":"2024-02-14T13:06:50.813522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822708+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:06:49.822708+0000","last_peered":"2024-02-14T13:06:49.822708+0000","last_clean":"2024-02-14T13:06:49.822708+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:06:49.822708+0000","last_undegraded":"2024-02-14T13:06:49.822708+0000","last_fullsized":"2024-02-14T13:06:49.822708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:14:01.429780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815989+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:06:49.815989+0000","last_peered":"2024-02-14T13:06:49.815989+0000","last_clean":"2024-02-14T13:06:49.815989+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:06:49.815989+0000","last_undegraded":"2024-02-14T13:06:49.815989+0000","last_fullsized":"2024-02-14T13:06:49.815989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:11.506567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818763+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:06:49.818763+0000","last_peered":"2024-02-14T13:06:49.818763+0000","last_clean":"2024-02-14T13:06:49.818763+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:06:49.818763+0000","last_undegraded":"2024-02-14T13:06:49.818763+0000","last_fullsized":"2024-02-14T13:06:49.818763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:42:15.473826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808856+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:06:50.808856+0000","last_peered":"2024-02-14T13:06:50.808856+0000","last_clean":"2024-02-14T13:06:50.808856+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:06:50.808856+0000","last_undegraded":"2024-02-14T13:06:50.808856+0000","last_fullsized":"2024-02-14T13:06:50.808856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878412+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:06:50.878412+0000","last_peered":"2024-02-14T13:06:50.878412+0000","last_clean":"2024-02-14T13:06:50.878412+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:06:50.878412+0000","last_undegraded":"2024-02-14T13:06:50.878412+0000","last_fullsized":"2024-02-14T13:06:50.878412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824974+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:06:49.824974+0000","last_peered":"2024-02-14T13:06:49.824974+0000","last_clean":"2024-02-14T13:06:49.824974+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:06:49.824974+0000","last_undegraded":"2024-02-14T13:06:49.824974+0000","last_fullsized":"2024-02-14T13:06:49.824974+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:50:04.831632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818466+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:06:49.818466+0000","last_peered":"2024-02-14T13:06:49.818466+0000","last_clean":"2024-02-14T13:06:49.818466+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:06:49.818466+0000","last_undegraded":"2024-02-14T13:06:49.818466+0000","last_fullsized":"2024-02-14T13:06:49.818466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:20:20.760868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815561+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:06:49.815561+0000","last_peered":"2024-02-14T13:06:49.815561+0000","last_clean":"2024-02-14T13:06:49.815561+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:06:49.815561+0000","last_undegraded":"2024-02-14T13:06:49.815561+0000","last_fullsized":"2024-02-14T13:06:49.815561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:37:35.096694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794828+0000","last_change":"2024-02-14T13:06:48.794828+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794828+0000","last_undegraded":"2024-02-14T13:06:48.794828+0000","last_fullsized":"2024-02-14T13:06:48.794828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816237+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:06:49.816237+0000","last_peered":"2024-02-14T13:06:49.816237+0000","last_clean":"2024-02-14T13:06:49.816237+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:06:49.816237+0000","last_undegraded":"2024-02-14T13:06:49.816237+0000","last_fullsized":"2024-02-14T13:06:49.816237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:16:48.356409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832216+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:06:50.832216+0000","last_peered":"2024-02-14T13:06:50.832216+0000","last_clean":"2024-02-14T13:06:50.832216+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:06:50.832216+0000","last_undegraded":"2024-02-14T13:06:50.832216+0000","last_fullsized":"2024-02-14T13:06:50.832216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878378+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:06:50.878378+0000","last_peered":"2024-02-14T13:06:50.878378+0000","last_clean":"2024-02-14T13:06:50.878378+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:06:50.878378+0000","last_undegraded":"2024-02-14T13:06:50.878378+0000","last_fullsized":"2024-02-14T13:06:50.878378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816375+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:06:49.816375+0000","last_peered":"2024-02-14T13:06:49.816375+0000","last_clean":"2024-02-14T13:06:49.816375+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:06:49.816375+0000","last_undegraded":"2024-02-14T13:06:49.816375+0000","last_fullsized":"2024-02-14T13:06:49.816375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:52:02.123233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":7048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":10,"up_from":74,"seq":317827579922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1536000,"data_stored":1028606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.747},{"interface":"front","average":{"1min":1.841,"5min":1.841,"15min":1.841},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":16.844999999999999,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.73699999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":9,"up_from":69,"seq":296352743447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498}]},{"osd":2,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70099999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.40999999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.623}]},{"osd":8,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71599999999999997}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65000000000000002}]}]},{"osd":8,"up_from":61,"seq":261993005084,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":445606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68799999999999994,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.038},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.435,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75800000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.879},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":1.1020000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97399999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.85299999999999998,"5min":0.872,"15min":0.872},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.86399999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.1659999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.115}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":1.3620000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":7,"up_from":53,"seq":227633266721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1035952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.89200000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32400000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39900000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.745},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":48,"seq":206158430247,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":445119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.3080000000000001,"15min":1.423},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93000000000000005,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95799999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.3660000000000001,"15min":1.4810000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0169999999999999,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:06:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.56000000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67500000000000004}]},{"osd":8,"last update":"Wed Feb 14 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0209999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.622},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.64200000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":942080,"data_stored":446614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.34000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51700000000000002,"15min":0.48099999999999998},"min":{"1min":0.435,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.378,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.497},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.69799999999999995}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68100000000000005}]},{"osd":9,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78900000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:05:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.624}]},{"osd":2,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54000000000000004,"15min":0.498},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.79200000000000004,"15min":0.89200000000000002},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Feb 14 13:06:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.42599999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92100000000000004,"5min":1.224,"15min":1.224},"last":0.56599999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63600000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":436556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.623}]},{"osd":1,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.495},{"interface":"front","average":{"1min":0.621,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.751}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33500000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.622,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64900000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":3,"up_from":27,"seq":115964117045,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.318},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.173,"5min":0.52300000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":16.736999999999998,"5min":16.736999999999998,"15min":16.736999999999998},"last":16.736999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.54100000000000004},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":5.1159999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":4.8170000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":0.72499999999999998,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":20.550000000000001,"5min":20.550000000000001,"15min":20.550000000000001},"last":20.550000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.59899999999999998,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0540000000000003,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":6.0540000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:06:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":3.6000000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":13.26},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.56699999999999995,"15min":0.53600000000000003},"min":{"1min":0.46800000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":22.808}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":16.702999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53100000000000003,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.7669999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":13.172000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":16.648},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":5.048}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":3.9409999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":16.771000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.504999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":436454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.26200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.443},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.89100000000000001},"min":{"1min":0.439,"5min":0.314,"15min":0.314},"max":{"1min":3.718,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.36199999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.56100000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0429999999999999,"5min":6.327,"15min":6.327},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.58799999999999997,"15min":0.57099999999999995},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.621},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.57999999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.46000000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.627,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66600000000000004}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51300000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.60199999999999998}]}]},{"osd":5,"up_from":40,"seq":171798691883,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1017723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.34300000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Wed Feb 14 13:06:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82399999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41499999999999998}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.39300000000000002}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998}]},{"osd":10,"last update":"Wed Feb 14 13:06:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:06:55.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-14T13:06:56.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 -- 172.21.15.12:0/2677649748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3540ff2d0 msgr2=0x7ff3540ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2677649748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3540ff2d0 0x7ff3540ff750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff344009900 tx=0x7ff34402bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:56.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 -- 172.21.15.12:0/2677649748 shutdown_connections 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2677649748 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3540ffc90 0x7ff354109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2677649748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3540ff2d0 0x7ff3540ff750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2677649748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff354102860 0x7ff354102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 -- 172.21.15.12:0/2677649748 >> 172.21.15.12:0/2677649748 conn(0x7ff3540fae10 msgr2=0x7ff3540fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 -- 172.21.15.12:0/2677649748 shutdown_connections 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.097+0000 7ff35a66f640 1 -- 172.21.15.12:0/2677649748 wait complete. 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 Processor -- start 2024-02-14T13:06:56.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 -- start start 2024-02-14T13:06:56.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3540ff2d0 0x7ff354197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3540ffc90 0x7ff3541978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 0x7ff35419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35419ee60 con 0x7ff354102860 2024-02-14T13:06:56.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35419efd0 con 0x7ff3540ff2d0 2024-02-14T13:06:56.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff35a66f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35419f190 con 0x7ff3540ffc90 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 0x7ff35419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 0x7ff35419e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47416/0 (socket says 172.21.15.12:47416) 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 -- 172.21.15.12:0/2639063481 learned_addr learned my addr 172.21.15.12:0/2639063481 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff353fff640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3540ff2d0 0x7ff354197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff3537fe640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3540ffc90 0x7ff3541978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 -- 172.21.15.12:0/2639063481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3540ffc90 msgr2=0x7ff3541978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3540ffc90 0x7ff3541978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 -- 172.21.15.12:0/2639063481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3540ff2d0 msgr2=0x7ff354197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.098+0000 7ff358c0c640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3540ff2d0 0x7ff354197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff358c0c640 1 -- 172.21.15.12:0/2639063481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344009560 con 0x7ff354102860 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff358c0c640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 0x7ff35419e920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00eaa0 tx=0x7ff34c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c004d20 con 0x7ff354102860 2024-02-14T13:06:56.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff34c004e80 con 0x7ff354102860 2024-02-14T13:06:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35419f470 con 0x7ff354102860 2024-02-14T13:06:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c005a10 con 0x7ff354102860 2024-02-14T13:06:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.099+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35419f9d0 con 0x7ff354102860 2024-02-14T13:06:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.100+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354108720 con 0x7ff354102860 2024-02-14T13:06:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.101+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7ff34c005020 con 0x7ff354102860 2024-02-14T13:06:56.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.102+0000 7ff3517fa640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3400a2150 0x7ff3400a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.102+0000 7ff353fff640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3400a2150 0x7ff3400a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.102+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff34c0cdf60 con 0x7ff354102860 2024-02-14T13:06:56.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.102+0000 7ff353fff640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3400a2150 0x7ff3400a4610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff354069540 tx=0x7ff33c009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:56.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.106+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff34c096e80 con 0x7ff354102860 2024-02-14T13:06:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:55 smithi012 ceph-mon[32370]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:55 smithi012 ceph-mon[32370]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-02-14T13:06:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:55 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1785653083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:55 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/973031616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:55 smithi103 ceph-mon[36921]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:55 smithi103 ceph-mon[36921]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-02-14T13:06:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:55 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1785653083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:55 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/973031616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.286+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff35402cec0 con 0x7ff3400a2150 2024-02-14T13:06:56.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.296+0000 7ff3517fa640 1 -- 172.21.15.12:0/2639063481 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334976 (secure 0 0 0) 0x7ff35402cec0 con 0x7ff3400a2150 2024-02-14T13:06:56.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3400a2150 msgr2=0x7ff3400a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3400a2150 0x7ff3400a4610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff354069540 tx=0x7ff33c009110 comp rx=0 tx=0).stop 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 msgr2=0x7ff35419e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 0x7ff35419e920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00eaa0 tx=0x7ff34c00eea0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 shutdown_connections 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3400a2150 0x7ff3400a4610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff354102860 0x7ff35419e920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3540ffc90 0x7ff3541978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 --2- 172.21.15.12:0/2639063481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3540ff2d0 0x7ff354197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.299+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 >> 172.21.15.12:0/2639063481 conn(0x7ff3540fae10 msgr2=0x7ff3541058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.300+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 shutdown_connections 2024-02-14T13:06:56.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.300+0000 7ff35a66f640 1 -- 172.21.15.12:0/2639063481 wait complete. 2024-02-14T13:06:56.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:55 smithi055 ceph-mon[36853]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:06:56.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:55 smithi055 ceph-mon[36853]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-02-14T13:06:56.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:55 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1785653083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:06:56.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:55 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/973031616' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:06:56.312 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-02-14T13:06:54.351595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":129,"num_read_kb":112,"num_write":220,"num_write_kb":2950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361792,"kb_used_data":12572,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580032,"statfs":{"total":1151940427776,"available":1151569952768,"internally_reserved":0,"allocated":12873728,"data_stored":7019787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001377"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812053+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:06:49.812053+0000","last_peered":"2024-02-14T13:06:49.812053+0000","last_clean":"2024-02-14T13:06:49.812053+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:06:49.812053+0000","last_undegraded":"2024-02-14T13:06:49.812053+0000","last_fullsized":"2024-02-14T13:06:49.812053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:13:58.218901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809005+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:06:50.809005+0000","last_peered":"2024-02-14T13:06:50.809005+0000","last_clean":"2024-02-14T13:06:50.809005+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:06:50.809005+0000","last_undegraded":"2024-02-14T13:06:50.809005+0000","last_fullsized":"2024-02-14T13:06:50.809005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808797+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:06:50.808797+0000","last_peered":"2024-02-14T13:06:50.808797+0000","last_clean":"2024-02-14T13:06:50.808797+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:06:50.808797+0000","last_undegraded":"2024-02-14T13:06:50.808797+0000","last_fullsized":"2024-02-14T13:06:50.808797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822590+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:06:49.822590+0000","last_peered":"2024-02-14T13:06:49.822590+0000","last_clean":"2024-02-14T13:06:49.822590+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:06:49.822590+0000","last_undegraded":"2024-02-14T13:06:49.822590+0000","last_fullsized":"2024-02-14T13:06:49.822590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:50:36.640645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809253+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:06:50.809253+0000","last_peered":"2024-02-14T13:06:50.809253+0000","last_clean":"2024-02-14T13:06:50.809253+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:06:50.809253+0000","last_undegraded":"2024-02-14T13:06:50.809253+0000","last_fullsized":"2024-02-14T13:06:50.809253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822805+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:06:49.822805+0000","last_peered":"2024-02-14T13:06:49.822805+0000","last_clean":"2024-02-14T13:06:49.822805+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:06:49.822805+0000","last_undegraded":"2024-02-14T13:06:49.822805+0000","last_fullsized":"2024-02-14T13:06:49.822805+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:31:51.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813081+0000","last_change":"2024-02-14T13:06:49.816529+0000","last_active":"2024-02-14T13:06:50.813081+0000","last_peered":"2024-02-14T13:06:50.813081+0000","last_clean":"2024-02-14T13:06:50.813081+0000","last_became_active":"2024-02-14T13:06:49.816153+0000","last_became_peered":"2024-02-14T13:06:49.816153+0000","last_unstale":"2024-02-14T13:06:50.813081+0000","last_undegraded":"2024-02-14T13:06:50.813081+0000","last_fullsized":"2024-02-14T13:06:50.813081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:03:10.291658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824426+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:06:49.824426+0000","last_peered":"2024-02-14T13:06:49.824426+0000","last_clean":"2024-02-14T13:06:49.824426+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:06:49.824426+0000","last_undegraded":"2024-02-14T13:06:49.824426+0000","last_fullsized":"2024-02-14T13:06:49.824426+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:04:23.822784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832644+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:06:50.832644+0000","last_peered":"2024-02-14T13:06:50.832644+0000","last_clean":"2024-02-14T13:06:50.832644+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:06:50.832644+0000","last_undegraded":"2024-02-14T13:06:50.832644+0000","last_fullsized":"2024-02-14T13:06:50.832644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.823871+0000","last_change":"2024-02-14T13:06:49.820207+0000","last_active":"2024-02-14T13:06:49.823871+0000","last_peered":"2024-02-14T13:06:49.823871+0000","last_clean":"2024-02-14T13:06:49.823871+0000","last_became_active":"2024-02-14T13:06:49.819829+0000","last_became_peered":"2024-02-14T13:06:49.819829+0000","last_unstale":"2024-02-14T13:06:49.823871+0000","last_undegraded":"2024-02-14T13:06:49.823871+0000","last_fullsized":"2024-02-14T13:06:49.823871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:53:14.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813526+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:06:50.813526+0000","last_peered":"2024-02-14T13:06:50.813526+0000","last_clean":"2024-02-14T13:06:50.813526+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:06:50.813526+0000","last_undegraded":"2024-02-14T13:06:50.813526+0000","last_fullsized":"2024-02-14T13:06:50.813526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.814699+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:06:49.814699+0000","last_peered":"2024-02-14T13:06:49.814699+0000","last_clean":"2024-02-14T13:06:49.814699+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:06:49.814699+0000","last_undegraded":"2024-02-14T13:06:49.814699+0000","last_fullsized":"2024-02-14T13:06:49.814699+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:06:59.776439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878215+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:06:50.878215+0000","last_peered":"2024-02-14T13:06:50.878215+0000","last_clean":"2024-02-14T13:06:50.878215+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:06:50.878215+0000","last_undegraded":"2024-02-14T13:06:50.878215+0000","last_fullsized":"2024-02-14T13:06:50.878215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808595+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:06:50.808595+0000","last_peered":"2024-02-14T13:06:50.808595+0000","last_clean":"2024-02-14T13:06:50.808595+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:06:50.808595+0000","last_undegraded":"2024-02-14T13:06:50.808595+0000","last_fullsized":"2024-02-14T13:06:50.808595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808546+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:06:50.808546+0000","last_peered":"2024-02-14T13:06:50.808546+0000","last_clean":"2024-02-14T13:06:50.808546+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:06:50.808546+0000","last_undegraded":"2024-02-14T13:06:50.808546+0000","last_fullsized":"2024-02-14T13:06:50.808546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832106+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:06:50.832106+0000","last_peered":"2024-02-14T13:06:50.832106+0000","last_clean":"2024-02-14T13:06:50.832106+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:06:50.832106+0000","last_undegraded":"2024-02-14T13:06:50.832106+0000","last_fullsized":"2024-02-14T13:06:50.832106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815917+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:06:49.815917+0000","last_peered":"2024-02-14T13:06:49.815917+0000","last_clean":"2024-02-14T13:06:49.815917+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:06:49.815917+0000","last_undegraded":"2024-02-14T13:06:49.815917+0000","last_fullsized":"2024-02-14T13:06:49.815917+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:56:21.643596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812072+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:06:49.812072+0000","last_peered":"2024-02-14T13:06:49.812072+0000","last_clean":"2024-02-14T13:06:49.812072+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:06:49.812072+0000","last_undegraded":"2024-02-14T13:06:49.812072+0000","last_fullsized":"2024-02-14T13:06:49.812072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:39:06.773096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.825195+0000","last_change":"2024-02-14T13:06:49.823862+0000","last_active":"2024-02-14T13:06:49.825195+0000","last_peered":"2024-02-14T13:06:49.825195+0000","last_clean":"2024-02-14T13:06:49.825195+0000","last_became_active":"2024-02-14T13:06:49.822726+0000","last_became_peered":"2024-02-14T13:06:49.822726+0000","last_unstale":"2024-02-14T13:06:49.825195+0000","last_undegraded":"2024-02-14T13:06:49.825195+0000","last_fullsized":"2024-02-14T13:06:49.825195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:43:29.397696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816953+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:06:49.816953+0000","last_peered":"2024-02-14T13:06:49.816953+0000","last_clean":"2024-02-14T13:06:49.816953+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:06:49.816953+0000","last_undegraded":"2024-02-14T13:06:49.816953+0000","last_fullsized":"2024-02-14T13:06:49.816953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824391+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:06:49.824391+0000","last_peered":"2024-02-14T13:06:49.824391+0000","last_clean":"2024-02-14T13:06:49.824391+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:06:49.824391+0000","last_undegraded":"2024-02-14T13:06:49.824391+0000","last_fullsized":"2024-02-14T13:06:49.824391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:55:05.999626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.826178+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:06:49.826178+0000","last_peered":"2024-02-14T13:06:49.826178+0000","last_clean":"2024-02-14T13:06:49.826178+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:06:49.826178+0000","last_undegraded":"2024-02-14T13:06:49.826178+0000","last_fullsized":"2024-02-14T13:06:49.826178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808994+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:06:50.808994+0000","last_peered":"2024-02-14T13:06:50.808994+0000","last_clean":"2024-02-14T13:06:50.808994+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:06:50.808994+0000","last_undegraded":"2024-02-14T13:06:50.808994+0000","last_fullsized":"2024-02-14T13:06:50.808994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809630+0000","last_change":"2024-02-14T13:06:48.808351+0000","last_active":"2024-02-14T13:06:50.809630+0000","last_peered":"2024-02-14T13:06:50.809630+0000","last_clean":"2024-02-14T13:06:50.809630+0000","last_became_active":"2024-02-14T13:06:48.808059+0000","last_became_peered":"2024-02-14T13:06:48.808059+0000","last_unstale":"2024-02-14T13:06:50.809630+0000","last_undegraded":"2024-02-14T13:06:50.809630+0000","last_fullsized":"2024-02-14T13:06:50.809630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:24:45.902193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832310+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:06:50.832310+0000","last_peered":"2024-02-14T13:06:50.832310+0000","last_clean":"2024-02-14T13:06:50.832310+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:06:50.832310+0000","last_undegraded":"2024-02-14T13:06:50.832310+0000","last_fullsized":"2024-02-14T13:06:50.832310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809388+0000","last_change":"2024-02-14T13:06:48.803897+0000","last_active":"2024-02-14T13:06:50.809388+0000","last_peered":"2024-02-14T13:06:50.809388+0000","last_clean":"2024-02-14T13:06:50.809388+0000","last_became_active":"2024-02-14T13:06:48.803533+0000","last_became_peered":"2024-02-14T13:06:48.803533+0000","last_unstale":"2024-02-14T13:06:50.809388+0000","last_undegraded":"2024-02-14T13:06:50.809388+0000","last_fullsized":"2024-02-14T13:06:50.809388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:51:56.000004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.795340+0000","last_change":"2024-02-14T13:06:48.795340+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.795340+0000","last_undegraded":"2024-02-14T13:06:48.795340+0000","last_fullsized":"2024-02-14T13:06:48.795340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806994+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:06:48.806994+0000","last_peered":"2024-02-14T13:06:48.806994+0000","last_clean":"2024-02-14T13:06:48.806994+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:06:48.806994+0000","last_undegraded":"2024-02-14T13:06:48.806994+0000","last_fullsized":"2024-02-14T13:06:48.806994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:25:37.533263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809268+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:06:50.809268+0000","last_peered":"2024-02-14T13:06:50.809268+0000","last_clean":"2024-02-14T13:06:50.809268+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:06:50.809268+0000","last_undegraded":"2024-02-14T13:06:50.809268+0000","last_fullsized":"2024-02-14T13:06:50.809268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822712+0000","last_change":"2024-02-14T13:06:48.810464+0000","last_active":"2024-02-14T13:06:49.822712+0000","last_peered":"2024-02-14T13:06:49.822712+0000","last_clean":"2024-02-14T13:06:49.822712+0000","last_became_active":"2024-02-14T13:06:48.810159+0000","last_became_peered":"2024-02-14T13:06:48.810159+0000","last_unstale":"2024-02-14T13:06:49.822712+0000","last_undegraded":"2024-02-14T13:06:49.822712+0000","last_fullsized":"2024-02-14T13:06:49.822712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:00.546934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794518+0000","last_change":"2024-02-14T13:06:48.794518+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794518+0000","last_undegraded":"2024-02-14T13:06:48.794518+0000","last_fullsized":"2024-02-14T13:06:48.794518+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877891+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:06:50.877891+0000","last_peered":"2024-02-14T13:06:50.877891+0000","last_clean":"2024-02-14T13:06:50.877891+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:06:50.877891+0000","last_undegraded":"2024-02-14T13:06:50.877891+0000","last_fullsized":"2024-02-14T13:06:50.877891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.812759+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:06:49.812759+0000","last_peered":"2024-02-14T13:06:49.812759+0000","last_clean":"2024-02-14T13:06:49.812759+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:06:49.812759+0000","last_undegraded":"2024-02-14T13:06:49.812759+0000","last_fullsized":"2024-02-14T13:06:49.812759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:18:26.025809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.808127+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:06:48.808127+0000","last_peered":"2024-02-14T13:06:48.808127+0000","last_clean":"2024-02-14T13:06:48.808127+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:06:48.808127+0000","last_undegraded":"2024-02-14T13:06:48.808127+0000","last_fullsized":"2024-02-14T13:06:48.808127+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:57.998957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815082+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:06:49.815082+0000","last_peered":"2024-02-14T13:06:49.815082+0000","last_clean":"2024-02-14T13:06:49.815082+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:06:49.815082+0000","last_undegraded":"2024-02-14T13:06:49.815082+0000","last_fullsized":"2024-02-14T13:06:49.815082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:38:27.382191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.799054+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:06:49.799054+0000","last_peered":"2024-02-14T13:06:49.799054+0000","last_clean":"2024-02-14T13:06:49.799054+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:06:49.799054+0000","last_undegraded":"2024-02-14T13:06:49.799054+0000","last_fullsized":"2024-02-14T13:06:49.799054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832560+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:06:50.832560+0000","last_peered":"2024-02-14T13:06:50.832560+0000","last_clean":"2024-02-14T13:06:50.832560+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:06:50.832560+0000","last_undegraded":"2024-02-14T13:06:50.832560+0000","last_fullsized":"2024-02-14T13:06:50.832560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813368+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:06:50.813368+0000","last_peered":"2024-02-14T13:06:50.813368+0000","last_clean":"2024-02-14T13:06:50.813368+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:06:50.813368+0000","last_undegraded":"2024-02-14T13:06:50.813368+0000","last_fullsized":"2024-02-14T13:06:50.813368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808949+0000","last_change":"2024-02-14T13:06:49.813126+0000","last_active":"2024-02-14T13:06:50.808949+0000","last_peered":"2024-02-14T13:06:50.808949+0000","last_clean":"2024-02-14T13:06:50.808949+0000","last_became_active":"2024-02-14T13:06:49.812790+0000","last_became_peered":"2024-02-14T13:06:49.812790+0000","last_unstale":"2024-02-14T13:06:50.808949+0000","last_undegraded":"2024-02-14T13:06:50.808949+0000","last_fullsized":"2024-02-14T13:06:50.808949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:10:56.354605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.808124+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:06:48.808124+0000","last_peered":"2024-02-14T13:06:48.808124+0000","last_clean":"2024-02-14T13:06:48.808124+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:06:48.808124+0000","last_undegraded":"2024-02-14T13:06:48.808124+0000","last_fullsized":"2024-02-14T13:06:48.808124+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.181317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832394+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:06:50.832394+0000","last_peered":"2024-02-14T13:06:50.832394+0000","last_clean":"2024-02-14T13:06:50.832394+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:06:50.832394+0000","last_undegraded":"2024-02-14T13:06:50.832394+0000","last_fullsized":"2024-02-14T13:06:50.832394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'6","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.828953+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:06:49.828953+0000","last_peered":"2024-02-14T13:06:49.828953+0000","last_clean":"2024-02-14T13:06:49.828953+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:06:49.828953+0000","last_undegraded":"2024-02-14T13:06:49.828953+0000","last_fullsized":"2024-02-14T13:06:49.828953+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809571+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:06:50.809571+0000","last_peered":"2024-02-14T13:06:50.809571+0000","last_clean":"2024-02-14T13:06:50.809571+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:06:50.809571+0000","last_undegraded":"2024-02-14T13:06:50.809571+0000","last_fullsized":"2024-02-14T13:06:50.809571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.826772+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:06:49.826772+0000","last_peered":"2024-02-14T13:06:49.826772+0000","last_clean":"2024-02-14T13:06:49.826772+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:06:49.826772+0000","last_undegraded":"2024-02-14T13:06:49.826772+0000","last_fullsized":"2024-02-14T13:06:49.826772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878225+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:06:50.878225+0000","last_peered":"2024-02-14T13:06:50.878225+0000","last_clean":"2024-02-14T13:06:50.878225+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:06:50.878225+0000","last_undegraded":"2024-02-14T13:06:50.878225+0000","last_fullsized":"2024-02-14T13:06:50.878225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806305+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:06:48.806305+0000","last_peered":"2024-02-14T13:06:48.806305+0000","last_clean":"2024-02-14T13:06:48.806305+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:06:48.806305+0000","last_undegraded":"2024-02-14T13:06:48.806305+0000","last_fullsized":"2024-02-14T13:06:48.806305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:31.587944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813427+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:06:50.813427+0000","last_peered":"2024-02-14T13:06:50.813427+0000","last_clean":"2024-02-14T13:06:50.813427+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:06:50.813427+0000","last_undegraded":"2024-02-14T13:06:50.813427+0000","last_fullsized":"2024-02-14T13:06:50.813427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.796142+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:06:49.796142+0000","last_peered":"2024-02-14T13:06:49.796142+0000","last_clean":"2024-02-14T13:06:49.796142+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:06:49.796142+0000","last_undegraded":"2024-02-14T13:06:49.796142+0000","last_fullsized":"2024-02-14T13:06:49.796142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813169+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:06:50.813169+0000","last_peered":"2024-02-14T13:06:50.813169+0000","last_clean":"2024-02-14T13:06:50.813169+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:06:50.813169+0000","last_undegraded":"2024-02-14T13:06:50.813169+0000","last_fullsized":"2024-02-14T13:06:50.813169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808973+0000","last_change":"2024-02-14T13:06:48.803956+0000","last_active":"2024-02-14T13:06:50.808973+0000","last_peered":"2024-02-14T13:06:50.808973+0000","last_clean":"2024-02-14T13:06:50.808973+0000","last_became_active":"2024-02-14T13:06:48.803671+0000","last_became_peered":"2024-02-14T13:06:48.803671+0000","last_unstale":"2024-02-14T13:06:50.808973+0000","last_undegraded":"2024-02-14T13:06:50.808973+0000","last_fullsized":"2024-02-14T13:06:50.808973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:28:48.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794153+0000","last_change":"2024-02-14T13:06:48.794153+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794153+0000","last_undegraded":"2024-02-14T13:06:48.794153+0000","last_fullsized":"2024-02-14T13:06:48.794153+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809613+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:06:50.809613+0000","last_peered":"2024-02-14T13:06:50.809613+0000","last_clean":"2024-02-14T13:06:50.809613+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:06:50.809613+0000","last_undegraded":"2024-02-14T13:06:50.809613+0000","last_fullsized":"2024-02-14T13:06:50.809613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.811836+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:06:49.811836+0000","last_peered":"2024-02-14T13:06:49.811836+0000","last_clean":"2024-02-14T13:06:49.811836+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:06:49.811836+0000","last_undegraded":"2024-02-14T13:06:49.811836+0000","last_fullsized":"2024-02-14T13:06:49.811836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:41:55.808724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.795929+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:06:49.795929+0000","last_peered":"2024-02-14T13:06:49.795929+0000","last_clean":"2024-02-14T13:06:49.795929+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:06:49.795929+0000","last_undegraded":"2024-02-14T13:06:49.795929+0000","last_fullsized":"2024-02-14T13:06:49.795929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.827294+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:06:49.827294+0000","last_peered":"2024-02-14T13:06:49.827294+0000","last_clean":"2024-02-14T13:06:49.827294+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:06:49.827294+0000","last_undegraded":"2024-02-14T13:06:49.827294+0000","last_fullsized":"2024-02-14T13:06:49.827294+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:19:32.507781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813446+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:06:50.813446+0000","last_peered":"2024-02-14T13:06:50.813446+0000","last_clean":"2024-02-14T13:06:50.813446+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:06:50.813446+0000","last_undegraded":"2024-02-14T13:06:50.813446+0000","last_fullsized":"2024-02-14T13:06:50.813446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822844+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:06:49.822844+0000","last_peered":"2024-02-14T13:06:49.822844+0000","last_clean":"2024-02-14T13:06:49.822844+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:06:49.822844+0000","last_undegraded":"2024-02-14T13:06:49.822844+0000","last_fullsized":"2024-02-14T13:06:49.822844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:55:35.065612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.795281+0000","last_change":"2024-02-14T13:06:48.795281+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.795281+0000","last_undegraded":"2024-02-14T13:06:48.795281+0000","last_fullsized":"2024-02-14T13:06:48.795281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877771+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:06:50.877771+0000","last_peered":"2024-02-14T13:06:50.877771+0000","last_clean":"2024-02-14T13:06:50.877771+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:06:50.877771+0000","last_undegraded":"2024-02-14T13:06:50.877771+0000","last_fullsized":"2024-02-14T13:06:50.877771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.809105+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:06:49.809105+0000","last_peered":"2024-02-14T13:06:49.809105+0000","last_clean":"2024-02-14T13:06:49.809105+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:06:49.809105+0000","last_undegraded":"2024-02-14T13:06:49.809105+0000","last_fullsized":"2024-02-14T13:06:49.809105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:16:50.101289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.795981+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:06:49.795981+0000","last_peered":"2024-02-14T13:06:49.795981+0000","last_clean":"2024-02-14T13:06:49.795981+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:06:49.795981+0000","last_undegraded":"2024-02-14T13:06:49.795981+0000","last_fullsized":"2024-02-14T13:06:49.795981+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813026+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:06:50.813026+0000","last_peered":"2024-02-14T13:06:50.813026+0000","last_clean":"2024-02-14T13:06:50.813026+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:06:50.813026+0000","last_undegraded":"2024-02-14T13:06:50.813026+0000","last_fullsized":"2024-02-14T13:06:50.813026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877819+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:06:50.877819+0000","last_peered":"2024-02-14T13:06:50.877819+0000","last_clean":"2024-02-14T13:06:50.877819+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:06:50.877819+0000","last_undegraded":"2024-02-14T13:06:50.877819+0000","last_fullsized":"2024-02-14T13:06:50.877819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.812936+0000","last_change":"2024-02-14T13:06:48.812095+0000","last_active":"2024-02-14T13:06:50.812936+0000","last_peered":"2024-02-14T13:06:50.812936+0000","last_clean":"2024-02-14T13:06:50.812936+0000","last_became_active":"2024-02-14T13:06:48.811567+0000","last_became_peered":"2024-02-14T13:06:48.811567+0000","last_unstale":"2024-02-14T13:06:50.812936+0000","last_undegraded":"2024-02-14T13:06:50.812936+0000","last_fullsized":"2024-02-14T13:06:50.812936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:31:53.462420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809512+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:06:50.809512+0000","last_peered":"2024-02-14T13:06:50.809512+0000","last_clean":"2024-02-14T13:06:50.809512+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:06:50.809512+0000","last_undegraded":"2024-02-14T13:06:50.809512+0000","last_fullsized":"2024-02-14T13:06:50.809512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878268+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:06:50.878268+0000","last_peered":"2024-02-14T13:06:50.878268+0000","last_clean":"2024-02-14T13:06:50.878268+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:06:50.878268+0000","last_undegraded":"2024-02-14T13:06:50.878268+0000","last_fullsized":"2024-02-14T13:06:50.878268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.800853+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:06:49.800853+0000","last_peered":"2024-02-14T13:06:49.800853+0000","last_clean":"2024-02-14T13:06:49.800853+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:06:49.800853+0000","last_undegraded":"2024-02-14T13:06:49.800853+0000","last_fullsized":"2024-02-14T13:06:49.800853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824789+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:06:49.824789+0000","last_peered":"2024-02-14T13:06:49.824789+0000","last_clean":"2024-02-14T13:06:49.824789+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:06:49.824789+0000","last_undegraded":"2024-02-14T13:06:49.824789+0000","last_fullsized":"2024-02-14T13:06:49.824789+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:27:39.218470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818324+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:06:49.818324+0000","last_peered":"2024-02-14T13:06:49.818324+0000","last_clean":"2024-02-14T13:06:49.818324+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:06:49.818324+0000","last_undegraded":"2024-02-14T13:06:49.818324+0000","last_fullsized":"2024-02-14T13:06:49.818324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809096+0000","last_change":"2024-02-14T13:06:49.810268+0000","last_active":"2024-02-14T13:06:50.809096+0000","last_peered":"2024-02-14T13:06:50.809096+0000","last_clean":"2024-02-14T13:06:50.809096+0000","last_became_active":"2024-02-14T13:06:49.809434+0000","last_became_peered":"2024-02-14T13:06:49.809434+0000","last_unstale":"2024-02-14T13:06:50.809096+0000","last_undegraded":"2024-02-14T13:06:50.809096+0000","last_fullsized":"2024-02-14T13:06:50.809096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:46:18.599259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832095+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:06:50.832095+0000","last_peered":"2024-02-14T13:06:50.832095+0000","last_clean":"2024-02-14T13:06:50.832095+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:06:50.832095+0000","last_undegraded":"2024-02-14T13:06:50.832095+0000","last_fullsized":"2024-02-14T13:06:50.832095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809169+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:06:50.809169+0000","last_peered":"2024-02-14T13:06:50.809169+0000","last_clean":"2024-02-14T13:06:50.809169+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:06:50.809169+0000","last_undegraded":"2024-02-14T13:06:50.809169+0000","last_fullsized":"2024-02-14T13:06:50.809169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.792193+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:06:49.792193+0000","last_peered":"2024-02-14T13:06:49.792193+0000","last_clean":"2024-02-14T13:06:49.792193+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:06:49.792193+0000","last_undegraded":"2024-02-14T13:06:49.792193+0000","last_fullsized":"2024-02-14T13:06:49.792193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.820685+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:06:49.820685+0000","last_peered":"2024-02-14T13:06:49.820685+0000","last_clean":"2024-02-14T13:06:49.820685+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:06:49.820685+0000","last_undegraded":"2024-02-14T13:06:49.820685+0000","last_fullsized":"2024-02-14T13:06:49.820685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:16.168235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815789+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:06:49.815789+0000","last_peered":"2024-02-14T13:06:49.815789+0000","last_clean":"2024-02-14T13:06:49.815789+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:06:49.815789+0000","last_undegraded":"2024-02-14T13:06:49.815789+0000","last_fullsized":"2024-02-14T13:06:49.815789+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824499+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:06:49.824499+0000","last_peered":"2024-02-14T13:06:49.824499+0000","last_clean":"2024-02-14T13:06:49.824499+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:06:49.824499+0000","last_undegraded":"2024-02-14T13:06:49.824499+0000","last_fullsized":"2024-02-14T13:06:49.824499+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:57:57.403268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809235+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:06:50.809235+0000","last_peered":"2024-02-14T13:06:50.809235+0000","last_clean":"2024-02-14T13:06:50.809235+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:06:50.809235+0000","last_undegraded":"2024-02-14T13:06:50.809235+0000","last_fullsized":"2024-02-14T13:06:50.809235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813309+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:06:50.813309+0000","last_peered":"2024-02-14T13:06:50.813309+0000","last_clean":"2024-02-14T13:06:50.813309+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:06:50.813309+0000","last_undegraded":"2024-02-14T13:06:50.813309+0000","last_fullsized":"2024-02-14T13:06:50.813309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.817406+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:06:49.817406+0000","last_peered":"2024-02-14T13:06:49.817406+0000","last_clean":"2024-02-14T13:06:49.817406+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:06:49.817406+0000","last_undegraded":"2024-02-14T13:06:49.817406+0000","last_fullsized":"2024-02-14T13:06:49.817406+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813695+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:06:50.813695+0000","last_peered":"2024-02-14T13:06:50.813695+0000","last_clean":"2024-02-14T13:06:50.813695+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:06:50.813695+0000","last_undegraded":"2024-02-14T13:06:50.813695+0000","last_fullsized":"2024-02-14T13:06:50.813695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-02-14T13:06:48.806420+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:06:48.806420+0000","last_peered":"2024-02-14T13:06:48.806420+0000","last_clean":"2024-02-14T13:06:48.806420+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:06:48.806420+0000","last_undegraded":"2024-02-14T13:06:48.806420+0000","last_fullsized":"2024-02-14T13:06:48.806420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:26.079907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813273+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:06:50.813273+0000","last_peered":"2024-02-14T13:06:50.813273+0000","last_clean":"2024-02-14T13:06:50.813273+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:06:50.813273+0000","last_undegraded":"2024-02-14T13:06:50.813273+0000","last_fullsized":"2024-02-14T13:06:50.813273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878539+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:06:50.878539+0000","last_peered":"2024-02-14T13:06:50.878539+0000","last_clean":"2024-02-14T13:06:50.878539+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:06:50.878539+0000","last_undegraded":"2024-02-14T13:06:50.878539+0000","last_fullsized":"2024-02-14T13:06:50.878539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813522+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:06:50.813522+0000","last_peered":"2024-02-14T13:06:50.813522+0000","last_clean":"2024-02-14T13:06:50.813522+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:06:50.813522+0000","last_undegraded":"2024-02-14T13:06:50.813522+0000","last_fullsized":"2024-02-14T13:06:50.813522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.822708+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:06:49.822708+0000","last_peered":"2024-02-14T13:06:49.822708+0000","last_clean":"2024-02-14T13:06:49.822708+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:06:49.822708+0000","last_undegraded":"2024-02-14T13:06:49.822708+0000","last_fullsized":"2024-02-14T13:06:49.822708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:14:01.429780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815989+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:06:49.815989+0000","last_peered":"2024-02-14T13:06:49.815989+0000","last_clean":"2024-02-14T13:06:49.815989+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:06:49.815989+0000","last_undegraded":"2024-02-14T13:06:49.815989+0000","last_fullsized":"2024-02-14T13:06:49.815989+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:11.506567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818763+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:06:49.818763+0000","last_peered":"2024-02-14T13:06:49.818763+0000","last_clean":"2024-02-14T13:06:49.818763+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:06:49.818763+0000","last_undegraded":"2024-02-14T13:06:49.818763+0000","last_fullsized":"2024-02-14T13:06:49.818763+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:42:15.473826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808856+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:06:50.808856+0000","last_peered":"2024-02-14T13:06:50.808856+0000","last_clean":"2024-02-14T13:06:50.808856+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:06:50.808856+0000","last_undegraded":"2024-02-14T13:06:50.808856+0000","last_fullsized":"2024-02-14T13:06:50.808856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878412+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:06:50.878412+0000","last_peered":"2024-02-14T13:06:50.878412+0000","last_clean":"2024-02-14T13:06:50.878412+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:06:50.878412+0000","last_undegraded":"2024-02-14T13:06:50.878412+0000","last_fullsized":"2024-02-14T13:06:50.878412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.824974+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:06:49.824974+0000","last_peered":"2024-02-14T13:06:49.824974+0000","last_clean":"2024-02-14T13:06:49.824974+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:06:49.824974+0000","last_undegraded":"2024-02-14T13:06:49.824974+0000","last_fullsized":"2024-02-14T13:06:49.824974+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:50:04.831632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.818466+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:06:49.818466+0000","last_peered":"2024-02-14T13:06:49.818466+0000","last_clean":"2024-02-14T13:06:49.818466+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:06:49.818466+0000","last_undegraded":"2024-02-14T13:06:49.818466+0000","last_fullsized":"2024-02-14T13:06:49.818466+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:20:20.760868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.815561+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:06:49.815561+0000","last_peered":"2024-02-14T13:06:49.815561+0000","last_clean":"2024-02-14T13:06:49.815561+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:06:49.815561+0000","last_undegraded":"2024-02-14T13:06:49.815561+0000","last_fullsized":"2024-02-14T13:06:49.815561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:37:35.096694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-02-14T13:06:48.794828+0000","last_change":"2024-02-14T13:06:48.794828+0000","last_active":"2024-02-14T13:06:48.779091+0000","last_peered":"2024-02-14T13:06:48.779091+0000","last_clean":"2024-02-14T13:06:48.779091+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-02-14T13:06:48.794828+0000","last_undegraded":"2024-02-14T13:06:48.794828+0000","last_fullsized":"2024-02-14T13:06:48.794828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816237+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:06:49.816237+0000","last_peered":"2024-02-14T13:06:49.816237+0000","last_clean":"2024-02-14T13:06:49.816237+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:06:49.816237+0000","last_undegraded":"2024-02-14T13:06:49.816237+0000","last_fullsized":"2024-02-14T13:06:49.816237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:16:48.356409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832216+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:06:50.832216+0000","last_peered":"2024-02-14T13:06:50.832216+0000","last_clean":"2024-02-14T13:06:50.832216+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:06:50.832216+0000","last_undegraded":"2024-02-14T13:06:50.832216+0000","last_fullsized":"2024-02-14T13:06:50.832216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878378+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:06:50.878378+0000","last_peered":"2024-02-14T13:06:50.878378+0000","last_clean":"2024-02-14T13:06:50.878378+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:06:50.878378+0000","last_undegraded":"2024-02-14T13:06:50.878378+0000","last_fullsized":"2024-02-14T13:06:50.878378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-02-14T13:06:49.816375+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:06:49.816375+0000","last_peered":"2024-02-14T13:06:49.816375+0000","last_clean":"2024-02-14T13:06:49.816375+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:06:49.816375+0000","last_undegraded":"2024-02-14T13:06:49.816375+0000","last_fullsized":"2024-02-14T13:06:49.816375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:52:02.123233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":7048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":10,"up_from":74,"seq":317827579922,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1536000,"data_stored":1028606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51400000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.747},{"interface":"front","average":{"1min":1.841,"5min":1.841,"15min":1.841},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":16.844999999999999,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.73699999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":9,"up_from":69,"seq":296352743447,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.498}]},{"osd":2,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70099999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.40999999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.623}]},{"osd":8,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.71599999999999997}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65000000000000002}]}]},{"osd":8,"up_from":61,"seq":261993005084,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":445606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68799999999999994,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.038},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.435,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75800000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.879},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":1.1020000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97399999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.85299999999999998,"5min":0.872,"15min":0.872},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.86399999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.1659999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.115}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":1.3620000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":7,"up_from":53,"seq":227633266721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1035952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.89200000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32400000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39900000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.745},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":48,"seq":206158430247,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":445119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.3080000000000001,"15min":1.423},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93000000000000005,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95799999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.3660000000000001,"15min":1.4810000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0169999999999999,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:06:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.56000000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67500000000000004}]},{"osd":8,"last update":"Wed Feb 14 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0209999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.622},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.64200000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":942080,"data_stored":446614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.34000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51700000000000002,"15min":0.48099999999999998},"min":{"1min":0.435,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.378,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.497},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.69799999999999995}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68100000000000005}]},{"osd":9,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78900000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:05:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.624}]},{"osd":2,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54000000000000004,"15min":0.498},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46999999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.79200000000000004,"15min":0.89200000000000002},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed Feb 14 13:06:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.42599999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92100000000000004,"5min":1.224,"15min":1.224},"last":0.56599999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.63600000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":436556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.623}]},{"osd":1,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.495},{"interface":"front","average":{"1min":0.621,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.751}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33500000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.504},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44500000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.622,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60099999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64900000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":3,"up_from":27,"seq":115964117045,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":905216,"data_stored":427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.318},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.173,"5min":0.52300000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":16.736999999999998,"5min":16.736999999999998,"15min":16.736999999999998},"last":16.736999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.54100000000000004},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":5.1159999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":4.8170000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":0.72499999999999998,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":20.550000000000001,"5min":20.550000000000001,"15min":20.550000000000001},"last":20.550000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.59899999999999998,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0540000000000003,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":6.0540000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:06:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":3.6000000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":13.26},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.56699999999999995,"15min":0.53600000000000003},"min":{"1min":0.46800000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":22.808}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":16.702999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53100000000000003,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":1.7669999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":13.172000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":16.648},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":5.048}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":3.9409999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":16.771000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.504999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":436454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.26200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.443},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.89100000000000001},"min":{"1min":0.439,"5min":0.314,"15min":0.314},"max":{"1min":3.718,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.36199999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.56100000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0429999999999999,"5min":6.327,"15min":6.327},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.58799999999999997,"15min":0.57099999999999995},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.621},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.57999999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.46000000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.627,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66600000000000004}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51300000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.60199999999999998}]}]},{"osd":5,"up_from":40,"seq":171798691883,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712504,"statfs":{"total":95995035648,"available":95961604096,"internally_reserved":0,"allocated":1499136,"data_stored":1017723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.317}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.28799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.379},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.34300000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Wed Feb 14 13:06:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82399999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.41499999999999998}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.39300000000000002}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998}]},{"osd":10,"last update":"Wed Feb 14 13:06:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:06:56.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-02-14T13:06:56.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-02-14T13:06:48.795340+0000', 'last_change': '2024-02-14T13:06:48.795340+0000', 'last_active': '2024-02-14T13:06:48.779091+0000', 'last_peered': '2024-02-14T13:06:48.779091+0000', 'last_clean': '2024-02-14T13:06:48.779091+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-14T13:06:48.795340+0000', 'last_undegraded': '2024-02-14T13:06:48.795340+0000', 'last_fullsized': '2024-02-14T13:06:48.795340+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_clean_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4, 1], 'acting': [5, 4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-14T13:06:56.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-02-14T13:06:48.794518+0000', 'last_change': '2024-02-14T13:06:48.794518+0000', 'last_active': '2024-02-14T13:06:48.779091+0000', 'last_peered': '2024-02-14T13:06:48.779091+0000', 'last_clean': '2024-02-14T13:06:48.779091+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-14T13:06:48.794518+0000', 'last_undegraded': '2024-02-14T13:06:48.794518+0000', 'last_fullsized': '2024-02-14T13:06:48.794518+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_clean_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4, 3], 'acting': [5, 4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-02-14T13:06:48.794153+0000', 'last_change': '2024-02-14T13:06:48.794153+0000', 'last_active': '2024-02-14T13:06:48.779091+0000', 'last_peered': '2024-02-14T13:06:48.779091+0000', 'last_clean': '2024-02-14T13:06:48.779091+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-14T13:06:48.794153+0000', 'last_undegraded': '2024-02-14T13:06:48.794153+0000', 'last_fullsized': '2024-02-14T13:06:48.794153+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_clean_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4, 1], 'acting': [5, 4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-02-14T13:06:48.795281+0000', 'last_change': '2024-02-14T13:06:48.795281+0000', 'last_active': '2024-02-14T13:06:48.779091+0000', 'last_peered': '2024-02-14T13:06:48.779091+0000', 'last_clean': '2024-02-14T13:06:48.779091+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-14T13:06:48.795281+0000', 'last_undegraded': '2024-02-14T13:06:48.795281+0000', 'last_fullsized': '2024-02-14T13:06:48.795281+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_clean_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2, 4], 'acting': [5, 2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-02-14T13:06:56.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-02-14T13:06:48.794828+0000', 'last_change': '2024-02-14T13:06:48.794828+0000', 'last_active': '2024-02-14T13:06:48.779091+0000', 'last_peered': '2024-02-14T13:06:48.779091+0000', 'last_clean': '2024-02-14T13:06:48.779091+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-02-14T13:06:48.794828+0000', 'last_undegraded': '2024-02-14T13:06:48.794828+0000', 'last_fullsized': '2024-02-14T13:06:48.794828+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'last_clean_scrub_stamp': '2024-02-14T13:06:48.779091+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 9, 3], 'acting': [5, 9, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-02-14T13:06:56.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-14T13:06:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 -- 172.21.15.12:0/2399307771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 msgr2=0x7f8614109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 --2- 172.21.15.12:0/2399307771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f8614109740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f860c009ca0 tx=0x7f860c02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 -- 172.21.15.12:0/2399307771 shutdown_connections 2024-02-14T13:06:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 --2- 172.21.15.12:0/2399307771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f8614109740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 --2- 172.21.15.12:0/2399307771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86141024f0 0x7f8614102970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 --2- 172.21.15.12:0/2399307771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86140ff520 0x7f86140ff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 -- 172.21.15.12:0/2399307771 >> 172.21.15.12:0/2399307771 conn(0x7f86140fae50 msgr2=0x7f86140fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 -- 172.21.15.12:0/2399307771 shutdown_connections 2024-02-14T13:06:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.452+0000 7f861a172640 1 -- 172.21.15.12:0/2399307771 wait complete. 2024-02-14T13:06:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 Processor -- start 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 -- start start 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86140ff520 0x7f86141971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86141024f0 0x7f8614197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f861419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861419ece0 con 0x7f8614102eb0 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861419ee50 con 0x7f86141024f0 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f861a172640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861419f010 con 0x7f86140ff520 2024-02-14T13:06:56.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f861419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f861419e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47436/0 (socket says 172.21.15.12:47436) 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 -- 172.21.15.12:0/3903846243 learned_addr learned my addr 172.21.15.12:0/3903846243 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8612ffd640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86141024f0 0x7f8614197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 -- 172.21.15.12:0/3903846243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86140ff520 msgr2=0x7f86141971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86140ff520 0x7f86141971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 -- 172.21.15.12:0/3903846243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86141024f0 msgr2=0x7f8614197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86141024f0 0x7f8614197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.453+0000 7f8613fff640 1 -- 172.21.15.12:0/3903846243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c009900 con 0x7f8614102eb0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.454+0000 7f8613fff640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f861419e7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f860c037040 tx=0x7f860c0346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.454+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c003970 con 0x7f8614102eb0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.454+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f860c004040 con 0x7f8614102eb0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.454+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861419f290 con 0x7f8614102eb0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.454+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c0406b0 con 0x7f8614102eb0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.454+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861419f740 con 0x7f8614102eb0 2024-02-14T13:06:56.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.455+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8614108550 con 0x7f8614102eb0 2024-02-14T13:06:56.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.456+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f860c00a040 con 0x7f8614102eb0 2024-02-14T13:06:56.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.456+0000 7f8610ff9640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f85fc0a2150 0x7f85fc0a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.456+0000 7f86137fe640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f85fc0a2150 0x7f85fc0a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.456+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f860c0f1270 con 0x7f8614102eb0 2024-02-14T13:06:56.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.457+0000 7f86137fe640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f85fc0a2150 0x7f85fc0a4610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86140696e0 tx=0x7f8604005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:56.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.460+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f860c0ba550 con 0x7f8614102eb0 2024-02-14T13:06:56.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.710+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f861410cc80 con 0x7f8614102eb0 2024-02-14T13:06:56.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.711+0000 7f8610ff9640 1 -- 172.21.15.12:0/3903846243 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2628 (secure 0 0 0) 0x7f860c044a60 con 0x7f8614102eb0 2024-02-14T13:06:56.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:56.713 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":367,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":12,"num_up_osds":12,"osd_up_since":1707915960,"num_in_osds":12,"osd_in_since":1707915939,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592618,"bytes_used":370475008,"bytes_avail":1151569952768,"bytes_total":1151940427776,"inactive_pgs_ratio":0.051546391099691391,"read_bytes_sec":511,"write_bytes_sec":2047,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":18,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:standby-replay","gid":24503},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24505}],"up:standby":10},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.12:8443/"}},"servicemap":{"epoch":17,"modified":"2024-02-14T13:06:36.347772+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","11":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f85fc0a2150 msgr2=0x7f85fc0a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f85fc0a2150 0x7f85fc0a4610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86140696e0 tx=0x7f8604005c90 comp rx=0 tx=0).stop 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 msgr2=0x7f861419e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f861419e7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f860c037040 tx=0x7f860c0346f0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 shutdown_connections 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f85fc0a2150 0x7f85fc0a4610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8614102eb0 0x7f861419e7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86141024f0 0x7f8614197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 --2- 172.21.15.12:0/3903846243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86140ff520 0x7f86141971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 >> 172.21.15.12:0/3903846243 conn(0x7f86140fae50 msgr2=0x7f8614105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 shutdown_connections 2024-02-14T13:06:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.713+0000 7f861a172640 1 -- 172.21.15.12:0/3903846243 wait complete. 2024-02-14T13:06:56.726 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-02-14T13:06:56.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-14T13:06:56.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 -- 172.21.15.12:0/3168229803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8100150 msgr2=0x7fd9a8100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/3168229803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8100150 0x7fd9a8100570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd998009900 tx=0x7fd99802bc30 comp rx=0 tx=0).stop 2024-02-14T13:06:56.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 -- 172.21.15.12:0/3168229803 shutdown_connections 2024-02-14T13:06:56.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/3168229803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8101d00 0x7fd9a8108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/3168229803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9a8101340 0x7fd9a81017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/3168229803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8100150 0x7fd9a8100570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 -- 172.21.15.12:0/3168229803 >> 172.21.15.12:0/3168229803 conn(0x7fd9a80fb6e0 msgr2=0x7fd9a80fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:56.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 -- 172.21.15.12:0/3168229803 shutdown_connections 2024-02-14T13:06:56.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.828+0000 7fd9ad19a640 1 -- 172.21.15.12:0/3168229803 wait complete. 2024-02-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 Processor -- start 2024-02-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 -- start start 2024-02-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8100150 0x7fd9a81961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9a8101340 0x7fd9a81966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 0x7fd9a819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a819dca0 con 0x7fd9a8101d00 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a819de10 con 0x7fd9a8100150 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9ad19a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a819dfd0 con 0x7fd9a8101340 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 0x7fd9a819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 0x7fd9a819d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47452/0 (socket says 172.21.15.12:47452) 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 -- 172.21.15.12:0/2230975828 learned_addr learned my addr 172.21.15.12:0/2230975828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd99ffff640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9a8101340 0x7fd9a81966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a6d9d640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8100150 0x7fd9a81961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 -- 172.21.15.12:0/2230975828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9a8101340 msgr2=0x7fd9a81966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9a8101340 0x7fd9a81966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 -- 172.21.15.12:0/2230975828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8100150 msgr2=0x7fd9a81961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8100150 0x7fd9a81961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a759e640 1 -- 172.21.15.12:0/2230975828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009560 con 0x7fd9a8101d00 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.829+0000 7fd9a6d9d640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8100150 0x7fd9a81961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.830+0000 7fd9a759e640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 0x7fd9a819d760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000cce0 tx=0x7fd9a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.830+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000f450 con 0x7fd9a8101d00 2024-02-14T13:06:56.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.830+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a819e2b0 con 0x7fd9a8101d00 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.830+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd9a000fa90 con 0x7fd9a8101d00 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.830+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0018b90 con 0x7fd9a8101d00 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.830+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a819e7c0 con 0x7fd9a8101d00 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.831+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8107470 con 0x7fd9a8101d00 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.832+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fd9a000fc00 con 0x7fd9a8101d00 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.832+0000 7fd9a4d99640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd9940a2150 0x7fd9940a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:06:56.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.832+0000 7fd9a6d9d640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd9940a2150 0x7fd9940a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:06:56.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.832+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd9a00ce470 con 0x7fd9a8101d00 2024-02-14T13:06:56.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.833+0000 7fd9a6d9d640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd9940a2150 0x7fd9940a4610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd998036040 tx=0x7fd998000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:06:56.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:56.837+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd9a0097490 con 0x7fd9a8101d00 2024-02-14T13:06:57.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.015+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9a802ce20 con 0x7fd9940a2150 2024-02-14T13:06:57.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.025+0000 7fd9a4d99640 1 -- 172.21.15.12:0/2230975828 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335881 (secure 0 0 0) 0x7fd9a802ce20 con 0x7fd9940a2150 2024-02-14T13:06:57.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:06:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.028+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd9940a2150 msgr2=0x7fd9940a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.028+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd9940a2150 0x7fd9940a4610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd998036040 tx=0x7fd998000bc0 comp rx=0 tx=0).stop 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.028+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 msgr2=0x7fd9a819d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.028+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 0x7fd9a819d760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000cce0 tx=0x7fd9a000a620 comp rx=0 tx=0).stop 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 shutdown_connections 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd9940a2150 0x7fd9940a4610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9a8101d00 0x7fd9a819d760 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9a8101340 0x7fd9a81966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 --2- 172.21.15.12:0/2230975828 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9a8100150 0x7fd9a81961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:06:57.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 >> 172.21.15.12:0/2230975828 conn(0x7fd9a80fb6e0 msgr2=0x7fd9a8104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:06:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 shutdown_connections 2024-02-14T13:06:57.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:06:57.029+0000 7fd9ad19a640 1 -- 172.21.15.12:0/2230975828 wait complete. 2024-02-14T13:06:57.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:56 smithi012 ceph-mon[32370]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:56 smithi012 ceph-mon[32370]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:56 smithi012 ceph-mon[32370]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:56 smithi012 ceph-mon[32370]: pgmap v291: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-02-14T13:06:57.041 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:56 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3903846243' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-14T13:06:57.041 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-02-14T13:06:56.352044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629476,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":144,"num_read_kb":157,"num_write":242,"num_write_kb":2993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362004,"kb_used_data":12820,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579820,"statfs":{"total":1151940427776,"available":1151569735680,"internally_reserved":0,"allocated":13127680,"data_stored":7191988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39108,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":48,"num_write":61,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.563874"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878800+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:06:50.878800+0000","last_peered":"2024-02-14T13:06:50.878800+0000","last_clean":"2024-02-14T13:06:50.878800+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:06:50.878800+0000","last_undegraded":"2024-02-14T13:06:50.878800+0000","last_fullsized":"2024-02-14T13:06:50.878800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:07:35.255009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809005+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:06:50.809005+0000","last_peered":"2024-02-14T13:06:50.809005+0000","last_clean":"2024-02-14T13:06:50.809005+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:06:50.809005+0000","last_undegraded":"2024-02-14T13:06:50.809005+0000","last_fullsized":"2024-02-14T13:06:50.809005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808797+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:06:50.808797+0000","last_peered":"2024-02-14T13:06:50.808797+0000","last_clean":"2024-02-14T13:06:50.808797+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:06:50.808797+0000","last_undegraded":"2024-02-14T13:06:50.808797+0000","last_fullsized":"2024-02-14T13:06:50.808797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878107+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:06:50.878107+0000","last_peered":"2024-02-14T13:06:50.878107+0000","last_clean":"2024-02-14T13:06:50.878107+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:06:50.878107+0000","last_undegraded":"2024-02-14T13:06:50.878107+0000","last_fullsized":"2024-02-14T13:06:50.878107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:37.758671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809253+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:06:50.809253+0000","last_peered":"2024-02-14T13:06:50.809253+0000","last_clean":"2024-02-14T13:06:50.809253+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:06:50.809253+0000","last_undegraded":"2024-02-14T13:06:50.809253+0000","last_fullsized":"2024-02-14T13:06:50.809253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.840835+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:06:50.840835+0000","last_peered":"2024-02-14T13:06:50.840835+0000","last_clean":"2024-02-14T13:06:50.840835+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:06:50.840835+0000","last_undegraded":"2024-02-14T13:06:50.840835+0000","last_fullsized":"2024-02-14T13:06:50.840835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:48:13.393242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813081+0000","last_change":"2024-02-14T13:06:49.816529+0000","last_active":"2024-02-14T13:06:50.813081+0000","last_peered":"2024-02-14T13:06:50.813081+0000","last_clean":"2024-02-14T13:06:50.813081+0000","last_became_active":"2024-02-14T13:06:49.816153+0000","last_became_peered":"2024-02-14T13:06:49.816153+0000","last_unstale":"2024-02-14T13:06:50.813081+0000","last_undegraded":"2024-02-14T13:06:50.813081+0000","last_fullsized":"2024-02-14T13:06:50.813081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:03:10.291658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877734+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:06:50.877734+0000","last_peered":"2024-02-14T13:06:50.877734+0000","last_clean":"2024-02-14T13:06:50.877734+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:06:50.877734+0000","last_undegraded":"2024-02-14T13:06:50.877734+0000","last_fullsized":"2024-02-14T13:06:50.877734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:44:35.774128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832644+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:06:50.832644+0000","last_peered":"2024-02-14T13:06:50.832644+0000","last_clean":"2024-02-14T13:06:50.832644+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:06:50.832644+0000","last_undegraded":"2024-02-14T13:06:50.832644+0000","last_fullsized":"2024-02-14T13:06:50.832644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.841234+0000","last_change":"2024-02-14T13:06:49.820207+0000","last_active":"2024-02-14T13:06:50.841234+0000","last_peered":"2024-02-14T13:06:50.841234+0000","last_clean":"2024-02-14T13:06:50.841234+0000","last_became_active":"2024-02-14T13:06:49.819829+0000","last_became_peered":"2024-02-14T13:06:49.819829+0000","last_unstale":"2024-02-14T13:06:50.841234+0000","last_undegraded":"2024-02-14T13:06:50.841234+0000","last_fullsized":"2024-02-14T13:06:50.841234+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:50:22.902955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813526+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:06:50.813526+0000","last_peered":"2024-02-14T13:06:50.813526+0000","last_clean":"2024-02-14T13:06:50.813526+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:06:50.813526+0000","last_undegraded":"2024-02-14T13:06:50.813526+0000","last_fullsized":"2024-02-14T13:06:50.813526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878070+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:06:50.878070+0000","last_peered":"2024-02-14T13:06:50.878070+0000","last_clean":"2024-02-14T13:06:50.878070+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:06:50.878070+0000","last_undegraded":"2024-02-14T13:06:50.878070+0000","last_fullsized":"2024-02-14T13:06:50.878070+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:28:48.545577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878215+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:06:50.878215+0000","last_peered":"2024-02-14T13:06:50.878215+0000","last_clean":"2024-02-14T13:06:50.878215+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:06:50.878215+0000","last_undegraded":"2024-02-14T13:06:50.878215+0000","last_fullsized":"2024-02-14T13:06:50.878215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808595+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:06:50.808595+0000","last_peered":"2024-02-14T13:06:50.808595+0000","last_clean":"2024-02-14T13:06:50.808595+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:06:50.808595+0000","last_undegraded":"2024-02-14T13:06:50.808595+0000","last_fullsized":"2024-02-14T13:06:50.808595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808546+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:06:50.808546+0000","last_peered":"2024-02-14T13:06:50.808546+0000","last_clean":"2024-02-14T13:06:50.808546+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:06:50.808546+0000","last_undegraded":"2024-02-14T13:06:50.808546+0000","last_fullsized":"2024-02-14T13:06:50.808546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832106+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:06:50.832106+0000","last_peered":"2024-02-14T13:06:50.832106+0000","last_clean":"2024-02-14T13:06:50.832106+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:06:50.832106+0000","last_undegraded":"2024-02-14T13:06:50.832106+0000","last_fullsized":"2024-02-14T13:06:50.832106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878799+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:06:50.878799+0000","last_peered":"2024-02-14T13:06:50.878799+0000","last_clean":"2024-02-14T13:06:50.878799+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:06:50.878799+0000","last_undegraded":"2024-02-14T13:06:50.878799+0000","last_fullsized":"2024-02-14T13:06:50.878799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:44:57.840170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878830+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:06:50.878830+0000","last_peered":"2024-02-14T13:06:50.878830+0000","last_clean":"2024-02-14T13:06:50.878830+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:06:50.878830+0000","last_undegraded":"2024-02-14T13:06:50.878830+0000","last_fullsized":"2024-02-14T13:06:50.878830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:40.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877985+0000","last_change":"2024-02-14T13:06:49.823862+0000","last_active":"2024-02-14T13:06:50.877985+0000","last_peered":"2024-02-14T13:06:50.877985+0000","last_clean":"2024-02-14T13:06:50.877985+0000","last_became_active":"2024-02-14T13:06:49.822726+0000","last_became_peered":"2024-02-14T13:06:49.822726+0000","last_unstale":"2024-02-14T13:06:50.877985+0000","last_undegraded":"2024-02-14T13:06:50.877985+0000","last_fullsized":"2024-02-14T13:06:50.877985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:25:28.794330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878739+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:06:50.878739+0000","last_peered":"2024-02-14T13:06:50.878739+0000","last_clean":"2024-02-14T13:06:50.878739+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:06:50.878739+0000","last_undegraded":"2024-02-14T13:06:50.878739+0000","last_fullsized":"2024-02-14T13:06:50.878739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879428+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:06:50.879428+0000","last_peered":"2024-02-14T13:06:50.879428+0000","last_clean":"2024-02-14T13:06:50.879428+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:06:50.879428+0000","last_undegraded":"2024-02-14T13:06:50.879428+0000","last_fullsized":"2024-02-14T13:06:50.879428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:02:56.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879560+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:06:50.879560+0000","last_peered":"2024-02-14T13:06:50.879560+0000","last_clean":"2024-02-14T13:06:50.879560+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:06:50.879560+0000","last_undegraded":"2024-02-14T13:06:50.879560+0000","last_fullsized":"2024-02-14T13:06:50.879560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808994+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:06:50.808994+0000","last_peered":"2024-02-14T13:06:50.808994+0000","last_clean":"2024-02-14T13:06:50.808994+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:06:50.808994+0000","last_undegraded":"2024-02-14T13:06:50.808994+0000","last_fullsized":"2024-02-14T13:06:50.808994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809630+0000","last_change":"2024-02-14T13:06:48.808351+0000","last_active":"2024-02-14T13:06:50.809630+0000","last_peered":"2024-02-14T13:06:50.809630+0000","last_clean":"2024-02-14T13:06:50.809630+0000","last_became_active":"2024-02-14T13:06:48.808059+0000","last_became_peered":"2024-02-14T13:06:48.808059+0000","last_unstale":"2024-02-14T13:06:50.809630+0000","last_undegraded":"2024-02-14T13:06:50.809630+0000","last_fullsized":"2024-02-14T13:06:50.809630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:24:45.902193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832310+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:06:50.832310+0000","last_peered":"2024-02-14T13:06:50.832310+0000","last_clean":"2024-02-14T13:06:50.832310+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:06:50.832310+0000","last_undegraded":"2024-02-14T13:06:50.832310+0000","last_fullsized":"2024-02-14T13:06:50.832310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809388+0000","last_change":"2024-02-14T13:06:48.803897+0000","last_active":"2024-02-14T13:06:50.809388+0000","last_peered":"2024-02-14T13:06:50.809388+0000","last_clean":"2024-02-14T13:06:50.809388+0000","last_became_active":"2024-02-14T13:06:48.803533+0000","last_became_peered":"2024-02-14T13:06:48.803533+0000","last_unstale":"2024-02-14T13:06:50.809388+0000","last_undegraded":"2024-02-14T13:06:50.809388+0000","last_fullsized":"2024-02-14T13:06:50.809388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:51:56.000004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879367+0000","last_change":"2024-02-14T13:06:49.813074+0000","last_active":"2024-02-14T13:06:50.879367+0000","last_peered":"2024-02-14T13:06:50.879367+0000","last_clean":"2024-02-14T13:06:50.879367+0000","last_became_active":"2024-02-14T13:06:49.812777+0000","last_became_peered":"2024-02-14T13:06:49.812777+0000","last_unstale":"2024-02-14T13:06:50.879367+0000","last_undegraded":"2024-02-14T13:06:50.879367+0000","last_fullsized":"2024-02-14T13:06:50.879367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:41:03.784230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879102+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:06:50.879102+0000","last_peered":"2024-02-14T13:06:50.879102+0000","last_clean":"2024-02-14T13:06:50.879102+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:06:50.879102+0000","last_undegraded":"2024-02-14T13:06:50.879102+0000","last_fullsized":"2024-02-14T13:06:50.879102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:56:07.991489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809268+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:06:50.809268+0000","last_peered":"2024-02-14T13:06:50.809268+0000","last_clean":"2024-02-14T13:06:50.809268+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:06:50.809268+0000","last_undegraded":"2024-02-14T13:06:50.809268+0000","last_fullsized":"2024-02-14T13:06:50.809268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.840649+0000","last_change":"2024-02-14T13:06:48.810464+0000","last_active":"2024-02-14T13:06:50.840649+0000","last_peered":"2024-02-14T13:06:50.840649+0000","last_clean":"2024-02-14T13:06:50.840649+0000","last_became_active":"2024-02-14T13:06:48.810159+0000","last_became_peered":"2024-02-14T13:06:48.810159+0000","last_unstale":"2024-02-14T13:06:50.840649+0000","last_undegraded":"2024-02-14T13:06:50.840649+0000","last_fullsized":"2024-02-14T13:06:50.840649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:00.546934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879597+0000","last_change":"2024-02-14T13:06:49.797327+0000","last_active":"2024-02-14T13:06:50.879597+0000","last_peered":"2024-02-14T13:06:50.879597+0000","last_clean":"2024-02-14T13:06:50.879597+0000","last_became_active":"2024-02-14T13:06:49.796953+0000","last_became_peered":"2024-02-14T13:06:49.796953+0000","last_unstale":"2024-02-14T13:06:50.879597+0000","last_undegraded":"2024-02-14T13:06:50.879597+0000","last_fullsized":"2024-02-14T13:06:50.879597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:58:33.031583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877891+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:06:50.877891+0000","last_peered":"2024-02-14T13:06:50.877891+0000","last_clean":"2024-02-14T13:06:50.877891+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:06:50.877891+0000","last_undegraded":"2024-02-14T13:06:50.877891+0000","last_fullsized":"2024-02-14T13:06:50.877891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877491+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:06:50.877491+0000","last_peered":"2024-02-14T13:06:50.877491+0000","last_clean":"2024-02-14T13:06:50.877491+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:06:50.877491+0000","last_undegraded":"2024-02-14T13:06:50.877491+0000","last_fullsized":"2024-02-14T13:06:50.877491+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:09.968642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879111+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:06:50.879111+0000","last_peered":"2024-02-14T13:06:50.879111+0000","last_clean":"2024-02-14T13:06:50.879111+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:06:50.879111+0000","last_undegraded":"2024-02-14T13:06:50.879111+0000","last_fullsized":"2024-02-14T13:06:50.879111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:15:04.555490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879056+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:06:50.879056+0000","last_peered":"2024-02-14T13:06:50.879056+0000","last_clean":"2024-02-14T13:06:50.879056+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:06:50.879056+0000","last_undegraded":"2024-02-14T13:06:50.879056+0000","last_fullsized":"2024-02-14T13:06:50.879056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:05:31.916433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.841109+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:06:50.841109+0000","last_peered":"2024-02-14T13:06:50.841109+0000","last_clean":"2024-02-14T13:06:50.841109+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:06:50.841109+0000","last_undegraded":"2024-02-14T13:06:50.841109+0000","last_fullsized":"2024-02-14T13:06:50.841109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832560+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:06:50.832560+0000","last_peered":"2024-02-14T13:06:50.832560+0000","last_clean":"2024-02-14T13:06:50.832560+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:06:50.832560+0000","last_undegraded":"2024-02-14T13:06:50.832560+0000","last_fullsized":"2024-02-14T13:06:50.832560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813368+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:06:50.813368+0000","last_peered":"2024-02-14T13:06:50.813368+0000","last_clean":"2024-02-14T13:06:50.813368+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:06:50.813368+0000","last_undegraded":"2024-02-14T13:06:50.813368+0000","last_fullsized":"2024-02-14T13:06:50.813368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808949+0000","last_change":"2024-02-14T13:06:49.813126+0000","last_active":"2024-02-14T13:06:50.808949+0000","last_peered":"2024-02-14T13:06:50.808949+0000","last_clean":"2024-02-14T13:06:50.808949+0000","last_became_active":"2024-02-14T13:06:49.812790+0000","last_became_peered":"2024-02-14T13:06:49.812790+0000","last_unstale":"2024-02-14T13:06:50.808949+0000","last_undegraded":"2024-02-14T13:06:50.808949+0000","last_fullsized":"2024-02-14T13:06:50.808949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:10:56.354605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879414+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:06:50.879414+0000","last_peered":"2024-02-14T13:06:50.879414+0000","last_clean":"2024-02-14T13:06:50.879414+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:06:50.879414+0000","last_undegraded":"2024-02-14T13:06:50.879414+0000","last_fullsized":"2024-02-14T13:06:50.879414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:52:36.229786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832394+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:06:50.832394+0000","last_peered":"2024-02-14T13:06:50.832394+0000","last_clean":"2024-02-14T13:06:50.832394+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:06:50.832394+0000","last_undegraded":"2024-02-14T13:06:50.832394+0000","last_fullsized":"2024-02-14T13:06:50.832394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'17","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:54.840239+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:06:54.840239+0000","last_peered":"2024-02-14T13:06:54.840239+0000","last_clean":"2024-02-14T13:06:54.840239+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:06:54.840239+0000","last_undegraded":"2024-02-14T13:06:54.840239+0000","last_fullsized":"2024-02-14T13:06:54.840239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":42,"num_write":17,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809571+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:06:50.809571+0000","last_peered":"2024-02-14T13:06:50.809571+0000","last_clean":"2024-02-14T13:06:50.809571+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:06:50.809571+0000","last_undegraded":"2024-02-14T13:06:50.809571+0000","last_fullsized":"2024-02-14T13:06:50.809571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877910+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:06:50.877910+0000","last_peered":"2024-02-14T13:06:50.877910+0000","last_clean":"2024-02-14T13:06:50.877910+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:06:50.877910+0000","last_undegraded":"2024-02-14T13:06:50.877910+0000","last_fullsized":"2024-02-14T13:06:50.877910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878225+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:06:50.878225+0000","last_peered":"2024-02-14T13:06:50.878225+0000","last_clean":"2024-02-14T13:06:50.878225+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:06:50.878225+0000","last_undegraded":"2024-02-14T13:06:50.878225+0000","last_fullsized":"2024-02-14T13:06:50.878225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879263+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:06:50.879263+0000","last_peered":"2024-02-14T13:06:50.879263+0000","last_clean":"2024-02-14T13:06:50.879263+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:06:50.879263+0000","last_undegraded":"2024-02-14T13:06:50.879263+0000","last_fullsized":"2024-02-14T13:06:50.879263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:08:08.869692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813427+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:06:50.813427+0000","last_peered":"2024-02-14T13:06:50.813427+0000","last_clean":"2024-02-14T13:06:50.813427+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:06:50.813427+0000","last_undegraded":"2024-02-14T13:06:50.813427+0000","last_fullsized":"2024-02-14T13:06:50.813427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877635+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:06:50.877635+0000","last_peered":"2024-02-14T13:06:50.877635+0000","last_clean":"2024-02-14T13:06:50.877635+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:06:50.877635+0000","last_undegraded":"2024-02-14T13:06:50.877635+0000","last_fullsized":"2024-02-14T13:06:50.877635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813169+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:06:50.813169+0000","last_peered":"2024-02-14T13:06:50.813169+0000","last_clean":"2024-02-14T13:06:50.813169+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:06:50.813169+0000","last_undegraded":"2024-02-14T13:06:50.813169+0000","last_fullsized":"2024-02-14T13:06:50.813169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808973+0000","last_change":"2024-02-14T13:06:48.803956+0000","last_active":"2024-02-14T13:06:50.808973+0000","last_peered":"2024-02-14T13:06:50.808973+0000","last_clean":"2024-02-14T13:06:50.808973+0000","last_became_active":"2024-02-14T13:06:48.803671+0000","last_became_peered":"2024-02-14T13:06:48.803671+0000","last_unstale":"2024-02-14T13:06:50.808973+0000","last_undegraded":"2024-02-14T13:06:50.808973+0000","last_fullsized":"2024-02-14T13:06:50.808973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:28:48.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879148+0000","last_change":"2024-02-14T13:06:49.815017+0000","last_active":"2024-02-14T13:06:50.879148+0000","last_peered":"2024-02-14T13:06:50.879148+0000","last_clean":"2024-02-14T13:06:50.879148+0000","last_became_active":"2024-02-14T13:06:49.809970+0000","last_became_peered":"2024-02-14T13:06:49.809970+0000","last_unstale":"2024-02-14T13:06:50.879148+0000","last_undegraded":"2024-02-14T13:06:50.879148+0000","last_fullsized":"2024-02-14T13:06:50.879148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:54:02.156674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809613+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:06:50.809613+0000","last_peered":"2024-02-14T13:06:50.809613+0000","last_clean":"2024-02-14T13:06:50.809613+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:06:50.809613+0000","last_undegraded":"2024-02-14T13:06:50.809613+0000","last_fullsized":"2024-02-14T13:06:50.809613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878255+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:06:50.878255+0000","last_peered":"2024-02-14T13:06:50.878255+0000","last_clean":"2024-02-14T13:06:50.878255+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:06:50.878255+0000","last_undegraded":"2024-02-14T13:06:50.878255+0000","last_fullsized":"2024-02-14T13:06:50.878255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:03:11.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878501+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:06:50.878501+0000","last_peered":"2024-02-14T13:06:50.878501+0000","last_clean":"2024-02-14T13:06:50.878501+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:06:50.878501+0000","last_undegraded":"2024-02-14T13:06:50.878501+0000","last_fullsized":"2024-02-14T13:06:50.878501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.841171+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:06:50.841171+0000","last_peered":"2024-02-14T13:06:50.841171+0000","last_clean":"2024-02-14T13:06:50.841171+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:06:50.841171+0000","last_undegraded":"2024-02-14T13:06:50.841171+0000","last_fullsized":"2024-02-14T13:06:50.841171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:59:33.260459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813446+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:06:50.813446+0000","last_peered":"2024-02-14T13:06:50.813446+0000","last_clean":"2024-02-14T13:06:50.813446+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:06:50.813446+0000","last_undegraded":"2024-02-14T13:06:50.813446+0000","last_fullsized":"2024-02-14T13:06:50.813446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.840976+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:06:50.840976+0000","last_peered":"2024-02-14T13:06:50.840976+0000","last_clean":"2024-02-14T13:06:50.840976+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:06:50.840976+0000","last_undegraded":"2024-02-14T13:06:50.840976+0000","last_fullsized":"2024-02-14T13:06:50.840976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:42:45.416138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879620+0000","last_change":"2024-02-14T13:06:49.820378+0000","last_active":"2024-02-14T13:06:50.879620+0000","last_peered":"2024-02-14T13:06:50.879620+0000","last_clean":"2024-02-14T13:06:50.879620+0000","last_became_active":"2024-02-14T13:06:49.820068+0000","last_became_peered":"2024-02-14T13:06:49.820068+0000","last_unstale":"2024-02-14T13:06:50.879620+0000","last_undegraded":"2024-02-14T13:06:50.879620+0000","last_fullsized":"2024-02-14T13:06:50.879620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:08.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877771+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:06:50.877771+0000","last_peered":"2024-02-14T13:06:50.877771+0000","last_clean":"2024-02-14T13:06:50.877771+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:06:50.877771+0000","last_undegraded":"2024-02-14T13:06:50.877771+0000","last_fullsized":"2024-02-14T13:06:50.877771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877888+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:06:50.877888+0000","last_peered":"2024-02-14T13:06:50.877888+0000","last_clean":"2024-02-14T13:06:50.877888+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:06:50.877888+0000","last_undegraded":"2024-02-14T13:06:50.877888+0000","last_fullsized":"2024-02-14T13:06:50.877888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:01.914405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877853+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:06:50.877853+0000","last_peered":"2024-02-14T13:06:50.877853+0000","last_clean":"2024-02-14T13:06:50.877853+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:06:50.877853+0000","last_undegraded":"2024-02-14T13:06:50.877853+0000","last_fullsized":"2024-02-14T13:06:50.877853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813026+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:06:50.813026+0000","last_peered":"2024-02-14T13:06:50.813026+0000","last_clean":"2024-02-14T13:06:50.813026+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:06:50.813026+0000","last_undegraded":"2024-02-14T13:06:50.813026+0000","last_fullsized":"2024-02-14T13:06:50.813026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877819+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:06:50.877819+0000","last_peered":"2024-02-14T13:06:50.877819+0000","last_clean":"2024-02-14T13:06:50.877819+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:06:50.877819+0000","last_undegraded":"2024-02-14T13:06:50.877819+0000","last_fullsized":"2024-02-14T13:06:50.877819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.812936+0000","last_change":"2024-02-14T13:06:48.812095+0000","last_active":"2024-02-14T13:06:50.812936+0000","last_peered":"2024-02-14T13:06:50.812936+0000","last_clean":"2024-02-14T13:06:50.812936+0000","last_became_active":"2024-02-14T13:06:48.811567+0000","last_became_peered":"2024-02-14T13:06:48.811567+0000","last_unstale":"2024-02-14T13:06:50.812936+0000","last_undegraded":"2024-02-14T13:06:50.812936+0000","last_fullsized":"2024-02-14T13:06:50.812936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:31:53.462420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809512+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:06:50.809512+0000","last_peered":"2024-02-14T13:06:50.809512+0000","last_clean":"2024-02-14T13:06:50.809512+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:06:50.809512+0000","last_undegraded":"2024-02-14T13:06:50.809512+0000","last_fullsized":"2024-02-14T13:06:50.809512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878268+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:06:50.878268+0000","last_peered":"2024-02-14T13:06:50.878268+0000","last_clean":"2024-02-14T13:06:50.878268+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:06:50.878268+0000","last_undegraded":"2024-02-14T13:06:50.878268+0000","last_fullsized":"2024-02-14T13:06:50.878268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:53.798165+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:06:53.798165+0000","last_peered":"2024-02-14T13:06:53.798165+0000","last_clean":"2024-02-14T13:06:53.798165+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:06:53.798165+0000","last_undegraded":"2024-02-14T13:06:53.798165+0000","last_fullsized":"2024-02-14T13:06:53.798165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878283+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:06:50.878283+0000","last_peered":"2024-02-14T13:06:50.878283+0000","last_clean":"2024-02-14T13:06:50.878283+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:06:50.878283+0000","last_undegraded":"2024-02-14T13:06:50.878283+0000","last_fullsized":"2024-02-14T13:06:50.878283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:11:41.708425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878006+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:06:50.878006+0000","last_peered":"2024-02-14T13:06:50.878006+0000","last_clean":"2024-02-14T13:06:50.878006+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:06:50.878006+0000","last_undegraded":"2024-02-14T13:06:50.878006+0000","last_fullsized":"2024-02-14T13:06:50.878006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809096+0000","last_change":"2024-02-14T13:06:49.810268+0000","last_active":"2024-02-14T13:06:50.809096+0000","last_peered":"2024-02-14T13:06:50.809096+0000","last_clean":"2024-02-14T13:06:50.809096+0000","last_became_active":"2024-02-14T13:06:49.809434+0000","last_became_peered":"2024-02-14T13:06:49.809434+0000","last_unstale":"2024-02-14T13:06:50.809096+0000","last_undegraded":"2024-02-14T13:06:50.809096+0000","last_fullsized":"2024-02-14T13:06:50.809096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:46:18.599259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832095+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:06:50.832095+0000","last_peered":"2024-02-14T13:06:50.832095+0000","last_clean":"2024-02-14T13:06:50.832095+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:06:50.832095+0000","last_undegraded":"2024-02-14T13:06:50.832095+0000","last_fullsized":"2024-02-14T13:06:50.832095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809169+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:06:50.809169+0000","last_peered":"2024-02-14T13:06:50.809169+0000","last_clean":"2024-02-14T13:06:50.809169+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:06:50.809169+0000","last_undegraded":"2024-02-14T13:06:50.809169+0000","last_fullsized":"2024-02-14T13:06:50.809169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877589+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:06:50.877589+0000","last_peered":"2024-02-14T13:06:50.877589+0000","last_clean":"2024-02-14T13:06:50.877589+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:06:50.877589+0000","last_undegraded":"2024-02-14T13:06:50.877589+0000","last_fullsized":"2024-02-14T13:06:50.877589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878150+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:06:50.878150+0000","last_peered":"2024-02-14T13:06:50.878150+0000","last_clean":"2024-02-14T13:06:50.878150+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:06:50.878150+0000","last_undegraded":"2024-02-14T13:06:50.878150+0000","last_fullsized":"2024-02-14T13:06:50.878150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:09:58.626393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877686+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:06:50.877686+0000","last_peered":"2024-02-14T13:06:50.877686+0000","last_clean":"2024-02-14T13:06:50.877686+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:06:50.877686+0000","last_undegraded":"2024-02-14T13:06:50.877686+0000","last_fullsized":"2024-02-14T13:06:50.877686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878238+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:06:50.878238+0000","last_peered":"2024-02-14T13:06:50.878238+0000","last_clean":"2024-02-14T13:06:50.878238+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:06:50.878238+0000","last_undegraded":"2024-02-14T13:06:50.878238+0000","last_fullsized":"2024-02-14T13:06:50.878238+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:03:06.405049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809235+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:06:50.809235+0000","last_peered":"2024-02-14T13:06:50.809235+0000","last_clean":"2024-02-14T13:06:50.809235+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:06:50.809235+0000","last_undegraded":"2024-02-14T13:06:50.809235+0000","last_fullsized":"2024-02-14T13:06:50.809235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813309+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:06:50.813309+0000","last_peered":"2024-02-14T13:06:50.813309+0000","last_clean":"2024-02-14T13:06:50.813309+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:06:50.813309+0000","last_undegraded":"2024-02-14T13:06:50.813309+0000","last_fullsized":"2024-02-14T13:06:50.813309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878047+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:06:50.878047+0000","last_peered":"2024-02-14T13:06:50.878047+0000","last_clean":"2024-02-14T13:06:50.878047+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:06:50.878047+0000","last_undegraded":"2024-02-14T13:06:50.878047+0000","last_fullsized":"2024-02-14T13:06:50.878047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813695+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:06:50.813695+0000","last_peered":"2024-02-14T13:06:50.813695+0000","last_clean":"2024-02-14T13:06:50.813695+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:06:50.813695+0000","last_undegraded":"2024-02-14T13:06:50.813695+0000","last_fullsized":"2024-02-14T13:06:50.813695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879310+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:06:50.879310+0000","last_peered":"2024-02-14T13:06:50.879310+0000","last_clean":"2024-02-14T13:06:50.879310+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:06:50.879310+0000","last_undegraded":"2024-02-14T13:06:50.879310+0000","last_fullsized":"2024-02-14T13:06:50.879310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:15:32.979424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813273+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:06:50.813273+0000","last_peered":"2024-02-14T13:06:50.813273+0000","last_clean":"2024-02-14T13:06:50.813273+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:06:50.813273+0000","last_undegraded":"2024-02-14T13:06:50.813273+0000","last_fullsized":"2024-02-14T13:06:50.813273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878539+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:06:50.878539+0000","last_peered":"2024-02-14T13:06:50.878539+0000","last_clean":"2024-02-14T13:06:50.878539+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:06:50.878539+0000","last_undegraded":"2024-02-14T13:06:50.878539+0000","last_fullsized":"2024-02-14T13:06:50.878539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813522+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:06:50.813522+0000","last_peered":"2024-02-14T13:06:50.813522+0000","last_clean":"2024-02-14T13:06:50.813522+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:06:50.813522+0000","last_undegraded":"2024-02-14T13:06:50.813522+0000","last_fullsized":"2024-02-14T13:06:50.813522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878767+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:06:50.878767+0000","last_peered":"2024-02-14T13:06:50.878767+0000","last_clean":"2024-02-14T13:06:50.878767+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:06:50.878767+0000","last_undegraded":"2024-02-14T13:06:50.878767+0000","last_fullsized":"2024-02-14T13:06:50.878767+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:34:48.890593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878097+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:06:50.878097+0000","last_peered":"2024-02-14T13:06:50.878097+0000","last_clean":"2024-02-14T13:06:50.878097+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:06:50.878097+0000","last_undegraded":"2024-02-14T13:06:50.878097+0000","last_fullsized":"2024-02-14T13:06:50.878097+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:05:53.262774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878374+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:06:50.878374+0000","last_peered":"2024-02-14T13:06:50.878374+0000","last_clean":"2024-02-14T13:06:50.878374+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:06:50.878374+0000","last_undegraded":"2024-02-14T13:06:50.878374+0000","last_fullsized":"2024-02-14T13:06:50.878374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:27:29.251638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808856+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:06:50.808856+0000","last_peered":"2024-02-14T13:06:50.808856+0000","last_clean":"2024-02-14T13:06:50.808856+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:06:50.808856+0000","last_undegraded":"2024-02-14T13:06:50.808856+0000","last_fullsized":"2024-02-14T13:06:50.808856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878412+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:06:50.878412+0000","last_peered":"2024-02-14T13:06:50.878412+0000","last_clean":"2024-02-14T13:06:50.878412+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:06:50.878412+0000","last_undegraded":"2024-02-14T13:06:50.878412+0000","last_fullsized":"2024-02-14T13:06:50.878412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878482+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:06:50.878482+0000","last_peered":"2024-02-14T13:06:50.878482+0000","last_clean":"2024-02-14T13:06:50.878482+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:06:50.878482+0000","last_undegraded":"2024-02-14T13:06:50.878482+0000","last_fullsized":"2024-02-14T13:06:50.878482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:46:06.005807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878235+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:06:50.878235+0000","last_peered":"2024-02-14T13:06:50.878235+0000","last_clean":"2024-02-14T13:06:50.878235+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:06:50.878235+0000","last_undegraded":"2024-02-14T13:06:50.878235+0000","last_fullsized":"2024-02-14T13:06:50.878235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:27:21.465567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878089+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:06:50.878089+0000","last_peered":"2024-02-14T13:06:50.878089+0000","last_clean":"2024-02-14T13:06:50.878089+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:06:50.878089+0000","last_undegraded":"2024-02-14T13:06:50.878089+0000","last_fullsized":"2024-02-14T13:06:50.878089+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:41.122395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879314+0000","last_change":"2024-02-14T13:06:49.819554+0000","last_active":"2024-02-14T13:06:50.879314+0000","last_peered":"2024-02-14T13:06:50.879314+0000","last_clean":"2024-02-14T13:06:50.879314+0000","last_became_active":"2024-02-14T13:06:49.818512+0000","last_became_peered":"2024-02-14T13:06:49.818512+0000","last_unstale":"2024-02-14T13:06:50.879314+0000","last_undegraded":"2024-02-14T13:06:50.879314+0000","last_fullsized":"2024-02-14T13:06:50.879314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:25:37.709104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877630+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:06:50.877630+0000","last_peered":"2024-02-14T13:06:50.877630+0000","last_clean":"2024-02-14T13:06:50.877630+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:06:50.877630+0000","last_undegraded":"2024-02-14T13:06:50.877630+0000","last_fullsized":"2024-02-14T13:06:50.877630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:04:06.483820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832216+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:06:50.832216+0000","last_peered":"2024-02-14T13:06:50.832216+0000","last_clean":"2024-02-14T13:06:50.832216+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:06:50.832216+0000","last_undegraded":"2024-02-14T13:06:50.832216+0000","last_fullsized":"2024-02-14T13:06:50.832216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878378+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:06:50.878378+0000","last_peered":"2024-02-14T13:06:50.878378+0000","last_clean":"2024-02-14T13:06:50.878378+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:06:50.878378+0000","last_undegraded":"2024-02-14T13:06:50.878378+0000","last_fullsized":"2024-02-14T13:06:50.878378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878276+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:06:50.878276+0000","last_peered":"2024-02-14T13:06:50.878276+0000","last_clean":"2024-02-14T13:06:50.878276+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:06:50.878276+0000","last_undegraded":"2024-02-14T13:06:50.878276+0000","last_fullsized":"2024-02-14T13:06:50.878276+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:39:46.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38991,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":48,"num_write":60,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":80392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318286,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":445002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":10,"up_from":74,"seq":317827579923,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1073874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.5},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68400000000000005}]},{"osd":5,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65300000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.841,"5min":1.841,"15min":1.841},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":16.844999999999999,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.82999999999999996}]},{"osd":9,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":9,"up_from":69,"seq":296352743448,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":445584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.441}]},{"osd":4,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69599999999999995}]},{"osd":8,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.64600000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73699999999999999}]}]},{"osd":8,"up_from":61,"seq":261993005084,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":445606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68799999999999994,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.038},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.435,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75800000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.879},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":1.1020000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97399999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.85299999999999998,"5min":0.872,"15min":0.872},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.86399999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.1659999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.115}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":1.3620000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":7,"up_from":53,"seq":227633266721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1035952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.89200000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32400000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39900000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.745},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":48,"seq":206158430247,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":445119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.3080000000000001,"15min":1.423},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93000000000000005,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95799999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.3660000000000001,"15min":1.4810000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0169999999999999,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:06:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.56000000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67500000000000004}]},{"osd":8,"last update":"Wed Feb 14 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0209999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.622},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.64200000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":942080,"data_stored":446614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.34000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51700000000000002,"15min":0.48099999999999998},"min":{"1min":0.435,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59699999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.438},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.378,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65700000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:06:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.497},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.754},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.69799999999999995}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68100000000000005}]},{"osd":9,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78900000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:05:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54000000000000004,"15min":0.498},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Feb 14 13:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.79200000000000004,"15min":0.89200000000000002},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.435}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92100000000000004,"5min":1.224,"15min":1.224},"last":0.625}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.46500000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.61599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":483229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.622,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.78700000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":445340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.318},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.173,"5min":0.52300000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":16.736999999999998,"5min":16.736999999999998,"15min":16.736999999999998},"last":0.29199999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.54100000000000004},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":0.72499999999999998,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":20.550000000000001,"5min":20.550000000000001,"15min":20.550000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.59899999999999998,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0540000000000003,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed Feb 14 13:06:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.56699999999999995,"15min":0.53600000000000003},"min":{"1min":0.46800000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53100000000000003,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46899999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38900000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.375},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53600000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.629},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":4,"up_from":35,"seq":150323855409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.26200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.495}]},{"osd":2,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.621}]},{"osd":3,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.89100000000000001},"min":{"1min":0.439,"5min":0.314,"15min":0.314},"max":{"1min":3.718,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.56100000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0429999999999999,"5min":6.327,"15min":6.327},"last":0.84099999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.79000000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.58799999999999997,"15min":0.57099999999999995},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.57999999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77100000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.627,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.88600000000000001}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.747}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":5,"up_from":40,"seq":171798691884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32684,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712468,"statfs":{"total":95995035648,"available":95961567232,"internally_reserved":0,"allocated":1536000,"data_stored":1035552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67500000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.371}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.745}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Feb 14 13:06:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.505},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82399999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.621}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60899999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.76700000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":38387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:06:57.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:56 smithi103 ceph-mon[36921]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:56 smithi103 ceph-mon[36921]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:56 smithi103 ceph-mon[36921]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:56 smithi103 ceph-mon[36921]: pgmap v291: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-02-14T13:06:57.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:56 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3903846243' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-14T13:06:57.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:56 smithi055 ceph-mon[36853]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:56 smithi055 ceph-mon[36853]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:56 smithi055 ceph-mon[36853]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:57.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:56 smithi055 ceph-mon[36853]: pgmap v291: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-02-14T13:06:57.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:56 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3903846243' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-02-14T13:06:58.212 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:57 smithi055 ceph-mon[36853]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:58.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:57 smithi012 ceph-mon[32370]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:06:58.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:57 smithi103 ceph-mon[36921]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:07:00.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-14T13:07:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 -- 172.21.15.12:0/1265302921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108102450 msgr2=0x7f01081028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 --2- 172.21.15.12:0/1265302921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108102450 0x7f01081028d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009900 tx=0x7f00f802bc30 comp rx=0 tx=0).stop 2024-02-14T13:07:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 -- 172.21.15.12:0/1265302921 shutdown_connections 2024-02-14T13:07:00.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 --2- 172.21.15.12:0/1265302921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102e10 0x7f01081096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 --2- 172.21.15.12:0/1265302921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108102450 0x7f01081028d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 --2- 172.21.15.12:0/1265302921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0108101260 0x7f0108101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 -- 172.21.15.12:0/1265302921 >> 172.21.15.12:0/1265302921 conn(0x7f01080fc810 msgr2=0x7f01080fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 -- 172.21.15.12:0/1265302921 shutdown_connections 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 -- 172.21.15.12:0/1265302921 wait complete. 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.156+0000 7f010ff4f640 1 Processor -- start 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 -- start start 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 0x7f0108074fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102450 0x7f0108073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0108102e10 0x7f0108073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080742c0 con 0x7f0108101260 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108074430 con 0x7f0108102450 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010ff4f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01081a1330 con 0x7f0108102e10 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 0x7f0108074fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:00.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 0x7f0108074fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47468/0 (socket says 172.21.15.12:47468) 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 -- 172.21.15.12:0/2066828121 learned_addr learned my addr 172.21.15.12:0/2066828121 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010d4ea640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102450 0x7f0108073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010e4ec640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0108102e10 0x7f0108073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 -- 172.21.15.12:0/2066828121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0108102e10 msgr2=0x7f0108073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0108102e10 0x7f0108073b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 -- 172.21.15.12:0/2066828121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102450 msgr2=0x7f0108073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102450 0x7f0108073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 -- 172.21.15.12:0/2066828121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8009560 con 0x7f0108101260 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010d4ea640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102450 0x7f0108073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f010dceb640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 0x7f0108074fe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f010000d980 tx=0x7f010000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.157+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100009c30 con 0x7f0108101260 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.158+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f0100009d90 con 0x7f0108101260 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.158+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010000f6b0 con 0x7f0108101260 2024-02-14T13:07:00.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.158+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01081a15e0 con 0x7f0108101260 2024-02-14T13:07:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.158+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01081a1a70 con 0x7f0108101260 2024-02-14T13:07:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.159+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0108108580 con 0x7f0108101260 2024-02-14T13:07:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.160+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f0100010460 con 0x7f0108101260 2024-02-14T13:07:00.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.160+0000 7f00feffd640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f00f40a2150 0x7f00f40a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.160+0000 7f010d4ea640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f00f40a2150 0x7f00f40a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.160+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f01000cdab0 con 0x7f0108101260 2024-02-14T13:07:00.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.161+0000 7f010d4ea640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f00f40a2150 0x7f00f40a4610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009230 tx=0x7f00f8005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:00.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.164+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0100096ad0 con 0x7f0108101260 2024-02-14T13:07:00.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:06:59 smithi012 ceph-mon[32370]: pgmap v292: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-02-14T13:07:00.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:06:59 smithi103 ceph-mon[36921]: pgmap v292: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-02-14T13:07:00.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:06:59 smithi055 ceph-mon[36853]: pgmap v292: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-02-14T13:07:00.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.344+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f010802cef0 con 0x7f00f40a2150 2024-02-14T13:07:00.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.354+0000 7f00feffd640 1 -- 172.21.15.12:0/2066828121 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335885 (secure 0 0 0) 0x7f010802cef0 con 0x7f00f40a2150 2024-02-14T13:07:00.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:07:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f00f40a2150 msgr2=0x7f00f40a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f00f40a2150 0x7f00f40a4610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009230 tx=0x7f00f8005fd0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 msgr2=0x7f0108074fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 0x7f0108074fe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f010000d980 tx=0x7f010000de40 comp rx=0 tx=0).stop 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 shutdown_connections 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f00f40a2150 0x7f00f40a4610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0108102e10 0x7f0108073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0108102450 0x7f0108073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 --2- 172.21.15.12:0/2066828121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0108101260 0x7f0108074fe0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 >> 172.21.15.12:0/2066828121 conn(0x7f01080fc810 msgr2=0x7f0108105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 shutdown_connections 2024-02-14T13:07:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:00.358+0000 7f010ff4f640 1 -- 172.21.15.12:0/2066828121 wait complete. 2024-02-14T13:07:00.370 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-02-14T13:06:58.352582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629476,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":144,"num_read_kb":157,"num_write":242,"num_write_kb":2993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362036,"kb_used_data":12856,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579788,"statfs":{"total":1151940427776,"available":1151569702912,"internally_reserved":0,"allocated":13164544,"data_stored":7228569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39108,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":48,"num_write":61,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.562140"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878800+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:06:50.878800+0000","last_peered":"2024-02-14T13:06:50.878800+0000","last_clean":"2024-02-14T13:06:50.878800+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:06:50.878800+0000","last_undegraded":"2024-02-14T13:06:50.878800+0000","last_fullsized":"2024-02-14T13:06:50.878800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:07:35.255009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809005+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:06:50.809005+0000","last_peered":"2024-02-14T13:06:50.809005+0000","last_clean":"2024-02-14T13:06:50.809005+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:06:50.809005+0000","last_undegraded":"2024-02-14T13:06:50.809005+0000","last_fullsized":"2024-02-14T13:06:50.809005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808797+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:06:50.808797+0000","last_peered":"2024-02-14T13:06:50.808797+0000","last_clean":"2024-02-14T13:06:50.808797+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:06:50.808797+0000","last_undegraded":"2024-02-14T13:06:50.808797+0000","last_fullsized":"2024-02-14T13:06:50.808797+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878107+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:06:50.878107+0000","last_peered":"2024-02-14T13:06:50.878107+0000","last_clean":"2024-02-14T13:06:50.878107+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:06:50.878107+0000","last_undegraded":"2024-02-14T13:06:50.878107+0000","last_fullsized":"2024-02-14T13:06:50.878107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:37.758671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809253+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:06:50.809253+0000","last_peered":"2024-02-14T13:06:50.809253+0000","last_clean":"2024-02-14T13:06:50.809253+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:06:50.809253+0000","last_undegraded":"2024-02-14T13:06:50.809253+0000","last_fullsized":"2024-02-14T13:06:50.809253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.840835+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:06:50.840835+0000","last_peered":"2024-02-14T13:06:50.840835+0000","last_clean":"2024-02-14T13:06:50.840835+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:06:50.840835+0000","last_undegraded":"2024-02-14T13:06:50.840835+0000","last_fullsized":"2024-02-14T13:06:50.840835+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:48:13.393242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813081+0000","last_change":"2024-02-14T13:06:49.816529+0000","last_active":"2024-02-14T13:06:50.813081+0000","last_peered":"2024-02-14T13:06:50.813081+0000","last_clean":"2024-02-14T13:06:50.813081+0000","last_became_active":"2024-02-14T13:06:49.816153+0000","last_became_peered":"2024-02-14T13:06:49.816153+0000","last_unstale":"2024-02-14T13:06:50.813081+0000","last_undegraded":"2024-02-14T13:06:50.813081+0000","last_fullsized":"2024-02-14T13:06:50.813081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:03:10.291658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877734+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:06:50.877734+0000","last_peered":"2024-02-14T13:06:50.877734+0000","last_clean":"2024-02-14T13:06:50.877734+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:06:50.877734+0000","last_undegraded":"2024-02-14T13:06:50.877734+0000","last_fullsized":"2024-02-14T13:06:50.877734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:44:35.774128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832644+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:06:50.832644+0000","last_peered":"2024-02-14T13:06:50.832644+0000","last_clean":"2024-02-14T13:06:50.832644+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:06:50.832644+0000","last_undegraded":"2024-02-14T13:06:50.832644+0000","last_fullsized":"2024-02-14T13:06:50.832644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.841234+0000","last_change":"2024-02-14T13:06:49.820207+0000","last_active":"2024-02-14T13:06:50.841234+0000","last_peered":"2024-02-14T13:06:50.841234+0000","last_clean":"2024-02-14T13:06:50.841234+0000","last_became_active":"2024-02-14T13:06:49.819829+0000","last_became_peered":"2024-02-14T13:06:49.819829+0000","last_unstale":"2024-02-14T13:06:50.841234+0000","last_undegraded":"2024-02-14T13:06:50.841234+0000","last_fullsized":"2024-02-14T13:06:50.841234+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:50:22.902955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813526+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:06:50.813526+0000","last_peered":"2024-02-14T13:06:50.813526+0000","last_clean":"2024-02-14T13:06:50.813526+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:06:50.813526+0000","last_undegraded":"2024-02-14T13:06:50.813526+0000","last_fullsized":"2024-02-14T13:06:50.813526+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878070+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:06:50.878070+0000","last_peered":"2024-02-14T13:06:50.878070+0000","last_clean":"2024-02-14T13:06:50.878070+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:06:50.878070+0000","last_undegraded":"2024-02-14T13:06:50.878070+0000","last_fullsized":"2024-02-14T13:06:50.878070+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:28:48.545577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878215+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:06:50.878215+0000","last_peered":"2024-02-14T13:06:50.878215+0000","last_clean":"2024-02-14T13:06:50.878215+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:06:50.878215+0000","last_undegraded":"2024-02-14T13:06:50.878215+0000","last_fullsized":"2024-02-14T13:06:50.878215+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808595+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:06:50.808595+0000","last_peered":"2024-02-14T13:06:50.808595+0000","last_clean":"2024-02-14T13:06:50.808595+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:06:50.808595+0000","last_undegraded":"2024-02-14T13:06:50.808595+0000","last_fullsized":"2024-02-14T13:06:50.808595+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808546+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:06:50.808546+0000","last_peered":"2024-02-14T13:06:50.808546+0000","last_clean":"2024-02-14T13:06:50.808546+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:06:50.808546+0000","last_undegraded":"2024-02-14T13:06:50.808546+0000","last_fullsized":"2024-02-14T13:06:50.808546+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832106+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:06:50.832106+0000","last_peered":"2024-02-14T13:06:50.832106+0000","last_clean":"2024-02-14T13:06:50.832106+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:06:50.832106+0000","last_undegraded":"2024-02-14T13:06:50.832106+0000","last_fullsized":"2024-02-14T13:06:50.832106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878799+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:06:50.878799+0000","last_peered":"2024-02-14T13:06:50.878799+0000","last_clean":"2024-02-14T13:06:50.878799+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:06:50.878799+0000","last_undegraded":"2024-02-14T13:06:50.878799+0000","last_fullsized":"2024-02-14T13:06:50.878799+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:44:57.840170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878830+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:06:50.878830+0000","last_peered":"2024-02-14T13:06:50.878830+0000","last_clean":"2024-02-14T13:06:50.878830+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:06:50.878830+0000","last_undegraded":"2024-02-14T13:06:50.878830+0000","last_fullsized":"2024-02-14T13:06:50.878830+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:40.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877985+0000","last_change":"2024-02-14T13:06:49.823862+0000","last_active":"2024-02-14T13:06:50.877985+0000","last_peered":"2024-02-14T13:06:50.877985+0000","last_clean":"2024-02-14T13:06:50.877985+0000","last_became_active":"2024-02-14T13:06:49.822726+0000","last_became_peered":"2024-02-14T13:06:49.822726+0000","last_unstale":"2024-02-14T13:06:50.877985+0000","last_undegraded":"2024-02-14T13:06:50.877985+0000","last_fullsized":"2024-02-14T13:06:50.877985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:25:28.794330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878739+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:06:50.878739+0000","last_peered":"2024-02-14T13:06:50.878739+0000","last_clean":"2024-02-14T13:06:50.878739+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:06:50.878739+0000","last_undegraded":"2024-02-14T13:06:50.878739+0000","last_fullsized":"2024-02-14T13:06:50.878739+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879428+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:06:50.879428+0000","last_peered":"2024-02-14T13:06:50.879428+0000","last_clean":"2024-02-14T13:06:50.879428+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:06:50.879428+0000","last_undegraded":"2024-02-14T13:06:50.879428+0000","last_fullsized":"2024-02-14T13:06:50.879428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:02:56.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879560+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:06:50.879560+0000","last_peered":"2024-02-14T13:06:50.879560+0000","last_clean":"2024-02-14T13:06:50.879560+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:06:50.879560+0000","last_undegraded":"2024-02-14T13:06:50.879560+0000","last_fullsized":"2024-02-14T13:06:50.879560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808994+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:06:50.808994+0000","last_peered":"2024-02-14T13:06:50.808994+0000","last_clean":"2024-02-14T13:06:50.808994+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:06:50.808994+0000","last_undegraded":"2024-02-14T13:06:50.808994+0000","last_fullsized":"2024-02-14T13:06:50.808994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809630+0000","last_change":"2024-02-14T13:06:48.808351+0000","last_active":"2024-02-14T13:06:50.809630+0000","last_peered":"2024-02-14T13:06:50.809630+0000","last_clean":"2024-02-14T13:06:50.809630+0000","last_became_active":"2024-02-14T13:06:48.808059+0000","last_became_peered":"2024-02-14T13:06:48.808059+0000","last_unstale":"2024-02-14T13:06:50.809630+0000","last_undegraded":"2024-02-14T13:06:50.809630+0000","last_fullsized":"2024-02-14T13:06:50.809630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:24:45.902193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832310+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:06:50.832310+0000","last_peered":"2024-02-14T13:06:50.832310+0000","last_clean":"2024-02-14T13:06:50.832310+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:06:50.832310+0000","last_undegraded":"2024-02-14T13:06:50.832310+0000","last_fullsized":"2024-02-14T13:06:50.832310+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809388+0000","last_change":"2024-02-14T13:06:48.803897+0000","last_active":"2024-02-14T13:06:50.809388+0000","last_peered":"2024-02-14T13:06:50.809388+0000","last_clean":"2024-02-14T13:06:50.809388+0000","last_became_active":"2024-02-14T13:06:48.803533+0000","last_became_peered":"2024-02-14T13:06:48.803533+0000","last_unstale":"2024-02-14T13:06:50.809388+0000","last_undegraded":"2024-02-14T13:06:50.809388+0000","last_fullsized":"2024-02-14T13:06:50.809388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:51:56.000004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879367+0000","last_change":"2024-02-14T13:06:49.813074+0000","last_active":"2024-02-14T13:06:50.879367+0000","last_peered":"2024-02-14T13:06:50.879367+0000","last_clean":"2024-02-14T13:06:50.879367+0000","last_became_active":"2024-02-14T13:06:49.812777+0000","last_became_peered":"2024-02-14T13:06:49.812777+0000","last_unstale":"2024-02-14T13:06:50.879367+0000","last_undegraded":"2024-02-14T13:06:50.879367+0000","last_fullsized":"2024-02-14T13:06:50.879367+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:41:03.784230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879102+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:06:50.879102+0000","last_peered":"2024-02-14T13:06:50.879102+0000","last_clean":"2024-02-14T13:06:50.879102+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:06:50.879102+0000","last_undegraded":"2024-02-14T13:06:50.879102+0000","last_fullsized":"2024-02-14T13:06:50.879102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:56:07.991489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809268+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:06:50.809268+0000","last_peered":"2024-02-14T13:06:50.809268+0000","last_clean":"2024-02-14T13:06:50.809268+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:06:50.809268+0000","last_undegraded":"2024-02-14T13:06:50.809268+0000","last_fullsized":"2024-02-14T13:06:50.809268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.840649+0000","last_change":"2024-02-14T13:06:48.810464+0000","last_active":"2024-02-14T13:06:50.840649+0000","last_peered":"2024-02-14T13:06:50.840649+0000","last_clean":"2024-02-14T13:06:50.840649+0000","last_became_active":"2024-02-14T13:06:48.810159+0000","last_became_peered":"2024-02-14T13:06:48.810159+0000","last_unstale":"2024-02-14T13:06:50.840649+0000","last_undegraded":"2024-02-14T13:06:50.840649+0000","last_fullsized":"2024-02-14T13:06:50.840649+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:00.546934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879597+0000","last_change":"2024-02-14T13:06:49.797327+0000","last_active":"2024-02-14T13:06:50.879597+0000","last_peered":"2024-02-14T13:06:50.879597+0000","last_clean":"2024-02-14T13:06:50.879597+0000","last_became_active":"2024-02-14T13:06:49.796953+0000","last_became_peered":"2024-02-14T13:06:49.796953+0000","last_unstale":"2024-02-14T13:06:50.879597+0000","last_undegraded":"2024-02-14T13:06:50.879597+0000","last_fullsized":"2024-02-14T13:06:50.879597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:58:33.031583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877891+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:06:50.877891+0000","last_peered":"2024-02-14T13:06:50.877891+0000","last_clean":"2024-02-14T13:06:50.877891+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:06:50.877891+0000","last_undegraded":"2024-02-14T13:06:50.877891+0000","last_fullsized":"2024-02-14T13:06:50.877891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877491+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:06:50.877491+0000","last_peered":"2024-02-14T13:06:50.877491+0000","last_clean":"2024-02-14T13:06:50.877491+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:06:50.877491+0000","last_undegraded":"2024-02-14T13:06:50.877491+0000","last_fullsized":"2024-02-14T13:06:50.877491+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:09.968642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879111+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:06:50.879111+0000","last_peered":"2024-02-14T13:06:50.879111+0000","last_clean":"2024-02-14T13:06:50.879111+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:06:50.879111+0000","last_undegraded":"2024-02-14T13:06:50.879111+0000","last_fullsized":"2024-02-14T13:06:50.879111+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:15:04.555490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879056+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:06:50.879056+0000","last_peered":"2024-02-14T13:06:50.879056+0000","last_clean":"2024-02-14T13:06:50.879056+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:06:50.879056+0000","last_undegraded":"2024-02-14T13:06:50.879056+0000","last_fullsized":"2024-02-14T13:06:50.879056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:05:31.916433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.841109+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:06:50.841109+0000","last_peered":"2024-02-14T13:06:50.841109+0000","last_clean":"2024-02-14T13:06:50.841109+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:06:50.841109+0000","last_undegraded":"2024-02-14T13:06:50.841109+0000","last_fullsized":"2024-02-14T13:06:50.841109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832560+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:06:50.832560+0000","last_peered":"2024-02-14T13:06:50.832560+0000","last_clean":"2024-02-14T13:06:50.832560+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:06:50.832560+0000","last_undegraded":"2024-02-14T13:06:50.832560+0000","last_fullsized":"2024-02-14T13:06:50.832560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813368+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:06:50.813368+0000","last_peered":"2024-02-14T13:06:50.813368+0000","last_clean":"2024-02-14T13:06:50.813368+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:06:50.813368+0000","last_undegraded":"2024-02-14T13:06:50.813368+0000","last_fullsized":"2024-02-14T13:06:50.813368+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808949+0000","last_change":"2024-02-14T13:06:49.813126+0000","last_active":"2024-02-14T13:06:50.808949+0000","last_peered":"2024-02-14T13:06:50.808949+0000","last_clean":"2024-02-14T13:06:50.808949+0000","last_became_active":"2024-02-14T13:06:49.812790+0000","last_became_peered":"2024-02-14T13:06:49.812790+0000","last_unstale":"2024-02-14T13:06:50.808949+0000","last_undegraded":"2024-02-14T13:06:50.808949+0000","last_fullsized":"2024-02-14T13:06:50.808949+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:10:56.354605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879414+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:06:50.879414+0000","last_peered":"2024-02-14T13:06:50.879414+0000","last_clean":"2024-02-14T13:06:50.879414+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:06:50.879414+0000","last_undegraded":"2024-02-14T13:06:50.879414+0000","last_fullsized":"2024-02-14T13:06:50.879414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:52:36.229786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832394+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:06:50.832394+0000","last_peered":"2024-02-14T13:06:50.832394+0000","last_clean":"2024-02-14T13:06:50.832394+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:06:50.832394+0000","last_undegraded":"2024-02-14T13:06:50.832394+0000","last_fullsized":"2024-02-14T13:06:50.832394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'17","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:54.840239+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:06:54.840239+0000","last_peered":"2024-02-14T13:06:54.840239+0000","last_clean":"2024-02-14T13:06:54.840239+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:06:54.840239+0000","last_undegraded":"2024-02-14T13:06:54.840239+0000","last_fullsized":"2024-02-14T13:06:54.840239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":42,"num_write":17,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809571+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:06:50.809571+0000","last_peered":"2024-02-14T13:06:50.809571+0000","last_clean":"2024-02-14T13:06:50.809571+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:06:50.809571+0000","last_undegraded":"2024-02-14T13:06:50.809571+0000","last_fullsized":"2024-02-14T13:06:50.809571+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877910+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:06:50.877910+0000","last_peered":"2024-02-14T13:06:50.877910+0000","last_clean":"2024-02-14T13:06:50.877910+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:06:50.877910+0000","last_undegraded":"2024-02-14T13:06:50.877910+0000","last_fullsized":"2024-02-14T13:06:50.877910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878225+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:06:50.878225+0000","last_peered":"2024-02-14T13:06:50.878225+0000","last_clean":"2024-02-14T13:06:50.878225+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:06:50.878225+0000","last_undegraded":"2024-02-14T13:06:50.878225+0000","last_fullsized":"2024-02-14T13:06:50.878225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879263+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:06:50.879263+0000","last_peered":"2024-02-14T13:06:50.879263+0000","last_clean":"2024-02-14T13:06:50.879263+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:06:50.879263+0000","last_undegraded":"2024-02-14T13:06:50.879263+0000","last_fullsized":"2024-02-14T13:06:50.879263+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:08:08.869692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813427+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:06:50.813427+0000","last_peered":"2024-02-14T13:06:50.813427+0000","last_clean":"2024-02-14T13:06:50.813427+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:06:50.813427+0000","last_undegraded":"2024-02-14T13:06:50.813427+0000","last_fullsized":"2024-02-14T13:06:50.813427+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877635+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:06:50.877635+0000","last_peered":"2024-02-14T13:06:50.877635+0000","last_clean":"2024-02-14T13:06:50.877635+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:06:50.877635+0000","last_undegraded":"2024-02-14T13:06:50.877635+0000","last_fullsized":"2024-02-14T13:06:50.877635+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813169+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:06:50.813169+0000","last_peered":"2024-02-14T13:06:50.813169+0000","last_clean":"2024-02-14T13:06:50.813169+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:06:50.813169+0000","last_undegraded":"2024-02-14T13:06:50.813169+0000","last_fullsized":"2024-02-14T13:06:50.813169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808973+0000","last_change":"2024-02-14T13:06:48.803956+0000","last_active":"2024-02-14T13:06:50.808973+0000","last_peered":"2024-02-14T13:06:50.808973+0000","last_clean":"2024-02-14T13:06:50.808973+0000","last_became_active":"2024-02-14T13:06:48.803671+0000","last_became_peered":"2024-02-14T13:06:48.803671+0000","last_unstale":"2024-02-14T13:06:50.808973+0000","last_undegraded":"2024-02-14T13:06:50.808973+0000","last_fullsized":"2024-02-14T13:06:50.808973+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:28:48.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879148+0000","last_change":"2024-02-14T13:06:49.815017+0000","last_active":"2024-02-14T13:06:50.879148+0000","last_peered":"2024-02-14T13:06:50.879148+0000","last_clean":"2024-02-14T13:06:50.879148+0000","last_became_active":"2024-02-14T13:06:49.809970+0000","last_became_peered":"2024-02-14T13:06:49.809970+0000","last_unstale":"2024-02-14T13:06:50.879148+0000","last_undegraded":"2024-02-14T13:06:50.879148+0000","last_fullsized":"2024-02-14T13:06:50.879148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:54:02.156674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809613+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:06:50.809613+0000","last_peered":"2024-02-14T13:06:50.809613+0000","last_clean":"2024-02-14T13:06:50.809613+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:06:50.809613+0000","last_undegraded":"2024-02-14T13:06:50.809613+0000","last_fullsized":"2024-02-14T13:06:50.809613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878255+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:06:50.878255+0000","last_peered":"2024-02-14T13:06:50.878255+0000","last_clean":"2024-02-14T13:06:50.878255+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:06:50.878255+0000","last_undegraded":"2024-02-14T13:06:50.878255+0000","last_fullsized":"2024-02-14T13:06:50.878255+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:03:11.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878501+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:06:50.878501+0000","last_peered":"2024-02-14T13:06:50.878501+0000","last_clean":"2024-02-14T13:06:50.878501+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:06:50.878501+0000","last_undegraded":"2024-02-14T13:06:50.878501+0000","last_fullsized":"2024-02-14T13:06:50.878501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'1","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.841171+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:06:50.841171+0000","last_peered":"2024-02-14T13:06:50.841171+0000","last_clean":"2024-02-14T13:06:50.841171+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:06:50.841171+0000","last_undegraded":"2024-02-14T13:06:50.841171+0000","last_fullsized":"2024-02-14T13:06:50.841171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:59:33.260459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813446+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:06:50.813446+0000","last_peered":"2024-02-14T13:06:50.813446+0000","last_clean":"2024-02-14T13:06:50.813446+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:06:50.813446+0000","last_undegraded":"2024-02-14T13:06:50.813446+0000","last_fullsized":"2024-02-14T13:06:50.813446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.840976+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:06:50.840976+0000","last_peered":"2024-02-14T13:06:50.840976+0000","last_clean":"2024-02-14T13:06:50.840976+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:06:50.840976+0000","last_undegraded":"2024-02-14T13:06:50.840976+0000","last_fullsized":"2024-02-14T13:06:50.840976+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:42:45.416138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879620+0000","last_change":"2024-02-14T13:06:49.820378+0000","last_active":"2024-02-14T13:06:50.879620+0000","last_peered":"2024-02-14T13:06:50.879620+0000","last_clean":"2024-02-14T13:06:50.879620+0000","last_became_active":"2024-02-14T13:06:49.820068+0000","last_became_peered":"2024-02-14T13:06:49.820068+0000","last_unstale":"2024-02-14T13:06:50.879620+0000","last_undegraded":"2024-02-14T13:06:50.879620+0000","last_fullsized":"2024-02-14T13:06:50.879620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:08.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877771+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:06:50.877771+0000","last_peered":"2024-02-14T13:06:50.877771+0000","last_clean":"2024-02-14T13:06:50.877771+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:06:50.877771+0000","last_undegraded":"2024-02-14T13:06:50.877771+0000","last_fullsized":"2024-02-14T13:06:50.877771+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877888+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:06:50.877888+0000","last_peered":"2024-02-14T13:06:50.877888+0000","last_clean":"2024-02-14T13:06:50.877888+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:06:50.877888+0000","last_undegraded":"2024-02-14T13:06:50.877888+0000","last_fullsized":"2024-02-14T13:06:50.877888+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:01.914405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877853+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:06:50.877853+0000","last_peered":"2024-02-14T13:06:50.877853+0000","last_clean":"2024-02-14T13:06:50.877853+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:06:50.877853+0000","last_undegraded":"2024-02-14T13:06:50.877853+0000","last_fullsized":"2024-02-14T13:06:50.877853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":340,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813026+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:06:50.813026+0000","last_peered":"2024-02-14T13:06:50.813026+0000","last_clean":"2024-02-14T13:06:50.813026+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:06:50.813026+0000","last_undegraded":"2024-02-14T13:06:50.813026+0000","last_fullsized":"2024-02-14T13:06:50.813026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877819+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:06:50.877819+0000","last_peered":"2024-02-14T13:06:50.877819+0000","last_clean":"2024-02-14T13:06:50.877819+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:06:50.877819+0000","last_undegraded":"2024-02-14T13:06:50.877819+0000","last_fullsized":"2024-02-14T13:06:50.877819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.812936+0000","last_change":"2024-02-14T13:06:48.812095+0000","last_active":"2024-02-14T13:06:50.812936+0000","last_peered":"2024-02-14T13:06:50.812936+0000","last_clean":"2024-02-14T13:06:50.812936+0000","last_became_active":"2024-02-14T13:06:48.811567+0000","last_became_peered":"2024-02-14T13:06:48.811567+0000","last_unstale":"2024-02-14T13:06:50.812936+0000","last_undegraded":"2024-02-14T13:06:50.812936+0000","last_fullsized":"2024-02-14T13:06:50.812936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:31:53.462420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809512+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:06:50.809512+0000","last_peered":"2024-02-14T13:06:50.809512+0000","last_clean":"2024-02-14T13:06:50.809512+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:06:50.809512+0000","last_undegraded":"2024-02-14T13:06:50.809512+0000","last_fullsized":"2024-02-14T13:06:50.809512+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878268+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:06:50.878268+0000","last_peered":"2024-02-14T13:06:50.878268+0000","last_clean":"2024-02-14T13:06:50.878268+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:06:50.878268+0000","last_undegraded":"2024-02-14T13:06:50.878268+0000","last_fullsized":"2024-02-14T13:06:50.878268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:53.798165+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:06:53.798165+0000","last_peered":"2024-02-14T13:06:53.798165+0000","last_clean":"2024-02-14T13:06:53.798165+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:06:53.798165+0000","last_undegraded":"2024-02-14T13:06:53.798165+0000","last_fullsized":"2024-02-14T13:06:53.798165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878283+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:06:50.878283+0000","last_peered":"2024-02-14T13:06:50.878283+0000","last_clean":"2024-02-14T13:06:50.878283+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:06:50.878283+0000","last_undegraded":"2024-02-14T13:06:50.878283+0000","last_fullsized":"2024-02-14T13:06:50.878283+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:11:41.708425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878006+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:06:50.878006+0000","last_peered":"2024-02-14T13:06:50.878006+0000","last_clean":"2024-02-14T13:06:50.878006+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:06:50.878006+0000","last_undegraded":"2024-02-14T13:06:50.878006+0000","last_fullsized":"2024-02-14T13:06:50.878006+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809096+0000","last_change":"2024-02-14T13:06:49.810268+0000","last_active":"2024-02-14T13:06:50.809096+0000","last_peered":"2024-02-14T13:06:50.809096+0000","last_clean":"2024-02-14T13:06:50.809096+0000","last_became_active":"2024-02-14T13:06:49.809434+0000","last_became_peered":"2024-02-14T13:06:49.809434+0000","last_unstale":"2024-02-14T13:06:50.809096+0000","last_undegraded":"2024-02-14T13:06:50.809096+0000","last_fullsized":"2024-02-14T13:06:50.809096+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:46:18.599259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832095+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:06:50.832095+0000","last_peered":"2024-02-14T13:06:50.832095+0000","last_clean":"2024-02-14T13:06:50.832095+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:06:50.832095+0000","last_undegraded":"2024-02-14T13:06:50.832095+0000","last_fullsized":"2024-02-14T13:06:50.832095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809169+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:06:50.809169+0000","last_peered":"2024-02-14T13:06:50.809169+0000","last_clean":"2024-02-14T13:06:50.809169+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:06:50.809169+0000","last_undegraded":"2024-02-14T13:06:50.809169+0000","last_fullsized":"2024-02-14T13:06:50.809169+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877589+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:06:50.877589+0000","last_peered":"2024-02-14T13:06:50.877589+0000","last_clean":"2024-02-14T13:06:50.877589+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:06:50.877589+0000","last_undegraded":"2024-02-14T13:06:50.877589+0000","last_fullsized":"2024-02-14T13:06:50.877589+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878150+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:06:50.878150+0000","last_peered":"2024-02-14T13:06:50.878150+0000","last_clean":"2024-02-14T13:06:50.878150+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:06:50.878150+0000","last_undegraded":"2024-02-14T13:06:50.878150+0000","last_fullsized":"2024-02-14T13:06:50.878150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:09:58.626393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877686+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:06:50.877686+0000","last_peered":"2024-02-14T13:06:50.877686+0000","last_clean":"2024-02-14T13:06:50.877686+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:06:50.877686+0000","last_undegraded":"2024-02-14T13:06:50.877686+0000","last_fullsized":"2024-02-14T13:06:50.877686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878238+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:06:50.878238+0000","last_peered":"2024-02-14T13:06:50.878238+0000","last_clean":"2024-02-14T13:06:50.878238+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:06:50.878238+0000","last_undegraded":"2024-02-14T13:06:50.878238+0000","last_fullsized":"2024-02-14T13:06:50.878238+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:03:06.405049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.809235+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:06:50.809235+0000","last_peered":"2024-02-14T13:06:50.809235+0000","last_clean":"2024-02-14T13:06:50.809235+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:06:50.809235+0000","last_undegraded":"2024-02-14T13:06:50.809235+0000","last_fullsized":"2024-02-14T13:06:50.809235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813309+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:06:50.813309+0000","last_peered":"2024-02-14T13:06:50.813309+0000","last_clean":"2024-02-14T13:06:50.813309+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:06:50.813309+0000","last_undegraded":"2024-02-14T13:06:50.813309+0000","last_fullsized":"2024-02-14T13:06:50.813309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878047+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:06:50.878047+0000","last_peered":"2024-02-14T13:06:50.878047+0000","last_clean":"2024-02-14T13:06:50.878047+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:06:50.878047+0000","last_undegraded":"2024-02-14T13:06:50.878047+0000","last_fullsized":"2024-02-14T13:06:50.878047+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813695+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:06:50.813695+0000","last_peered":"2024-02-14T13:06:50.813695+0000","last_clean":"2024-02-14T13:06:50.813695+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:06:50.813695+0000","last_undegraded":"2024-02-14T13:06:50.813695+0000","last_fullsized":"2024-02-14T13:06:50.813695+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879310+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:06:50.879310+0000","last_peered":"2024-02-14T13:06:50.879310+0000","last_clean":"2024-02-14T13:06:50.879310+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:06:50.879310+0000","last_undegraded":"2024-02-14T13:06:50.879310+0000","last_fullsized":"2024-02-14T13:06:50.879310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:15:32.979424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813273+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:06:50.813273+0000","last_peered":"2024-02-14T13:06:50.813273+0000","last_clean":"2024-02-14T13:06:50.813273+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:06:50.813273+0000","last_undegraded":"2024-02-14T13:06:50.813273+0000","last_fullsized":"2024-02-14T13:06:50.813273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878539+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:06:50.878539+0000","last_peered":"2024-02-14T13:06:50.878539+0000","last_clean":"2024-02-14T13:06:50.878539+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:06:50.878539+0000","last_undegraded":"2024-02-14T13:06:50.878539+0000","last_fullsized":"2024-02-14T13:06:50.878539+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.813522+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:06:50.813522+0000","last_peered":"2024-02-14T13:06:50.813522+0000","last_clean":"2024-02-14T13:06:50.813522+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:06:50.813522+0000","last_undegraded":"2024-02-14T13:06:50.813522+0000","last_fullsized":"2024-02-14T13:06:50.813522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878767+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:06:50.878767+0000","last_peered":"2024-02-14T13:06:50.878767+0000","last_clean":"2024-02-14T13:06:50.878767+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:06:50.878767+0000","last_undegraded":"2024-02-14T13:06:50.878767+0000","last_fullsized":"2024-02-14T13:06:50.878767+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:34:48.890593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878097+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:06:50.878097+0000","last_peered":"2024-02-14T13:06:50.878097+0000","last_clean":"2024-02-14T13:06:50.878097+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:06:50.878097+0000","last_undegraded":"2024-02-14T13:06:50.878097+0000","last_fullsized":"2024-02-14T13:06:50.878097+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:05:53.262774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878374+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:06:50.878374+0000","last_peered":"2024-02-14T13:06:50.878374+0000","last_clean":"2024-02-14T13:06:50.878374+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:06:50.878374+0000","last_undegraded":"2024-02-14T13:06:50.878374+0000","last_fullsized":"2024-02-14T13:06:50.878374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:27:29.251638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.808856+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:06:50.808856+0000","last_peered":"2024-02-14T13:06:50.808856+0000","last_clean":"2024-02-14T13:06:50.808856+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:06:50.808856+0000","last_undegraded":"2024-02-14T13:06:50.808856+0000","last_fullsized":"2024-02-14T13:06:50.808856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878412+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:06:50.878412+0000","last_peered":"2024-02-14T13:06:50.878412+0000","last_clean":"2024-02-14T13:06:50.878412+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:06:50.878412+0000","last_undegraded":"2024-02-14T13:06:50.878412+0000","last_fullsized":"2024-02-14T13:06:50.878412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878482+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:06:50.878482+0000","last_peered":"2024-02-14T13:06:50.878482+0000","last_clean":"2024-02-14T13:06:50.878482+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:06:50.878482+0000","last_undegraded":"2024-02-14T13:06:50.878482+0000","last_fullsized":"2024-02-14T13:06:50.878482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:46:06.005807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878235+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:06:50.878235+0000","last_peered":"2024-02-14T13:06:50.878235+0000","last_clean":"2024-02-14T13:06:50.878235+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:06:50.878235+0000","last_undegraded":"2024-02-14T13:06:50.878235+0000","last_fullsized":"2024-02-14T13:06:50.878235+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:27:21.465567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878089+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:06:50.878089+0000","last_peered":"2024-02-14T13:06:50.878089+0000","last_clean":"2024-02-14T13:06:50.878089+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:06:50.878089+0000","last_undegraded":"2024-02-14T13:06:50.878089+0000","last_fullsized":"2024-02-14T13:06:50.878089+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:41.122395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.879314+0000","last_change":"2024-02-14T13:06:49.819554+0000","last_active":"2024-02-14T13:06:50.879314+0000","last_peered":"2024-02-14T13:06:50.879314+0000","last_clean":"2024-02-14T13:06:50.879314+0000","last_became_active":"2024-02-14T13:06:49.818512+0000","last_became_peered":"2024-02-14T13:06:49.818512+0000","last_unstale":"2024-02-14T13:06:50.879314+0000","last_undegraded":"2024-02-14T13:06:50.879314+0000","last_fullsized":"2024-02-14T13:06:50.879314+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:25:37.709104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.877630+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:06:50.877630+0000","last_peered":"2024-02-14T13:06:50.877630+0000","last_clean":"2024-02-14T13:06:50.877630+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:06:50.877630+0000","last_undegraded":"2024-02-14T13:06:50.877630+0000","last_fullsized":"2024-02-14T13:06:50.877630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:04:06.483820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.832216+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:06:50.832216+0000","last_peered":"2024-02-14T13:06:50.832216+0000","last_clean":"2024-02-14T13:06:50.832216+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:06:50.832216+0000","last_undegraded":"2024-02-14T13:06:50.832216+0000","last_fullsized":"2024-02-14T13:06:50.832216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878378+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:06:50.878378+0000","last_peered":"2024-02-14T13:06:50.878378+0000","last_clean":"2024-02-14T13:06:50.878378+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:06:50.878378+0000","last_undegraded":"2024-02-14T13:06:50.878378+0000","last_fullsized":"2024-02-14T13:06:50.878378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-02-14T13:06:50.878276+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:06:50.878276+0000","last_peered":"2024-02-14T13:06:50.878276+0000","last_clean":"2024-02-14T13:06:50.878276+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:06:50.878276+0000","last_undegraded":"2024-02-14T13:06:50.878276+0000","last_fullsized":"2024-02-14T13:06:50.878276+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:39:46.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38991,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":48,"num_write":60,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":122157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318286,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":445002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":10,"up_from":74,"seq":317827579923,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1073874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.63},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.5},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68400000000000005}]},{"osd":5,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65300000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.841,"5min":1.841,"15min":1.841},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":16.844999999999999,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.82999999999999996}]},{"osd":9,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":9,"up_from":69,"seq":296352743448,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":445584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.441}]},{"osd":4,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69599999999999995}]},{"osd":8,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.64600000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73699999999999999}]}]},{"osd":8,"up_from":61,"seq":261993005084,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":445606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.49099999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72299999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68799999999999994,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":1.038},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71899999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.435,"15min":0.432},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.35499999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64800000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.84599999999999997}]},{"osd":4,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.75800000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.879},{"interface":"front","average":{"1min":0.62,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":1.1020000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74099999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75900000000000001,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.97399999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.92100000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69999999999999996,"15min":0.70399999999999996},"min":{"1min":0.50800000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.85299999999999998,"5min":0.872,"15min":0.872},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68899999999999995,"15min":0.69299999999999995},"min":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.86399999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.1659999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":1.115}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":1.3620000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":7,"up_from":53,"seq":227633266721,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1035952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72699999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.69699999999999995,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.89200000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32400000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39900000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.751,"15min":0.748},"min":{"1min":0.53400000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.745},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":6,"up_from":48,"seq":206158430247,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":445119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.27900000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.3080000000000001,"15min":1.423},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93000000000000005,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95799999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48499999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.46300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.501,"15min":0.49099999999999999},"min":{"1min":0.32700000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":1.3660000000000001,"15min":1.4810000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0169999999999999,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65300000000000002,"15min":0.64800000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:06:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.70199999999999996,"15min":0.69399999999999995},"min":{"1min":0.56000000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.67500000000000004}]},{"osd":8,"last update":"Wed Feb 14 13:06:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.745,"15min":0.752},"min":{"1min":0.51000000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0209999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.622},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.64200000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":978944,"data_stored":483195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48999999999999999,"15min":0.47199999999999998},"min":{"1min":0.34000000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.51700000000000002,"15min":0.48099999999999998},"min":{"1min":0.435,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.52000000000000002},"min":{"1min":0.33000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.93600000000000005}]},{"osd":3,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51900000000000002},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.70899999999999996}]},{"osd":4,"last update":"Wed Feb 14 13:06:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.45700000000000002,"15min":0.44},"min":{"1min":0.33000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.45500000000000002,"15min":0.435},"min":{"1min":0.378,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.75800000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:06:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.39200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.89200000000000002}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.52100000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.80000000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.91300000000000003}]},{"osd":8,"last update":"Wed Feb 14 13:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.05,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51000000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78200000000000003}]},{"osd":9,"last update":"Wed Feb 14 13:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82399999999999995}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.075}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:05:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"min":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.53000000000000003,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.54000000000000004,"15min":0.498},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80800000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.39300000000000002,"15min":0.38200000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Feb 14 13:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.34200000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.79200000000000004,"15min":0.89200000000000002},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.435}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.65900000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:06:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56899999999999995,"15min":0.55700000000000005},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41999999999999998}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92100000000000004,"5min":1.224,"15min":1.224},"last":0.625}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.46500000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.61599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":983040,"data_stored":483229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.504},"min":{"1min":0.36499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:18 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.375,"5min":0.311,"15min":0.311},"max":{"1min":0.71699999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72299999999999998}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.43099999999999999,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.441,"15min":0.42399999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.45600000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:06:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.622,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.81399999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:06:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.78700000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":946176,"data_stored":445340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.318},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.173,"5min":0.52300000000000002,"15min":0.39700000000000002},"min":{"1min":0.29399999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":16.736999999999998,"5min":16.736999999999998,"15min":16.736999999999998},"last":0.29199999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.54100000000000004},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":5.1159999999999997,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Feb 14 13:06:49 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":0.72499999999999998,"15min":0.57099999999999995},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":20.550000000000001,"5min":20.550000000000001,"15min":20.550000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.59899999999999998,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":6.0540000000000003,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed Feb 14 13:06:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.36399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.57699999999999996,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.56699999999999995,"15min":0.53600000000000003},"min":{"1min":0.46800000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51700000000000002,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53100000000000003,"15min":0.51800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.46899999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.38900000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.375},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53600000000000003}]},{"osd":10,"last update":"Wed Feb 14 13:06:36 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.629},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":4,"up_from":35,"seq":150323855409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.39500000000000002,"15min":0.38500000000000001},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.42299999999999999,"15min":0.40300000000000002},"min":{"1min":0.26200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.495}]},{"osd":2,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.621}]},{"osd":3,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56399999999999995,"15min":0.54200000000000004},"min":{"1min":0.435,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.81100000000000005,"15min":0.89100000000000001},"min":{"1min":0.439,"5min":0.314,"15min":0.314},"max":{"1min":3.718,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Feb 14 13:06:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.65400000000000003,"15min":0.627},"min":{"1min":0.56100000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0429999999999999,"5min":6.327,"15min":6.327},"last":0.84099999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:05:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.623,"15min":0.61399999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.79000000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.58799999999999997,"15min":0.57099999999999995},"min":{"1min":0.42999999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.63800000000000001,"15min":0.61199999999999999},"min":{"1min":0.57999999999999996,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77100000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.627,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.88600000000000001}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.747}]},{"osd":10,"last update":"Wed Feb 14 13:06:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":5,"up_from":40,"seq":171798691884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32684,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712468,"statfs":{"total":95995035648,"available":95961567232,"internally_reserved":0,"allocated":1536000,"data_stored":1035552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.36299999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.68300000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67500000000000004}]},{"osd":1,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.378,"15min":0.378},"max":{"1min":0.73099999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75800000000000001,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36799999999999999,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51200000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.371,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.371}]},{"osd":3,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.375,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.745}]},{"osd":4,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.40100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85499999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:05:59 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Feb 14 13:06:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88900000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.505},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.82399999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.621}]},{"osd":8,"last update":"Wed Feb 14 13:06:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.80700000000000005,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77500000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60899999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.76700000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:06:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":38387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:07:00.375 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-14T13:07:00.376 INFO:tasks.cephadm:Setting up client nodes... 2024-02-14T13:07:00.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-14T13:07:00.652 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:01.103 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:00 smithi012 ceph-mon[32370]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:07:01.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:00 smithi103 ceph-mon[36921]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:07:01.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:00 smithi055 ceph-mon[36853]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:07:02.035 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:01 smithi012 ceph-mon[32370]: pgmap v293: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-02-14T13:07:02.224 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:01 smithi103 ceph-mon[36921]: pgmap v293: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-02-14T13:07:02.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 -- 172.21.15.12:0/3885061133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0100c60 msgr2=0x7fcfb0101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:02.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 --2- 172.21.15.12:0/3885061133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0100c60 0x7fcfb0101080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00099c0 tx=0x7fcfa0009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 -- 172.21.15.12:0/3885061133 shutdown_connections 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 --2- 172.21.15.12:0/3885061133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb0102800 0x7fcfb01090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 --2- 172.21.15.12:0/3885061133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0100c60 0x7fcfb0101080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 --2- 172.21.15.12:0/3885061133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0101e60 0x7fcfb01022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 -- 172.21.15.12:0/3885061133 >> 172.21.15.12:0/3885061133 conn(0x7fcfb00fc220 msgr2=0x7fcfb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 -- 172.21.15.12:0/3885061133 shutdown_connections 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 -- 172.21.15.12:0/3885061133 wait complete. 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 Processor -- start 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.281+0000 7fcfb6344700 1 -- start start 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0100c60 0x7fcfb0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 0x7fcfb01981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb0102800 0x7fcfb019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb019f7f0 con 0x7fcfb0101e60 2024-02-14T13:07:02.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb019f930 con 0x7fcfb0100c60 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb019faf0 con 0x7fcfb0102800 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 0x7fcfb01981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 0x7fcfb01981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47480/0 (socket says 172.21.15.12:47480) 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 -- 172.21.15.12:0/875100515 learned_addr learned my addr 172.21.15.12:0/875100515 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb48e1700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb0102800 0x7fcfb019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaffff700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0100c60 0x7fcfb0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 -- 172.21.15.12:0/875100515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb0102800 msgr2=0x7fcfb019f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb0102800 0x7fcfb019f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 -- 172.21.15.12:0/875100515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0100c60 msgr2=0x7fcfb0197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0100c60 0x7fcfb0197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 -- 172.21.15.12:0/875100515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00095f0 con 0x7fcfb0101e60 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaffff700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0100c60 0x7fcfb0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfaf7fe700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 0x7fcfb01981b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400d980 tx=0x7fcfa400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4004220 con 0x7fcfb0101e60 2024-02-14T13:07:02.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb019fdd0 con 0x7fcfb0101e60 2024-02-14T13:07:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fcfa4007640 con 0x7fcfb0101e60 2024-02-14T13:07:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.282+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4005720 con 0x7fcfb0101e60 2024-02-14T13:07:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.283+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb01a0250 con 0x7fcfb0101e60 2024-02-14T13:07:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.284+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb0050230 con 0x7fcfb0101e60 2024-02-14T13:07:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.285+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fcfa400b750 con 0x7fcfb0101e60 2024-02-14T13:07:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.285+0000 7fcfad7fa700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcf980a2290 0x7fcf980a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.286+0000 7fcfaffff700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcf980a2290 0x7fcf980a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.286+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcfa40cdb40 con 0x7fcfb0101e60 2024-02-14T13:07:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.286+0000 7fcfaffff700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcf980a2290 0x7fcf980a4750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00038c0 tx=0x7fcfa0005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:02.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.290+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcfa4096b60 con 0x7fcfb0101e60 2024-02-14T13:07:02.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:01 smithi055 ceph-mon[36853]: pgmap v293: 97 pgs: 97 active+clean; 615 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 5.6 KiB/s wr, 7 op/s 2024-02-14T13:07:02.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.577+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcfb01a0680 con 0x7fcfb0101e60 2024-02-14T13:07:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.580+0000 7fcfad7fa700 1 -- 172.21.15.12:0/875100515 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcfa40160f0 con 0x7fcfb0101e60 2024-02-14T13:07:02.581 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-02-14T13:07:02.581 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD2usxlI256IhAADroNdiOqJvjNrmrmaUDaMA== 2024-02-14T13:07:02.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.581+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcf980a2290 msgr2=0x7fcf980a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:02.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.581+0000 7fcfb6344700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcf980a2290 0x7fcf980a4750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00038c0 tx=0x7fcfa0005fb0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.581+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 msgr2=0x7fcfb01981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.581+0000 7fcfb6344700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 0x7fcfb01981b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400d980 tx=0x7fcfa400dc90 comp rx=0 tx=0).stop 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 shutdown_connections 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb0102800 0x7fcfb019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb0100c60 0x7fcfb0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcf980a2290 0x7fcf980a4750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 --2- 172.21.15.12:0/875100515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb0101e60 0x7fcfb01981b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 >> 172.21.15.12:0/875100515 conn(0x7fcfb00fc220 msgr2=0x7fcfb00fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 shutdown_connections 2024-02-14T13:07:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:02.582+0000 7fcfb6344700 1 -- 172.21.15.12:0/875100515 wait complete. 2024-02-14T13:07:03.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:02 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/875100515' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-14T13:07:03.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:02 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/875100515' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-14T13:07:03.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:02 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/875100515' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-14T13:07:03.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:02 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/875100515' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-14T13:07:03.256 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:07:03.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-14T13:07:03.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-14T13:07:03.301 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-14T13:07:03.301 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-14T13:07:03.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph mgr dump --format=json 2024-02-14T13:07:03.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:02 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/875100515' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-14T13:07:03.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:02 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/875100515' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-14T13:07:03.586 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:03.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:03 smithi012 ceph-mon[32370]: pgmap v294: 97 pgs: 97 active+clean; 620 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-02-14T13:07:04.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:03 smithi103 ceph-mon[36921]: pgmap v294: 97 pgs: 97 active+clean; 620 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-02-14T13:07:04.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:03 smithi055 ceph-mon[36853]: pgmap v294: 97 pgs: 97 active+clean; 620 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-02-14T13:07:05.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 -- 172.21.15.12:0/4253327608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c1043a0 msgr2=0x7fa03c10ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:05.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 --2- 172.21.15.12:0/4253327608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c1043a0 0x7fa03c10ed50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa03400b0d0 tx=0x7fa03400b3e0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 -- 172.21.15.12:0/4253327608 shutdown_connections 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 --2- 172.21.15.12:0/4253327608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c1043a0 0x7fa03c10ed50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 --2- 172.21.15.12:0/4253327608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c06a770 0x7fa03c06ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 --2- 172.21.15.12:0/4253327608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 0x7fa03c103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 -- 172.21.15.12:0/4253327608 >> 172.21.15.12:0/4253327608 conn(0x7fa03c076cc0 msgr2=0x7fa03c0770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 -- 172.21.15.12:0/4253327608 shutdown_connections 2024-02-14T13:07:05.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.242+0000 7fa04115e700 1 -- 172.21.15.12:0/4253327608 wait complete. 2024-02-14T13:07:05.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.243+0000 7fa04115e700 1 Processor -- start 2024-02-14T13:07:05.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.243+0000 7fa04115e700 1 -- start start 2024-02-14T13:07:05.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.243+0000 7fa04115e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 0x7fa03c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:05.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.243+0000 7fa04115e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 0x7fa03c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:05.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.243+0000 7fa04115e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c1043a0 0x7fa03c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:05.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.243+0000 7fa04115e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c19f630 con 0x7fa03c06a770 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa04115e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c19f7a0 con 0x7fa03c1043a0 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa04115e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c19f960 con 0x7fa03c1039e0 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 0x7fa03c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 0x7fa03c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44626/0 (socket says 172.21.15.12:44626) 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 -- 172.21.15.12:0/3433885214 learned_addr learned my addr 172.21.15.12:0/3433885214 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03a59c700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 0x7fa03c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03b59e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c1043a0 0x7fa03c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 -- 172.21.15.12:0/3433885214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 msgr2=0x7fa03c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 0x7fa03c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 -- 172.21.15.12:0/3433885214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c1043a0 msgr2=0x7fa03c19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c1043a0 0x7fa03c19f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 -- 172.21.15.12:0/3433885214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009d00 con 0x7fa03c06a770 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03b59e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c1043a0 0x7fa03c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03a59c700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 0x7fa03c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:05.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa03ad9d700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 0x7fa03c19a750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00d950 tx=0x7fa02c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:05.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c009b40 con 0x7fa03c06a770 2024-02-14T13:07:05.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa02c009ca0 con 0x7fa03c06a770 2024-02-14T13:07:05.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c19fc40 con 0x7fa03c06a770 2024-02-14T13:07:05.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00f6b0 con 0x7fa03c06a770 2024-02-14T13:07:05.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.244+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c1a74a0 con 0x7fa03c06a770 2024-02-14T13:07:05.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.245+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0689e0 con 0x7fa03c06a770 2024-02-14T13:07:05.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.246+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fa02c010460 con 0x7fa03c06a770 2024-02-14T13:07:05.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.247+0000 7fa023fff700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa0240a2260 0x7fa0240a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:05.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.247+0000 7fa03a59c700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa0240a2260 0x7fa0240a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:05.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.247+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa02c0cdfa0 con 0x7fa03c06a770 2024-02-14T13:07:05.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.247+0000 7fa03a59c700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa0240a2260 0x7fa0240a4720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa03c102db0 tx=0x7fa030008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:05.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.251+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa02c096fc0 con 0x7fa03c06a770 2024-02-14T13:07:05.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.518+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa03c111fd0 con 0x7fa03c06a770 2024-02-14T13:07:05.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.523+0000 7fa023fff700 1 -- 172.21.15.12:0/3433885214 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+261483 (secure 0 0 0) 0x7fa02c09a680 con 0x7fa03c06a770 2024-02-14T13:07:05.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa0240a2260 msgr2=0x7fa0240a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa0240a2260 0x7fa0240a4720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa03c102db0 tx=0x7fa030008040 comp rx=0 tx=0).stop 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 msgr2=0x7fa03c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 0x7fa03c19a750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00d950 tx=0x7fa02c00dd10 comp rx=0 tx=0).stop 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 shutdown_connections 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c1043a0 0x7fa03c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa0240a2260 0x7fa0240a4720 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa03c06a770 0x7fa03c19a750 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 --2- 172.21.15.12:0/3433885214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa03c1039e0 0x7fa03c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 >> 172.21.15.12:0/3433885214 conn(0x7fa03c076cc0 msgr2=0x7fa03c10d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 shutdown_connections 2024-02-14T13:07:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:05.526+0000 7fa04115e700 1 -- 172.21.15.12:0/3433885214 wait complete. 2024-02-14T13:07:06.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:05 smithi012 ceph-mon[32370]: pgmap v295: 97 pgs: 97 active+clean; 620 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-14T13:07:06.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:05 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3433885214' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-14T13:07:06.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:05 smithi103 ceph-mon[36921]: pgmap v295: 97 pgs: 97 active+clean; 620 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-14T13:07:06.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:05 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3433885214' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-14T13:07:06.254 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1684027624},{"type":"v1","addr":"172.21.15.12:6801","nonce":1684027624}]},"active_addr":"172.21.15.12:6801/1684027624","active_change":"2024-02-14T12:59:48.272238+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.12:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3292141252}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":718192834}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":527314931}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3929135111}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2749720122}]}]} 2024-02-14T13:07:06.259 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-14T13:07:06.259 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-14T13:07:06.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-14T13:07:06.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:05 smithi055 ceph-mon[36853]: pgmap v295: 97 pgs: 97 active+clean; 620 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-14T13:07:06.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:05 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3433885214' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-14T13:07:06.502 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:08.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 -- 172.21.15.12:0/2814060879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760102760 msgr2=0x7f876010ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 --2- 172.21.15.12:0/2814060879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760102760 0x7f876010ebc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f875800b0a0 tx=0x7f875800b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 -- 172.21.15.12:0/2814060879 shutdown_connections 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 --2- 172.21.15.12:0/2814060879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760102760 0x7f876010ebc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 --2- 172.21.15.12:0/2814060879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8760107e80 0x7f8760108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 --2- 172.21.15.12:0/2814060879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8760101da0 0x7f8760102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 -- 172.21.15.12:0/2814060879 >> 172.21.15.12:0/2814060879 conn(0x7f8760078de0 msgr2=0x7f87600791f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 -- 172.21.15.12:0/2814060879 shutdown_connections 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.115+0000 7f876697c700 1 -- 172.21.15.12:0/2814060879 wait complete. 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 Processor -- start 2024-02-14T13:07:08.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 -- start start 2024-02-14T13:07:08.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 0x7f8760198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:08.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8760102760 0x7f8760198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8760107e80 0x7f876019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876019d120 con 0x7f8760101da0 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876019d290 con 0x7f8760107e80 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f876697c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876019d450 con 0x7f8760102760 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f875ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 0x7f8760198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f875ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 0x7f8760198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44648/0 (socket says 172.21.15.12:44648) 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f875ffff700 1 -- 172.21.15.12:0/1807268270 learned_addr learned my addr 172.21.15.12:0/1807268270 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f875f7fe700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8760102760 0x7f8760198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.116+0000 7f8764f19700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8760107e80 0x7f876019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875ffff700 1 -- 172.21.15.12:0/1807268270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8760102760 msgr2=0x7f8760198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875ffff700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8760102760 0x7f8760198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875ffff700 1 -- 172.21.15.12:0/1807268270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8760107e80 msgr2=0x7f876019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:08.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875ffff700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8760107e80 0x7f876019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875ffff700 1 -- 172.21.15.12:0/1807268270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758009d00 con 0x7f8760101da0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875ffff700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 0x7f8760198240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f875000c9b0 tx=0x7f875000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750007b00 con 0x7f8760101da0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876019d730 con 0x7f8760101da0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f875000ce50 con 0x7f8760101da0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750018660 con 0x7f8760101da0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.117+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87601a4f90 con 0x7f8760101da0 2024-02-14T13:07:08.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.118+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87600689e0 con 0x7f8760101da0 2024-02-14T13:07:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.119+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f875000f450 con 0x7f8760101da0 2024-02-14T13:07:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.120+0000 7f875d7fa700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f87480a21e0 0x7f87480a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.120+0000 7f875f7fe700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f87480a21e0 0x7f87480a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.120+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f87500cdb50 con 0x7f8760101da0 2024-02-14T13:07:08.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.120+0000 7f875f7fe700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f87480a21e0 0x7f87480a46a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8760079200 tx=0x7f875400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:08.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.124+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8750096b70 con 0x7f8760101da0 2024-02-14T13:07:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:07 smithi012 ceph-mon[32370]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-02-14T13:07:08.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:07 smithi103 ceph-mon[36921]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-02-14T13:07:08.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:07 smithi055 ceph-mon[36853]: pgmap v296: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-02-14T13:07:08.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.328+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8760111e10 con 0x7f8760101da0 2024-02-14T13:07:08.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.329+0000 7f875d7fa700 1 -- 172.21.15.12:0/1807268270 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22110 (secure 0 0 0) 0x7f8750083e60 con 0x7f8760101da0 2024-02-14T13:07:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:07:08.332 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:50.799671+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:07:08.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f87480a21e0 msgr2=0x7f87480a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:08.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f87480a21e0 0x7f87480a46a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8760079200 tx=0x7f875400b410 comp rx=0 tx=0).stop 2024-02-14T13:07:08.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 msgr2=0x7f8760198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:08.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 0x7f8760198240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f875000c9b0 tx=0x7f875000ccc0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 shutdown_connections 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8760107e80 0x7f876019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f87480a21e0 0x7f87480a46a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8760101da0 0x7f8760198240 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 --2- 172.21.15.12:0/1807268270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8760102760 0x7f8760198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 >> 172.21.15.12:0/1807268270 conn(0x7f8760078de0 msgr2=0x7f8760100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 shutdown_connections 2024-02-14T13:07:08.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:08.333+0000 7f876697c700 1 -- 172.21.15.12:0/1807268270 wait complete. 2024-02-14T13:07:08.961 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-14T13:07:08.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-14T13:07:09.208 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:09.216 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:08 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1807268270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:07:09.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:08 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1807268270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:07:09.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:08 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1807268270' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:07:10.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:09 smithi012 ceph-mon[32370]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-14T13:07:10.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:09 smithi103 ceph-mon[36921]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-14T13:07:10.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:09 smithi055 ceph-mon[36853]: pgmap v297: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-14T13:07:10.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 -- 172.21.15.12:0/533522726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190105f40 msgr2=0x7fa19010db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:10.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 --2- 172.21.15.12:0/533522726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190105f40 0x7fa19010db10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa18000b0a0 tx=0x7fa18000b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:10.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 -- 172.21.15.12:0/533522726 shutdown_connections 2024-02-14T13:07:10.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 --2- 172.21.15.12:0/533522726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190105f40 0x7fa19010db10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 --2- 172.21.15.12:0/533522726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190100eb0 0x7fa190101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 --2- 172.21.15.12:0/533522726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa190101860 0x7fa190105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 -- 172.21.15.12:0/533522726 >> 172.21.15.12:0/533522726 conn(0x7fa190076c40 msgr2=0x7fa190077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 -- 172.21.15.12:0/533522726 shutdown_connections 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.874+0000 7fa194a88700 1 -- 172.21.15.12:0/533522726 wait complete. 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 Processor -- start 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 -- start start 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190100eb0 0x7fa190102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa190101860 0x7fa190102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 0x7fa190103380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:10.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901a67c0 con 0x7fa190100eb0 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901a6930 con 0x7fa190105f40 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.875+0000 7fa194a88700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1901a6af0 con 0x7fa190101860 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 0x7fa190103380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 0x7fa190103380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.12:36658/0 (socket says 172.21.15.12:36658) 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 -- 172.21.15.12:0/3502602284 learned_addr learned my addr 172.21.15.12:0/3502602284 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190100eb0 0x7fa190102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18dd9b700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa190101860 0x7fa190102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 -- 172.21.15.12:0/3502602284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa190101860 msgr2=0x7fa190102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa190101860 0x7fa190102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 -- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190100eb0 msgr2=0x7fa190102900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190100eb0 0x7fa190102900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:10.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 -- 172.21.15.12:0/3502602284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009d00 con 0x7fa190105f40 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18e59c700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190100eb0 0x7fa190102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa18ed9d700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 0x7fa190103380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa18000b070 tx=0x7fa180004e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18000e040 con 0x7fa190105f40 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.876+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1901a6d70 con 0x7fa190105f40 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.877+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1901a7230 con 0x7fa190105f40 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.877+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa180007850 con 0x7fa190105f40 2024-02-14T13:07:10.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.877+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800267d0 con 0x7fa190105f40 2024-02-14T13:07:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.878+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19010a150 con 0x7fa190105f40 2024-02-14T13:07:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.879+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fa18001d9f0 con 0x7fa190105f40 2024-02-14T13:07:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.879+0000 7fa1877fe700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a21e0 0x7fa17c0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.879+0000 7fa18e59c700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a21e0 0x7fa17c0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.879+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa1800cf3e0 con 0x7fa190105f40 2024-02-14T13:07:10.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.880+0000 7fa18e59c700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a21e0 0x7fa17c0a46a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa188005950 tx=0x7fa18800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:10.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:10.884+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa180098460 con 0x7fa190105f40 2024-02-14T13:07:11.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.085+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa190103de0 con 0x7fa190105f40 2024-02-14T13:07:11.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.087+0000 7fa1877fe700 1 -- 172.21.15.12:0/3502602284 <== mon.2 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22110 (secure 0 0 0) 0x7fa18009bb20 con 0x7fa190105f40 2024-02-14T13:07:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:07:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":87,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:06:50.799671+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:07:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a21e0 msgr2=0x7fa17c0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a21e0 0x7fa17c0a46a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa188005950 tx=0x7fa18800b410 comp rx=0 tx=0).stop 2024-02-14T13:07:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 msgr2=0x7fa190103380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 0x7fa190103380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa18000b070 tx=0x7fa180004e40 comp rx=0 tx=0).stop 2024-02-14T13:07:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 shutdown_connections 2024-02-14T13:07:11.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa190105f40 0x7fa190103380 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a21e0 0x7fa17c0a46a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa190100eb0 0x7fa190102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 --2- 172.21.15.12:0/3502602284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa190101860 0x7fa190102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 >> 172.21.15.12:0/3502602284 conn(0x7fa190076c40 msgr2=0x7fa19006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 shutdown_connections 2024-02-14T13:07:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:11.090+0000 7fa194a88700 1 -- 172.21.15.12:0/3502602284 wait complete. 2024-02-14T13:07:11.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-14T13:07:11.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-14T13:07:11.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-14T13:07:11.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-14T13:07:11.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-14T13:07:11.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-14T13:07:11.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-14T13:07:11.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-14T13:07:11.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-02-14T13:07:11.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-02-14T13:07:11.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-02-14T13:07:11.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-02-14T13:07:11.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:11 smithi103 ceph-mon[36921]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-14T13:07:11.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:11 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3502602284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:07:12.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:11 smithi012 ceph-mon[32370]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-14T13:07:12.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:11 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3502602284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:07:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:11 smithi055 ceph-mon[36853]: pgmap v298: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-14T13:07:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:11 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3502602284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:07:12.628 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.633 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.633 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.634 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.634 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:12.949 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:13.136 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:13.138 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:14.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:13 smithi012 ceph-mon[32370]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-02-14T13:07:14.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:13 smithi103 ceph-mon[36921]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-02-14T13:07:14.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:13 smithi055 ceph-mon[36853]: pgmap v299: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-02-14T13:07:16.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:15 smithi012 ceph-mon[32370]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-14T13:07:16.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:15 smithi103 ceph-mon[36921]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-14T13:07:16.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:15 smithi055 ceph-mon[36853]: pgmap v300: 97 pgs: 97 active+clean; 636 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-14T13:07:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:17 smithi012 ceph-mon[32370]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-02-14T13:07:18.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:17 smithi103 ceph-mon[36921]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-02-14T13:07:18.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:17 smithi055 ceph-mon[36853]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.8 KiB/s wr, 3 op/s 2024-02-14T13:07:19.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 -- 172.21.15.12:0/3063344403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8107040 msgr2=0x7fcae810ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:19.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 --2- 172.21.15.12:0/3063344403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8107040 0x7fcae810ec10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcae000b0a0 tx=0x7fcae000b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 -- 172.21.15.12:0/3063344403 shutdown_connections 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 --2- 172.21.15.12:0/3063344403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8107040 0x7fcae810ec10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 --2- 172.21.15.12:0/3063344403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcae8101f60 0x7fcae8102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 --2- 172.21.15.12:0/3063344403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae8102910 0x7fcae8106960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 -- 172.21.15.12:0/3063344403 >> 172.21.15.12:0/3063344403 conn(0x7fcae80fd7d0 msgr2=0x7fcae80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 -- 172.21.15.12:0/3063344403 shutdown_connections 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 -- 172.21.15.12:0/3063344403 wait complete. 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 Processor -- start 2024-02-14T13:07:19.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.785+0000 7fcaee298700 1 -- start start 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaee298700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae8101f60 0x7fcae8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaee298700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8102910 0x7fcae81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaee298700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcae8107040 0x7fcae819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaee298700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819d1f0 con 0x7fcae8102910 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaee298700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819d360 con 0x7fcae8107040 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaee298700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819d520 con 0x7fcae8101f60 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8102910 0x7fcae81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8102910 0x7fcae81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52402/0 (socket says 172.21.15.12:52402) 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 -- 172.21.15.12:0/2768292997 learned_addr learned my addr 172.21.15.12:0/2768292997 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:19.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae7fff700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae8101f60 0x7fcae8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaec835700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcae8107040 0x7fcae819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 -- 172.21.15.12:0/2768292997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae8101f60 msgr2=0x7fcae8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcae8101f60 0x7fcae8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 -- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcae8107040 msgr2=0x7fcae819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcae8107040 0x7fcae819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcae77fe700 1 -- 172.21.15.12:0/2768292997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009d00 con 0x7fcae8102910 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.786+0000 7fcaec835700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcae8107040 0x7fcae819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.787+0000 7fcae77fe700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8102910 0x7fcae81988a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00d950 tx=0x7fcadc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.787+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc004a30 con 0x7fcae8102910 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.787+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae819d800 con 0x7fcae8102910 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.787+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fcadc005500 con 0x7fcae8102910 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.787+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae81a5060 con 0x7fcae8102910 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.787+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc009c90 con 0x7fcae8102910 2024-02-14T13:07:19.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.788+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcae8103440 con 0x7fcae8102910 2024-02-14T13:07:19.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.790+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fcadc005000 con 0x7fcae8102910 2024-02-14T13:07:19.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae57fa700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcad00a2260 0x7fcad00a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae7fff700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcad00a2260 0x7fcad00a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcadc0cdae0 con 0x7fcae8102910 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae57fa700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] conn(0x7fcad00aba40 0x7fcad00ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 --> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcad00ae510 con 0x7fcad00aba40 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcadc0cde50 con 0x7fcae8102910 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcae7fff700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcad00a2260 0x7fcad00a4720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005950 tx=0x7fcad800b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.791+0000 7fcaec835700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] conn(0x7fcad00aba40 0x7fcad00ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.792+0000 7fcaec835700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] conn(0x7fcad00aba40 0x7fcad00ade60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.793+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== osd.7 v2:172.21.15.55:6816/4145865981 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcad00ae510 con 0x7fcad00aba40 2024-02-14T13:07:19.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.810+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 --> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcae81120c0 con 0x7fcad00aba40 2024-02-14T13:07:19.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcae57fa700 1 -- 172.21.15.12:0/2768292997 <== osd.7 v2:172.21.15.55:6816/4145865981 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcae81120c0 con 0x7fcad00aba40 2024-02-14T13:07:19.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] conn(0x7fcad00aba40 msgr2=0x7fcad00ade60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:19.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] conn(0x7fcad00aba40 0x7fcad00ade60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:19.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcad00a2260 msgr2=0x7fcad00a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:19.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcad00a2260 0x7fcad00a4720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005950 tx=0x7fcad800b410 comp rx=0 tx=0).stop 2024-02-14T13:07:19.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8102910 msgr2=0x7fcae81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:19.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 --2- 172.21.15.12:0/2768292997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcae8102910 0x7fcae81988a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00d950 tx=0x7fcadc00dc60 comp rx=0 tx=0).stop 2024-02-14T13:07:19.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaec835700 1 -- 172.21.15.12:0/2768292997 reap_dead start 2024-02-14T13:07:19.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 shutdown_connections 2024-02-14T13:07:19.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 >> 172.21.15.12:0/2768292997 conn(0x7fcae80fd7d0 msgr2=0x7fcae80ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:19.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 shutdown_connections 2024-02-14T13:07:19.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:19.811+0000 7fcaee298700 1 -- 172.21.15.12:0/2768292997 wait complete. 2024-02-14T13:07:20.054 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:19 smithi012 ceph-mon[32370]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:20.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:19 smithi103 ceph-mon[36921]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:20.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:19 smithi055 ceph-mon[36853]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:21.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.572+0000 7f29b49fd700 1 -- 172.21.15.12:0/2259498533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 msgr2=0x7f29b010ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:21.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.572+0000 7f29b49fd700 1 --2- 172.21.15.12:0/2259498533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b010ebe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f29a80099c0 tx=0x7f29a8009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 -- 172.21.15.12:0/2259498533 shutdown_connections 2024-02-14T13:07:21.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 --2- 172.21.15.12:0/2259498533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b010ebe0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 --2- 172.21.15.12:0/2259498533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b0107da0 0x7f29b0108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 --2- 172.21.15.12:0/2259498533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b006a420 0x7f29b006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 -- 172.21.15.12:0/2259498533 >> 172.21.15.12:0/2259498533 conn(0x7f29b0076c40 msgr2=0x7f29b0077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 -- 172.21.15.12:0/2259498533 shutdown_connections 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 -- 172.21.15.12:0/2259498533 wait complete. 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 Processor -- start 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.573+0000 7f29b49fd700 1 -- start start 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b006a420 0x7f29b0198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b0107da0 0x7f29b019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b019d010 con 0x7f29b006adc0 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b019d180 con 0x7f29b0107da0 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b019d340 con 0x7f29b006a420 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b0198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52414/0 (socket says 172.21.15.12:52414) 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 -- 172.21.15.12:0/1487325893 learned_addr learned my addr 172.21.15.12:0/1487325893 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:21.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29aed9d700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b0107da0 0x7f29b019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29ae59c700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b006a420 0x7f29b0198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 -- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b006a420 msgr2=0x7f29b0198130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b006a420 0x7f29b0198130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 -- 172.21.15.12:0/1487325893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b0107da0 msgr2=0x7f29b019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29b0107da0 0x7f29b019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 -- 172.21.15.12:0/1487325893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80095f0 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29add9b700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b0198670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f299800c9b0 tx=0x7f299800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998007b00 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b019d620 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2998007c60 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998018660 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.574+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b01a4e80 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.575+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29b0112090 con 0x7f29b006adc0 2024-02-14T13:07:21.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.576+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f299800f450 con 0x7f29b006adc0 2024-02-14T13:07:21.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29a77fe700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f299c0a21e0 0x7f299c0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29ae59c700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f299c0a21e0 0x7f299c0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f29980ce1f0 con 0x7f29b006adc0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29a77fe700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] conn(0x7f299c0ab9c0 0x7f299c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 --> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f299c0ae490 con 0x7f299c0ab9c0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29980ce560 con 0x7f29b006adc0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29aed9d700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] conn(0x7f299c0ab9c0 0x7f299c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.577+0000 7f29ae59c700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f299c0a21e0 0x7f299c0a46a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009c90 tx=0x7f29a0009040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.578+0000 7f29aed9d700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] conn(0x7f299c0ab9c0 0x7f299c0adde0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:21.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.579+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== osd.5 v2:172.21.15.103:6808/67358017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f299c0ae490 con 0x7f299c0ab9c0 2024-02-14T13:07:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.596+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 --> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29b00623b0 con 0x7f299c0ab9c0 2024-02-14T13:07:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29a77fe700 1 -- 172.21.15.12:0/1487325893 <== osd.5 v2:172.21.15.103:6808/67358017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f29b00623b0 con 0x7f299c0ab9c0 2024-02-14T13:07:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] conn(0x7f299c0ab9c0 msgr2=0x7f299c0adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] conn(0x7f299c0ab9c0 0x7f299c0adde0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f299c0a21e0 msgr2=0x7f299c0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f299c0a21e0 0x7f299c0a46a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009c90 tx=0x7f29a0009040 comp rx=0 tx=0).stop 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 msgr2=0x7f29b0198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 --2- 172.21.15.12:0/1487325893 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b006adc0 0x7f29b0198670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f299800c9b0 tx=0x7f299800ccc0 comp rx=0 tx=0).stop 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29aed9d700 1 -- 172.21.15.12:0/1487325893 reap_dead start 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 shutdown_connections 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 >> 172.21.15.12:0/1487325893 conn(0x7f29b0076c40 msgr2=0x7f29b00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 shutdown_connections 2024-02-14T13:07:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:21.597+0000 7f29b49fd700 1 -- 172.21.15.12:0/1487325893 wait complete. 2024-02-14T13:07:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:21 smithi012 ceph-mon[32370]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:22.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:21 smithi103 ceph-mon[36921]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:22.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:21 smithi055 ceph-mon[36853]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:24.143 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:23 smithi012 ceph-mon[32370]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:07:24.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:23 smithi103 ceph-mon[36921]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:07:24.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:23 smithi055 ceph-mon[36853]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:07:24.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 -- 172.21.15.12:0/421776878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60105f40 msgr2=0x7fbf6010db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:24.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 --2- 172.21.15.12:0/421776878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60105f40 0x7fbf6010db10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800b0a0 tx=0x7fbf5800b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 -- 172.21.15.12:0/421776878 shutdown_connections 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 --2- 172.21.15.12:0/421776878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60105f40 0x7fbf6010db10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 --2- 172.21.15.12:0/421776878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf60100eb0 0x7fbf60101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 --2- 172.21.15.12:0/421776878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf60101860 0x7fbf60105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 -- 172.21.15.12:0/421776878 >> 172.21.15.12:0/421776878 conn(0x7fbf60076c40 msgr2=0x7fbf60077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 -- 172.21.15.12:0/421776878 shutdown_connections 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.597+0000 7fbf6580b700 1 -- 172.21.15.12:0/421776878 wait complete. 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.598+0000 7fbf6580b700 1 Processor -- start 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.598+0000 7fbf6580b700 1 -- start start 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf60100eb0 0x7fbf601984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60101860 0x7fbf601989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf60105f40 0x7fbf6019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6019d380 con 0x7fbf60101860 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6019d4f0 con 0x7fbf60105f40 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6019d6b0 con 0x7fbf60100eb0 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60101860 0x7fbf601989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60101860 0x7fbf601989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35186/0 (socket says 172.21.15.12:35186) 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 -- 172.21.15.12:0/562583358 learned_addr learned my addr 172.21.15.12:0/562583358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5effd700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf60100eb0 0x7fbf601984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 -- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf60100eb0 msgr2=0x7fbf601984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf60100eb0 0x7fbf601984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 -- 172.21.15.12:0/562583358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf60105f40 msgr2=0x7fbf6019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5f7fe700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf60105f40 0x7fbf6019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf60105f40 0x7fbf6019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 -- 172.21.15.12:0/562583358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009d00 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5effd700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf60100eb0 0x7fbf601984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf5e7fc700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60101860 0x7fbf601989e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b500 tx=0x7fbf5400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54011830 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fbf54011e70 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400f2e0 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6019d990 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.599+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf601a51f0 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.600+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf60102340 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.601+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fbf54010610 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf64809700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbf480a21e0 0x7fbf480a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf5effd700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbf480a21e0 0x7fbf480a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbf540cdd50 con 0x7fbf60101860 2024-02-14T13:07:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf64809700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] conn(0x7fbf480ab9c0 0x7fbf480adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 --> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf480ae490 con 0x7fbf480ab9c0 2024-02-14T13:07:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf540ce0c0 con 0x7fbf60101860 2024-02-14T13:07:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.602+0000 7fbf5effd700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbf480a21e0 0x7fbf480a46a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf50007900 tx=0x7fbf50008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.603+0000 7fbf5f7fe700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] conn(0x7fbf480ab9c0 0x7fbf480adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.603+0000 7fbf5f7fe700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] conn(0x7fbf480ab9c0 0x7fbf480adde0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.604+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== osd.2 v2:172.21.15.103:6800/3794024283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbf480ae490 con 0x7fbf480ab9c0 2024-02-14T13:07:24.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 --> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf601121a0 con 0x7fbf480ab9c0 2024-02-14T13:07:24.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf64809700 1 -- 172.21.15.12:0/562583358 <== osd.2 v2:172.21.15.103:6800/3794024283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf601121a0 con 0x7fbf480ab9c0 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] conn(0x7fbf480ab9c0 msgr2=0x7fbf480adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] conn(0x7fbf480ab9c0 0x7fbf480adde0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbf480a21e0 msgr2=0x7fbf480a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbf480a21e0 0x7fbf480a46a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbf50007900 tx=0x7fbf50008040 comp rx=0 tx=0).stop 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60101860 msgr2=0x7fbf601989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 --2- 172.21.15.12:0/562583358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf60101860 0x7fbf601989e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b500 tx=0x7fbf5400b8c0 comp rx=0 tx=0).stop 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf5f7fe700 1 -- 172.21.15.12:0/562583358 reap_dead start 2024-02-14T13:07:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.622+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 shutdown_connections 2024-02-14T13:07:24.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.623+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 >> 172.21.15.12:0/562583358 conn(0x7fbf60076c40 msgr2=0x7fbf600fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:24.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.623+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 shutdown_connections 2024-02-14T13:07:24.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:24.623+0000 7fbf6580b700 1 -- 172.21.15.12:0/562583358 wait complete. 2024-02-14T13:07:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 -- 172.21.15.12:0/3062053029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0101d70 msgr2=0x7f07a01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 --2- 172.21.15.12:0/3062053029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0101d70 0x7f07a01021f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f078c0099c0 tx=0x7f078c009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 -- 172.21.15.12:0/3062053029 shutdown_connections 2024-02-14T13:07:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 --2- 172.21.15.12:0/3062053029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a0102730 0x7f07a010eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 --2- 172.21.15.12:0/3062053029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0107d50 0x7f07a0108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 --2- 172.21.15.12:0/3062053029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0101d70 0x7f07a01021f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 -- 172.21.15.12:0/3062053029 >> 172.21.15.12:0/3062053029 conn(0x7f07a0078e50 msgr2=0x7f07a0079260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 -- 172.21.15.12:0/3062053029 shutdown_connections 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.204+0000 7f07a6afb700 1 -- 172.21.15.12:0/3062053029 wait complete. 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 Processor -- start 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 -- start start 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0101d70 0x7f07a0198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a0102730 0x7f07a0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0107d50 0x7f07a019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a019d0d0 con 0x7f07a0107d50 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a019d240 con 0x7f07a0101d70 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a6afb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a019d400 con 0x7f07a0102730 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0107d50 0x7f07a019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0107d50 0x7f07a019cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35192/0 (socket says 172.21.15.12:35192) 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 -- 172.21.15.12:0/2315817006 learned_addr learned my addr 172.21.15.12:0/2315817006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a4897700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0101d70 0x7f07a0198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f079ffff700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a0102730 0x7f07a0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 -- 172.21.15.12:0/2315817006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a0102730 msgr2=0x7f07a0198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a0102730 0x7f07a0198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 -- 172.21.15.12:0/2315817006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0101d70 msgr2=0x7f07a0198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07a0101d70 0x7f07a0198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.205+0000 7f07a5098700 1 -- 172.21.15.12:0/2315817006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0095f0 con 0x7f07a0107d50 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.206+0000 7f07a5098700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0107d50 0x7f07a019cac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0798007ee0 tx=0x7f079800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.206+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798017070 con 0x7f07a0107d50 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.206+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a019d6e0 con 0x7f07a0107d50 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.206+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f079800f040 con 0x7f07a0107d50 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.206+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798005650 con 0x7f07a0107d50 2024-02-14T13:07:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.206+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a01a4f40 con 0x7f07a0107d50 2024-02-14T13:07:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.207+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f07a0112020 con 0x7f07a0107d50 2024-02-14T13:07:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.208+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f0798004cd0 con 0x7f07a0107d50 2024-02-14T13:07:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.208+0000 7f079dffb700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f07900a21e0 0x7f07900a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f07a4897700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f07900a21e0 0x7f07900a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f07980cdb70 con 0x7f07a0107d50 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f079dffb700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] conn(0x7f07900ab9c0 0x7f07900adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 --> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f07900ae490 con 0x7f07900ab9c0 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07980cdee0 con 0x7f07a0107d50 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f079ffff700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] conn(0x7f07900ab9c0 0x7f07900adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f07a4897700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f07900a21e0 0x7f07900a46a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0794005950 tx=0x7f079400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.209+0000 7f079ffff700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] conn(0x7f07900ab9c0 0x7f07900adde0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.210+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== osd.9 v2:172.21.15.12:6826/4020892296 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f07900ae490 con 0x7f07900ab9c0 2024-02-14T13:07:25.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.226+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 --> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f07a0062430 con 0x7f07900ab9c0 2024-02-14T13:07:25.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.226+0000 7f079dffb700 1 -- 172.21.15.12:0/2315817006 <== osd.9 v2:172.21.15.12:6826/4020892296 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f07a0062430 con 0x7f07900ab9c0 2024-02-14T13:07:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] conn(0x7f07900ab9c0 msgr2=0x7f07900adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] conn(0x7f07900ab9c0 0x7f07900adde0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f07900a21e0 msgr2=0x7f07900a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f07900a21e0 0x7f07900a46a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0794005950 tx=0x7f079400b410 comp rx=0 tx=0).stop 2024-02-14T13:07:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0107d50 msgr2=0x7f07a019cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:25.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 --2- 172.21.15.12:0/2315817006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07a0107d50 0x7f07a019cac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0798007ee0 tx=0x7f079800d3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a5098700 1 -- 172.21.15.12:0/2315817006 reap_dead start 2024-02-14T13:07:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 shutdown_connections 2024-02-14T13:07:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 >> 172.21.15.12:0/2315817006 conn(0x7f07a0078e50 msgr2=0x7f07a0100980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 shutdown_connections 2024-02-14T13:07:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.227+0000 7f07a6afb700 1 -- 172.21.15.12:0/2315817006 wait complete. 2024-02-14T13:07:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:26.067 INFO:teuthology.orchestra.run.smithi012.stdout:171798691890 2024-02-14T13:07:26.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.415+0000 7fce51e2d700 1 -- 172.21.15.12:0/29067253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c107e70 msgr2=0x7fce4c108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.415+0000 7fce51e2d700 1 --2- 172.21.15.12:0/29067253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c107e70 0x7fce4c108250 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0099c0 tx=0x7fce3c009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 -- 172.21.15.12:0/29067253 shutdown_connections 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 --2- 172.21.15.12:0/29067253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c100c30 0x7fce4c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 --2- 172.21.15.12:0/29067253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c107e70 0x7fce4c108250 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 --2- 172.21.15.12:0/29067253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce4c100270 0x7fce4c1006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 -- 172.21.15.12:0/29067253 >> 172.21.15.12:0/29067253 conn(0x7fce4c0771f0 msgr2=0x7fce4c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 -- 172.21.15.12:0/29067253 shutdown_connections 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 -- 172.21.15.12:0/29067253 wait complete. 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 Processor -- start 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.416+0000 7fce51e2d700 1 -- start start 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c100270 0x7fce4c101450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce4c100c30 0x7fce4c101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c107e70 0x7fce4c101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1033f0 con 0x7fce4c100270 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1aace0 con 0x7fce4c107e70 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1aae70 con 0x7fce4c100c30 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c100270 0x7fce4c101450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c100270 0x7fce4c101450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35224/0 (socket says 172.21.15.12:35224) 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 -- 172.21.15.12:0/3763031762 learned_addr learned my addr 172.21.15.12:0/3763031762 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:26.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4affd700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce4c100c30 0x7fce4c101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4bfff700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c107e70 0x7fce4c101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 -- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce4c100c30 msgr2=0x7fce4c101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce4c100c30 0x7fce4c101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 -- 172.21.15.12:0/3763031762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c107e70 msgr2=0x7fce4c101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce4c107e70 0x7fce4c101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 -- 172.21.15.12:0/3763031762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0095f0 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce4b7fe700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c100270 0x7fce4c101450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00b580 tx=0x7fce3c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c01d070 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c1ab0f0 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fce3c003fd0 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.417+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c022e50 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.418+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c1ab500 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.418+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce4c112130 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fce3c022590 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce48ff9700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fce340a21e0 0x7fce340a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce4affd700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fce340a21e0 0x7fce340a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fce3c0cf240 con 0x7fce4c100270 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce48ff9700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] conn(0x7fce340ab9c0 0x7fce340adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:26.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 --> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce340ae490 con 0x7fce340ab9c0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.420+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce3c0cf6e0 con 0x7fce4c100270 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.421+0000 7fce4affd700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fce340a21e0 0x7fce340a46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce40005950 tx=0x7fce400058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.421+0000 7fce4bfff700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] conn(0x7fce340ab9c0 0x7fce340adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.421+0000 7fce4bfff700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] conn(0x7fce340ab9c0 0x7fce340adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.422+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== osd.8 v2:172.21.15.103:6816/1363317081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fce340ae490 con 0x7fce340ab9c0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.439+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 --> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce4c0623b0 con 0x7fce340ab9c0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.439+0000 7fce48ff9700 1 -- 172.21.15.12:0/3763031762 <== osd.8 v2:172.21.15.103:6816/1363317081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fce4c0623b0 con 0x7fce340ab9c0 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] conn(0x7fce340ab9c0 msgr2=0x7fce340adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] conn(0x7fce340ab9c0 0x7fce340adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fce340a21e0 msgr2=0x7fce340a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fce340a21e0 0x7fce340a46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce40005950 tx=0x7fce400058e0 comp rx=0 tx=0).stop 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c100270 msgr2=0x7fce4c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 --2- 172.21.15.12:0/3763031762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce4c100270 0x7fce4c101450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00b580 tx=0x7fce3c005e80 comp rx=0 tx=0).stop 2024-02-14T13:07:26.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce4bfff700 1 -- 172.21.15.12:0/3763031762 reap_dead start 2024-02-14T13:07:26.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 shutdown_connections 2024-02-14T13:07:26.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 >> 172.21.15.12:0/3763031762 conn(0x7fce4c0771f0 msgr2=0x7fce4c104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:26.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 shutdown_connections 2024-02-14T13:07:26.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:25.440+0000 7fce51e2d700 1 -- 172.21.15.12:0/3763031762 wait complete. 2024-02-14T13:07:26.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:25 smithi012 ceph-mon[32370]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:26.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:25 smithi103 ceph-mon[36921]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:26.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:25 smithi055 ceph-mon[36853]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 1 op/s 2024-02-14T13:07:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:261993005091 2024-02-14T13:07:26.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-02-14T13:07:28.183 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:27 smithi012 ceph-mon[32370]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:07:28.211 INFO:teuthology.orchestra.run.smithi012.stdout:227633266727 2024-02-14T13:07:28.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-14T13:07:28.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:27 smithi103 ceph-mon[36921]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:07:28.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:27 smithi055 ceph-mon[36853]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:07:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 -- 172.21.15.12:0/765191625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 msgr2=0x7fef1c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 --2- 172.21.15.12:0/765191625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c101290 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef18009990 tx=0x7fef18009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 -- 172.21.15.12:0/765191625 shutdown_connections 2024-02-14T13:07:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 --2- 172.21.15.12:0/765191625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c105f00 0x7fef1c10dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 --2- 172.21.15.12:0/765191625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c101290 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 --2- 172.21.15.12:0/765191625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef1c101860 0x7fef1c105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 -- 172.21.15.12:0/765191625 >> 172.21.15.12:0/765191625 conn(0x7fef1c076c70 msgr2=0x7fef1c077080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:28.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 -- 172.21.15.12:0/765191625 shutdown_connections 2024-02-14T13:07:28.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.424+0000 7fef244bc700 1 -- 172.21.15.12:0/765191625 wait complete. 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 Processor -- start 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 -- start start 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c101860 0x7fef1c198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef1c105f00 0x7fef1c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19d110 con 0x7fef1c100eb0 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19d280 con 0x7fef1c101860 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef244bc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c19d440 con 0x7fef1c105f00 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef22258700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef22258700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35234/0 (socket says 172.21.15.12:35234) 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef22258700 1 -- 172.21.15.12:0/3373781497 learned_addr learned my addr 172.21.15.12:0/3373781497 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.425+0000 7fef21a57700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c101860 0x7fef1c198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef22258700 1 -- 172.21.15.12:0/3373781497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef1c105f00 msgr2=0x7fef1c19cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef22258700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef1c105f00 0x7fef1c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef22258700 1 -- 172.21.15.12:0/3373781497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c101860 msgr2=0x7fef1c198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef22258700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef1c101860 0x7fef1c198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef22258700 1 -- 172.21.15.12:0/3373781497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180095f0 con 0x7fef1c100eb0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef22258700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c198230 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef180098e0 tx=0x7fef1800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1801d070 con 0x7fef1c100eb0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c19d6c0 con 0x7fef1c100eb0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fef18003680 con 0x7fef1c100eb0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c1a4f80 con 0x7fef1c100eb0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.426+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18017650 con 0x7fef1c100eb0 2024-02-14T13:07:28.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.427+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef00001030 con 0x7fef1c100eb0 2024-02-14T13:07:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.428+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fef1800fa50 con 0x7fef1c100eb0 2024-02-14T13:07:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.428+0000 7fef137fe700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef080a21e0 0x7fef080a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef21a57700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef080a21e0 0x7fef080a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fef180cf400 con 0x7fef1c100eb0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef137fe700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] conn(0x7fef080ab9c0 0x7fef080adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 --> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef080ae490 con 0x7fef080ab9c0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef180cf8a0 con 0x7fef1c100eb0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef22a59700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] conn(0x7fef080ab9c0 0x7fef080adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef21a57700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef080a21e0 0x7fef080a46a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0ff770 tx=0x7fef0c00a300 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.429+0000 7fef22a59700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] conn(0x7fef080ab9c0 0x7fef080adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.430+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== osd.3 v2:172.21.15.12:6810/95002866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fef080ae490 con 0x7fef080ab9c0 2024-02-14T13:07:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.446+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 --> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef00002dc0 con 0x7fef080ab9c0 2024-02-14T13:07:28.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.446+0000 7fef137fe700 1 -- 172.21.15.12:0/3373781497 <== osd.3 v2:172.21.15.12:6810/95002866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fef00002dc0 con 0x7fef080ab9c0 2024-02-14T13:07:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] conn(0x7fef080ab9c0 msgr2=0x7fef080adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] conn(0x7fef080ab9c0 0x7fef080adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef080a21e0 msgr2=0x7fef080a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef080a21e0 0x7fef080a46a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0ff770 tx=0x7fef0c00a300 comp rx=0 tx=0).stop 2024-02-14T13:07:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 msgr2=0x7fef1c198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 --2- 172.21.15.12:0/3373781497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef1c100eb0 0x7fef1c198230 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fef180098e0 tx=0x7fef1800f690 comp rx=0 tx=0).stop 2024-02-14T13:07:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef22a59700 1 -- 172.21.15.12:0/3373781497 reap_dead start 2024-02-14T13:07:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 shutdown_connections 2024-02-14T13:07:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 >> 172.21.15.12:0/3373781497 conn(0x7fef1c076c70 msgr2=0x7fef1c0fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 shutdown_connections 2024-02-14T13:07:28.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.447+0000 7fef244bc700 1 -- 172.21.15.12:0/3373781497 wait complete. 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 -- 172.21.15.12:0/3366417901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290101830 msgr2=0x7f5290105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 --2- 172.21.15.12:0/3366417901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290101830 0x7f5290105880 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5284009990 tx=0x7f5284009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 -- 172.21.15.12:0/3366417901 shutdown_connections 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 --2- 172.21.15.12:0/3366417901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5290105f60 0x7f529010db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 --2- 172.21.15.12:0/3366417901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5290100e80 0x7f5290101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 --2- 172.21.15.12:0/3366417901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290101830 0x7f5290105880 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 -- 172.21.15.12:0/3366417901 >> 172.21.15.12:0/3366417901 conn(0x7f5290077cf0 msgr2=0x7f5290078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 -- 172.21.15.12:0/3366417901 shutdown_connections 2024-02-14T13:07:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.622+0000 7f5294e56700 1 -- 172.21.15.12:0/3366417901 wait complete. 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 Processor -- start 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 -- start start 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290100e80 0x7f5290198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5290101830 0x7f5290198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5290105f60 0x7f529019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529019d110 con 0x7f5290100e80 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529019d280 con 0x7f5290101830 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f5294e56700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529019d440 con 0x7f5290105f60 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f528e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290100e80 0x7f5290198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f528e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290100e80 0x7f5290198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35248/0 (socket says 172.21.15.12:35248) 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f528e59c700 1 -- 172.21.15.12:0/417901470 learned_addr learned my addr 172.21.15.12:0/417901470 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f528dd9b700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5290101830 0x7f5290198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.623+0000 7f528ed9d700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5290105f60 0x7f529019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f528e59c700 1 -- 172.21.15.12:0/417901470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5290105f60 msgr2=0x7f529019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f528e59c700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5290105f60 0x7f529019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f528e59c700 1 -- 172.21.15.12:0/417901470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5290101830 msgr2=0x7f5290198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f528e59c700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5290101830 0x7f5290198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f528e59c700 1 -- 172.21.15.12:0/417901470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840095f0 con 0x7f5290100e80 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f528e59c700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290100e80 0x7f5290198230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f528000d950 tx=0x7f528000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528000f890 con 0x7f5290100e80 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5280010460 con 0x7f5290100e80 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528000e610 con 0x7f5290100e80 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529019d720 con 0x7f5290100e80 2024-02-14T13:07:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.624+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52901a4f80 con 0x7f5290100e80 2024-02-14T13:07:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.625+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5290110ee0 con 0x7f5290100e80 2024-02-14T13:07:28.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.627+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f5280010960 con 0x7f5290100e80 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f527f7fe700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52780a21e0 0x7f52780a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f528dd9b700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52780a21e0 0x7f52780a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f52800cdf20 con 0x7f5290100e80 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f527f7fe700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] conn(0x7f52780ab9c0 0x7f52780adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 --> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52780ae490 con 0x7f52780ab9c0 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52800ce3c0 con 0x7f5290100e80 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f528ed9d700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] conn(0x7f52780ab9c0 0x7f52780adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:28.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.628+0000 7f528dd9b700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52780a21e0 0x7f52780a46a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5284006010 tx=0x7f5284005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:28.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.629+0000 7f528ed9d700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] conn(0x7f52780ab9c0 0x7f52780adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:28.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.630+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== osd.6 v2:172.21.15.12:6818/677900962 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f52780ae490 con 0x7f52780ab9c0 2024-02-14T13:07:28.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 --> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5290062430 con 0x7f52780ab9c0 2024-02-14T13:07:28.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f527f7fe700 1 -- 172.21.15.12:0/417901470 <== osd.6 v2:172.21.15.12:6818/677900962 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5290062430 con 0x7f52780ab9c0 2024-02-14T13:07:28.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] conn(0x7f52780ab9c0 msgr2=0x7f52780adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] conn(0x7f52780ab9c0 0x7f52780adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52780a21e0 msgr2=0x7f52780a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f52780a21e0 0x7f52780a46a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5284006010 tx=0x7f5284005960 comp rx=0 tx=0).stop 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290100e80 msgr2=0x7f5290198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 --2- 172.21.15.12:0/417901470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5290100e80 0x7f5290198230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f528000d950 tx=0x7f528000dc60 comp rx=0 tx=0).stop 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f528ed9d700 1 -- 172.21.15.12:0/417901470 reap_dead start 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 shutdown_connections 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 >> 172.21.15.12:0/417901470 conn(0x7f5290077cf0 msgr2=0x7f529006a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 shutdown_connections 2024-02-14T13:07:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:28.647+0000 7f5294e56700 1 -- 172.21.15.12:0/417901470 wait complete. 2024-02-14T13:07:29.555 INFO:teuthology.orchestra.run.smithi012.stdout:206158430254 2024-02-14T13:07:29.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-14T13:07:29.969 INFO:teuthology.orchestra.run.smithi012.stdout:296352743455 2024-02-14T13:07:29.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-02-14T13:07:30.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:29 smithi012 ceph-mon[32370]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:30.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:29 smithi103 ceph-mon[36921]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:30.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:29 smithi055 ceph-mon[36853]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 -- 172.21.15.12:0/979034262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c107d50 msgr2=0x7f360c108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 --2- 172.21.15.12:0/979034262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c107d50 0x7f360c108130 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0099c0 tx=0x7f35fc009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 -- 172.21.15.12:0/979034262 shutdown_connections 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 --2- 172.21.15.12:0/979034262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f360c102730 0x7f360c10eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 --2- 172.21.15.12:0/979034262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c107d50 0x7f360c108130 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 --2- 172.21.15.12:0/979034262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360c101d70 0x7f360c1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 -- 172.21.15.12:0/979034262 >> 172.21.15.12:0/979034262 conn(0x7f360c078e50 msgr2=0x7f360c079260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 -- 172.21.15.12:0/979034262 shutdown_connections 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.179+0000 7f3612281700 1 -- 172.21.15.12:0/979034262 wait complete. 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 Processor -- start 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 -- start start 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c101d70 0x7f360c198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f360c102730 0x7f360c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360c107d50 0x7f360c19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c19d100 con 0x7f360c101d70 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c19d270 con 0x7f360c107d50 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f3612281700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c19d430 con 0x7f360c102730 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f360bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c101d70 0x7f360c198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f360bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c101d70 0x7f360c198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35278/0 (socket says 172.21.15.12:35278) 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.180+0000 7f360bfff700 1 -- 172.21.15.12:0/3006503018 learned_addr learned my addr 172.21.15.12:0/3006503018 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f361081e700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360c107d50 0x7f360c19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360b7fe700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f360c102730 0x7f360c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360bfff700 1 -- 172.21.15.12:0/3006503018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f360c102730 msgr2=0x7f360c198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360bfff700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f360c102730 0x7f360c198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360bfff700 1 -- 172.21.15.12:0/3006503018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360c107d50 msgr2=0x7f360c19caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360bfff700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360c107d50 0x7f360c19caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360bfff700 1 -- 172.21.15.12:0/3006503018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0095f0 con 0x7f360c101d70 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360b7fe700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f360c102730 0x7f360c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f361081e700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360c107d50 0x7f360c19caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f360bfff700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c101d70 0x7f360c198220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00b580 tx=0x7f35fc003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc01d070 con 0x7f360c101d70 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c19d6b0 con 0x7f360c101d70 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f35fc0040d0 con 0x7f360c101d70 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00f460 con 0x7f360c101d70 2024-02-14T13:07:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.181+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c1a4f70 con 0x7f360c101d70 2024-02-14T13:07:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.182+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f360c112160 con 0x7f360c101d70 2024-02-14T13:07:31.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.184+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f35fc022720 con 0x7f360c101d70 2024-02-14T13:07:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.185+0000 7f36097fa700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f35f40a21e0 0x7f35f40a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:31.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.185+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f35fc0cf610 con 0x7f360c101d70 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.185+0000 7f360b7fe700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f35f40a21e0 0x7f35f40a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.185+0000 7f36097fa700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] conn(0x7f35f40ab9c0 0x7f35f40adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.186+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 --> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35f40ae490 con 0x7f35f40ab9c0 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.186+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35fc0cf980 con 0x7f360c101d70 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.186+0000 7f361081e700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] conn(0x7f35f40ab9c0 0x7f35f40adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.186+0000 7f360b7fe700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f35f40a21e0 0x7f35f40a46a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f360c0793e0 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:31.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.186+0000 7f361081e700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] conn(0x7f35f40ab9c0 0x7f35f40adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:31.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.187+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== osd.0 v2:172.21.15.12:6802/389227292 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f35f40ae490 con 0x7f35f40ab9c0 2024-02-14T13:07:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.205+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 --> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f360c0623b0 con 0x7f35f40ab9c0 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.205+0000 7f36097fa700 1 -- 172.21.15.12:0/3006503018 <== osd.0 v2:172.21.15.12:6802/389227292 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f360c0623b0 con 0x7f35f40ab9c0 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] conn(0x7f35f40ab9c0 msgr2=0x7f35f40adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] conn(0x7f35f40ab9c0 0x7f35f40adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f35f40a21e0 msgr2=0x7f35f40a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f35f40a21e0 0x7f35f40a46a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f360c0793e0 tx=0x7f3600008040 comp rx=0 tx=0).stop 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c101d70 msgr2=0x7f360c198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 --2- 172.21.15.12:0/3006503018 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f360c101d70 0x7f360c198220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00b580 tx=0x7f35fc003710 comp rx=0 tx=0).stop 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f361081e700 1 -- 172.21.15.12:0/3006503018 reap_dead start 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 shutdown_connections 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 >> 172.21.15.12:0/3006503018 conn(0x7f360c078e50 msgr2=0x7f360c100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 shutdown_connections 2024-02-14T13:07:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:31.206+0000 7f3612281700 1 -- 172.21.15.12:0/3006503018 wait complete. 2024-02-14T13:07:31.701 INFO:teuthology.orchestra.run.smithi012.stdout:77309411393 2024-02-14T13:07:31.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-14T13:07:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:31 smithi012 ceph-mon[32370]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:32.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:31 smithi103 ceph-mon[36921]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:32.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:31 smithi055 ceph-mon[36853]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 -- 172.21.15.12:0/533442140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f41012d0 msgr2=0x7f47f4105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 --2- 172.21.15.12:0/533442140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f41012d0 0x7f47f4105080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f47e40099c0 tx=0x7f47e4009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 -- 172.21.15.12:0/533442140 shutdown_connections 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 --2- 172.21.15.12:0/533442140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f41057b0 0x7f47f410d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 --2- 172.21.15.12:0/533442140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f4100920 0x7f47f4100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 --2- 172.21.15.12:0/533442140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f41012d0 0x7f47f4105080 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 -- 172.21.15.12:0/533442140 >> 172.21.15.12:0/533442140 conn(0x7f47f4075fa0 msgr2=0x7f47f40763b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 -- 172.21.15.12:0/533442140 shutdown_connections 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 -- 172.21.15.12:0/533442140 wait complete. 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 Processor -- start 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.810+0000 7f47fbe28700 1 -- start start 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f4100920 0x7f47f4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f41012d0 0x7f47f41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f41057b0 0x7f47f419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f419d200 con 0x7f47f4100920 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f419d370 con 0x7f47f41057b0 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f419d530 con 0x7f47f41012d0 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f4100920 0x7f47f4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f4100920 0x7f47f4198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35302/0 (socket says 172.21.15.12:35302) 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 -- 172.21.15.12:0/2745532118 learned_addr learned my addr 172.21.15.12:0/2745532118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f93c3700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f41012d0 0x7f47f41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 -- 172.21.15.12:0/2745532118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f41012d0 msgr2=0x7f47f41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fa3c5700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f41057b0 0x7f47f419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f41012d0 0x7f47f41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 -- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f41057b0 msgr2=0x7f47f419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f41057b0 0x7f47f419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 -- 172.21.15.12:0/2745532118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40095f0 con 0x7f47f4100920 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f93c3700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47f41012d0 0x7f47f41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fa3c5700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47f41057b0 0x7f47f419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47f9bc4700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f4100920 0x7f47f4198370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47f000ea80 tx=0x7f47f000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000cb90 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f47f0004500 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f419d810 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0016410 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.811+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f41a5070 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.812+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47f410ffa0 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.813+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f47f0003f00 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47eaffd700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47e00a2260 0x7f47e00a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47f93c3700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47e00a2260 0x7f47e00a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47f00ce4f0 con 0x7f47f4100920 2024-02-14T13:07:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47eaffd700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] conn(0x7f47e00aba40 0x7f47e00ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 --> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47e00ae510 con 0x7f47e00aba40 2024-02-14T13:07:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47f00ce860 con 0x7f47f4100920 2024-02-14T13:07:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47f93c3700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47e00a2260 0x7f47e00a4720 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009990 tx=0x7f47e4005fb0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.814+0000 7f47fa3c5700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] conn(0x7f47e00aba40 0x7f47e00ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.815+0000 7f47fa3c5700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] conn(0x7f47e00aba40 0x7f47e00ade60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.816+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== osd.1 v2:172.21.15.55:6800/2858711523 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f47e00ae510 con 0x7f47e00aba40 2024-02-14T13:07:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.832+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 --> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47f4062430 con 0x7f47e00aba40 2024-02-14T13:07:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.832+0000 7f47eaffd700 1 -- 172.21.15.12:0/2745532118 <== osd.1 v2:172.21.15.55:6800/2858711523 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47f4062430 con 0x7f47e00aba40 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] conn(0x7f47e00aba40 msgr2=0x7f47e00ade60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] conn(0x7f47e00aba40 0x7f47e00ade60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47e00a2260 msgr2=0x7f47e00a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f47e00a2260 0x7f47e00a4720 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009990 tx=0x7f47e4005fb0 comp rx=0 tx=0).stop 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f4100920 msgr2=0x7f47f4198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 --2- 172.21.15.12:0/2745532118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f4100920 0x7f47f4198370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47f000ea80 tx=0x7f47f000ee40 comp rx=0 tx=0).stop 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fa3c5700 1 -- 172.21.15.12:0/2745532118 reap_dead start 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 shutdown_connections 2024-02-14T13:07:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 >> 172.21.15.12:0/2745532118 conn(0x7f47f4075fa0 msgr2=0x7f47f41045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 shutdown_connections 2024-02-14T13:07:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:32.833+0000 7f47fbe28700 1 -- 172.21.15.12:0/2745532118 wait complete. 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 -- 172.21.15.12:0/129335355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 msgr2=0x7f3450101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 --2- 172.21.15.12:0/129335355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f3450101bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3438009990 tx=0x7f3438009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 -- 172.21.15.12:0/129335355 shutdown_connections 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 --2- 172.21.15.12:0/129335355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3450102130 0x7f345010db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 --2- 172.21.15.12:0/129335355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3450105c60 0x7f3450106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 --2- 172.21.15.12:0/129335355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f3450101bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 -- 172.21.15.12:0/129335355 >> 172.21.15.12:0/129335355 conn(0x7f3450075f60 msgr2=0x7f3450076370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:33.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 -- 172.21.15.12:0/129335355 shutdown_connections 2024-02-14T13:07:33.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 -- 172.21.15.12:0/129335355 wait complete. 2024-02-14T13:07:33.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 Processor -- start 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.564+0000 7f34560e4700 1 -- start start 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f34501981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3450102130 0x7f3450198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3450105c60 0x7f345019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345019d070 con 0x7f3450101770 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345019d1e0 con 0x7f3450105c60 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345019d3a0 con 0x7f3450102130 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f34501981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:33.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f34501981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35324/0 (socket says 172.21.15.12:35324) 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 -- 172.21.15.12:0/2344826021 learned_addr learned my addr 172.21.15.12:0/2344826021 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344effd700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3450102130 0x7f3450198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344ffff700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3450105c60 0x7f345019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 -- 172.21.15.12:0/2344826021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3450102130 msgr2=0x7f3450198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3450102130 0x7f3450198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 -- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3450105c60 msgr2=0x7f345019ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3450105c60 0x7f345019ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 -- 172.21.15.12:0/2344826021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380095f0 con 0x7f3450101770 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344effd700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3450102130 0x7f3450198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344ffff700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3450105c60 0x7f345019ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344f7fe700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f34501981e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3440007e20 tx=0x7f344000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000ae00 con 0x7f3450101770 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345019d680 con 0x7f3450101770 2024-02-14T13:07:33.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3440012900 con 0x7f3450101770 2024-02-14T13:07:33.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.565+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400118b0 con 0x7f3450101770 2024-02-14T13:07:33.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.566+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34501a4ee0 con 0x7f3450101770 2024-02-14T13:07:33.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.566+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3450110fb0 con 0x7f3450101770 2024-02-14T13:07:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.568+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f3440012a70 con 0x7f3450101770 2024-02-14T13:07:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.568+0000 7f344cff9700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f343c0a21e0 0x7f343c0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f34400ce620 con 0x7f3450101770 2024-02-14T13:07:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344effd700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f343c0a21e0 0x7f343c0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:33.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344cff9700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] conn(0x7f343c0ab9c0 0x7f343c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 --> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f343c0ae490 con 0x7f343c0ab9c0 2024-02-14T13:07:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34400ceac0 con 0x7f3450101770 2024-02-14T13:07:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344effd700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f343c0a21e0 0x7f343c0a46a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3438006010 tx=0x7f343800b540 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344ffff700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] conn(0x7f343c0ab9c0 0x7f343c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.569+0000 7f344ffff700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] conn(0x7f343c0ab9c0 0x7f343c0adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:33.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.570+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== osd.4 v2:172.21.15.55:6808/59815868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f343c0ae490 con 0x7f343c0ab9c0 2024-02-14T13:07:33.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.587+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 --> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3450100ff0 con 0x7f343c0ab9c0 2024-02-14T13:07:33.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.587+0000 7f344cff9700 1 -- 172.21.15.12:0/2344826021 <== osd.4 v2:172.21.15.55:6808/59815868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3450100ff0 con 0x7f343c0ab9c0 2024-02-14T13:07:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] conn(0x7f343c0ab9c0 msgr2=0x7f343c0adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] conn(0x7f343c0ab9c0 0x7f343c0adde0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f343c0a21e0 msgr2=0x7f343c0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f343c0a21e0 0x7f343c0a46a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3438006010 tx=0x7f343800b540 comp rx=0 tx=0).stop 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 msgr2=0x7f34501981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 --2- 172.21.15.12:0/2344826021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3450101770 0x7f34501981e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3440007e20 tx=0x7f344000a340 comp rx=0 tx=0).stop 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f344ffff700 1 -- 172.21.15.12:0/2344826021 reap_dead start 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 shutdown_connections 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 >> 172.21.15.12:0/2344826021 conn(0x7f3450075f60 msgr2=0x7f3450100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 shutdown_connections 2024-02-14T13:07:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:33.588+0000 7f34560e4700 1 -- 172.21.15.12:0/2344826021 wait complete. 2024-02-14T13:07:34.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:33 smithi012 ceph-mon[32370]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:34.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:33 smithi103 ceph-mon[36921]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:34.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:33 smithi055 ceph-mon[36853]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:34.592 INFO:teuthology.orchestra.run.smithi012.stdout:34359738444 2024-02-14T13:07:34.593 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-14T13:07:34.986 INFO:teuthology.orchestra.run.smithi012.stdout:150323855417 2024-02-14T13:07:34.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-14T13:07:35.686 INFO:teuthology.orchestra.run.smithi012.stdout:115964117053 2024-02-14T13:07:35.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-14T13:07:36.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:35 smithi012 ceph-mon[32370]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:36.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:35 smithi103 ceph-mon[36921]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:36.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:35 smithi055 ceph-mon[36853]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:37.040 INFO:teuthology.orchestra.run.smithi012.stdout:55834574920 2024-02-14T13:07:37.040 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-14T13:07:37.087 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:37.125 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:37.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 -- 172.21.15.12:0/2337936061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18801015c0 msgr2=0x7f188010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 --2- 172.21.15.12:0/2337936061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18801015c0 0x7f188010daa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f187800b0a0 tx=0x7f187800b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 -- 172.21.15.12:0/2337936061 shutdown_connections 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 --2- 172.21.15.12:0/2337936061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18801015c0 0x7f188010daa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 --2- 172.21.15.12:0/2337936061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1880106c60 0x7f1880107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 --2- 172.21.15.12:0/2337936061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1880100c20 0x7f1880101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 -- 172.21.15.12:0/2337936061 >> 172.21.15.12:0/2337936061 conn(0x7f1880077b50 msgr2=0x7f1880077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 -- 172.21.15.12:0/2337936061 shutdown_connections 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.991+0000 7f188833f700 1 -- 172.21.15.12:0/2337936061 wait complete. 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 Processor -- start 2024-02-14T13:07:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 -- start start 2024-02-14T13:07:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1880100c20 0x7f1880199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18801015c0 0x7f1880199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1880106c60 0x7f18801a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188019a040 con 0x7f1880106c60 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18801a4800 con 0x7f18801015c0 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f188833f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18801a4940 con 0x7f1880100c20 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1880106c60 0x7f18801a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1880106c60 0x7f18801a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56806/0 (socket says 172.21.15.12:56806) 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 -- 172.21.15.12:0/2859660767 learned_addr learned my addr 172.21.15.12:0/2859660767 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18860db700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1880100c20 0x7f1880199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18858da700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18801015c0 0x7f1880199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 -- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1880100c20 msgr2=0x7f1880199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1880100c20 0x7f1880199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 -- 172.21.15.12:0/2859660767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18801015c0 msgr2=0x7f1880199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18801015c0 0x7f1880199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18868dc700 1 -- 172.21.15.12:0/2859660767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1878009d00 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.992+0000 7f18858da700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18801015c0 0x7f1880199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.993+0000 7f18868dc700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1880106c60 0x7f18801a42c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f187800b070 tx=0x7f1878004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.993+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187800e040 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.993+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1878007950 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.993+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18801a4bc0 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.993+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187801b8f0 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.993+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18801a5030 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.994+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1880110f70 con 0x7f1880106c60 2024-02-14T13:07:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.995+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f187801ba50 con 0x7f1880106c60 2024-02-14T13:07:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.995+0000 7f18777fe700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f186c0a2260 0x7f186c0a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18860db700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f186c0a2260 0x7f186c0a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f18780d00f0 con 0x7f1880106c60 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18777fe700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] conn(0x7f186c0aba40 0x7f186c0ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 --> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f186c0ae510 con 0x7f186c0aba40 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18780d0460 con 0x7f1880106c60 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18860db700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f186c0a2260 0x7f186c0a4720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f187c005950 tx=0x7f187c00b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.996+0000 7f18858da700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] conn(0x7f186c0aba40 0x7f186c0ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.997+0000 7f18858da700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] conn(0x7f186c0aba40 0x7f186c0ade60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:37.998+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== osd.11 v2:172.21.15.103:6824/4052235474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f186c0ae510 con 0x7f186c0aba40 2024-02-14T13:07:38.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.014+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 --> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18800623b0 con 0x7f186c0aba40 2024-02-14T13:07:38.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.014+0000 7f18777fe700 1 -- 172.21.15.12:0/2859660767 <== osd.11 v2:172.21.15.103:6824/4052235474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f18800623b0 con 0x7f186c0aba40 2024-02-14T13:07:38.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] conn(0x7f186c0aba40 msgr2=0x7f186c0ade60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:38.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] conn(0x7f186c0aba40 0x7f186c0ade60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:38.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f186c0a2260 msgr2=0x7f186c0a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:38.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f186c0a2260 0x7f186c0a4720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f187c005950 tx=0x7f187c00b410 comp rx=0 tx=0).stop 2024-02-14T13:07:38.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1880106c60 msgr2=0x7f18801a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:38.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 --2- 172.21.15.12:0/2859660767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1880106c60 0x7f18801a42c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f187800b070 tx=0x7f1878004e40 comp rx=0 tx=0).stop 2024-02-14T13:07:38.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f18868dc700 1 -- 172.21.15.12:0/2859660767 reap_dead start 2024-02-14T13:07:38.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 shutdown_connections 2024-02-14T13:07:38.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 >> 172.21.15.12:0/2859660767 conn(0x7f1880077b50 msgr2=0x7f18800ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:38.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 shutdown_connections 2024-02-14T13:07:38.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:38.015+0000 7f188833f700 1 -- 172.21.15.12:0/2859660767 wait complete. 2024-02-14T13:07:38.182 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:37 smithi012 ceph-mon[32370]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:38.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:37 smithi103 ceph-mon[36921]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:38.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:37 smithi055 ceph-mon[36853]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 -- 172.21.15.12:0/3501664424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 msgr2=0x7f5c3806a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/3501664424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c3806a8a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009990 tx=0x7f5c28009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 -- 172.21.15.12:0/3501664424 shutdown_connections 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/3501664424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c381070a0 0x7f5c3810ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/3501664424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c3806a8a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/3501664424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c3806ae70 0x7f5c38106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 -- 172.21.15.12:0/3501664424 >> 172.21.15.12:0/3501664424 conn(0x7f5c38076c70 msgr2=0x7f5c38077080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 -- 172.21.15.12:0/3501664424 shutdown_connections 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.577+0000 7f5c3e31b700 1 -- 172.21.15.12:0/3501664424 wait complete. 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 Processor -- start 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 -- start start 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c38198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3806ae70 0x7f5c381987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c381070a0 0x7f5c3819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3819d170 con 0x7f5c3806a4c0 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3819d2e0 con 0x7f5c381070a0 2024-02-14T13:07:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3e31b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3819d4a0 con 0x7f5c3806ae70 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c38198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c38198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56824/0 (socket says 172.21.15.12:56824) 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c37fff700 1 -- 172.21.15.12:0/484730637 learned_addr learned my addr 172.21.15.12:0/484730637 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c3c8b8700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c381070a0 0x7f5c3819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.578+0000 7f5c377fe700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3806ae70 0x7f5c381987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c37fff700 1 -- 172.21.15.12:0/484730637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3806ae70 msgr2=0x7f5c381987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c37fff700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3806ae70 0x7f5c381987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c37fff700 1 -- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c381070a0 msgr2=0x7f5c3819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c37fff700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c381070a0 0x7f5c3819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c37fff700 1 -- 172.21.15.12:0/484730637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280095f0 con 0x7f5c3806a4c0 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c37fff700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c38198290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c280098e0 tx=0x7f5c2800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2801d070 con 0x7f5c3806a4c0 2024-02-14T13:07:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3819d720 con 0x7f5c3806a4c0 2024-02-14T13:07:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5c28003680 con 0x7f5c3806a4c0 2024-02-14T13:07:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28017650 con 0x7f5c3806a4c0 2024-02-14T13:07:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.579+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c381a4fe0 con 0x7f5c3806a4c0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.580+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c38112070 con 0x7f5c3806a4c0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.581+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f5c28022470 con 0x7f5c3806a4c0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c357fa700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c200a21e0 0x7f5c200a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c377fe700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c200a21e0 0x7f5c200a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5c280cf4d0 con 0x7f5c3806a4c0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c357fa700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] conn(0x7f5c200ab9c0 0x7f5c200adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 --> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c200ae490 con 0x7f5c200ab9c0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c280cf970 con 0x7f5c3806a4c0 2024-02-14T13:07:39.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c377fe700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c200a21e0 0x7f5c200a46a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c005950 tx=0x7f5c2c0058e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.582+0000 7f5c3c8b8700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] conn(0x7f5c200ab9c0 0x7f5c200adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.583+0000 7f5c3c8b8700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] conn(0x7f5c200ab9c0 0x7f5c200adde0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:39.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.584+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== osd.10 v2:172.21.15.55:6824/3825680100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5c200ae490 con 0x7f5c200ab9c0 2024-02-14T13:07:39.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.600+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 --> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c380623b0 con 0x7f5c200ab9c0 2024-02-14T13:07:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.601+0000 7f5c357fa700 1 -- 172.21.15.12:0/484730637 <== osd.10 v2:172.21.15.55:6824/3825680100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5c380623b0 con 0x7f5c200ab9c0 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.601+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] conn(0x7f5c200ab9c0 msgr2=0x7f5c200adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.601+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] conn(0x7f5c200ab9c0 0x7f5c200adde0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c200a21e0 msgr2=0x7f5c200a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c200a21e0 0x7f5c200a46a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c005950 tx=0x7f5c2c0058e0 comp rx=0 tx=0).stop 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 msgr2=0x7f5c38198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 --2- 172.21.15.12:0/484730637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c3806a4c0 0x7f5c38198290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c280098e0 tx=0x7f5c2800f690 comp rx=0 tx=0).stop 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3c8b8700 1 -- 172.21.15.12:0/484730637 reap_dead start 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 shutdown_connections 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 >> 172.21.15.12:0/484730637 conn(0x7f5c38076c70 msgr2=0x7f5c380ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 shutdown_connections 2024-02-14T13:07:39.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:39.602+0000 7f5c3e31b700 1 -- 172.21.15.12:0/484730637 wait complete. 2024-02-14T13:07:40.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:39 smithi012 ceph-mon[32370]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:40.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:39 smithi103 ceph-mon[36921]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:40.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:39 smithi055 ceph-mon[36853]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 -- 172.21.15.12:0/992528025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 msgr2=0x7f208810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 --2- 172.21.15.12:0/992528025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f208810ec40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f208000b0a0 tx=0x7f208000b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 -- 172.21.15.12:0/992528025 shutdown_connections 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 --2- 172.21.15.12:0/992528025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f208810ec40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 --2- 172.21.15.12:0/992528025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2088107f00 0x7f20881082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 --2- 172.21.15.12:0/992528025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f208806a460 0x7f208806a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 -- 172.21.15.12:0/992528025 >> 172.21.15.12:0/992528025 conn(0x7f2088077a80 msgr2=0x7f2088077e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.712+0000 7f208ee27700 1 -- 172.21.15.12:0/992528025 shutdown_connections 2024-02-14T13:07:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 -- 172.21.15.12:0/992528025 wait complete. 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 Processor -- start 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 -- start start 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208806a460 0x7f2088198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f20881988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2088107f00 0x7f208819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208819d270 con 0x7f208806ae20 2024-02-14T13:07:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208819d3e0 con 0x7f208806a460 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.713+0000 7f208ee27700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208819d5a0 con 0x7f2088107f00 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f20881988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f20881988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56840/0 (socket says 172.21.15.12:56840) 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 -- 172.21.15.12:0/3829014486 learned_addr learned my addr 172.21.15.12:0/3829014486 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f208d3c4700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2088107f00 0x7f208819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f208cbc3700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208806a460 0x7f2088198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 -- 172.21.15.12:0/3829014486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2088107f00 msgr2=0x7f208819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2088107f00 0x7f208819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 -- 172.21.15.12:0/3829014486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208806a460 msgr2=0x7f2088198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208806a460 0x7f2088198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 -- 172.21.15.12:0/3829014486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080009d00 con 0x7f208806ae20 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f208d3c4700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2088107f00 0x7f208819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:40.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2087fff700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f20881988d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f207800d950 tx=0x7f207800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.714+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078009940 con 0x7f208806ae20 2024-02-14T13:07:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.715+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2078010460 con 0x7f208806ae20 2024-02-14T13:07:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.715+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208819d880 con 0x7f208806ae20 2024-02-14T13:07:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.715+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207800f620 con 0x7f208806ae20 2024-02-14T13:07:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.715+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20881a50e0 con 0x7f208806ae20 2024-02-14T13:07:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.716+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208810a2a0 con 0x7f208806ae20 2024-02-14T13:07:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.717+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f20780105d0 con 0x7f208806ae20 2024-02-14T13:07:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.717+0000 7f2085ffb700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f20740a2260 0x7f20740a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.718+0000 7f208cbc3700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f20740a2260 0x7f20740a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.718+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f20780cd870 con 0x7f208806ae20 2024-02-14T13:07:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.718+0000 7f208cbc3700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f20740a2260 0x7f20740a4720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2088103220 tx=0x7f207000a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.722+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f207809a3c0 con 0x7f208806ae20 2024-02-14T13:07:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.929+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f20881996f0 con 0x7f208806ae20 2024-02-14T13:07:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.930+0000 7f2085ffb700 1 -- 172.21.15.12:0/3829014486 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2078099f50 con 0x7f208806ae20 2024-02-14T13:07:40.932 INFO:teuthology.orchestra.run.smithi012.stdout:227633266730 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f20740a2260 msgr2=0x7f20740a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f20740a2260 0x7f20740a4720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2088103220 tx=0x7f207000a380 comp rx=0 tx=0).stop 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 msgr2=0x7f20881988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f20881988d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f207800d950 tx=0x7f207800dc60 comp rx=0 tx=0).stop 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 shutdown_connections 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2088107f00 0x7f208819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f208806a460 0x7f2088198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f20740a2260 0x7f20740a4720 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 --2- 172.21.15.12:0/3829014486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f208806ae20 0x7f20881988d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 >> 172.21.15.12:0/3829014486 conn(0x7f2088077a80 msgr2=0x7f20880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 shutdown_connections 2024-02-14T13:07:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:40.932+0000 7f208ee27700 1 -- 172.21.15.12:0/3829014486 wait complete. 2024-02-14T13:07:40.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3829014486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-14T13:07:41.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3829014486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-14T13:07:41.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:40 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3829014486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-14T13:07:41.402 INFO:teuthology.orchestra.run.smithi012.stdout:317827579932 2024-02-14T13:07:41.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-02-14T13:07:41.408 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:41.804 INFO:teuthology.orchestra.run.smithi012.stdout:352187318295 2024-02-14T13:07:41.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-02-14T13:07:42.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:41 smithi012 ceph-mon[32370]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:42.236 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:42.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:41 smithi103 ceph-mon[36921]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:42.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:41 smithi055 ceph-mon[36853]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:42.669 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:42.669 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:42.669 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:42.670 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:42.715 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266727 got 227633266730 for osd.7 2024-02-14T13:07:42.715 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:44.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:43 smithi012 ceph-mon[32370]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:44.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:43 smithi103 ceph-mon[36921]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:44.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:43 smithi055 ceph-mon[36853]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 -- 172.21.15.12:0/357917921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 msgr2=0x7ff1f4105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/357917921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f4105820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc009990 tx=0x7ff1dc009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 -- 172.21.15.12:0/357917921 shutdown_connections 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/357917921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1f4105f00 0x7ff1f410dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/357917921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1f4100eb0 0x7ff1f4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/357917921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f4105820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 -- 172.21.15.12:0/357917921 >> 172.21.15.12:0/357917921 conn(0x7ff1f4076c70 msgr2=0x7ff1f4077080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:45.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 -- 172.21.15.12:0/357917921 shutdown_connections 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 -- 172.21.15.12:0/357917921 wait complete. 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 Processor -- start 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.880+0000 7ff1f94c0700 1 -- start start 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1f4100eb0 0x7ff1f4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1f4105f00 0x7ff1f419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f419d150 con 0x7ff1f4101860 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f419d2c0 con 0x7ff1f4105f00 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f419d480 con 0x7ff1f4100eb0 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f41987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52758/0 (socket says 172.21.15.12:52758) 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 -- 172.21.15.12:0/2034663593 learned_addr learned my addr 172.21.15.12:0/2034663593 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:45.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f2ffd700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1f4100eb0 0x7ff1f4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 -- 172.21.15.12:0/2034663593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1f4100eb0 msgr2=0x7ff1f4198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1f4100eb0 0x7ff1f4198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 -- 172.21.15.12:0/2034663593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1f4105f00 msgr2=0x7ff1f419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f37fe700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1f4105f00 0x7ff1f419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1f4105f00 0x7ff1f419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 -- 172.21.15.12:0/2034663593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0095f0 con 0x7ff1f4101860 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f27fc700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f41987b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc000c00 tx=0x7ff1dc00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc01d070 con 0x7ff1f4101860 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f419d700 con 0x7ff1f4101860 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff1dc003680 con 0x7ff1f4101860 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.881+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0173f0 con 0x7ff1f4101860 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.882+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f41a4fc0 con 0x7ff1f4101860 2024-02-14T13:07:45.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.882+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f4109220 con 0x7ff1f4101860 2024-02-14T13:07:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.884+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7ff1dc022470 con 0x7ff1f4101860 2024-02-14T13:07:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.884+0000 7ff1ebfff700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1e00a21e0 0x7ff1e00a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.884+0000 7ff1f2ffd700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1e00a21e0 0x7ff1e00a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.884+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff1dc0cefb0 con 0x7ff1f4101860 2024-02-14T13:07:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.885+0000 7ff1f2ffd700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1e00a21e0 0x7ff1e00a46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a400 tx=0x7ff1e400d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:45.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:45.888+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff1dc098060 con 0x7ff1f4101860 2024-02-14T13:07:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:45.917 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:46.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.100+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7ff1f41995d0 con 0x7ff1f4101860 2024-02-14T13:07:46.102 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:45 smithi012 ceph-mon[32370]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:46.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.100+0000 7ff1ebfff700 1 -- 172.21.15.12:0/2034663593 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff1dc09b720 con 0x7ff1f4101860 2024-02-14T13:07:46.103 INFO:teuthology.orchestra.run.smithi012.stdout:296352743458 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1e00a21e0 msgr2=0x7ff1e00a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1e00a21e0 0x7ff1e00a46a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a400 tx=0x7ff1e400d040 comp rx=0 tx=0).stop 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 msgr2=0x7ff1f41987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f41987b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc000c00 tx=0x7ff1dc00f710 comp rx=0 tx=0).stop 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 shutdown_connections 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1f4105f00 0x7ff1f419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1f4100eb0 0x7ff1f4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1e00a21e0 0x7ff1e00a46a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 --2- 172.21.15.12:0/2034663593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1f4101860 0x7ff1f41987b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 >> 172.21.15.12:0/2034663593 conn(0x7ff1f4076c70 msgr2=0x7ff1f40feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 shutdown_connections 2024-02-14T13:07:46.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:46.103+0000 7ff1f94c0700 1 -- 172.21.15.12:0/2034663593 wait complete. 2024-02-14T13:07:46.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:45 smithi103 ceph-mon[36921]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:46.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:45 smithi055 ceph-mon[36853]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:47.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:46 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2034663593' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-02-14T13:07:47.284 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:46 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2034663593' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-02-14T13:07:47.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:46 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2034663593' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-02-14T13:07:47.700 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743455 got 296352743458 for osd.9 2024-02-14T13:07:47.700 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:48.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:47 smithi012 ceph-mon[32370]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:48.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:47 smithi103 ceph-mon[36921]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:48.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:47 smithi055 ceph-mon[36853]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:07:49.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-02-14T13:07:49.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-02-14T13:07:49.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:48 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:07:49.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-02-14T13:07:49.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-02-14T13:07:49.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:48 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-02-14T13:07:49.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-02-14T13:07:49.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-02-14T13:07:49.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-02-14T13:07:49.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-02-14T13:07:49.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:48 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:07:49.952 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:07:50.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-02-14T13:07:50.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-02-14T13:07:50.312 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:49 smithi055 ceph-mon[36853]: osdmap e88: 12 total, 12 up, 12 in 2024-02-14T13:07:50.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:50.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-02-14T13:07:50.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-02-14T13:07:50.468 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:49 smithi012 ceph-mon[32370]: osdmap e88: 12 total, 12 up, 12 in 2024-02-14T13:07:50.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-02-14T13:07:50.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:49 smithi103 ceph-mon[36921]: osdmap e88: 12 total, 12 up, 12 in 2024-02-14T13:07:51.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:50 smithi012 ceph-mon[32370]: osdmap e89: 12 total, 12 up, 12 in 2024-02-14T13:07:51.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.197 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:50 smithi055 ceph-mon[36853]: osdmap e89: 12 total, 12 up, 12 in 2024-02-14T13:07:51.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:50 smithi103 ceph-mon[36921]: osdmap e89: 12 total, 12 up, 12 in 2024-02-14T13:07:51.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:07:51.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 -- 172.21.15.12:0/3001339372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 msgr2=0x7f6598105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 --2- 172.21.15.12:0/3001339372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598105820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6588009990 tx=0x7f6588009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 -- 172.21.15.12:0/3001339372 shutdown_connections 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 --2- 172.21.15.12:0/3001339372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6598105f00 0x7f659810dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 --2- 172.21.15.12:0/3001339372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6598100eb0 0x7f6598101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 --2- 172.21.15.12:0/3001339372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598105820 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 -- 172.21.15.12:0/3001339372 >> 172.21.15.12:0/3001339372 conn(0x7f6598076c70 msgr2=0x7f6598077080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 -- 172.21.15.12:0/3001339372 shutdown_connections 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.828+0000 7f65a0615700 1 -- 172.21.15.12:0/3001339372 wait complete. 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 Processor -- start 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 -- start start 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6598100eb0 0x7f65981981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:51.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6598105f00 0x7f659819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659819d0d0 con 0x7f6598101860 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659819d240 con 0x7f6598105f00 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f65a0615700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659819d400 con 0x7f6598100eb0 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f659dbb0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f659dbb0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52772/0 (socket says 172.21.15.12:52772) 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.829+0000 7f659dbb0700 1 -- 172.21.15.12:0/1375775671 learned_addr learned my addr 172.21.15.12:0/1375775671 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659ebb2700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6598105f00 0x7f659819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659e3b1700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6598100eb0 0x7f65981981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659dbb0700 1 -- 172.21.15.12:0/1375775671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6598100eb0 msgr2=0x7f65981981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659dbb0700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6598100eb0 0x7f65981981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659dbb0700 1 -- 172.21.15.12:0/1375775671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6598105f00 msgr2=0x7f659819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:51.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659dbb0700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6598105f00 0x7f659819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659dbb0700 1 -- 172.21.15.12:0/1375775671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880095f0 con 0x7f6598101860 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f659dbb0700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598198730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6588000c00 tx=0x7f658800f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658801d070 con 0x7f6598101860 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6588003680 con 0x7f6598101860 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659819d680 con 0x7f6598101860 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588017650 con 0x7f6598101860 2024-02-14T13:07:51.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.830+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65981a4f40 con 0x7f6598101860 2024-02-14T13:07:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.831+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6598109220 con 0x7f6598101860 2024-02-14T13:07:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.832+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f65880050d0 con 0x7f6598101860 2024-02-14T13:07:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.833+0000 7f658f7fe700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f65840a21e0 0x7f65840a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.833+0000 7f659e3b1700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f65840a21e0 0x7f65840a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.833+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f65880cf470 con 0x7f6598101860 2024-02-14T13:07:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.833+0000 7f659e3b1700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f65840a21e0 0x7f65840a46a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6594005ea0 tx=0x7f6594005e30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:51.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:51.837+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f65880982f0 con 0x7f6598101860 2024-02-14T13:07:52.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.043+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f6598199550 con 0x7f6598101860 2024-02-14T13:07:52.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.043+0000 7f658f7fe700 1 -- 172.21.15.12:0/1375775671 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6588027020 con 0x7f6598101860 2024-02-14T13:07:52.045 INFO:teuthology.orchestra.run.smithi012.stdout:261993005096 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.045+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f65840a21e0 msgr2=0x7f65840a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.045+0000 7f65a0615700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f65840a21e0 0x7f65840a46a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6594005ea0 tx=0x7f6594005e30 comp rx=0 tx=0).stop 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.045+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 msgr2=0x7f6598198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.045+0000 7f65a0615700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598198730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6588000c00 tx=0x7f658800f6f0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 shutdown_connections 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6598105f00 0x7f659819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6598100eb0 0x7f65981981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f65840a21e0 0x7f65840a46a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 --2- 172.21.15.12:0/1375775671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6598101860 0x7f6598198730 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 >> 172.21.15.12:0/1375775671 conn(0x7f6598076c70 msgr2=0x7f65980fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:52.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 shutdown_connections 2024-02-14T13:07:52.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.046+0000 7f65a0615700 1 -- 172.21.15.12:0/1375775671 wait complete. 2024-02-14T13:07:52.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:52 smithi012 ceph-mon[32370]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-02-14T13:07:52.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:52 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1375775671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-02-14T13:07:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:52 smithi103 ceph-mon[36921]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-02-14T13:07:52.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:52 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1375775671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-02-14T13:07:52.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:52 smithi055 ceph-mon[36853]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-02-14T13:07:52.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:52 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1375775671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-02-14T13:07:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 -- 172.21.15.12:0/3297810904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 msgr2=0x7f84dc107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 --2- 172.21.15.12:0/3297810904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc107090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009990 tx=0x7f84cc009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 -- 172.21.15.12:0/3297810904 shutdown_connections 2024-02-14T13:07:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 --2- 172.21.15.12:0/3297810904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84dc1015c0 0x7f84dc10da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 --2- 172.21.15.12:0/3297810904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc107090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 --2- 172.21.15.12:0/3297810904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc100c00 0x7f84dc101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 -- 172.21.15.12:0/3297810904 >> 172.21.15.12:0/3297810904 conn(0x7f84dc077c30 msgr2=0x7f84dc078040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 -- 172.21.15.12:0/3297810904 shutdown_connections 2024-02-14T13:07:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.887+0000 7f84e26cf700 1 -- 172.21.15.12:0/3297810904 wait complete. 2024-02-14T13:07:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 Processor -- start 2024-02-14T13:07:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 -- start start 2024-02-14T13:07:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc100c00 0x7f84dc1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84dc1015c0 0x7f84dc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc1a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc199ee0 con 0x7f84dc106cb0 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc1a46a0 con 0x7f84dc100c00 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.888+0000 7f84e26cf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc1a47e0 con 0x7f84dc1015c0 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc1a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc1a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52800/0 (socket says 172.21.15.12:52800) 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 -- 172.21.15.12:0/689629935 learned_addr learned my addr 172.21.15.12:0/689629935 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84db7fe700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84dc1015c0 0x7f84dc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84dbfff700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc100c00 0x7f84dc1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 -- 172.21.15.12:0/689629935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84dc1015c0 msgr2=0x7f84dc199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84dc1015c0 0x7f84dc199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 -- 172.21.15.12:0/689629935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc100c00 msgr2=0x7f84dc1990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc100c00 0x7f84dc1990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 -- 172.21.15.12:0/689629935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0095f0 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e0c6c700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc1a4160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f84d400b970 tx=0x7f84d400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400c930 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc1a4ac0 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f84d4014440 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40075d0 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.889+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc1a4f70 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.890+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc109020 con 0x7f84dc106cb0 2024-02-14T13:07:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.891+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f84d40145b0 con 0x7f84dc106cb0 2024-02-14T13:07:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.892+0000 7f84d97fa700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84c40a21e0 0x7f84c40a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.892+0000 7f84dbfff700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84c40a21e0 0x7f84c40a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.892+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f84d4006e40 con 0x7f84dc106cb0 2024-02-14T13:07:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.893+0000 7f84dbfff700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84c40a21e0 0x7f84c40a46a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f84cc006010 tx=0x7f84cc00b540 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:52.896+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f84d40967a0 con 0x7f84dc106cb0 2024-02-14T13:07:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.099+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84dc110d40 con 0x7f84dc106cb0 2024-02-14T13:07:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.100+0000 7f84d97fa700 1 -- 172.21.15.12:0/689629935 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84d4099e60 con 0x7f84dc106cb0 2024-02-14T13:07:53.102 INFO:teuthology.orchestra.run.smithi012.stdout:77309411398 2024-02-14T13:07:53.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84c40a21e0 msgr2=0x7f84c40a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:53.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84c40a21e0 0x7f84c40a46a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f84cc006010 tx=0x7f84cc00b540 comp rx=0 tx=0).stop 2024-02-14T13:07:53.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 msgr2=0x7f84dc1a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:53.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc1a4160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f84d400b970 tx=0x7f84d400bc80 comp rx=0 tx=0).stop 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 shutdown_connections 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84c40a21e0 0x7f84c40a46a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84dc106cb0 0x7f84dc1a4160 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84dc100c00 0x7f84dc1990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 --2- 172.21.15.12:0/689629935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84dc1015c0 0x7f84dc199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 >> 172.21.15.12:0/689629935 conn(0x7f84dc077c30 msgr2=0x7f84dc0ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 shutdown_connections 2024-02-14T13:07:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.102+0000 7f84e26cf700 1 -- 172.21.15.12:0/689629935 wait complete. 2024-02-14T13:07:53.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:53 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/689629935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-14T13:07:53.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:53 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/689629935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-14T13:07:53.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:53 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/689629935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-14T13:07:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 -- 172.21.15.12:0/3813157996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec101d70 msgr2=0x7f84ec1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 --2- 172.21.15.12:0/3813157996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec101d70 0x7f84ec1021f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0099c0 tx=0x7f84dc009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 -- 172.21.15.12:0/3813157996 shutdown_connections 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 --2- 172.21.15.12:0/3813157996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84ec102730 0x7f84ec10eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 --2- 172.21.15.12:0/3813157996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec107d50 0x7f84ec108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 --2- 172.21.15.12:0/3813157996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec101d70 0x7f84ec1021f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 -- 172.21.15.12:0/3813157996 >> 172.21.15.12:0/3813157996 conn(0x7f84ec078e50 msgr2=0x7f84ec079260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 -- 172.21.15.12:0/3813157996 shutdown_connections 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.904+0000 7f84f428a700 1 -- 172.21.15.12:0/3813157996 wait complete. 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 Processor -- start 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 -- start start 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84ec101d70 0x7f84ec198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec102730 0x7f84ec1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 0x7f84ec19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec19d060 con 0x7f84ec107d50 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec19d1d0 con 0x7f84ec102730 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f428a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec19d390 con 0x7f84ec101d70 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f2827700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 0x7f84ec19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f2827700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 0x7f84ec19ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52806/0 (socket says 172.21.15.12:52806) 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.905+0000 7f84f2827700 1 -- 172.21.15.12:0/3895680054 learned_addr learned my addr 172.21.15.12:0/3895680054 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2026700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84ec101d70 0x7f84ec198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f1825700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec102730 0x7f84ec1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2827700 1 -- 172.21.15.12:0/3895680054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84ec101d70 msgr2=0x7f84ec198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2827700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84ec101d70 0x7f84ec198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2827700 1 -- 172.21.15.12:0/3895680054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec102730 msgr2=0x7f84ec1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2827700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec102730 0x7f84ec1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2827700 1 -- 172.21.15.12:0/3895680054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc0095f0 con 0x7f84ec107d50 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f2827700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 0x7f84ec19ca50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84e4007d70 tx=0x7f84e400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400ac90 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f84e400adf0 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec19d670 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40116b0 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.906+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec1a4ed0 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.907+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec10a230 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.908+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f84e4012420 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.909+0000 7f84e37fe700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84d80a21e0 0x7f84d80a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.909+0000 7f84f2026700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84d80a21e0 0x7f84d80a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.909+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f84e40ce510 con 0x7f84ec107d50 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.909+0000 7f84f2026700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84d80a21e0 0x7f84d80a46a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009a10 tx=0x7f84e8009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:53.913+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f84e4097410 con 0x7f84ec107d50 2024-02-14T13:07:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.116+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f84ec103400 con 0x7f84ec107d50 2024-02-14T13:07:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.116+0000 7f84e37fe700 1 -- 172.21.15.12:0/3895680054 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84e409aad0 con 0x7f84ec107d50 2024-02-14T13:07:54.118 INFO:teuthology.orchestra.run.smithi012.stdout:206158430259 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84d80a21e0 msgr2=0x7f84d80a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84d80a21e0 0x7f84d80a46a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009a10 tx=0x7f84e8009190 comp rx=0 tx=0).stop 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 msgr2=0x7f84ec19ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 0x7f84ec19ca50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f84e4007d70 tx=0x7f84e400a340 comp rx=0 tx=0).stop 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 shutdown_connections 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f84d80a21e0 0x7f84d80a46a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ec107d50 0x7f84ec19ca50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84ec101d70 0x7f84ec198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 --2- 172.21.15.12:0/3895680054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec102730 0x7f84ec1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 >> 172.21.15.12:0/3895680054 conn(0x7f84ec078e50 msgr2=0x7f84ec100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 shutdown_connections 2024-02-14T13:07:54.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.118+0000 7f84f428a700 1 -- 172.21.15.12:0/3895680054 wait complete. 2024-02-14T13:07:54.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:54 smithi012 ceph-mon[32370]: pgmap v321: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:54.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:54 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3895680054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-14T13:07:54.725 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430254 got 206158430259 for osd.6 2024-02-14T13:07:54.725 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:54.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:54 smithi103 ceph-mon[36921]: pgmap v321: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:54.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:54 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3895680054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-14T13:07:54.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:54 smithi055 ceph-mon[36853]: pgmap v321: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:54.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:54 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3895680054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-14T13:07:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 -- 172.21.15.12:0/4013421460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc101d70 msgr2=0x7efcfc1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 --2- 172.21.15.12:0/4013421460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc101d70 0x7efcfc1021f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efcf00099c0 tx=0x7efcf0009cd0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 -- 172.21.15.12:0/4013421460 shutdown_connections 2024-02-14T13:07:54.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 --2- 172.21.15.12:0/4013421460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc102730 0x7efcfc10eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 --2- 172.21.15.12:0/4013421460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcfc107d50 0x7efcfc108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 --2- 172.21.15.12:0/4013421460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc101d70 0x7efcfc1021f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 -- 172.21.15.12:0/4013421460 >> 172.21.15.12:0/4013421460 conn(0x7efcfc078e50 msgr2=0x7efcfc079260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 -- 172.21.15.12:0/4013421460 shutdown_connections 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.909+0000 7efd01c18700 1 -- 172.21.15.12:0/4013421460 wait complete. 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 Processor -- start 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 -- start start 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc101d70 0x7efcfc074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 0x7efcfc074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcfc107d50 0x7efcfc074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc075fc0 con 0x7efcfc102730 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc1aab30 con 0x7efcfc101d70 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efd01c18700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc1aacc0 con 0x7efcfc107d50 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.910+0000 7efcfaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 0x7efcfc074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:54.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 0x7efcfc074560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55922/0 (socket says 172.21.15.12:55922) 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 -- 172.21.15.12:0/2331188331 learned_addr learned my addr 172.21.15.12:0/2331188331 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfbfff700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcfc107d50 0x7efcfc074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfb7fe700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc101d70 0x7efcfc074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 -- 172.21.15.12:0/2331188331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcfc107d50 msgr2=0x7efcfc074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcfc107d50 0x7efcfc074aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 -- 172.21.15.12:0/2331188331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc101d70 msgr2=0x7efcfc074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc101d70 0x7efcfc074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 -- 172.21.15.12:0/2331188331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00095f0 con 0x7efcfc102730 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfb7fe700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc101d70 0x7efcfc074020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcfaffd700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 0x7efcfc074560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efcf000b580 tx=0x7efcf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf001d070 con 0x7efcfc102730 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc1aaf40 con 0x7efcfc102730 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7efcf0003f50 con 0x7efcfc102730 2024-02-14T13:07:54.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0022d60 con 0x7efcfc102730 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.911+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc1ab350 con 0x7efcfc102730 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.912+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc10a230 con 0x7efcfc102730 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.913+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7efcf0022470 con 0x7efcfc102730 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.914+0000 7efcf8ff9700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efce40a21e0 0x7efce40a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.914+0000 7efcfb7fe700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efce40a21e0 0x7efce40a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.914+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7efcf00cf000 con 0x7efcfc102730 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.914+0000 7efcfb7fe700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efce40a21e0 0x7efce40a46a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcec009b50 tx=0x7efcec009550 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:54.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:54.918+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efcf0097f80 con 0x7efcfc102730 2024-02-14T13:07:55.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.127+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efcfc103400 con 0x7efcfc102730 2024-02-14T13:07:55.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.128+0000 7efcf8ff9700 1 -- 172.21.15.12:0/2331188331 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcf009b640 con 0x7efcfc102730 2024-02-14T13:07:55.130 INFO:teuthology.orchestra.run.smithi012.stdout:150323855421 2024-02-14T13:07:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efce40a21e0 msgr2=0x7efce40a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efce40a21e0 0x7efce40a46a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcec009b50 tx=0x7efcec009550 comp rx=0 tx=0).stop 2024-02-14T13:07:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 msgr2=0x7efcfc074560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 0x7efcfc074560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efcf000b580 tx=0x7efcf0004730 comp rx=0 tx=0).stop 2024-02-14T13:07:55.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 shutdown_connections 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcfc107d50 0x7efcfc074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcfc101d70 0x7efcfc074020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efce40a21e0 0x7efce40a46a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 --2- 172.21.15.12:0/2331188331 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcfc102730 0x7efcfc074560 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 >> 172.21.15.12:0/2331188331 conn(0x7efcfc078e50 msgr2=0x7efcfc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 shutdown_connections 2024-02-14T13:07:55.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.130+0000 7efd01c18700 1 -- 172.21.15.12:0/2331188331 wait complete. 2024-02-14T13:07:55.455 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:55 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2331188331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 -- 172.21.15.12:0/3448111710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 msgr2=0x7f02a8107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 --2- 172.21.15.12:0/3448111710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a8107040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f02a000b0a0 tx=0x7f02a000b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 -- 172.21.15.12:0/3448111710 shutdown_connections 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 --2- 172.21.15.12:0/3448111710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a81015c0 0x7f02a810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 --2- 172.21.15.12:0/3448111710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a8107040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 --2- 172.21.15.12:0/3448111710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a8100c20 0x7f02a8101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 -- 172.21.15.12:0/3448111710 >> 172.21.15.12:0/3448111710 conn(0x7f02a8077b50 msgr2=0x7f02a8077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 -- 172.21.15.12:0/3448111710 shutdown_connections 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.559+0000 7f02ac839700 1 -- 172.21.15.12:0/3448111710 wait complete. 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 Processor -- start 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 -- start start 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a8100c20 0x7f02a8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a81015c0 0x7f02a81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a819d240 con 0x7f02a8106c60 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a819d3b0 con 0x7f02a81015c0 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02ac839700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a819d570 con 0x7f02a8100c20 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02a6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02a6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55946/0 (socket says 172.21.15.12:55946) 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02a6d9d700 1 -- 172.21.15.12:0/188562672 learned_addr learned my addr 172.21.15.12:0/188562672 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:55.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02a659c700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a8100c20 0x7f02a8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.560+0000 7f02a5d9b700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a81015c0 0x7f02a81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02a6d9d700 1 -- 172.21.15.12:0/188562672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a8100c20 msgr2=0x7f02a8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02a6d9d700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a8100c20 0x7f02a8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02a6d9d700 1 -- 172.21.15.12:0/188562672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a81015c0 msgr2=0x7f02a81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02a6d9d700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a81015c0 0x7f02a81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02a6d9d700 1 -- 172.21.15.12:0/188562672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0009d00 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02a6d9d700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a819cc30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f029800c900 tx=0x7f029800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980078d0 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f029800f450 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a819d850 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298018660 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.561+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a81a50b0 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.562+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a80689e0 con 0x7f02a8106c60 2024-02-14T13:07:55.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.564+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f029800f5c0 con 0x7f02a8106c60 2024-02-14T13:07:55.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.564+0000 7f029f7fe700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f02940a21e0 0x7f02940a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:55.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.564+0000 7f02a659c700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f02940a21e0 0x7f02940a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:55.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.564+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f02980cdfd0 con 0x7f02a8106c60 2024-02-14T13:07:55.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.565+0000 7f02a659c700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f02940a21e0 0x7f02940a46a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02a000b830 tx=0x7f02a0006210 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:55.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.568+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0298096ec0 con 0x7f02a8106c60 2024-02-14T13:07:55.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:55 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2331188331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-14T13:07:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.775+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f02a8110c90 con 0x7f02a8106c60 2024-02-14T13:07:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.775+0000 7f029f7fe700 1 -- 172.21.15.12:0/188562672 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f029809a580 con 0x7f02a8106c60 2024-02-14T13:07:55.777 INFO:teuthology.orchestra.run.smithi012.stdout:317827579935 2024-02-14T13:07:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f02940a21e0 msgr2=0x7f02940a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f02940a21e0 0x7f02940a46a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f02a000b830 tx=0x7f02a0006210 comp rx=0 tx=0).stop 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 msgr2=0x7f02a819cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a819cc30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f029800c900 tx=0x7f029800cc10 comp rx=0 tx=0).stop 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 shutdown_connections 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f02940a21e0 0x7f02940a46a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02a8106c60 0x7f02a819cc30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02a8100c20 0x7f02a8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 --2- 172.21.15.12:0/188562672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02a81015c0 0x7f02a81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 >> 172.21.15.12:0/188562672 conn(0x7f02a8077b50 msgr2=0x7f02a80fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.777+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 shutdown_connections 2024-02-14T13:07:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:55.778+0000 7f02ac839700 1 -- 172.21.15.12:0/188562672 wait complete. 2024-02-14T13:07:55.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:55 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2331188331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-14T13:07:56.163 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855417 got 150323855421 for osd.4 2024-02-14T13:07:56.163 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:56 smithi012 ceph-mon[32370]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:56.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:56 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/188562672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-02-14T13:07:56.628 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411398 for osd.2 2024-02-14T13:07:56.628 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:56.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:56 smithi103 ceph-mon[36921]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:56.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:56 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/188562672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-02-14T13:07:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:56 smithi055 ceph-mon[36853]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:56.810 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:56 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/188562672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-02-14T13:07:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1610438352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484106cb0 msgr2=0x7fc484107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1610438352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484106cb0 0x7fc484107090 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc478009990 tx=0x7fc478009ca0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1610438352 shutdown_connections 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1610438352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4841015c0 0x7fc48410da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1610438352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484106cb0 0x7fc484107090 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1610438352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc484100c00 0x7fc484101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1610438352 >> 172.21.15.12:0/1610438352 conn(0x7fc484077c30 msgr2=0x7fc484078040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.512+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1610438352 shutdown_connections 2024-02-14T13:07:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1610438352 wait complete. 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 Processor -- start 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 -- start start 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 0x7fc484198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4841015c0 0x7fc484198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc484106cb0 0x7fc48419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48419d020 con 0x7fc484100c00 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48419d190 con 0x7fc484106cb0 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48c5f9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48419d350 con 0x7fc4841015c0 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48a395700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 0x7fc484198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48a395700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 0x7fc484198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55966/0 (socket says 172.21.15.12:55966) 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.513+0000 7fc48a395700 1 -- 172.21.15.12:0/1178884951 learned_addr learned my addr 172.21.15.12:0/1178884951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc489b94700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4841015c0 0x7fc484198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:57.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48a395700 1 -- 172.21.15.12:0/1178884951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4841015c0 msgr2=0x7fc484198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48a395700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4841015c0 0x7fc484198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48a395700 1 -- 172.21.15.12:0/1178884951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc484106cb0 msgr2=0x7fc48419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48a395700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc484106cb0 0x7fc48419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48a395700 1 -- 172.21.15.12:0/1178884951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780095f0 con 0x7fc484100c00 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc489b94700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4841015c0 0x7fc484198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48a395700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 0x7fc484198140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4780098e0 tx=0x7fc47800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47801d070 con 0x7fc484100c00 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc478003680 con 0x7fc484100c00 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48419d5d0 con 0x7fc484100c00 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478017650 con 0x7fc484100c00 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.514+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4841a4e90 con 0x7fc484100c00 2024-02-14T13:07:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.515+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4840689e0 con 0x7fc484100c00 2024-02-14T13:07:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.516+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fc478022470 con 0x7fc484100c00 2024-02-14T13:07:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.517+0000 7fc4777fe700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4700a21e0 0x7fc4700a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.517+0000 7fc489b94700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4700a21e0 0x7fc4700a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.517+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc4780cf490 con 0x7fc484100c00 2024-02-14T13:07:57.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.518+0000 7fc489b94700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4700a21e0 0x7fc4700a46a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc484078210 tx=0x7fc48000b2c0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:57.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.521+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc478098370 con 0x7fc484100c00 2024-02-14T13:07:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.727+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc484110c80 con 0x7fc484100c00 2024-02-14T13:07:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.728+0000 7fc4777fe700 1 -- 172.21.15.12:0/1178884951 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc478027020 con 0x7fc484100c00 2024-02-14T13:07:57.730 INFO:teuthology.orchestra.run.smithi012.stdout:115964117059 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4700a21e0 msgr2=0x7fc4700a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4700a21e0 0x7fc4700a46a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc484078210 tx=0x7fc48000b2c0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 msgr2=0x7fc484198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 0x7fc484198140 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4780098e0 tx=0x7fc47800f690 comp rx=0 tx=0).stop 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 shutdown_connections 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc484106cb0 0x7fc48419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4700a21e0 0x7fc4700a46a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc484100c00 0x7fc484198140 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 --2- 172.21.15.12:0/1178884951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4841015c0 0x7fc484198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 >> 172.21.15.12:0/1178884951 conn(0x7fc484077c30 msgr2=0x7fc4840fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:57.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 shutdown_connections 2024-02-14T13:07:57.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:57.730+0000 7fc48c5f9700 1 -- 172.21.15.12:0/1178884951 wait complete. 2024-02-14T13:07:57.963 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579932 got 317827579935 for osd.10 2024-02-14T13:07:57.963 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:58.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005091 got 261993005096 for osd.8 2024-02-14T13:07:58.417 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:58.613 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:58 smithi055 ceph-mon[36853]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:58.613 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:58 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1178884951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-14T13:07:58.659 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:58 smithi012 ceph-mon[32370]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:58.660 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:58 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1178884951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 -- 172.21.15.12:0/3850330848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188107040 msgr2=0x7ff18810ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 --2- 172.21.15.12:0/3850330848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188107040 0x7ff18810ec10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff18000b0a0 tx=0x7ff18000b3b0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 -- 172.21.15.12:0/3850330848 shutdown_connections 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 --2- 172.21.15.12:0/3850330848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188107040 0x7ff18810ec10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 --2- 172.21.15.12:0/3850330848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff188101f60 0x7ff188102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 --2- 172.21.15.12:0/3850330848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 0x7ff188106960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 -- 172.21.15.12:0/3850330848 >> 172.21.15.12:0/3850330848 conn(0x7ff1880fd7d0 msgr2=0x7ff1880ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 -- 172.21.15.12:0/3850330848 shutdown_connections 2024-02-14T13:07:58.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 -- 172.21.15.12:0/3850330848 wait complete. 2024-02-14T13:07:58.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.668+0000 7ff18e322700 1 Processor -- start 2024-02-14T13:07:58.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 -- start start 2024-02-14T13:07:58.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 0x7ff188198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:58.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 0x7ff188198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff188107040 0x7ff18819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18819d3b0 con 0x7ff188101f60 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18819d520 con 0x7ff188107040 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18e322700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18819d6e0 con 0x7ff188102910 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 0x7ff188198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 0x7ff188198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55986/0 (socket says 172.21.15.12:55986) 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 -- 172.21.15.12:0/1966392657 learned_addr learned my addr 172.21.15.12:0/1966392657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff1877fe700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 0x7ff188198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 -- 172.21.15.12:0/1966392657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 msgr2=0x7ff188198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff18c8bf700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff188107040 0x7ff18819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 0x7ff188198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 -- 172.21.15.12:0/1966392657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff188107040 msgr2=0x7ff18819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff188107040 0x7ff18819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff187fff700 1 -- 172.21.15.12:0/1966392657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff180009d00 con 0x7ff188101f60 2024-02-14T13:07:58.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.669+0000 7ff1877fe700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 0x7ff188198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.670+0000 7ff187fff700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 0x7ff188198520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b530 tx=0x7ff17800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.670+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178011830 con 0x7ff188101f60 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.670+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff178011e70 con 0x7ff188101f60 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.670+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18819d9c0 con 0x7ff188101f60 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.670+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800f2e0 con 0x7ff188101f60 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.670+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1881a5220 con 0x7ff188101f60 2024-02-14T13:07:58.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.671+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18810a360 con 0x7ff188101f60 2024-02-14T13:07:58.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.672+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7ff1780105f0 con 0x7ff188101f60 2024-02-14T13:07:58.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.673+0000 7ff1857fa700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1700a2260 0x7ff1700a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:07:58.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.673+0000 7ff1877fe700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1700a2260 0x7ff1700a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:07:58.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.673+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff1780cdce0 con 0x7ff188101f60 2024-02-14T13:07:58.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.673+0000 7ff1877fe700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1700a2260 0x7ff1700a4720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff188100f80 tx=0x7ff17c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:07:58.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.677+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff178096be0 con 0x7ff188101f60 2024-02-14T13:07:58.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:58 smithi103 ceph-mon[36921]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:58.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:58 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1178884951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-14T13:07:58.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.881+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff18819db50 con 0x7ff188101f60 2024-02-14T13:07:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.881+0000 7ff1857fa700 1 -- 172.21.15.12:0/1966392657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff18819db50 con 0x7ff188101f60 2024-02-14T13:07:58.883 INFO:teuthology.orchestra.run.smithi012.stdout:34359738450 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1700a2260 msgr2=0x7ff1700a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1700a2260 0x7ff1700a4720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff188100f80 tx=0x7ff17c008040 comp rx=0 tx=0).stop 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 msgr2=0x7ff188198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 0x7ff188198520 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b530 tx=0x7ff17800b8f0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 shutdown_connections 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff188107040 0x7ff18819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff1700a2260 0x7ff1700a4720 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff188101f60 0x7ff188198520 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 --2- 172.21.15.12:0/1966392657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff188102910 0x7ff188198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:07:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 >> 172.21.15.12:0/1966392657 conn(0x7ff1880fd7d0 msgr2=0x7ff1880ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:07:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 shutdown_connections 2024-02-14T13:07:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:58.883+0000 7ff18e322700 1 -- 172.21.15.12:0/1966392657 wait complete. 2024-02-14T13:07:59.305 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117053 got 115964117059 for osd.3 2024-02-14T13:07:59.305 DEBUG:teuthology.parallel:result is None 2024-02-14T13:07:59.901 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:59 smithi055 ceph-mon[36853]: pgmap v324: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:59.901 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:07:59 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1966392657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-14T13:07:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:59 smithi012 ceph-mon[32370]: pgmap v324: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:07:59 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1966392657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-14T13:07:59.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:59 smithi103 ceph-mon[36921]: pgmap v324: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:07:59.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:07:59 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1966392657' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 -- 172.21.15.12:0/20071762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0106e10 msgr2=0x7fcac01071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 --2- 172.21.15.12:0/20071762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0106e10 0x7fcac01071f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009990 tx=0x7fcab4009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 -- 172.21.15.12:0/20071762 shutdown_connections 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 --2- 172.21.15.12:0/20071762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac01018c0 0x7fcac010daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 --2- 172.21.15.12:0/20071762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0106e10 0x7fcac01071f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 --2- 172.21.15.12:0/20071762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcac0100f00 0x7fcac0101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 -- 172.21.15.12:0/20071762 >> 172.21.15.12:0/20071762 conn(0x7fcac0077a80 msgr2=0x7fcac0077e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 -- 172.21.15.12:0/20071762 shutdown_connections 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.508+0000 7fcac761f700 1 -- 172.21.15.12:0/20071762 wait complete. 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 Processor -- start 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 -- start start 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 0x7fcac0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcac01018c0 0x7fcac0198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac0106e10 0x7fcac019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac019d230 con 0x7fcac0100f00 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac019d3a0 con 0x7fcac01018c0 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac761f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac019d560 con 0x7fcac0106e10 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 0x7fcac0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:00.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 0x7fcac0198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56016/0 (socket says 172.21.15.12:56016) 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 -- 172.21.15.12:0/891217345 learned_addr learned my addr 172.21.15.12:0/891217345 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac4bba700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcac01018c0 0x7fcac0198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 -- 172.21.15.12:0/891217345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac0106e10 msgr2=0x7fcac019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac0106e10 0x7fcac019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 -- 172.21.15.12:0/891217345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcac01018c0 msgr2=0x7fcac0198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcac01018c0 0x7fcac0198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.428 INFO:teuthology.orchestra.run.smithi012.stdout:171798691897 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.509+0000 7fcac53bb700 1 -- 172.21.15.12:0/891217345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40095f0 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.510+0000 7fcac53bb700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 0x7fcac0198350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcab40098e0 tx=0x7fcab400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.510+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab401d070 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.510+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac019d7e0 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.510+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fcab400fc70 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.510+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab40176e0 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.510+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac01a50a0 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.511+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac01023a0 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.513+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fcab40229e0 con 0x7fcac0100f00 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.513+0000 7fcab27fc700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcaac0a21e0 0x7fcaac0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:00.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.513+0000 7fcac4bba700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcaac0a21e0 0x7fcaac0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.513+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fcab40cf450 con 0x7fcac0100f00 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.514+0000 7fcac4bba700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcaac0a21e0 0x7fcaac0a46a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.517+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcab4098330 con 0x7fcac0100f00 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.725+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcac0199710 con 0x7fcac0100f00 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.725+0000 7fcab27fc700 1 -- 172.21.15.12:0/891217345 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcab409b9f0 con 0x7fcac0100f00 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcaac0a21e0 msgr2=0x7fcaac0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcaac0a21e0 0x7fcaac0a46a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc008040 comp rx=0 tx=0).stop 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 msgr2=0x7fcac0198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 0x7fcac0198350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcab40098e0 tx=0x7fcab400f740 comp rx=0 tx=0).stop 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 shutdown_connections 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcac0106e10 0x7fcac019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fcaac0a21e0 0x7fcaac0a46a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcac0100f00 0x7fcac0198350 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 --2- 172.21.15.12:0/891217345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcac01018c0 0x7fcac0198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 >> 172.21.15.12:0/891217345 conn(0x7fcac0077a80 msgr2=0x7fcac01001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.727+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 shutdown_connections 2024-02-14T13:08:00.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:07:59.728+0000 7fcac761f700 1 -- 172.21.15.12:0/891217345 wait complete. 2024-02-14T13:08:00.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:00 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/891217345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-14T13:08:00.869 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:00 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/891217345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-14T13:08:00.893 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:00 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/891217345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-14T13:08:01.025 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691890 got 171798691897 for osd.5 2024-02-14T13:08:01.025 DEBUG:teuthology.parallel:result is None 2024-02-14T13:08:01.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:01 smithi012 ceph-mon[32370]: pgmap v325: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:01.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:01 smithi103 ceph-mon[36921]: pgmap v325: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:02.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:01 smithi055 ceph-mon[36853]: pgmap v325: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 986 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:02.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738450 for osd.0 2024-02-14T13:08:02.320 DEBUG:teuthology.parallel:result is None 2024-02-14T13:08:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/1442544016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d41018c0 msgr2=0x7ff4d410dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/1442544016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d41018c0 0x7ff4d410dae0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00b0d0 tx=0x7ff4cc00b3e0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/1442544016 shutdown_connections 2024-02-14T13:08:03.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/1442544016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d41018c0 0x7ff4d410dae0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/1442544016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d4106d50 0x7ff4d4107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/1442544016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4d4100f00 0x7ff4d4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/1442544016 >> 172.21.15.12:0/1442544016 conn(0x7ff4d4077ae0 msgr2=0x7ff4d4077ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/1442544016 shutdown_connections 2024-02-14T13:08:03.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.018+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/1442544016 wait complete. 2024-02-14T13:08:03.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 Processor -- start 2024-02-14T13:08:03.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 -- start start 2024-02-14T13:08:03.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 0x7ff4d4197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d41018c0 0x7ff4d4197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4d4106d50 0x7ff4d419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d419c100 con 0x7ff4d4100f00 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d419c270 con 0x7ff4d4106d50 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d8ad5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d419c430 con 0x7ff4d41018c0 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 0x7ff4d4197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 0x7ff4d4197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56042/0 (socket says 172.21.15.12:56042) 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d259c700 1 -- 172.21.15.12:0/3127950031 learned_addr learned my addr 172.21.15.12:0/3127950031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.019+0000 7ff4d1d9b700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d41018c0 0x7ff4d4197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d2d9d700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4d4106d50 0x7ff4d419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d259c700 1 -- 172.21.15.12:0/3127950031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d41018c0 msgr2=0x7ff4d4197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d259c700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d41018c0 0x7ff4d4197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d259c700 1 -- 172.21.15.12:0/3127950031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4d4106d50 msgr2=0x7ff4d419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d259c700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4d4106d50 0x7ff4d419baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d259c700 1 -- 172.21.15.12:0/3127950031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009d00 con 0x7ff4d4100f00 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d259c700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 0x7ff4d4197220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400d9e0 tx=0x7ff4c400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400ec50 con 0x7ff4d4100f00 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d419c710 con 0x7ff4d4100f00 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff4c400edb0 con 0x7ff4d4100f00 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c40147e0 con 0x7ff4d4100f00 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.020+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d406a590 con 0x7ff4d4100f00 2024-02-14T13:08:03.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.021+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40689e0 con 0x7ff4d4100f00 2024-02-14T13:08:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.023+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7ff4c4016b40 con 0x7ff4d4100f00 2024-02-14T13:08:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.023+0000 7ff4c37fe700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4bc0a21e0 0x7ff4bc0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.023+0000 7ff4d1d9b700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4bc0a21e0 0x7ff4bc0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.023+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4c40cfe20 con 0x7ff4d4100f00 2024-02-14T13:08:03.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.024+0000 7ff4d1d9b700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4bc0a21e0 0x7ff4bc0a46a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4078020 tx=0x7ff4c800a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:03.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.027+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff4c4098d80 con 0x7ff4d4100f00 2024-02-14T13:08:03.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 -- 172.21.15.12:0/2193184722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d20107d70 msgr2=0x7f1d20108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 --2- 172.21.15.12:0/2193184722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d20107d70 0x7f1d20108150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000b0d0 tx=0x7f1d1000b3e0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 -- 172.21.15.12:0/2193184722 shutdown_connections 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 --2- 172.21.15.12:0/2193184722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2006a370 0x7f1d2010ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 --2- 172.21.15.12:0/2193184722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d20107d70 0x7f1d20108150 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 --2- 172.21.15.12:0/2193184722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d200699d0 0x7f1d20069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 -- 172.21.15.12:0/2193184722 >> 172.21.15.12:0/2193184722 conn(0x7f1d20077b50 msgr2=0x7f1d20077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 -- 172.21.15.12:0/2193184722 shutdown_connections 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.228+0000 7f1d25cef700 1 -- 172.21.15.12:0/2193184722 wait complete. 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 Processor -- start 2024-02-14T13:08:03.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 -- start start 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d200699d0 0x7f1d201983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 0x7f1d201988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d20107d70 0x7f1d2019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2019d230 con 0x7f1d2006a370 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2019d3a0 con 0x7f1d20107d70 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d25cef700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2019d560 con 0x7f1d200699d0 2024-02-14T13:08:03.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d1effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 0x7f1d201988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d1effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 0x7f1d201988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56062/0 (socket says 172.21.15.12:56062) 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d1effd700 1 -- 172.21.15.12:0/4222817101 learned_addr learned my addr 172.21.15.12:0/4222817101 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d1ffff700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d20107d70 0x7f1d2019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.229+0000 7f1d1f7fe700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d200699d0 0x7f1d201983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1effd700 1 -- 172.21.15.12:0/4222817101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d200699d0 msgr2=0x7f1d201983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1effd700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d200699d0 0x7f1d201983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1effd700 1 -- 172.21.15.12:0/4222817101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d20107d70 msgr2=0x7f1d2019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1effd700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d20107d70 0x7f1d2019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1effd700 1 -- 172.21.15.12:0/4222817101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10009d00 con 0x7f1d2006a370 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1effd700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 0x7f1d201988e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400d950 tx=0x7f1d1400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400f890 con 0x7f1d2006a370 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2019d840 con 0x7f1d2006a370 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1d14010460 con 0x7f1d2006a370 2024-02-14T13:08:03.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d201a50a0 con 0x7f1d2006a370 2024-02-14T13:08:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.230+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400e610 con 0x7f1d2006a370 2024-02-14T13:08:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.231+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2010a290 con 0x7f1d2006a370 2024-02-14T13:08:03.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.232+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f1d14010960 con 0x7f1d2006a370 2024-02-14T13:08:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.233+0000 7f1d1cff9700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1d080a21e0 0x7f1d080a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.233+0000 7f1d1f7fe700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1d080a21e0 0x7f1d080a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.233+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1d140cdf70 con 0x7f1d2006a370 2024-02-14T13:08:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.234+0000 7f1d1f7fe700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1d080a21e0 0x7f1d080a46a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009fd0 tx=0x7f1d1000b040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:03.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.237+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4d4110d10 con 0x7ff4d4100f00 2024-02-14T13:08:03.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.237+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1d14096dc0 con 0x7f1d2006a370 2024-02-14T13:08:03.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.237+0000 7ff4c37fe700 1 -- 172.21.15.12:0/3127950031 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4c409c440 con 0x7ff4d4100f00 2024-02-14T13:08:03.239 INFO:teuthology.orchestra.run.smithi012.stdout:55834574926 2024-02-14T13:08:03.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4bc0a21e0 msgr2=0x7ff4bc0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4bc0a21e0 0x7ff4bc0a46a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4078020 tx=0x7ff4c800a380 comp rx=0 tx=0).stop 2024-02-14T13:08:03.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 msgr2=0x7ff4d4197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 0x7ff4d4197220 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400d9e0 tx=0x7ff4c400dcf0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 shutdown_connections 2024-02-14T13:08:03.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4d4106d50 0x7ff4d419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff4bc0a21e0 0x7ff4bc0a46a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d4100f00 0x7ff4d4197220 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 --2- 172.21.15.12:0/3127950031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4d41018c0 0x7ff4d4197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 >> 172.21.15.12:0/3127950031 conn(0x7ff4d4077ae0 msgr2=0x7ff4d40ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 shutdown_connections 2024-02-14T13:08:03.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.240+0000 7ff4d8ad5700 1 -- 172.21.15.12:0/3127950031 wait complete. 2024-02-14T13:08:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.451+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f1d201996e0 con 0x7f1d2006a370 2024-02-14T13:08:03.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.451+0000 7f1d1cff9700 1 -- 172.21.15.12:0/4222817101 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f1d14020090 con 0x7f1d2006a370 2024-02-14T13:08:03.453 INFO:teuthology.orchestra.run.smithi012.stdout:352187318300 2024-02-14T13:08:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.453+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1d080a21e0 msgr2=0x7f1d080a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.453+0000 7f1d25cef700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1d080a21e0 0x7f1d080a46a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009fd0 tx=0x7f1d1000b040 comp rx=0 tx=0).stop 2024-02-14T13:08:03.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.453+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 msgr2=0x7f1d201988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.453+0000 7f1d25cef700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 0x7f1d201988e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400d950 tx=0x7f1d1400dc60 comp rx=0 tx=0).stop 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 shutdown_connections 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d20107d70 0x7f1d2019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d200699d0 0x7f1d201983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1d080a21e0 0x7f1d080a46a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 --2- 172.21.15.12:0/4222817101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d2006a370 0x7f1d201988e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 >> 172.21.15.12:0/4222817101 conn(0x7f1d20077b50 msgr2=0x7f1d200ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 shutdown_connections 2024-02-14T13:08:03.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:03.454+0000 7f1d25cef700 1 -- 172.21.15.12:0/4222817101 wait complete. 2024-02-14T13:08:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:03 smithi012 ceph-mon[32370]: pgmap v326: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:03 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3127950031' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-14T13:08:03.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:03 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/4222817101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-02-14T13:08:03.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:03 smithi103 ceph-mon[36921]: pgmap v326: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:03.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:03 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3127950031' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-14T13:08:03.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:03 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/4222817101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-02-14T13:08:04.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:03 smithi055 ceph-mon[36853]: pgmap v326: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:04.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:03 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3127950031' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-14T13:08:04.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:03 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/4222817101' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-02-14T13:08:04.273 INFO:tasks.cephadm.ceph_manager.ceph:need seq 352187318295 got 352187318300 for osd.11 2024-02-14T13:08:04.273 DEBUG:teuthology.parallel:result is None 2024-02-14T13:08:04.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574926 for osd.1 2024-02-14T13:08:04.912 DEBUG:teuthology.parallel:result is None 2024-02-14T13:08:04.912 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-14T13:08:04.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph pg dump --format=json 2024-02-14T13:08:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:05.715 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:05 smithi012 ceph-mon[32370]: pgmap v327: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:05.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:05 smithi103 ceph-mon[36921]: pgmap v327: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:06.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:05 smithi055 ceph-mon[36853]: pgmap v327: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-02-14T13:08:06.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 -- 172.21.15.12:0/1567058941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 msgr2=0x7f7520107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 --2- 172.21.15.12:0/1567058941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f7520107170 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7510009990 tx=0x7f7510009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 -- 172.21.15.12:0/1567058941 shutdown_connections 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 --2- 172.21.15.12:0/1567058941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100cd0 0x7f752010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 --2- 172.21.15.12:0/1567058941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f7520107170 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 --2- 172.21.15.12:0/1567058941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7520100310 0x7f7520100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 -- 172.21.15.12:0/1567058941 >> 172.21.15.12:0/1567058941 conn(0x7f7520077220 msgr2=0x7f75200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 -- 172.21.15.12:0/1567058941 shutdown_connections 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.883+0000 7f752515d700 1 -- 172.21.15.12:0/1567058941 wait complete. 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 Processor -- start 2024-02-14T13:08:06.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 -- start start 2024-02-14T13:08:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100310 0x7f7520198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:06.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7520100cd0 0x7f75201987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f752019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752019d160 con 0x7f7520106d90 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752019d2d0 con 0x7f7520100310 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f752515d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752019d490 con 0x7f7520100cd0 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f751f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f752019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f751f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f752019cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43694/0 (socket says 172.21.15.12:43694) 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f751f59e700 1 -- 172.21.15.12:0/1554080907 learned_addr learned my addr 172.21.15.12:0/1554080907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f751ed9d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100310 0x7f7520198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.884+0000 7f751e59c700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7520100cd0 0x7f75201987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751f59e700 1 -- 172.21.15.12:0/1554080907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7520100cd0 msgr2=0x7f75201987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:06.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751f59e700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7520100cd0 0x7f75201987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751f59e700 1 -- 172.21.15.12:0/1554080907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100310 msgr2=0x7f7520198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751f59e700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100310 0x7f7520198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751f59e700 1 -- 172.21.15.12:0/1554080907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100095f0 con 0x7f7520106d90 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751ed9d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100310 0x7f7520198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f751f59e700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f752019cb50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7518007d60 tx=0x7f751800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800ac90 con 0x7f7520106d90 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752019d770 con 0x7f7520106d90 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f751800adf0 con 0x7f7520106d90 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518012420 con 0x7f7520106d90 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.885+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75201a4fd0 con 0x7f7520106d90 2024-02-14T13:08:06.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.886+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752010a360 con 0x7f7520106d90 2024-02-14T13:08:06.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.887+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f7518003a00 con 0x7f7520106d90 2024-02-14T13:08:06.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.888+0000 7f7507fff700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75080a21e0 0x7f75080a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:06.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.888+0000 7f751ed9d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75080a21e0 0x7f75080a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:06.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.888+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f75180cdf10 con 0x7f7520106d90 2024-02-14T13:08:06.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.889+0000 7f751ed9d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75080a21e0 0x7f75080a46a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f751000b5c0 tx=0x7f7510005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:06.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:06.894+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7518096e70 con 0x7f7520106d90 2024-02-14T13:08:07.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.108+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75201995e0 con 0x7f75080a21e0 2024-02-14T13:08:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.119+0000 7f7507fff700 1 -- 172.21.15.12:0/1554080907 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344700 (secure 0 0 0) 0x7f75201995e0 con 0x7f75080a21e0 2024-02-14T13:08:07.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:07.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75080a21e0 msgr2=0x7f75080a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:07.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75080a21e0 0x7f75080a46a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f751000b5c0 tx=0x7f7510005960 comp rx=0 tx=0).stop 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 msgr2=0x7f752019cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f752019cb50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7518007d60 tx=0x7f751800a340 comp rx=0 tx=0).stop 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 shutdown_connections 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f75080a21e0 0x7f75080a46a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7520106d90 0x7f752019cb50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7520100310 0x7f7520198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 --2- 172.21.15.12:0/1554080907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7520100cd0 0x7f75201987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 >> 172.21.15.12:0/1554080907 conn(0x7f7520077220 msgr2=0x7f7520104da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 shutdown_connections 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:07.124+0000 7f752515d700 1 -- 172.21.15.12:0/1554080907 wait complete. 2024-02-14T13:08:07.130 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:08:07.763 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-02-14T13:08:06.371695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652446,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":287,"num_read_kb":251,"num_write":258,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362544,"kb_used_data":13308,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579280,"statfs":{"total":1151940427776,"available":1151569182720,"internally_reserved":0,"allocated":13627392,"data_stored":7504674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003061"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991858+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:07:49.991858+0000","last_peered":"2024-02-14T13:07:49.991858+0000","last_clean":"2024-02-14T13:07:49.991858+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:07:49.991858+0000","last_undegraded":"2024-02-14T13:07:49.991858+0000","last_fullsized":"2024-02-14T13:07:49.991858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:07:35.255009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989087+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:07:49.989087+0000","last_peered":"2024-02-14T13:07:49.989087+0000","last_clean":"2024-02-14T13:07:49.989087+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:07:49.989087+0000","last_undegraded":"2024-02-14T13:07:49.989087+0000","last_fullsized":"2024-02-14T13:07:49.989087+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989049+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:07:49.989049+0000","last_peered":"2024-02-14T13:07:49.989049+0000","last_clean":"2024-02-14T13:07:49.989049+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:07:49.989049+0000","last_undegraded":"2024-02-14T13:07:49.989049+0000","last_fullsized":"2024-02-14T13:07:49.989049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182893+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:07:50.182893+0000","last_peered":"2024-02-14T13:07:50.182893+0000","last_clean":"2024-02-14T13:07:50.182893+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:07:50.182893+0000","last_undegraded":"2024-02-14T13:07:50.182893+0000","last_fullsized":"2024-02-14T13:07:50.182893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:37.758671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992800+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:07:49.992800+0000","last_peered":"2024-02-14T13:07:49.992800+0000","last_clean":"2024-02-14T13:07:49.992800+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:07:49.992800+0000","last_undegraded":"2024-02-14T13:07:49.992800+0000","last_fullsized":"2024-02-14T13:07:49.992800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992055+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:07:49.992055+0000","last_peered":"2024-02-14T13:07:49.992055+0000","last_clean":"2024-02-14T13:07:49.992055+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:07:49.992055+0000","last_undegraded":"2024-02-14T13:07:49.992055+0000","last_fullsized":"2024-02-14T13:07:49.992055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:48:13.393242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.997082+0000","last_change":"2024-02-14T13:07:49.997082+0000","last_active":"2024-02-14T13:07:49.997082+0000","last_peered":"2024-02-14T13:07:49.997082+0000","last_clean":"2024-02-14T13:07:49.997082+0000","last_became_active":"2024-02-14T13:07:49.996562+0000","last_became_peered":"2024-02-14T13:07:49.996562+0000","last_unstale":"2024-02-14T13:07:49.997082+0000","last_undegraded":"2024-02-14T13:07:49.997082+0000","last_fullsized":"2024-02-14T13:07:49.997082+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:46:59.368975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288903+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:07:50.288903+0000","last_peered":"2024-02-14T13:07:50.288903+0000","last_clean":"2024-02-14T13:07:50.288903+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:07:50.288903+0000","last_undegraded":"2024-02-14T13:07:50.288903+0000","last_fullsized":"2024-02-14T13:07:50.288903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:44:35.774128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995166+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:07:49.995166+0000","last_peered":"2024-02-14T13:07:49.995166+0000","last_clean":"2024-02-14T13:07:49.995166+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:07:49.995166+0000","last_undegraded":"2024-02-14T13:07:49.995166+0000","last_fullsized":"2024-02-14T13:07:49.995166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.997254+0000","last_change":"2024-02-14T13:07:49.997254+0000","last_active":"2024-02-14T13:07:49.997254+0000","last_peered":"2024-02-14T13:07:49.997254+0000","last_clean":"2024-02-14T13:07:49.997254+0000","last_became_active":"2024-02-14T13:07:49.996802+0000","last_became_peered":"2024-02-14T13:07:49.996802+0000","last_unstale":"2024-02-14T13:07:49.997254+0000","last_undegraded":"2024-02-14T13:07:49.997254+0000","last_fullsized":"2024-02-14T13:07:49.997254+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:10:22.499475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989909+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:07:49.989909+0000","last_peered":"2024-02-14T13:07:49.989909+0000","last_clean":"2024-02-14T13:07:49.989909+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:07:49.989909+0000","last_undegraded":"2024-02-14T13:07:49.989909+0000","last_fullsized":"2024-02-14T13:07:49.989909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182828+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:07:50.182828+0000","last_peered":"2024-02-14T13:07:50.182828+0000","last_clean":"2024-02-14T13:07:50.182828+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:07:50.182828+0000","last_undegraded":"2024-02-14T13:07:50.182828+0000","last_fullsized":"2024-02-14T13:07:50.182828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:28:48.545577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994589+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:07:49.994589+0000","last_peered":"2024-02-14T13:07:49.994589+0000","last_clean":"2024-02-14T13:07:49.994589+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:07:49.994589+0000","last_undegraded":"2024-02-14T13:07:49.994589+0000","last_fullsized":"2024-02-14T13:07:49.994589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.988910+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:07:49.988910+0000","last_peered":"2024-02-14T13:07:49.988910+0000","last_clean":"2024-02-14T13:07:49.988910+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:07:49.988910+0000","last_undegraded":"2024-02-14T13:07:49.988910+0000","last_fullsized":"2024-02-14T13:07:49.988910+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.988851+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:07:49.988851+0000","last_peered":"2024-02-14T13:07:49.988851+0000","last_clean":"2024-02-14T13:07:49.988851+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:07:49.988851+0000","last_undegraded":"2024-02-14T13:07:49.988851+0000","last_fullsized":"2024-02-14T13:07:49.988851+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994782+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:07:49.994782+0000","last_peered":"2024-02-14T13:07:49.994782+0000","last_clean":"2024-02-14T13:07:49.994782+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:07:49.994782+0000","last_undegraded":"2024-02-14T13:07:49.994782+0000","last_fullsized":"2024-02-14T13:07:49.994782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991960+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:07:49.991960+0000","last_peered":"2024-02-14T13:07:49.991960+0000","last_clean":"2024-02-14T13:07:49.991960+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:07:49.991960+0000","last_undegraded":"2024-02-14T13:07:49.991960+0000","last_fullsized":"2024-02-14T13:07:49.991960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:44:57.840170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986700+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:07:49.986700+0000","last_peered":"2024-02-14T13:07:49.986700+0000","last_clean":"2024-02-14T13:07:49.986700+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:07:49.986700+0000","last_undegraded":"2024-02-14T13:07:49.986700+0000","last_fullsized":"2024-02-14T13:07:49.986700+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:40.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.996120+0000","last_change":"2024-02-14T13:07:49.996120+0000","last_active":"2024-02-14T13:07:49.996120+0000","last_peered":"2024-02-14T13:07:49.996120+0000","last_clean":"2024-02-14T13:07:49.996120+0000","last_became_active":"2024-02-14T13:07:49.995741+0000","last_became_peered":"2024-02-14T13:07:49.995741+0000","last_unstale":"2024-02-14T13:07:49.996120+0000","last_undegraded":"2024-02-14T13:07:49.996120+0000","last_fullsized":"2024-02-14T13:07:49.996120+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:52:11.329858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986639+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:07:49.986639+0000","last_peered":"2024-02-14T13:07:49.986639+0000","last_clean":"2024-02-14T13:07:49.986639+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:07:49.986639+0000","last_undegraded":"2024-02-14T13:07:49.986639+0000","last_fullsized":"2024-02-14T13:07:49.986639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289265+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:07:50.289265+0000","last_peered":"2024-02-14T13:07:50.289265+0000","last_clean":"2024-02-14T13:07:50.289265+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:07:50.289265+0000","last_undegraded":"2024-02-14T13:07:50.289265+0000","last_fullsized":"2024-02-14T13:07:50.289265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:02:56.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289385+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:07:50.289385+0000","last_peered":"2024-02-14T13:07:50.289385+0000","last_clean":"2024-02-14T13:07:50.289385+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:07:50.289385+0000","last_undegraded":"2024-02-14T13:07:50.289385+0000","last_fullsized":"2024-02-14T13:07:50.289385+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989183+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:07:49.989183+0000","last_peered":"2024-02-14T13:07:49.989183+0000","last_clean":"2024-02-14T13:07:49.989183+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:07:49.989183+0000","last_undegraded":"2024-02-14T13:07:49.989183+0000","last_fullsized":"2024-02-14T13:07:49.989183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.002234+0000","last_change":"2024-02-14T13:07:50.002234+0000","last_active":"2024-02-14T13:07:50.002234+0000","last_peered":"2024-02-14T13:07:50.002234+0000","last_clean":"2024-02-14T13:07:50.002234+0000","last_became_active":"2024-02-14T13:07:49.997402+0000","last_became_peered":"2024-02-14T13:07:49.997402+0000","last_unstale":"2024-02-14T13:07:50.002234+0000","last_undegraded":"2024-02-14T13:07:50.002234+0000","last_fullsized":"2024-02-14T13:07:50.002234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:04:33.555928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995038+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:07:49.995038+0000","last_peered":"2024-02-14T13:07:49.995038+0000","last_clean":"2024-02-14T13:07:49.995038+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:07:49.995038+0000","last_undegraded":"2024-02-14T13:07:49.995038+0000","last_fullsized":"2024-02-14T13:07:49.995038+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.000596+0000","last_change":"2024-02-14T13:07:50.000218+0000","last_active":"2024-02-14T13:07:50.000596+0000","last_peered":"2024-02-14T13:07:50.000596+0000","last_clean":"2024-02-14T13:07:50.000596+0000","last_became_active":"2024-02-14T13:07:49.996724+0000","last_became_peered":"2024-02-14T13:07:49.996724+0000","last_unstale":"2024-02-14T13:07:50.000596+0000","last_undegraded":"2024-02-14T13:07:50.000596+0000","last_fullsized":"2024-02-14T13:07:50.000596+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:44.605459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990517+0000","last_change":"2024-02-14T13:06:49.813074+0000","last_active":"2024-02-14T13:07:49.990517+0000","last_peered":"2024-02-14T13:07:49.990517+0000","last_clean":"2024-02-14T13:07:49.990517+0000","last_became_active":"2024-02-14T13:06:49.812777+0000","last_became_peered":"2024-02-14T13:06:49.812777+0000","last_unstale":"2024-02-14T13:07:49.990517+0000","last_undegraded":"2024-02-14T13:07:49.990517+0000","last_fullsized":"2024-02-14T13:07:49.990517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:41:03.784230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989841+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:07:49.989841+0000","last_peered":"2024-02-14T13:07:49.989841+0000","last_clean":"2024-02-14T13:07:49.989841+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:07:49.989841+0000","last_undegraded":"2024-02-14T13:07:49.989841+0000","last_fullsized":"2024-02-14T13:07:49.989841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:56:07.991489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993030+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:07:49.993030+0000","last_peered":"2024-02-14T13:07:49.993030+0000","last_clean":"2024-02-14T13:07:49.993030+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:07:49.993030+0000","last_undegraded":"2024-02-14T13:07:49.993030+0000","last_fullsized":"2024-02-14T13:07:49.993030+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.183963+0000","last_change":"2024-02-14T13:07:50.183963+0000","last_active":"2024-02-14T13:07:50.183963+0000","last_peered":"2024-02-14T13:07:50.183963+0000","last_clean":"2024-02-14T13:07:50.183963+0000","last_became_active":"2024-02-14T13:07:50.183583+0000","last_became_peered":"2024-02-14T13:07:50.183583+0000","last_unstale":"2024-02-14T13:07:50.183963+0000","last_undegraded":"2024-02-14T13:07:50.183963+0000","last_fullsized":"2024-02-14T13:07:50.183963+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:20:18.161314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989954+0000","last_change":"2024-02-14T13:06:49.797327+0000","last_active":"2024-02-14T13:07:49.989954+0000","last_peered":"2024-02-14T13:07:49.989954+0000","last_clean":"2024-02-14T13:07:49.989954+0000","last_became_active":"2024-02-14T13:06:49.796953+0000","last_became_peered":"2024-02-14T13:06:49.796953+0000","last_unstale":"2024-02-14T13:07:49.989954+0000","last_undegraded":"2024-02-14T13:07:49.989954+0000","last_fullsized":"2024-02-14T13:07:49.989954+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:58:33.031583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994549+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:07:49.994549+0000","last_peered":"2024-02-14T13:07:49.994549+0000","last_clean":"2024-02-14T13:07:49.994549+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:07:49.994549+0000","last_undegraded":"2024-02-14T13:07:49.994549+0000","last_fullsized":"2024-02-14T13:07:49.994549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288856+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:07:50.288856+0000","last_peered":"2024-02-14T13:07:50.288856+0000","last_clean":"2024-02-14T13:07:50.288856+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:07:50.288856+0000","last_undegraded":"2024-02-14T13:07:50.288856+0000","last_fullsized":"2024-02-14T13:07:50.288856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:09.968642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989818+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:07:49.989818+0000","last_peered":"2024-02-14T13:07:49.989818+0000","last_clean":"2024-02-14T13:07:49.989818+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:07:49.989818+0000","last_undegraded":"2024-02-14T13:07:49.989818+0000","last_fullsized":"2024-02-14T13:07:49.989818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:15:04.555490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986601+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:07:49.986601+0000","last_peered":"2024-02-14T13:07:49.986601+0000","last_clean":"2024-02-14T13:07:49.986601+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:07:49.986601+0000","last_undegraded":"2024-02-14T13:07:49.986601+0000","last_fullsized":"2024-02-14T13:07:49.986601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:05:31.916433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992241+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:07:49.992241+0000","last_peered":"2024-02-14T13:07:49.992241+0000","last_clean":"2024-02-14T13:07:49.992241+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:07:49.992241+0000","last_undegraded":"2024-02-14T13:07:49.992241+0000","last_fullsized":"2024-02-14T13:07:49.992241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995105+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:07:49.995105+0000","last_peered":"2024-02-14T13:07:49.995105+0000","last_clean":"2024-02-14T13:07:49.995105+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:07:49.995105+0000","last_undegraded":"2024-02-14T13:07:49.995105+0000","last_fullsized":"2024-02-14T13:07:49.995105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989793+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:07:49.989793+0000","last_peered":"2024-02-14T13:07:49.989793+0000","last_clean":"2024-02-14T13:07:49.989793+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:07:49.989793+0000","last_undegraded":"2024-02-14T13:07:49.989793+0000","last_fullsized":"2024-02-14T13:07:49.989793+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995343+0000","last_change":"2024-02-14T13:07:49.995343+0000","last_active":"2024-02-14T13:07:49.995343+0000","last_peered":"2024-02-14T13:07:49.995343+0000","last_clean":"2024-02-14T13:07:49.995343+0000","last_became_active":"2024-02-14T13:07:49.994945+0000","last_became_peered":"2024-02-14T13:07:49.994945+0000","last_unstale":"2024-02-14T13:07:49.995343+0000","last_undegraded":"2024-02-14T13:07:49.995343+0000","last_fullsized":"2024-02-14T13:07:49.995343+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:01:13.718211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990623+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:07:49.990623+0000","last_peered":"2024-02-14T13:07:49.990623+0000","last_clean":"2024-02-14T13:07:49.990623+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:07:49.990623+0000","last_undegraded":"2024-02-14T13:07:49.990623+0000","last_fullsized":"2024-02-14T13:07:49.990623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:52:36.229786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995045+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:07:49.995045+0000","last_peered":"2024-02-14T13:07:49.995045+0000","last_clean":"2024-02-14T13:07:49.995045+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:07:49.995045+0000","last_undegraded":"2024-02-14T13:07:49.995045+0000","last_fullsized":"2024-02-14T13:07:49.995045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'26","reported_seq":200,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:08:04.943959+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:08:04.943959+0000","last_peered":"2024-02-14T13:08:04.943959+0000","last_clean":"2024-02-14T13:08:04.943959+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:08:04.943959+0000","last_undegraded":"2024-02-14T13:08:04.943959+0000","last_fullsized":"2024-02-14T13:08:04.943959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":136,"num_write":26,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993465+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:07:49.993465+0000","last_peered":"2024-02-14T13:07:49.993465+0000","last_clean":"2024-02-14T13:07:49.993465+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:07:49.993465+0000","last_undegraded":"2024-02-14T13:07:49.993465+0000","last_fullsized":"2024-02-14T13:07:49.993465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989504+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:07:49.989504+0000","last_peered":"2024-02-14T13:07:49.989504+0000","last_clean":"2024-02-14T13:07:49.989504+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:07:49.989504+0000","last_undegraded":"2024-02-14T13:07:49.989504+0000","last_fullsized":"2024-02-14T13:07:49.989504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994708+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:07:49.994708+0000","last_peered":"2024-02-14T13:07:49.994708+0000","last_clean":"2024-02-14T13:07:49.994708+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:07:49.994708+0000","last_undegraded":"2024-02-14T13:07:49.994708+0000","last_fullsized":"2024-02-14T13:07:49.994708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989317+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:07:49.989317+0000","last_peered":"2024-02-14T13:07:49.989317+0000","last_clean":"2024-02-14T13:07:49.989317+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:07:49.989317+0000","last_undegraded":"2024-02-14T13:07:49.989317+0000","last_fullsized":"2024-02-14T13:07:49.989317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:08:08.869692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989727+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:07:49.989727+0000","last_peered":"2024-02-14T13:07:49.989727+0000","last_clean":"2024-02-14T13:07:49.989727+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:07:49.989727+0000","last_undegraded":"2024-02-14T13:07:49.989727+0000","last_fullsized":"2024-02-14T13:07:49.989727+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182478+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:07:50.182478+0000","last_peered":"2024-02-14T13:07:50.182478+0000","last_clean":"2024-02-14T13:07:50.182478+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:07:50.182478+0000","last_undegraded":"2024-02-14T13:07:50.182478+0000","last_fullsized":"2024-02-14T13:07:50.182478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989696+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:07:49.989696+0000","last_peered":"2024-02-14T13:07:49.989696+0000","last_clean":"2024-02-14T13:07:49.989696+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:07:49.989696+0000","last_undegraded":"2024-02-14T13:07:49.989696+0000","last_fullsized":"2024-02-14T13:07:49.989696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.190269+0000","last_change":"2024-02-14T13:07:50.190269+0000","last_active":"2024-02-14T13:07:50.190269+0000","last_peered":"2024-02-14T13:07:50.190269+0000","last_clean":"2024-02-14T13:07:50.190269+0000","last_became_active":"2024-02-14T13:07:50.184169+0000","last_became_peered":"2024-02-14T13:07:50.184169+0000","last_unstale":"2024-02-14T13:07:50.190269+0000","last_undegraded":"2024-02-14T13:07:50.190269+0000","last_fullsized":"2024-02-14T13:07:50.190269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:40:39.329485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989667+0000","last_change":"2024-02-14T13:06:49.815017+0000","last_active":"2024-02-14T13:07:49.989667+0000","last_peered":"2024-02-14T13:07:49.989667+0000","last_clean":"2024-02-14T13:07:49.989667+0000","last_became_active":"2024-02-14T13:06:49.809970+0000","last_became_peered":"2024-02-14T13:06:49.809970+0000","last_unstale":"2024-02-14T13:07:49.989667+0000","last_undegraded":"2024-02-14T13:07:49.989667+0000","last_fullsized":"2024-02-14T13:07:49.989667+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:54:02.156674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993296+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:07:49.993296+0000","last_peered":"2024-02-14T13:07:49.993296+0000","last_clean":"2024-02-14T13:07:49.993296+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:07:49.993296+0000","last_undegraded":"2024-02-14T13:07:49.993296+0000","last_fullsized":"2024-02-14T13:07:49.993296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991424+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:07:49.991424+0000","last_peered":"2024-02-14T13:07:49.991424+0000","last_clean":"2024-02-14T13:07:49.991424+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:07:49.991424+0000","last_undegraded":"2024-02-14T13:07:49.991424+0000","last_fullsized":"2024-02-14T13:07:49.991424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:03:11.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986588+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:07:49.986588+0000","last_peered":"2024-02-14T13:07:49.986588+0000","last_clean":"2024-02-14T13:07:49.986588+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:07:49.986588+0000","last_undegraded":"2024-02-14T13:07:49.986588+0000","last_fullsized":"2024-02-14T13:07:49.986588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992357+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:07:49.992357+0000","last_peered":"2024-02-14T13:07:49.992357+0000","last_clean":"2024-02-14T13:07:49.992357+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:07:49.992357+0000","last_undegraded":"2024-02-14T13:07:49.992357+0000","last_fullsized":"2024-02-14T13:07:49.992357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:59:33.260459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989710+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:07:49.989710+0000","last_peered":"2024-02-14T13:07:49.989710+0000","last_clean":"2024-02-14T13:07:49.989710+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:07:49.989710+0000","last_undegraded":"2024-02-14T13:07:49.989710+0000","last_fullsized":"2024-02-14T13:07:49.989710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992295+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:07:49.992295+0000","last_peered":"2024-02-14T13:07:49.992295+0000","last_clean":"2024-02-14T13:07:49.992295+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:07:49.992295+0000","last_undegraded":"2024-02-14T13:07:49.992295+0000","last_fullsized":"2024-02-14T13:07:49.992295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:42:45.416138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990025+0000","last_change":"2024-02-14T13:06:49.820378+0000","last_active":"2024-02-14T13:07:49.990025+0000","last_peered":"2024-02-14T13:07:49.990025+0000","last_clean":"2024-02-14T13:07:49.990025+0000","last_became_active":"2024-02-14T13:06:49.820068+0000","last_became_peered":"2024-02-14T13:06:49.820068+0000","last_unstale":"2024-02-14T13:07:49.990025+0000","last_undegraded":"2024-02-14T13:07:49.990025+0000","last_fullsized":"2024-02-14T13:07:49.990025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:08.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994452+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:07:49.994452+0000","last_peered":"2024-02-14T13:07:49.994452+0000","last_clean":"2024-02-14T13:07:49.994452+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:07:49.994452+0000","last_undegraded":"2024-02-14T13:07:49.994452+0000","last_fullsized":"2024-02-14T13:07:49.994452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289201+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:07:50.289201+0000","last_peered":"2024-02-14T13:07:50.289201+0000","last_clean":"2024-02-14T13:07:50.289201+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:07:50.289201+0000","last_undegraded":"2024-02-14T13:07:50.289201+0000","last_fullsized":"2024-02-14T13:07:50.289201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:01.914405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182688+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:07:50.182688+0000","last_peered":"2024-02-14T13:07:50.182688+0000","last_clean":"2024-02-14T13:07:50.182688+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:07:50.182688+0000","last_undegraded":"2024-02-14T13:07:50.182688+0000","last_fullsized":"2024-02-14T13:07:50.182688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":344,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989477+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:07:49.989477+0000","last_peered":"2024-02-14T13:07:49.989477+0000","last_clean":"2024-02-14T13:07:49.989477+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:07:49.989477+0000","last_undegraded":"2024-02-14T13:07:49.989477+0000","last_fullsized":"2024-02-14T13:07:49.989477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994351+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:07:49.994351+0000","last_peered":"2024-02-14T13:07:49.994351+0000","last_clean":"2024-02-14T13:07:49.994351+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:07:49.994351+0000","last_undegraded":"2024-02-14T13:07:49.994351+0000","last_fullsized":"2024-02-14T13:07:49.994351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.999952+0000","last_change":"2024-02-14T13:07:49.999375+0000","last_active":"2024-02-14T13:07:49.999952+0000","last_peered":"2024-02-14T13:07:49.999952+0000","last_clean":"2024-02-14T13:07:49.999952+0000","last_became_active":"2024-02-14T13:07:49.999030+0000","last_became_peered":"2024-02-14T13:07:49.999030+0000","last_unstale":"2024-02-14T13:07:49.999952+0000","last_undegraded":"2024-02-14T13:07:49.999952+0000","last_fullsized":"2024-02-14T13:07:49.999952+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T01:06:21.192366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993555+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:07:49.993555+0000","last_peered":"2024-02-14T13:07:49.993555+0000","last_clean":"2024-02-14T13:07:49.993555+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:07:49.993555+0000","last_undegraded":"2024-02-14T13:07:49.993555+0000","last_fullsized":"2024-02-14T13:07:49.993555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994820+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:07:49.994820+0000","last_peered":"2024-02-14T13:07:49.994820+0000","last_clean":"2024-02-14T13:07:49.994820+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:07:49.994820+0000","last_undegraded":"2024-02-14T13:07:49.994820+0000","last_fullsized":"2024-02-14T13:07:49.994820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986617+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:07:49.986617+0000","last_peered":"2024-02-14T13:07:49.986617+0000","last_clean":"2024-02-14T13:07:49.986617+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:07:49.986617+0000","last_undegraded":"2024-02-14T13:07:49.986617+0000","last_fullsized":"2024-02-14T13:07:49.986617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289469+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:07:50.289469+0000","last_peered":"2024-02-14T13:07:50.289469+0000","last_clean":"2024-02-14T13:07:50.289469+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:07:50.289469+0000","last_undegraded":"2024-02-14T13:07:50.289469+0000","last_fullsized":"2024-02-14T13:07:50.289469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:11:41.708425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182893+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:07:50.182893+0000","last_peered":"2024-02-14T13:07:50.182893+0000","last_clean":"2024-02-14T13:07:50.182893+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:07:50.182893+0000","last_undegraded":"2024-02-14T13:07:50.182893+0000","last_fullsized":"2024-02-14T13:07:50.182893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.290314+0000","last_change":"2024-02-14T13:07:50.290314+0000","last_active":"2024-02-14T13:07:50.290314+0000","last_peered":"2024-02-14T13:07:50.290314+0000","last_clean":"2024-02-14T13:07:50.290314+0000","last_became_active":"2024-02-14T13:07:50.289901+0000","last_became_peered":"2024-02-14T13:07:50.289901+0000","last_unstale":"2024-02-14T13:07:50.290314+0000","last_undegraded":"2024-02-14T13:07:50.290314+0000","last_fullsized":"2024-02-14T13:07:50.290314+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:08:59.324371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994897+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:07:49.994897+0000","last_peered":"2024-02-14T13:07:49.994897+0000","last_clean":"2024-02-14T13:07:49.994897+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:07:49.994897+0000","last_undegraded":"2024-02-14T13:07:49.994897+0000","last_fullsized":"2024-02-14T13:07:49.994897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992994+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:07:49.992994+0000","last_peered":"2024-02-14T13:07:49.992994+0000","last_clean":"2024-02-14T13:07:49.992994+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:07:49.992994+0000","last_undegraded":"2024-02-14T13:07:49.992994+0000","last_fullsized":"2024-02-14T13:07:49.992994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288987+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:07:50.288987+0000","last_peered":"2024-02-14T13:07:50.288987+0000","last_clean":"2024-02-14T13:07:50.288987+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:07:50.288987+0000","last_undegraded":"2024-02-14T13:07:50.288987+0000","last_fullsized":"2024-02-14T13:07:50.288987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992252+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:07:49.992252+0000","last_peered":"2024-02-14T13:07:49.992252+0000","last_clean":"2024-02-14T13:07:49.992252+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:07:49.992252+0000","last_undegraded":"2024-02-14T13:07:49.992252+0000","last_fullsized":"2024-02-14T13:07:49.992252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:09:58.626393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989293+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:07:49.989293+0000","last_peered":"2024-02-14T13:07:49.989293+0000","last_clean":"2024-02-14T13:07:49.989293+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:07:49.989293+0000","last_undegraded":"2024-02-14T13:07:49.989293+0000","last_fullsized":"2024-02-14T13:07:49.989293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289340+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:07:50.289340+0000","last_peered":"2024-02-14T13:07:50.289340+0000","last_clean":"2024-02-14T13:07:50.289340+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:07:50.289340+0000","last_undegraded":"2024-02-14T13:07:50.289340+0000","last_fullsized":"2024-02-14T13:07:50.289340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:03:06.405049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992908+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:07:49.992908+0000","last_peered":"2024-02-14T13:07:49.992908+0000","last_clean":"2024-02-14T13:07:49.992908+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:07:49.992908+0000","last_undegraded":"2024-02-14T13:07:49.992908+0000","last_fullsized":"2024-02-14T13:07:49.992908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989579+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:07:49.989579+0000","last_peered":"2024-02-14T13:07:49.989579+0000","last_clean":"2024-02-14T13:07:49.989579+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:07:49.989579+0000","last_undegraded":"2024-02-14T13:07:49.989579+0000","last_fullsized":"2024-02-14T13:07:49.989579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989702+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:07:49.989702+0000","last_peered":"2024-02-14T13:07:49.989702+0000","last_clean":"2024-02-14T13:07:49.989702+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:07:49.989702+0000","last_undegraded":"2024-02-14T13:07:49.989702+0000","last_fullsized":"2024-02-14T13:07:49.989702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990010+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:07:49.990010+0000","last_peered":"2024-02-14T13:07:49.990010+0000","last_clean":"2024-02-14T13:07:49.990010+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:07:49.990010+0000","last_undegraded":"2024-02-14T13:07:49.990010+0000","last_fullsized":"2024-02-14T13:07:49.990010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990447+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:07:49.990447+0000","last_peered":"2024-02-14T13:07:49.990447+0000","last_clean":"2024-02-14T13:07:49.990447+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:07:49.990447+0000","last_undegraded":"2024-02-14T13:07:49.990447+0000","last_fullsized":"2024-02-14T13:07:49.990447+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:15:32.979424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989637+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:07:49.989637+0000","last_peered":"2024-02-14T13:07:49.989637+0000","last_clean":"2024-02-14T13:07:49.989637+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:07:49.989637+0000","last_undegraded":"2024-02-14T13:07:49.989637+0000","last_fullsized":"2024-02-14T13:07:49.989637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994433+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:07:49.994433+0000","last_peered":"2024-02-14T13:07:49.994433+0000","last_clean":"2024-02-14T13:07:49.994433+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:07:49.994433+0000","last_undegraded":"2024-02-14T13:07:49.994433+0000","last_fullsized":"2024-02-14T13:07:49.994433+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990006+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:07:49.990006+0000","last_peered":"2024-02-14T13:07:49.990006+0000","last_clean":"2024-02-14T13:07:49.990006+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:07:49.990006+0000","last_undegraded":"2024-02-14T13:07:49.990006+0000","last_fullsized":"2024-02-14T13:07:49.990006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992076+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:07:49.992076+0000","last_peered":"2024-02-14T13:07:49.992076+0000","last_clean":"2024-02-14T13:07:49.992076+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:07:49.992076+0000","last_undegraded":"2024-02-14T13:07:49.992076+0000","last_fullsized":"2024-02-14T13:07:49.992076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:34:48.890593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989250+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:07:49.989250+0000","last_peered":"2024-02-14T13:07:49.989250+0000","last_clean":"2024-02-14T13:07:49.989250+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:07:49.989250+0000","last_undegraded":"2024-02-14T13:07:49.989250+0000","last_fullsized":"2024-02-14T13:07:49.989250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:05:53.262774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989203+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:07:49.989203+0000","last_peered":"2024-02-14T13:07:49.989203+0000","last_clean":"2024-02-14T13:07:49.989203+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:07:49.989203+0000","last_undegraded":"2024-02-14T13:07:49.989203+0000","last_fullsized":"2024-02-14T13:07:49.989203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:27:29.251638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.988973+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:07:49.988973+0000","last_peered":"2024-02-14T13:07:49.988973+0000","last_clean":"2024-02-14T13:07:49.988973+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:07:49.988973+0000","last_undegraded":"2024-02-14T13:07:49.988973+0000","last_fullsized":"2024-02-14T13:07:49.988973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994844+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:07:49.994844+0000","last_peered":"2024-02-14T13:07:49.994844+0000","last_clean":"2024-02-14T13:07:49.994844+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:07:49.994844+0000","last_undegraded":"2024-02-14T13:07:49.994844+0000","last_fullsized":"2024-02-14T13:07:49.994844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991495+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:07:49.991495+0000","last_peered":"2024-02-14T13:07:49.991495+0000","last_clean":"2024-02-14T13:07:49.991495+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:07:49.991495+0000","last_undegraded":"2024-02-14T13:07:49.991495+0000","last_fullsized":"2024-02-14T13:07:49.991495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:46:06.005807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990836+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:07:49.990836+0000","last_peered":"2024-02-14T13:07:49.990836+0000","last_clean":"2024-02-14T13:07:49.990836+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:07:49.990836+0000","last_undegraded":"2024-02-14T13:07:49.990836+0000","last_fullsized":"2024-02-14T13:07:49.990836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:27:21.465567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289137+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:07:50.289137+0000","last_peered":"2024-02-14T13:07:50.289137+0000","last_clean":"2024-02-14T13:07:50.289137+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:07:50.289137+0000","last_undegraded":"2024-02-14T13:07:50.289137+0000","last_fullsized":"2024-02-14T13:07:50.289137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:41.122395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989912+0000","last_change":"2024-02-14T13:06:49.819554+0000","last_active":"2024-02-14T13:07:49.989912+0000","last_peered":"2024-02-14T13:07:49.989912+0000","last_clean":"2024-02-14T13:07:49.989912+0000","last_became_active":"2024-02-14T13:06:49.818512+0000","last_became_peered":"2024-02-14T13:06:49.818512+0000","last_unstale":"2024-02-14T13:07:49.989912+0000","last_undegraded":"2024-02-14T13:07:49.989912+0000","last_fullsized":"2024-02-14T13:07:49.989912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:25:37.709104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288907+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:07:50.288907+0000","last_peered":"2024-02-14T13:07:50.288907+0000","last_clean":"2024-02-14T13:07:50.288907+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:07:50.288907+0000","last_undegraded":"2024-02-14T13:07:50.288907+0000","last_fullsized":"2024-02-14T13:07:50.288907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:04:06.483820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994953+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:07:49.994953+0000","last_peered":"2024-02-14T13:07:49.994953+0000","last_clean":"2024-02-14T13:07:49.994953+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:07:49.994953+0000","last_undegraded":"2024-02-14T13:07:49.994953+0000","last_fullsized":"2024-02-14T13:07:49.994953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994679+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:07:49.994679+0000","last_peered":"2024-02-14T13:07:49.994679+0000","last_clean":"2024-02-14T13:07:49.994679+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:07:49.994679+0000","last_undegraded":"2024-02-14T13:07:49.994679+0000","last_fullsized":"2024-02-14T13:07:49.994679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992174+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:07:49.992174+0000","last_peered":"2024-02-14T13:07:49.992174+0000","last_clean":"2024-02-14T13:07:49.992174+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:07:49.992174+0000","last_undegraded":"2024-02-14T13:07:49.992174+0000","last_fullsized":"2024-02-14T13:07:49.992174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:39:46.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61844,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":75,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318301,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":462278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.432}]},{"osd":1,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82599999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.625},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68600000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65300000000000002}]},{"osd":5,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84699999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.54600000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.75,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.92000000000000004,"5min":1.018,"15min":1.018},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.54900000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80900000000000005}]},{"osd":8,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68600000000000005}]},{"osd":9,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.629,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.874,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.67000000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67200000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.76200000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.91500000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.872}]}]},{"osd":10,"up_from":74,"seq":317827579938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1114003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.503},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58699999999999997}]},{"osd":2,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.754},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88500000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.877,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":1.083,"15min":1.083},"last":0.82399999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.9729999999999999,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86499999999999999,"5min":1.05,"15min":1.05},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":1.077,"15min":1.077},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.6299999999999999,"15min":1.77},"min":{"1min":0.53100000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93000000000000005,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.79000000000000004}]},{"osd":9,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":0.86699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.85099999999999998,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.97999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.86599999999999999}]},{"osd":11,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.01,"5min":1.056,"15min":1.056},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.88300000000000001}]}]},{"osd":9,"up_from":69,"seq":296352743463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.74399999999999999,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":11.996,"5min":11.996,"15min":11.996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.36499999999999999}]},{"osd":4,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.495},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.871,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.81599999999999995,"15min":0.77800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":11.965999999999999,"5min":11.965999999999999,"15min":11.965999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.113,"5min":0.82099999999999995,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":12.087,"5min":12.087,"15min":12.087},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89400000000000002,"5min":1.133,"15min":1.133},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97399999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.42299999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0640000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.296},"last":0.61399999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.004,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0149999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.64700000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81999999999999995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66200000000000003}]}]},{"osd":8,"up_from":61,"seq":261993005099,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":462882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.495},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.434,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.50800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.438},"min":{"1min":0.38,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.35999999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.40899999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.54100000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.626,"5min":0.503,"15min":0.503},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.71899999999999997,"15min":0.70299999999999996},"min":{"1min":0.63900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59599999999999997}]},{"osd":9,"last update":"Wed Feb 14 13:07:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.58099999999999996}]},{"osd":10,"last update":"Wed Feb 14 13:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.67300000000000004}]},{"osd":11,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.61799999999999999}]}]},{"osd":7,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1564672,"data_stored":1053345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75700000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":0.873,"15min":0.873},"last":0.78200000000000003}]},{"osd":3,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.46300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.84399999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.879,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.749},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51200000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82099999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:07:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.99399999999999999,"5min":1.069,"15min":1.069},"last":0.871},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89800000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94599999999999995,"5min":1.069,"15min":1.069},"last":0.92900000000000005}]},{"osd":11,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.97499999999999998}]}]},{"osd":6,"up_from":48,"seq":206158430262,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":462395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.499,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.56399999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":0.78100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.93500000000000005,"15min":1.2989999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76400000000000001,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69699999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.621}]},{"osd":3,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74099999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.32200000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.436}]},{"osd":4,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.81499999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.999,"15min":1.359},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72599999999999998,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":0.996},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85999999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.69499999999999995},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95699999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64700000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:07:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.006},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.5900000000000001,"5min":0.91200000000000003,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":16.891999999999999,"5min":16.891999999999999,"15min":16.891999999999999},"last":0.72099999999999997}]},{"osd":9,"last update":"Wed Feb 14 13:07:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85299999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.751,"15min":0.77400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98899999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51300000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:07:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.81399999999999995,"5min":1.091,"15min":1.091},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90500000000000003,"5min":1.05,"15min":1.05},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":523324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55200000000000005,"15min":0.49299999999999999},"min":{"1min":0.46700000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.496},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"max":{"1min":0.86599999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:07:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57599999999999996,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.998,"15min":0.998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.57199999999999995,"15min":0.53200000000000003},"min":{"1min":0.47199999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56799999999999995,"15min":0.52700000000000002},"min":{"1min":0.41799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55700000000000005,"15min":0.51100000000000001},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.47599999999999998,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.44600000000000001},"min":{"1min":0.34899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.29499999999999998}]},{"osd":5,"last update":"Wed Feb 14 13:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.53900000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47199999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:07:59 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":0.84499999999999997,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":17.373999999999999,"5min":17.373999999999999,"15min":17.373999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69699999999999995,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed Feb 14 13:07:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.441,"5min":0.37,"15min":0.37},"max":{"1min":1.024,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0069999999999999,"5min":1.157,"15min":1.157},"last":0.55100000000000005}]},{"osd":8,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.80500000000000005,"15min":0.79900000000000004},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.625,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:07:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.56499999999999995}]},{"osd":10,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.69199999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.60199999999999998}]},{"osd":11,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.63700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":1.103,"15min":1.103},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.54200000000000004},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:07:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.50700000000000001},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.439},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71899999999999997,"15min":0.86799999999999999},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Feb 14 13:07:33 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.50800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.629},{"interface":"front","average":{"1min":1.6879999999999999,"5min":0.83899999999999997,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":19.623999999999999,"5min":19.623999999999999,"15min":19.623999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.877,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.50800000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93999999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.224,"15min":1.224},"last":0.71699999999999997}]},{"osd":9,"last update":"Wed Feb 14 13:07:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.73499999999999999,"15min":0.75800000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.57799999999999996}]},{"osd":10,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97399999999999998,"5min":1.284,"15min":1.284},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96199999999999997,"5min":1.131,"15min":1.131},"last":0.59499999999999997}]},{"osd":11,"last update":"Wed Feb 14 13:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.749},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69099999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":523358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77400000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.623,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Feb 14 13:07:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.748,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.379,"5min":0.71899999999999997,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":17.402999999999999,"5min":17.402999999999999,"15min":17.402999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79000000000000004}]},{"osd":5,"last update":"Wed Feb 14 13:07:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.47299999999999998,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.47899999999999998,"15min":0.437},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59599999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.44700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.621},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.52100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.752}]},{"osd":9,"last update":"Wed Feb 14 13:07:14 2024","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":0.878,"15min":0.75},"min":{"1min":0.51000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":17.344000000000001,"5min":17.344000000000001,"15min":17.344000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97099999999999997,"5min":1.01,"15min":1.01},"last":0.63400000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:07:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.70899999999999996,"15min":0.68700000000000006},"min":{"1min":0.63700000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.59199999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.84599999999999997}]},{"osd":11,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73699999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117061,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":462616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.32300000000000001},"min":{"1min":0.26000000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59999999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.437},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.53300000000000003,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.54300000000000004,"5min":16.736999999999998,"15min":16.736999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59799999999999998,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.752,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.754},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.72399999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.746,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79300000000000004,"5min":20.550000000000001,"15min":20.550000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.53900000000000003},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80300000000000005,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:07:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60799999999999998,"15min":0.56599999999999995},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.69999999999999996,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":13.26,"5min":13.26,"15min":13.26},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.599,"5min":0.78300000000000003,"15min":0.60799999999999998},"min":{"1min":0.47299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":22.808,"5min":22.808,"15min":22.808},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.66100000000000003,"15min":0.55400000000000005},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66500000000000004,"5min":16.702999999999999,"15min":16.702999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.746,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:07:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.246,"5min":0.79400000000000004,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":13.172000000000001,"5min":13.172000000000001,"15min":13.172000000000001},"last":0.63600000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.86399999999999999,"15min":0.78800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.648,"5min":16.648,"15min":16.648},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":5.048,"5min":5.048,"15min":5.048},"last":0.68000000000000005}]},{"osd":10,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.498,"5min":0.93799999999999994,"15min":0.84399999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":16.771000000000001,"5min":16.771000000000001,"15min":16.771000000000001},"last":0.77000000000000002}]},{"osd":11,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":20.504999999999999,"5min":20.504999999999999,"15min":20.504999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.468,"5min":5.468,"15min":5.468},"last":0.81899999999999995}]}]},{"osd":4,"up_from":35,"seq":150323855424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"min":{"1min":0.317,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.75,"5min":0.753,"15min":0.753},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.439,"15min":0.40899999999999997},"min":{"1min":0.28799999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.55400000000000005},"min":{"1min":0.56100000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73399999999999999,"15min":0.86599999999999999},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.91300000000000003,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Feb 14 13:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68200000000000005,"15min":0.63600000000000001},"min":{"1min":0.53100000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.80400000000000005,"15min":0.85299999999999998},"min":{"1min":0.69499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98199999999999998,"5min":6.327,"15min":6.327},"last":0.37}]},{"osd":6,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66600000000000004,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Feb 14 13:07:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.66600000000000004,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73899999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71499999999999997,"15min":0.68899999999999995},"min":{"1min":0.60599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80800000000000005,"15min":0.78800000000000003},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.52600000000000002}]},{"osd":9,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.997,"15min":1.032},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0860000000000001,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.626}]},{"osd":10,"last update":"Wed Feb 14 13:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82599999999999996,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98799999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1299999999999999,"5min":1.151,"15min":1.151},"last":0.78600000000000003}]},{"osd":11,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55500000000000005}]}]},{"osd":5,"up_from":40,"seq":171798691899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1572864,"data_stored":1052945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.43099999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.77100000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72599999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79700000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.94099999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36299999999999999},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.502}]},{"osd":3,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55300000000000005,"15min":0.52400000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.746},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60199999999999998,"15min":0.57199999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88500000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:08:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76900000000000002}]},{"osd":7,"last update":"Wed Feb 14 13:07:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66200000000000003,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86899999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.83599999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:07:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.626},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.877,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63800000000000001}]},{"osd":9,"last update":"Wed Feb 14 13:07:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91700000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.874}]},{"osd":10,"last update":"Wed Feb 14 13:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:08:07.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph pg dump --format=json 2024-02-14T13:08:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:08.421 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: pgmap v328: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:08.421 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.421 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.422 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:08:08.422 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:08:08.422 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:08:08.422 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: pgmap v328: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:08:08.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:08:08.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:08:08.493 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: pgmap v328: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:08.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:08.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:08:08.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:08:08.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:08:08.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:08:09.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.699+0000 7ff528954700 1 -- 172.21.15.12:0/447897930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406a420 msgr2=0x7ff52406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:09.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.699+0000 7ff528954700 1 --2- 172.21.15.12:0/447897930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406a420 0x7ff52406a880 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff5180099c0 tx=0x7ff518009cd0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 -- 172.21.15.12:0/447897930 shutdown_connections 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 --2- 172.21.15.12:0/447897930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff52406adc0 0x7ff52410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 --2- 172.21.15.12:0/447897930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff524107da0 0x7ff524108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 --2- 172.21.15.12:0/447897930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406a420 0x7ff52406a880 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 -- 172.21.15.12:0/447897930 >> 172.21.15.12:0/447897930 conn(0x7ff524076c40 msgr2=0x7ff524077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 -- 172.21.15.12:0/447897930 shutdown_connections 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 -- 172.21.15.12:0/447897930 wait complete. 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 Processor -- start 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.700+0000 7ff528954700 1 -- start start 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff52406a420 0x7ff524100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 0x7ff524101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff524107da0 0x7ff5241017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5241a67d0 con 0x7ff52406adc0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5241a6940 con 0x7ff52406a420 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5241a6b00 con 0x7ff524107da0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 0x7ff524101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 0x7ff524101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43706/0 (socket says 172.21.15.12:43706) 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 -- 172.21.15.12:0/2045549293 learned_addr learned my addr 172.21.15.12:0/2045549293 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff522d9d700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff524107da0 0x7ff5241017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff52259c700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff52406a420 0x7ff524100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 -- 172.21.15.12:0/2045549293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff524107da0 msgr2=0x7ff5241017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff524107da0 0x7ff5241017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 -- 172.21.15.12:0/2045549293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff52406a420 msgr2=0x7ff524100d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff52406a420 0x7ff524100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 -- 172.21.15.12:0/2045549293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180095f0 con 0x7ff52406adc0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff521d9b700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 0x7ff524101260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff51800b580 tx=0x7ff518003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51801d070 con 0x7ff52406adc0 2024-02-14T13:08:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5241a6d80 con 0x7ff52406adc0 2024-02-14T13:08:09.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff5180040d0 con 0x7ff52406adc0 2024-02-14T13:08:09.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.701+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800f460 con 0x7ff52406adc0 2024-02-14T13:08:09.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.702+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5241a71a0 con 0x7ff52406adc0 2024-02-14T13:08:09.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.703+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52410a2c0 con 0x7ff52406adc0 2024-02-14T13:08:09.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.704+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7ff518022720 con 0x7ff52406adc0 2024-02-14T13:08:09.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.704+0000 7ff5137fe700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff50c0a21e0 0x7ff50c0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:09.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.704+0000 7ff52259c700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff50c0a21e0 0x7ff50c0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:09.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.704+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff5180cf380 con 0x7ff52406adc0 2024-02-14T13:08:09.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.705+0000 7ff52259c700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff50c0a21e0 0x7ff50c0a46a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff514006fd0 tx=0x7ff514008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:09.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.708+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff518098260 con 0x7ff52406adc0 2024-02-14T13:08:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.908+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5241022c0 con 0x7ff50c0a21e0 2024-02-14T13:08:09.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.919+0000 7ff5137fe700 1 -- 172.21.15.12:0/2045549293 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344671 (secure 0 0 0) 0x7ff5241022c0 con 0x7ff50c0a21e0 2024-02-14T13:08:09.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:09.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff50c0a21e0 msgr2=0x7ff50c0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:09.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff50c0a21e0 0x7ff50c0a46a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff514006fd0 tx=0x7ff514008040 comp rx=0 tx=0).stop 2024-02-14T13:08:09.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 msgr2=0x7ff524101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:09.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 0x7ff524101260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff51800b580 tx=0x7ff518003710 comp rx=0 tx=0).stop 2024-02-14T13:08:09.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 shutdown_connections 2024-02-14T13:08:09.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff524107da0 0x7ff5241017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff52406a420 0x7ff524100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff50c0a21e0 0x7ff50c0a46a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 --2- 172.21.15.12:0/2045549293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff52406adc0 0x7ff524101260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 >> 172.21.15.12:0/2045549293 conn(0x7ff524076c40 msgr2=0x7ff5240ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 shutdown_connections 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:09.923+0000 7ff528954700 1 -- 172.21.15.12:0/2045549293 wait complete. 2024-02-14T13:08:09.928 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-02-14T13:08:10.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:10 smithi012 ceph-mon[32370]: pgmap v329: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:10.345 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:10 smithi055 ceph-mon[36853]: pgmap v329: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:10.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:10 smithi103 ceph-mon[36921]: pgmap v329: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:10.619 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-02-14T13:08:08.372227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652446,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":287,"num_read_kb":251,"num_write":258,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362544,"kb_used_data":13308,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579280,"statfs":{"total":1151940427776,"available":1151569182720,"internally_reserved":0,"allocated":13627392,"data_stored":7504674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003180"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991858+0000","last_change":"2024-02-14T13:06:49.809279+0000","last_active":"2024-02-14T13:07:49.991858+0000","last_peered":"2024-02-14T13:07:49.991858+0000","last_clean":"2024-02-14T13:07:49.991858+0000","last_became_active":"2024-02-14T13:06:49.808862+0000","last_became_peered":"2024-02-14T13:06:49.808862+0000","last_unstale":"2024-02-14T13:07:49.991858+0000","last_undegraded":"2024-02-14T13:07:49.991858+0000","last_fullsized":"2024-02-14T13:07:49.991858+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:07:35.255009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989087+0000","last_change":"2024-02-14T13:06:49.822294+0000","last_active":"2024-02-14T13:07:49.989087+0000","last_peered":"2024-02-14T13:07:49.989087+0000","last_clean":"2024-02-14T13:07:49.989087+0000","last_became_active":"2024-02-14T13:06:49.821979+0000","last_became_peered":"2024-02-14T13:06:49.821979+0000","last_unstale":"2024-02-14T13:07:49.989087+0000","last_undegraded":"2024-02-14T13:07:49.989087+0000","last_fullsized":"2024-02-14T13:07:49.989087+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:13:05.438766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989049+0000","last_change":"2024-02-14T13:06:49.808997+0000","last_active":"2024-02-14T13:07:49.989049+0000","last_peered":"2024-02-14T13:07:49.989049+0000","last_clean":"2024-02-14T13:07:49.989049+0000","last_became_active":"2024-02-14T13:06:49.808678+0000","last_became_peered":"2024-02-14T13:06:49.808678+0000","last_unstale":"2024-02-14T13:07:49.989049+0000","last_undegraded":"2024-02-14T13:07:49.989049+0000","last_fullsized":"2024-02-14T13:07:49.989049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:01.150846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182893+0000","last_change":"2024-02-14T13:06:49.821364+0000","last_active":"2024-02-14T13:07:50.182893+0000","last_peered":"2024-02-14T13:07:50.182893+0000","last_clean":"2024-02-14T13:07:50.182893+0000","last_became_active":"2024-02-14T13:06:49.821013+0000","last_became_peered":"2024-02-14T13:06:49.821013+0000","last_unstale":"2024-02-14T13:07:50.182893+0000","last_undegraded":"2024-02-14T13:07:50.182893+0000","last_fullsized":"2024-02-14T13:07:50.182893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:37.758671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992800+0000","last_change":"2024-02-14T13:06:49.808253+0000","last_active":"2024-02-14T13:07:49.992800+0000","last_peered":"2024-02-14T13:07:49.992800+0000","last_clean":"2024-02-14T13:07:49.992800+0000","last_became_active":"2024-02-14T13:06:49.807575+0000","last_became_peered":"2024-02-14T13:06:49.807575+0000","last_unstale":"2024-02-14T13:07:49.992800+0000","last_undegraded":"2024-02-14T13:07:49.992800+0000","last_fullsized":"2024-02-14T13:07:49.992800+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:58:23.960503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992055+0000","last_change":"2024-02-14T13:06:49.813544+0000","last_active":"2024-02-14T13:07:49.992055+0000","last_peered":"2024-02-14T13:07:49.992055+0000","last_clean":"2024-02-14T13:07:49.992055+0000","last_became_active":"2024-02-14T13:06:49.812042+0000","last_became_peered":"2024-02-14T13:06:49.812042+0000","last_unstale":"2024-02-14T13:07:49.992055+0000","last_undegraded":"2024-02-14T13:07:49.992055+0000","last_fullsized":"2024-02-14T13:07:49.992055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:48:13.393242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.997082+0000","last_change":"2024-02-14T13:07:49.997082+0000","last_active":"2024-02-14T13:07:49.997082+0000","last_peered":"2024-02-14T13:07:49.997082+0000","last_clean":"2024-02-14T13:07:49.997082+0000","last_became_active":"2024-02-14T13:07:49.996562+0000","last_became_peered":"2024-02-14T13:07:49.996562+0000","last_unstale":"2024-02-14T13:07:49.997082+0000","last_undegraded":"2024-02-14T13:07:49.997082+0000","last_fullsized":"2024-02-14T13:07:49.997082+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:46:59.368975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288903+0000","last_change":"2024-02-14T13:06:49.818936+0000","last_active":"2024-02-14T13:07:50.288903+0000","last_peered":"2024-02-14T13:07:50.288903+0000","last_clean":"2024-02-14T13:07:50.288903+0000","last_became_active":"2024-02-14T13:06:49.818607+0000","last_became_peered":"2024-02-14T13:06:49.818607+0000","last_unstale":"2024-02-14T13:07:50.288903+0000","last_undegraded":"2024-02-14T13:07:50.288903+0000","last_fullsized":"2024-02-14T13:07:50.288903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:44:35.774128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995166+0000","last_change":"2024-02-14T13:06:49.823877+0000","last_active":"2024-02-14T13:07:49.995166+0000","last_peered":"2024-02-14T13:07:49.995166+0000","last_clean":"2024-02-14T13:07:49.995166+0000","last_became_active":"2024-02-14T13:06:49.823537+0000","last_became_peered":"2024-02-14T13:06:49.823537+0000","last_unstale":"2024-02-14T13:07:49.995166+0000","last_undegraded":"2024-02-14T13:07:49.995166+0000","last_fullsized":"2024-02-14T13:07:49.995166+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:38:50.850870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.997254+0000","last_change":"2024-02-14T13:07:49.997254+0000","last_active":"2024-02-14T13:07:49.997254+0000","last_peered":"2024-02-14T13:07:49.997254+0000","last_clean":"2024-02-14T13:07:49.997254+0000","last_became_active":"2024-02-14T13:07:49.996802+0000","last_became_peered":"2024-02-14T13:07:49.996802+0000","last_unstale":"2024-02-14T13:07:49.997254+0000","last_undegraded":"2024-02-14T13:07:49.997254+0000","last_fullsized":"2024-02-14T13:07:49.997254+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:10:22.499475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989909+0000","last_change":"2024-02-14T13:06:49.820464+0000","last_active":"2024-02-14T13:07:49.989909+0000","last_peered":"2024-02-14T13:07:49.989909+0000","last_clean":"2024-02-14T13:07:49.989909+0000","last_became_active":"2024-02-14T13:06:49.820086+0000","last_became_peered":"2024-02-14T13:06:49.820086+0000","last_unstale":"2024-02-14T13:07:49.989909+0000","last_undegraded":"2024-02-14T13:07:49.989909+0000","last_fullsized":"2024-02-14T13:07:49.989909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:20:58.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182828+0000","last_change":"2024-02-14T13:06:49.812761+0000","last_active":"2024-02-14T13:07:50.182828+0000","last_peered":"2024-02-14T13:07:50.182828+0000","last_clean":"2024-02-14T13:07:50.182828+0000","last_became_active":"2024-02-14T13:06:49.812329+0000","last_became_peered":"2024-02-14T13:06:49.812329+0000","last_unstale":"2024-02-14T13:07:50.182828+0000","last_undegraded":"2024-02-14T13:07:50.182828+0000","last_fullsized":"2024-02-14T13:07:50.182828+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:28:48.545577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994589+0000","last_change":"2024-02-14T13:06:49.822049+0000","last_active":"2024-02-14T13:07:49.994589+0000","last_peered":"2024-02-14T13:07:49.994589+0000","last_clean":"2024-02-14T13:07:49.994589+0000","last_became_active":"2024-02-14T13:06:49.821718+0000","last_became_peered":"2024-02-14T13:06:49.821718+0000","last_unstale":"2024-02-14T13:07:49.994589+0000","last_undegraded":"2024-02-14T13:07:49.994589+0000","last_fullsized":"2024-02-14T13:07:49.994589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:24:26.777642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.988910+0000","last_change":"2024-02-14T13:06:49.822572+0000","last_active":"2024-02-14T13:07:49.988910+0000","last_peered":"2024-02-14T13:07:49.988910+0000","last_clean":"2024-02-14T13:07:49.988910+0000","last_became_active":"2024-02-14T13:06:49.822247+0000","last_became_peered":"2024-02-14T13:06:49.822247+0000","last_unstale":"2024-02-14T13:07:49.988910+0000","last_undegraded":"2024-02-14T13:07:49.988910+0000","last_fullsized":"2024-02-14T13:07:49.988910+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:16:21.012868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.988851+0000","last_change":"2024-02-14T13:06:49.810561+0000","last_active":"2024-02-14T13:07:49.988851+0000","last_peered":"2024-02-14T13:07:49.988851+0000","last_clean":"2024-02-14T13:07:49.988851+0000","last_became_active":"2024-02-14T13:06:49.809802+0000","last_became_peered":"2024-02-14T13:06:49.809802+0000","last_unstale":"2024-02-14T13:07:49.988851+0000","last_undegraded":"2024-02-14T13:07:49.988851+0000","last_fullsized":"2024-02-14T13:07:49.988851+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:38.112137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994782+0000","last_change":"2024-02-14T13:06:49.817044+0000","last_active":"2024-02-14T13:07:49.994782+0000","last_peered":"2024-02-14T13:07:49.994782+0000","last_clean":"2024-02-14T13:07:49.994782+0000","last_became_active":"2024-02-14T13:06:49.816718+0000","last_became_peered":"2024-02-14T13:06:49.816718+0000","last_unstale":"2024-02-14T13:07:49.994782+0000","last_undegraded":"2024-02-14T13:07:49.994782+0000","last_fullsized":"2024-02-14T13:07:49.994782+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:32:57.430625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991960+0000","last_change":"2024-02-14T13:06:49.813130+0000","last_active":"2024-02-14T13:07:49.991960+0000","last_peered":"2024-02-14T13:07:49.991960+0000","last_clean":"2024-02-14T13:07:49.991960+0000","last_became_active":"2024-02-14T13:06:49.812819+0000","last_became_peered":"2024-02-14T13:06:49.812819+0000","last_unstale":"2024-02-14T13:07:49.991960+0000","last_undegraded":"2024-02-14T13:07:49.991960+0000","last_fullsized":"2024-02-14T13:07:49.991960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:44:57.840170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986700+0000","last_change":"2024-02-14T13:06:49.811456+0000","last_active":"2024-02-14T13:07:49.986700+0000","last_peered":"2024-02-14T13:07:49.986700+0000","last_clean":"2024-02-14T13:07:49.986700+0000","last_became_active":"2024-02-14T13:06:49.811135+0000","last_became_peered":"2024-02-14T13:06:49.811135+0000","last_unstale":"2024-02-14T13:07:49.986700+0000","last_undegraded":"2024-02-14T13:07:49.986700+0000","last_fullsized":"2024-02-14T13:07:49.986700+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:52:40.336063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.996120+0000","last_change":"2024-02-14T13:07:49.996120+0000","last_active":"2024-02-14T13:07:49.996120+0000","last_peered":"2024-02-14T13:07:49.996120+0000","last_clean":"2024-02-14T13:07:49.996120+0000","last_became_active":"2024-02-14T13:07:49.995741+0000","last_became_peered":"2024-02-14T13:07:49.995741+0000","last_unstale":"2024-02-14T13:07:49.996120+0000","last_undegraded":"2024-02-14T13:07:49.996120+0000","last_fullsized":"2024-02-14T13:07:49.996120+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:52:11.329858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'4","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986639+0000","last_change":"2024-02-14T13:06:48.809813+0000","last_active":"2024-02-14T13:07:49.986639+0000","last_peered":"2024-02-14T13:07:49.986639+0000","last_clean":"2024-02-14T13:07:49.986639+0000","last_became_active":"2024-02-14T13:06:48.809255+0000","last_became_peered":"2024-02-14T13:06:48.809255+0000","last_unstale":"2024-02-14T13:07:49.986639+0000","last_undegraded":"2024-02-14T13:07:49.986639+0000","last_fullsized":"2024-02-14T13:07:49.986639+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:21:43.721692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289265+0000","last_change":"2024-02-14T13:06:49.821162+0000","last_active":"2024-02-14T13:07:50.289265+0000","last_peered":"2024-02-14T13:07:50.289265+0000","last_clean":"2024-02-14T13:07:50.289265+0000","last_became_active":"2024-02-14T13:06:49.820815+0000","last_became_peered":"2024-02-14T13:06:49.820815+0000","last_unstale":"2024-02-14T13:07:50.289265+0000","last_undegraded":"2024-02-14T13:07:50.289265+0000","last_fullsized":"2024-02-14T13:07:50.289265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:02:56.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289385+0000","last_change":"2024-02-14T13:06:48.808550+0000","last_active":"2024-02-14T13:07:50.289385+0000","last_peered":"2024-02-14T13:07:50.289385+0000","last_clean":"2024-02-14T13:07:50.289385+0000","last_became_active":"2024-02-14T13:06:48.808215+0000","last_became_peered":"2024-02-14T13:06:48.808215+0000","last_unstale":"2024-02-14T13:07:50.289385+0000","last_undegraded":"2024-02-14T13:07:50.289385+0000","last_fullsized":"2024-02-14T13:07:50.289385+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:57:16.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989183+0000","last_change":"2024-02-14T13:06:49.814062+0000","last_active":"2024-02-14T13:07:49.989183+0000","last_peered":"2024-02-14T13:07:49.989183+0000","last_clean":"2024-02-14T13:07:49.989183+0000","last_became_active":"2024-02-14T13:06:49.813762+0000","last_became_peered":"2024-02-14T13:06:49.813762+0000","last_unstale":"2024-02-14T13:07:49.989183+0000","last_undegraded":"2024-02-14T13:07:49.989183+0000","last_fullsized":"2024-02-14T13:07:49.989183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:24:33.526915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.002234+0000","last_change":"2024-02-14T13:07:50.002234+0000","last_active":"2024-02-14T13:07:50.002234+0000","last_peered":"2024-02-14T13:07:50.002234+0000","last_clean":"2024-02-14T13:07:50.002234+0000","last_became_active":"2024-02-14T13:07:49.997402+0000","last_became_peered":"2024-02-14T13:07:49.997402+0000","last_unstale":"2024-02-14T13:07:50.002234+0000","last_undegraded":"2024-02-14T13:07:50.002234+0000","last_fullsized":"2024-02-14T13:07:50.002234+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:04:33.555928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995038+0000","last_change":"2024-02-14T13:06:49.821039+0000","last_active":"2024-02-14T13:07:49.995038+0000","last_peered":"2024-02-14T13:07:49.995038+0000","last_clean":"2024-02-14T13:07:49.995038+0000","last_became_active":"2024-02-14T13:06:49.820687+0000","last_became_peered":"2024-02-14T13:06:49.820687+0000","last_unstale":"2024-02-14T13:07:49.995038+0000","last_undegraded":"2024-02-14T13:07:49.995038+0000","last_fullsized":"2024-02-14T13:07:49.995038+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:14:05.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.000596+0000","last_change":"2024-02-14T13:07:50.000218+0000","last_active":"2024-02-14T13:07:50.000596+0000","last_peered":"2024-02-14T13:07:50.000596+0000","last_clean":"2024-02-14T13:07:50.000596+0000","last_became_active":"2024-02-14T13:07:49.996724+0000","last_became_peered":"2024-02-14T13:07:49.996724+0000","last_unstale":"2024-02-14T13:07:50.000596+0000","last_undegraded":"2024-02-14T13:07:50.000596+0000","last_fullsized":"2024-02-14T13:07:50.000596+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:44.605459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990517+0000","last_change":"2024-02-14T13:06:49.813074+0000","last_active":"2024-02-14T13:07:49.990517+0000","last_peered":"2024-02-14T13:07:49.990517+0000","last_clean":"2024-02-14T13:07:49.990517+0000","last_became_active":"2024-02-14T13:06:49.812777+0000","last_became_peered":"2024-02-14T13:06:49.812777+0000","last_unstale":"2024-02-14T13:07:49.990517+0000","last_undegraded":"2024-02-14T13:07:49.990517+0000","last_fullsized":"2024-02-14T13:07:49.990517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:41:03.784230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'1","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989841+0000","last_change":"2024-02-14T13:06:48.806051+0000","last_active":"2024-02-14T13:07:49.989841+0000","last_peered":"2024-02-14T13:07:49.989841+0000","last_clean":"2024-02-14T13:07:49.989841+0000","last_became_active":"2024-02-14T13:06:48.805732+0000","last_became_peered":"2024-02-14T13:06:48.805732+0000","last_unstale":"2024-02-14T13:07:49.989841+0000","last_undegraded":"2024-02-14T13:07:49.989841+0000","last_fullsized":"2024-02-14T13:07:49.989841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:56:07.991489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993030+0000","last_change":"2024-02-14T13:06:49.817448+0000","last_active":"2024-02-14T13:07:49.993030+0000","last_peered":"2024-02-14T13:07:49.993030+0000","last_clean":"2024-02-14T13:07:49.993030+0000","last_became_active":"2024-02-14T13:06:49.817134+0000","last_became_peered":"2024-02-14T13:06:49.817134+0000","last_unstale":"2024-02-14T13:07:49.993030+0000","last_undegraded":"2024-02-14T13:07:49.993030+0000","last_fullsized":"2024-02-14T13:07:49.993030+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:34:45.340290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'1","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.183963+0000","last_change":"2024-02-14T13:07:50.183963+0000","last_active":"2024-02-14T13:07:50.183963+0000","last_peered":"2024-02-14T13:07:50.183963+0000","last_clean":"2024-02-14T13:07:50.183963+0000","last_became_active":"2024-02-14T13:07:50.183583+0000","last_became_peered":"2024-02-14T13:07:50.183583+0000","last_unstale":"2024-02-14T13:07:50.183963+0000","last_undegraded":"2024-02-14T13:07:50.183963+0000","last_fullsized":"2024-02-14T13:07:50.183963+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:20:18.161314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989954+0000","last_change":"2024-02-14T13:06:49.797327+0000","last_active":"2024-02-14T13:07:49.989954+0000","last_peered":"2024-02-14T13:07:49.989954+0000","last_clean":"2024-02-14T13:07:49.989954+0000","last_became_active":"2024-02-14T13:06:49.796953+0000","last_became_peered":"2024-02-14T13:06:49.796953+0000","last_unstale":"2024-02-14T13:07:49.989954+0000","last_undegraded":"2024-02-14T13:07:49.989954+0000","last_fullsized":"2024-02-14T13:07:49.989954+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:58:33.031583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994549+0000","last_change":"2024-02-14T13:06:48.803259+0000","last_active":"2024-02-14T13:07:49.994549+0000","last_peered":"2024-02-14T13:07:49.994549+0000","last_clean":"2024-02-14T13:07:49.994549+0000","last_became_active":"2024-02-14T13:06:48.802670+0000","last_became_peered":"2024-02-14T13:06:48.802670+0000","last_unstale":"2024-02-14T13:07:49.994549+0000","last_undegraded":"2024-02-14T13:07:49.994549+0000","last_fullsized":"2024-02-14T13:07:49.994549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:40:53.036918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288856+0000","last_change":"2024-02-14T13:06:49.811928+0000","last_active":"2024-02-14T13:07:50.288856+0000","last_peered":"2024-02-14T13:07:50.288856+0000","last_clean":"2024-02-14T13:07:50.288856+0000","last_became_active":"2024-02-14T13:06:49.811606+0000","last_became_peered":"2024-02-14T13:06:49.811606+0000","last_unstale":"2024-02-14T13:07:50.288856+0000","last_undegraded":"2024-02-14T13:07:50.288856+0000","last_fullsized":"2024-02-14T13:07:50.288856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:02:09.968642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989818+0000","last_change":"2024-02-14T13:06:48.807135+0000","last_active":"2024-02-14T13:07:49.989818+0000","last_peered":"2024-02-14T13:07:49.989818+0000","last_clean":"2024-02-14T13:07:49.989818+0000","last_became_active":"2024-02-14T13:06:48.806797+0000","last_became_peered":"2024-02-14T13:06:48.806797+0000","last_unstale":"2024-02-14T13:07:49.989818+0000","last_undegraded":"2024-02-14T13:07:49.989818+0000","last_fullsized":"2024-02-14T13:07:49.989818+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:15:04.555490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986601+0000","last_change":"2024-02-14T13:06:49.813330+0000","last_active":"2024-02-14T13:07:49.986601+0000","last_peered":"2024-02-14T13:07:49.986601+0000","last_clean":"2024-02-14T13:07:49.986601+0000","last_became_active":"2024-02-14T13:06:49.813012+0000","last_became_peered":"2024-02-14T13:06:49.813012+0000","last_unstale":"2024-02-14T13:07:49.986601+0000","last_undegraded":"2024-02-14T13:07:49.986601+0000","last_fullsized":"2024-02-14T13:07:49.986601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:05:31.916433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992241+0000","last_change":"2024-02-14T13:06:48.809000+0000","last_active":"2024-02-14T13:07:49.992241+0000","last_peered":"2024-02-14T13:07:49.992241+0000","last_clean":"2024-02-14T13:07:49.992241+0000","last_became_active":"2024-02-14T13:06:48.808649+0000","last_became_peered":"2024-02-14T13:06:48.808649+0000","last_unstale":"2024-02-14T13:07:49.992241+0000","last_undegraded":"2024-02-14T13:07:49.992241+0000","last_fullsized":"2024-02-14T13:07:49.992241+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:42:28.249573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995105+0000","last_change":"2024-02-14T13:06:49.821398+0000","last_active":"2024-02-14T13:07:49.995105+0000","last_peered":"2024-02-14T13:07:49.995105+0000","last_clean":"2024-02-14T13:07:49.995105+0000","last_became_active":"2024-02-14T13:06:49.820121+0000","last_became_peered":"2024-02-14T13:06:49.820121+0000","last_unstale":"2024-02-14T13:07:49.995105+0000","last_undegraded":"2024-02-14T13:07:49.995105+0000","last_fullsized":"2024-02-14T13:07:49.995105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:39:48.045156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989793+0000","last_change":"2024-02-14T13:06:48.809328+0000","last_active":"2024-02-14T13:07:49.989793+0000","last_peered":"2024-02-14T13:07:49.989793+0000","last_clean":"2024-02-14T13:07:49.989793+0000","last_became_active":"2024-02-14T13:06:48.808989+0000","last_became_peered":"2024-02-14T13:06:48.808989+0000","last_unstale":"2024-02-14T13:07:49.989793+0000","last_undegraded":"2024-02-14T13:07:49.989793+0000","last_fullsized":"2024-02-14T13:07:49.989793+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:01:16.957130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995343+0000","last_change":"2024-02-14T13:07:49.995343+0000","last_active":"2024-02-14T13:07:49.995343+0000","last_peered":"2024-02-14T13:07:49.995343+0000","last_clean":"2024-02-14T13:07:49.995343+0000","last_became_active":"2024-02-14T13:07:49.994945+0000","last_became_peered":"2024-02-14T13:07:49.994945+0000","last_unstale":"2024-02-14T13:07:49.995343+0000","last_undegraded":"2024-02-14T13:07:49.995343+0000","last_fullsized":"2024-02-14T13:07:49.995343+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:01:13.718211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'3","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990623+0000","last_change":"2024-02-14T13:06:48.807640+0000","last_active":"2024-02-14T13:07:49.990623+0000","last_peered":"2024-02-14T13:07:49.990623+0000","last_clean":"2024-02-14T13:07:49.990623+0000","last_became_active":"2024-02-14T13:06:48.807337+0000","last_became_peered":"2024-02-14T13:06:48.807337+0000","last_unstale":"2024-02-14T13:07:49.990623+0000","last_undegraded":"2024-02-14T13:07:49.990623+0000","last_fullsized":"2024-02-14T13:07:49.990623+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:52:36.229786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.995045+0000","last_change":"2024-02-14T13:06:49.813546+0000","last_active":"2024-02-14T13:07:49.995045+0000","last_peered":"2024-02-14T13:07:49.995045+0000","last_clean":"2024-02-14T13:07:49.995045+0000","last_became_active":"2024-02-14T13:06:49.813173+0000","last_became_peered":"2024-02-14T13:06:49.813173+0000","last_unstale":"2024-02-14T13:07:49.995045+0000","last_undegraded":"2024-02-14T13:07:49.995045+0000","last_fullsized":"2024-02-14T13:07:49.995045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:49:03.044425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'26","reported_seq":200,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:08:04.943959+0000","last_change":"2024-02-14T13:06:48.810483+0000","last_active":"2024-02-14T13:08:04.943959+0000","last_peered":"2024-02-14T13:08:04.943959+0000","last_clean":"2024-02-14T13:08:04.943959+0000","last_became_active":"2024-02-14T13:06:48.809645+0000","last_became_peered":"2024-02-14T13:06:48.809645+0000","last_unstale":"2024-02-14T13:08:04.943959+0000","last_undegraded":"2024-02-14T13:08:04.943959+0000","last_fullsized":"2024-02-14T13:08:04.943959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:53:27.180806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":136,"num_write":26,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993465+0000","last_change":"2024-02-14T13:06:49.815132+0000","last_active":"2024-02-14T13:07:49.993465+0000","last_peered":"2024-02-14T13:07:49.993465+0000","last_clean":"2024-02-14T13:07:49.993465+0000","last_became_active":"2024-02-14T13:06:49.814807+0000","last_became_peered":"2024-02-14T13:06:49.814807+0000","last_unstale":"2024-02-14T13:07:49.993465+0000","last_undegraded":"2024-02-14T13:07:49.993465+0000","last_fullsized":"2024-02-14T13:07:49.993465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:45.793058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989504+0000","last_change":"2024-02-14T13:06:48.802809+0000","last_active":"2024-02-14T13:07:49.989504+0000","last_peered":"2024-02-14T13:07:49.989504+0000","last_clean":"2024-02-14T13:07:49.989504+0000","last_became_active":"2024-02-14T13:06:48.802444+0000","last_became_peered":"2024-02-14T13:06:48.802444+0000","last_unstale":"2024-02-14T13:07:49.989504+0000","last_undegraded":"2024-02-14T13:07:49.989504+0000","last_fullsized":"2024-02-14T13:07:49.989504+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:06:36.532035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994708+0000","last_change":"2024-02-14T13:06:49.816087+0000","last_active":"2024-02-14T13:07:49.994708+0000","last_peered":"2024-02-14T13:07:49.994708+0000","last_clean":"2024-02-14T13:07:49.994708+0000","last_became_active":"2024-02-14T13:06:49.814867+0000","last_became_peered":"2024-02-14T13:06:49.814867+0000","last_unstale":"2024-02-14T13:07:49.994708+0000","last_undegraded":"2024-02-14T13:07:49.994708+0000","last_fullsized":"2024-02-14T13:07:49.994708+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:16:43.682412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989317+0000","last_change":"2024-02-14T13:06:48.805531+0000","last_active":"2024-02-14T13:07:49.989317+0000","last_peered":"2024-02-14T13:07:49.989317+0000","last_clean":"2024-02-14T13:07:49.989317+0000","last_became_active":"2024-02-14T13:06:48.805216+0000","last_became_peered":"2024-02-14T13:06:48.805216+0000","last_unstale":"2024-02-14T13:07:49.989317+0000","last_undegraded":"2024-02-14T13:07:49.989317+0000","last_fullsized":"2024-02-14T13:07:49.989317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:08:08.869692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989727+0000","last_change":"2024-02-14T13:06:49.818478+0000","last_active":"2024-02-14T13:07:49.989727+0000","last_peered":"2024-02-14T13:07:49.989727+0000","last_clean":"2024-02-14T13:07:49.989727+0000","last_became_active":"2024-02-14T13:06:49.818104+0000","last_became_peered":"2024-02-14T13:06:49.818104+0000","last_unstale":"2024-02-14T13:07:49.989727+0000","last_undegraded":"2024-02-14T13:07:49.989727+0000","last_fullsized":"2024-02-14T13:07:49.989727+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:20:12.507550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182478+0000","last_change":"2024-02-14T13:06:48.807424+0000","last_active":"2024-02-14T13:07:50.182478+0000","last_peered":"2024-02-14T13:07:50.182478+0000","last_clean":"2024-02-14T13:07:50.182478+0000","last_became_active":"2024-02-14T13:06:48.807094+0000","last_became_peered":"2024-02-14T13:06:48.807094+0000","last_unstale":"2024-02-14T13:07:50.182478+0000","last_undegraded":"2024-02-14T13:07:50.182478+0000","last_fullsized":"2024-02-14T13:07:50.182478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:53:57.469653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989696+0000","last_change":"2024-02-14T13:06:49.824891+0000","last_active":"2024-02-14T13:07:49.989696+0000","last_peered":"2024-02-14T13:07:49.989696+0000","last_clean":"2024-02-14T13:07:49.989696+0000","last_became_active":"2024-02-14T13:06:49.824530+0000","last_became_peered":"2024-02-14T13:06:49.824530+0000","last_unstale":"2024-02-14T13:07:49.989696+0000","last_undegraded":"2024-02-14T13:07:49.989696+0000","last_fullsized":"2024-02-14T13:07:49.989696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:20:55.839031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.190269+0000","last_change":"2024-02-14T13:07:50.190269+0000","last_active":"2024-02-14T13:07:50.190269+0000","last_peered":"2024-02-14T13:07:50.190269+0000","last_clean":"2024-02-14T13:07:50.190269+0000","last_became_active":"2024-02-14T13:07:50.184169+0000","last_became_peered":"2024-02-14T13:07:50.184169+0000","last_unstale":"2024-02-14T13:07:50.190269+0000","last_undegraded":"2024-02-14T13:07:50.190269+0000","last_fullsized":"2024-02-14T13:07:50.190269+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:40:39.329485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989667+0000","last_change":"2024-02-14T13:06:49.815017+0000","last_active":"2024-02-14T13:07:49.989667+0000","last_peered":"2024-02-14T13:07:49.989667+0000","last_clean":"2024-02-14T13:07:49.989667+0000","last_became_active":"2024-02-14T13:06:49.809970+0000","last_became_peered":"2024-02-14T13:06:49.809970+0000","last_unstale":"2024-02-14T13:07:49.989667+0000","last_undegraded":"2024-02-14T13:07:49.989667+0000","last_fullsized":"2024-02-14T13:07:49.989667+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:54:02.156674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'1","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993296+0000","last_change":"2024-02-14T13:06:48.804251+0000","last_active":"2024-02-14T13:07:49.993296+0000","last_peered":"2024-02-14T13:07:49.993296+0000","last_clean":"2024-02-14T13:07:49.993296+0000","last_became_active":"2024-02-14T13:06:48.803641+0000","last_became_peered":"2024-02-14T13:06:48.803641+0000","last_unstale":"2024-02-14T13:07:49.993296+0000","last_undegraded":"2024-02-14T13:07:49.993296+0000","last_fullsized":"2024-02-14T13:07:49.993296+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:12:02.934023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991424+0000","last_change":"2024-02-14T13:06:49.808602+0000","last_active":"2024-02-14T13:07:49.991424+0000","last_peered":"2024-02-14T13:07:49.991424+0000","last_clean":"2024-02-14T13:07:49.991424+0000","last_became_active":"2024-02-14T13:06:49.808242+0000","last_became_peered":"2024-02-14T13:06:49.808242+0000","last_unstale":"2024-02-14T13:07:49.991424+0000","last_undegraded":"2024-02-14T13:07:49.991424+0000","last_fullsized":"2024-02-14T13:07:49.991424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:03:11.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986588+0000","last_change":"2024-02-14T13:06:48.804093+0000","last_active":"2024-02-14T13:07:49.986588+0000","last_peered":"2024-02-14T13:07:49.986588+0000","last_clean":"2024-02-14T13:07:49.986588+0000","last_became_active":"2024-02-14T13:06:48.803777+0000","last_became_peered":"2024-02-14T13:06:48.803777+0000","last_unstale":"2024-02-14T13:07:49.986588+0000","last_undegraded":"2024-02-14T13:07:49.986588+0000","last_fullsized":"2024-02-14T13:07:49.986588+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:22.829400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992357+0000","last_change":"2024-02-14T13:06:49.826670+0000","last_active":"2024-02-14T13:07:49.992357+0000","last_peered":"2024-02-14T13:07:49.992357+0000","last_clean":"2024-02-14T13:07:49.992357+0000","last_became_active":"2024-02-14T13:06:49.826142+0000","last_became_peered":"2024-02-14T13:06:49.826142+0000","last_unstale":"2024-02-14T13:07:49.992357+0000","last_undegraded":"2024-02-14T13:07:49.992357+0000","last_fullsized":"2024-02-14T13:07:49.992357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T13:59:33.260459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989710+0000","last_change":"2024-02-14T13:06:48.810204+0000","last_active":"2024-02-14T13:07:49.989710+0000","last_peered":"2024-02-14T13:07:49.989710+0000","last_clean":"2024-02-14T13:07:49.989710+0000","last_became_active":"2024-02-14T13:06:48.809660+0000","last_became_peered":"2024-02-14T13:06:48.809660+0000","last_unstale":"2024-02-14T13:07:49.989710+0000","last_undegraded":"2024-02-14T13:07:49.989710+0000","last_fullsized":"2024-02-14T13:07:49.989710+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:16:12.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992295+0000","last_change":"2024-02-14T13:06:49.810660+0000","last_active":"2024-02-14T13:07:49.992295+0000","last_peered":"2024-02-14T13:07:49.992295+0000","last_clean":"2024-02-14T13:07:49.992295+0000","last_became_active":"2024-02-14T13:06:49.810262+0000","last_became_peered":"2024-02-14T13:06:49.810262+0000","last_unstale":"2024-02-14T13:07:49.992295+0000","last_undegraded":"2024-02-14T13:07:49.992295+0000","last_fullsized":"2024-02-14T13:07:49.992295+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:42:45.416138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990025+0000","last_change":"2024-02-14T13:06:49.820378+0000","last_active":"2024-02-14T13:07:49.990025+0000","last_peered":"2024-02-14T13:07:49.990025+0000","last_clean":"2024-02-14T13:07:49.990025+0000","last_became_active":"2024-02-14T13:06:49.820068+0000","last_became_peered":"2024-02-14T13:06:49.820068+0000","last_unstale":"2024-02-14T13:07:49.990025+0000","last_undegraded":"2024-02-14T13:07:49.990025+0000","last_fullsized":"2024-02-14T13:07:49.990025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:13:08.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994452+0000","last_change":"2024-02-14T13:06:48.805731+0000","last_active":"2024-02-14T13:07:49.994452+0000","last_peered":"2024-02-14T13:07:49.994452+0000","last_clean":"2024-02-14T13:07:49.994452+0000","last_became_active":"2024-02-14T13:06:48.805436+0000","last_became_peered":"2024-02-14T13:06:48.805436+0000","last_unstale":"2024-02-14T13:07:49.994452+0000","last_undegraded":"2024-02-14T13:07:49.994452+0000","last_fullsized":"2024-02-14T13:07:49.994452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:17:19.189008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289201+0000","last_change":"2024-02-14T13:06:49.808367+0000","last_active":"2024-02-14T13:07:50.289201+0000","last_peered":"2024-02-14T13:07:50.289201+0000","last_clean":"2024-02-14T13:07:50.289201+0000","last_became_active":"2024-02-14T13:06:49.806803+0000","last_became_peered":"2024-02-14T13:06:49.806803+0000","last_unstale":"2024-02-14T13:07:50.289201+0000","last_undegraded":"2024-02-14T13:07:50.289201+0000","last_fullsized":"2024-02-14T13:07:50.289201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:13:01.914405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182688+0000","last_change":"2024-02-14T13:06:48.806647+0000","last_active":"2024-02-14T13:07:50.182688+0000","last_peered":"2024-02-14T13:07:50.182688+0000","last_clean":"2024-02-14T13:07:50.182688+0000","last_became_active":"2024-02-14T13:06:48.806251+0000","last_became_peered":"2024-02-14T13:06:48.806251+0000","last_unstale":"2024-02-14T13:07:50.182688+0000","last_undegraded":"2024-02-14T13:07:50.182688+0000","last_fullsized":"2024-02-14T13:07:50.182688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:16:45.945681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":344,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989477+0000","last_change":"2024-02-14T13:05:38.723491+0000","last_active":"2024-02-14T13:07:49.989477+0000","last_peered":"2024-02-14T13:07:49.989477+0000","last_clean":"2024-02-14T13:07:49.989477+0000","last_became_active":"2024-02-14T13:05:38.722889+0000","last_became_peered":"2024-02-14T13:05:38.722889+0000","last_unstale":"2024-02-14T13:07:49.989477+0000","last_undegraded":"2024-02-14T13:07:49.989477+0000","last_fullsized":"2024-02-14T13:07:49.989477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:02:17.377304+0000","last_clean_scrub_stamp":"2024-02-14T13:02:17.377304+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:09:14.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994351+0000","last_change":"2024-02-14T13:06:49.810325+0000","last_active":"2024-02-14T13:07:49.994351+0000","last_peered":"2024-02-14T13:07:49.994351+0000","last_clean":"2024-02-14T13:07:49.994351+0000","last_became_active":"2024-02-14T13:06:49.809651+0000","last_became_peered":"2024-02-14T13:06:49.809651+0000","last_unstale":"2024-02-14T13:07:49.994351+0000","last_undegraded":"2024-02-14T13:07:49.994351+0000","last_fullsized":"2024-02-14T13:07:49.994351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:50:25.103081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.999952+0000","last_change":"2024-02-14T13:07:49.999375+0000","last_active":"2024-02-14T13:07:49.999952+0000","last_peered":"2024-02-14T13:07:49.999952+0000","last_clean":"2024-02-14T13:07:49.999952+0000","last_became_active":"2024-02-14T13:07:49.999030+0000","last_became_peered":"2024-02-14T13:07:49.999030+0000","last_unstale":"2024-02-14T13:07:49.999952+0000","last_undegraded":"2024-02-14T13:07:49.999952+0000","last_fullsized":"2024-02-14T13:07:49.999952+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T01:06:21.192366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.993555+0000","last_change":"2024-02-14T13:06:48.809670+0000","last_active":"2024-02-14T13:07:49.993555+0000","last_peered":"2024-02-14T13:07:49.993555+0000","last_clean":"2024-02-14T13:07:49.993555+0000","last_became_active":"2024-02-14T13:06:48.809360+0000","last_became_peered":"2024-02-14T13:06:48.809360+0000","last_unstale":"2024-02-14T13:07:49.993555+0000","last_undegraded":"2024-02-14T13:07:49.993555+0000","last_fullsized":"2024-02-14T13:07:49.993555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:10:09.759620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994820+0000","last_change":"2024-02-14T13:06:49.809578+0000","last_active":"2024-02-14T13:07:49.994820+0000","last_peered":"2024-02-14T13:07:49.994820+0000","last_clean":"2024-02-14T13:07:49.994820+0000","last_became_active":"2024-02-14T13:06:49.809220+0000","last_became_peered":"2024-02-14T13:06:49.809220+0000","last_unstale":"2024-02-14T13:07:49.994820+0000","last_undegraded":"2024-02-14T13:07:49.994820+0000","last_fullsized":"2024-02-14T13:07:49.994820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:21:20.890236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.986617+0000","last_change":"2024-02-14T13:06:48.808684+0000","last_active":"2024-02-14T13:07:49.986617+0000","last_peered":"2024-02-14T13:07:49.986617+0000","last_clean":"2024-02-14T13:07:49.986617+0000","last_became_active":"2024-02-14T13:06:48.808377+0000","last_became_peered":"2024-02-14T13:06:48.808377+0000","last_unstale":"2024-02-14T13:07:49.986617+0000","last_undegraded":"2024-02-14T13:07:49.986617+0000","last_fullsized":"2024-02-14T13:07:49.986617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:35:50.667080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289469+0000","last_change":"2024-02-14T13:06:49.818435+0000","last_active":"2024-02-14T13:07:50.289469+0000","last_peered":"2024-02-14T13:07:50.289469+0000","last_clean":"2024-02-14T13:07:50.289469+0000","last_became_active":"2024-02-14T13:06:49.817793+0000","last_became_peered":"2024-02-14T13:06:49.817793+0000","last_unstale":"2024-02-14T13:07:50.289469+0000","last_undegraded":"2024-02-14T13:07:50.289469+0000","last_fullsized":"2024-02-14T13:07:50.289469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:11:41.708425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.182893+0000","last_change":"2024-02-14T13:06:48.809942+0000","last_active":"2024-02-14T13:07:50.182893+0000","last_peered":"2024-02-14T13:07:50.182893+0000","last_clean":"2024-02-14T13:07:50.182893+0000","last_became_active":"2024-02-14T13:06:48.809631+0000","last_became_peered":"2024-02-14T13:06:48.809631+0000","last_unstale":"2024-02-14T13:07:50.182893+0000","last_undegraded":"2024-02-14T13:07:50.182893+0000","last_fullsized":"2024-02-14T13:07:50.182893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:41:23.011859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.290314+0000","last_change":"2024-02-14T13:07:50.290314+0000","last_active":"2024-02-14T13:07:50.290314+0000","last_peered":"2024-02-14T13:07:50.290314+0000","last_clean":"2024-02-14T13:07:50.290314+0000","last_became_active":"2024-02-14T13:07:50.289901+0000","last_became_peered":"2024-02-14T13:07:50.289901+0000","last_unstale":"2024-02-14T13:07:50.290314+0000","last_undegraded":"2024-02-14T13:07:50.290314+0000","last_fullsized":"2024-02-14T13:07:50.290314+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:08:59.324371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994897+0000","last_change":"2024-02-14T13:06:48.802024+0000","last_active":"2024-02-14T13:07:49.994897+0000","last_peered":"2024-02-14T13:07:49.994897+0000","last_clean":"2024-02-14T13:07:49.994897+0000","last_became_active":"2024-02-14T13:06:48.801701+0000","last_became_peered":"2024-02-14T13:06:48.801701+0000","last_unstale":"2024-02-14T13:07:49.994897+0000","last_undegraded":"2024-02-14T13:07:49.994897+0000","last_fullsized":"2024-02-14T13:07:49.994897+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:11:37.899800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992994+0000","last_change":"2024-02-14T13:06:49.822081+0000","last_active":"2024-02-14T13:07:49.992994+0000","last_peered":"2024-02-14T13:07:49.992994+0000","last_clean":"2024-02-14T13:07:49.992994+0000","last_became_active":"2024-02-14T13:06:49.821729+0000","last_became_peered":"2024-02-14T13:06:49.821729+0000","last_unstale":"2024-02-14T13:07:49.992994+0000","last_undegraded":"2024-02-14T13:07:49.992994+0000","last_fullsized":"2024-02-14T13:07:49.992994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:27:00.248035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288987+0000","last_change":"2024-02-14T13:06:48.807099+0000","last_active":"2024-02-14T13:07:50.288987+0000","last_peered":"2024-02-14T13:07:50.288987+0000","last_clean":"2024-02-14T13:07:50.288987+0000","last_became_active":"2024-02-14T13:06:48.806627+0000","last_became_peered":"2024-02-14T13:06:48.806627+0000","last_unstale":"2024-02-14T13:07:50.288987+0000","last_undegraded":"2024-02-14T13:07:50.288987+0000","last_fullsized":"2024-02-14T13:07:50.288987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:21:26.579575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992252+0000","last_change":"2024-02-14T13:06:49.819878+0000","last_active":"2024-02-14T13:07:49.992252+0000","last_peered":"2024-02-14T13:07:49.992252+0000","last_clean":"2024-02-14T13:07:49.992252+0000","last_became_active":"2024-02-14T13:06:49.819562+0000","last_became_peered":"2024-02-14T13:06:49.819562+0000","last_unstale":"2024-02-14T13:07:49.992252+0000","last_undegraded":"2024-02-14T13:07:49.992252+0000","last_fullsized":"2024-02-14T13:07:49.992252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:09:58.626393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989293+0000","last_change":"2024-02-14T13:06:48.804605+0000","last_active":"2024-02-14T13:07:49.989293+0000","last_peered":"2024-02-14T13:07:49.989293+0000","last_clean":"2024-02-14T13:07:49.989293+0000","last_became_active":"2024-02-14T13:06:48.804325+0000","last_became_peered":"2024-02-14T13:06:48.804325+0000","last_unstale":"2024-02-14T13:07:49.989293+0000","last_undegraded":"2024-02-14T13:07:49.989293+0000","last_fullsized":"2024-02-14T13:07:49.989293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:19:57.427215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289340+0000","last_change":"2024-02-14T13:06:49.818631+0000","last_active":"2024-02-14T13:07:50.289340+0000","last_peered":"2024-02-14T13:07:50.289340+0000","last_clean":"2024-02-14T13:07:50.289340+0000","last_became_active":"2024-02-14T13:06:49.817877+0000","last_became_peered":"2024-02-14T13:06:49.817877+0000","last_unstale":"2024-02-14T13:07:50.289340+0000","last_undegraded":"2024-02-14T13:07:50.289340+0000","last_fullsized":"2024-02-14T13:07:50.289340+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:03:06.405049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'2","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992908+0000","last_change":"2024-02-14T13:06:48.808259+0000","last_active":"2024-02-14T13:07:49.992908+0000","last_peered":"2024-02-14T13:07:49.992908+0000","last_clean":"2024-02-14T13:07:49.992908+0000","last_became_active":"2024-02-14T13:06:48.807906+0000","last_became_peered":"2024-02-14T13:06:48.807906+0000","last_unstale":"2024-02-14T13:07:49.992908+0000","last_undegraded":"2024-02-14T13:07:49.992908+0000","last_fullsized":"2024-02-14T13:07:49.992908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:28:00.982733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989579+0000","last_change":"2024-02-14T13:06:49.821144+0000","last_active":"2024-02-14T13:07:49.989579+0000","last_peered":"2024-02-14T13:07:49.989579+0000","last_clean":"2024-02-14T13:07:49.989579+0000","last_became_active":"2024-02-14T13:06:49.819228+0000","last_became_peered":"2024-02-14T13:06:49.819228+0000","last_unstale":"2024-02-14T13:07:49.989579+0000","last_undegraded":"2024-02-14T13:07:49.989579+0000","last_fullsized":"2024-02-14T13:07:49.989579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T15:47:05.541196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989702+0000","last_change":"2024-02-14T13:06:48.803120+0000","last_active":"2024-02-14T13:07:49.989702+0000","last_peered":"2024-02-14T13:07:49.989702+0000","last_clean":"2024-02-14T13:07:49.989702+0000","last_became_active":"2024-02-14T13:06:48.802431+0000","last_became_peered":"2024-02-14T13:06:48.802431+0000","last_unstale":"2024-02-14T13:07:49.989702+0000","last_undegraded":"2024-02-14T13:07:49.989702+0000","last_fullsized":"2024-02-14T13:07:49.989702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T23:03:10.533979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990010+0000","last_change":"2024-02-14T13:06:49.819876+0000","last_active":"2024-02-14T13:07:49.990010+0000","last_peered":"2024-02-14T13:07:49.990010+0000","last_clean":"2024-02-14T13:07:49.990010+0000","last_became_active":"2024-02-14T13:06:49.819510+0000","last_became_peered":"2024-02-14T13:06:49.819510+0000","last_unstale":"2024-02-14T13:07:49.990010+0000","last_undegraded":"2024-02-14T13:07:49.990010+0000","last_fullsized":"2024-02-14T13:07:49.990010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:15:16.761937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990447+0000","last_change":"2024-02-14T13:06:48.805862+0000","last_active":"2024-02-14T13:07:49.990447+0000","last_peered":"2024-02-14T13:07:49.990447+0000","last_clean":"2024-02-14T13:07:49.990447+0000","last_became_active":"2024-02-14T13:06:48.805550+0000","last_became_peered":"2024-02-14T13:06:48.805550+0000","last_unstale":"2024-02-14T13:07:49.990447+0000","last_undegraded":"2024-02-14T13:07:49.990447+0000","last_fullsized":"2024-02-14T13:07:49.990447+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:15:32.979424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989637+0000","last_change":"2024-02-14T13:06:49.825808+0000","last_active":"2024-02-14T13:07:49.989637+0000","last_peered":"2024-02-14T13:07:49.989637+0000","last_clean":"2024-02-14T13:07:49.989637+0000","last_became_active":"2024-02-14T13:06:49.825411+0000","last_became_peered":"2024-02-14T13:06:49.825411+0000","last_unstale":"2024-02-14T13:07:49.989637+0000","last_undegraded":"2024-02-14T13:07:49.989637+0000","last_fullsized":"2024-02-14T13:07:49.989637+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:51:34.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994433+0000","last_change":"2024-02-14T13:06:48.804075+0000","last_active":"2024-02-14T13:07:49.994433+0000","last_peered":"2024-02-14T13:07:49.994433+0000","last_clean":"2024-02-14T13:07:49.994433+0000","last_became_active":"2024-02-14T13:06:48.803645+0000","last_became_peered":"2024-02-14T13:06:48.803645+0000","last_unstale":"2024-02-14T13:07:49.994433+0000","last_undegraded":"2024-02-14T13:07:49.994433+0000","last_fullsized":"2024-02-14T13:07:49.994433+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:47.773453+0000","last_clean_scrub_stamp":"2024-02-14T13:06:47.773453+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T17:44:37.422392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990006+0000","last_change":"2024-02-14T13:06:49.819692+0000","last_active":"2024-02-14T13:07:49.990006+0000","last_peered":"2024-02-14T13:07:49.990006+0000","last_clean":"2024-02-14T13:07:49.990006+0000","last_became_active":"2024-02-14T13:06:49.818855+0000","last_became_peered":"2024-02-14T13:06:49.818855+0000","last_unstale":"2024-02-14T13:07:49.990006+0000","last_undegraded":"2024-02-14T13:07:49.990006+0000","last_fullsized":"2024-02-14T13:07:49.990006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:59:06.493485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992076+0000","last_change":"2024-02-14T13:06:49.821393+0000","last_active":"2024-02-14T13:07:49.992076+0000","last_peered":"2024-02-14T13:07:49.992076+0000","last_clean":"2024-02-14T13:07:49.992076+0000","last_became_active":"2024-02-14T13:06:49.821043+0000","last_became_peered":"2024-02-14T13:06:49.821043+0000","last_unstale":"2024-02-14T13:07:49.992076+0000","last_undegraded":"2024-02-14T13:07:49.992076+0000","last_fullsized":"2024-02-14T13:07:49.992076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:34:48.890593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989250+0000","last_change":"2024-02-14T13:06:49.809684+0000","last_active":"2024-02-14T13:07:49.989250+0000","last_peered":"2024-02-14T13:07:49.989250+0000","last_clean":"2024-02-14T13:07:49.989250+0000","last_became_active":"2024-02-14T13:06:49.809285+0000","last_became_peered":"2024-02-14T13:06:49.809285+0000","last_unstale":"2024-02-14T13:07:49.989250+0000","last_undegraded":"2024-02-14T13:07:49.989250+0000","last_fullsized":"2024-02-14T13:07:49.989250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T20:05:53.262774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989203+0000","last_change":"2024-02-14T13:06:49.818248+0000","last_active":"2024-02-14T13:07:49.989203+0000","last_peered":"2024-02-14T13:07:49.989203+0000","last_clean":"2024-02-14T13:07:49.989203+0000","last_became_active":"2024-02-14T13:06:49.817753+0000","last_became_peered":"2024-02-14T13:06:49.817753+0000","last_unstale":"2024-02-14T13:07:49.989203+0000","last_undegraded":"2024-02-14T13:07:49.989203+0000","last_fullsized":"2024-02-14T13:07:49.989203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T22:27:29.251638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.988973+0000","last_change":"2024-02-14T13:06:49.821505+0000","last_active":"2024-02-14T13:07:49.988973+0000","last_peered":"2024-02-14T13:07:49.988973+0000","last_clean":"2024-02-14T13:07:49.988973+0000","last_became_active":"2024-02-14T13:06:49.821173+0000","last_became_peered":"2024-02-14T13:06:49.821173+0000","last_unstale":"2024-02-14T13:07:49.988973+0000","last_undegraded":"2024-02-14T13:07:49.988973+0000","last_fullsized":"2024-02-14T13:07:49.988973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T16:19:21.657109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994844+0000","last_change":"2024-02-14T13:06:49.808452+0000","last_active":"2024-02-14T13:07:49.994844+0000","last_peered":"2024-02-14T13:07:49.994844+0000","last_clean":"2024-02-14T13:07:49.994844+0000","last_became_active":"2024-02-14T13:06:49.808106+0000","last_became_peered":"2024-02-14T13:06:49.808106+0000","last_unstale":"2024-02-14T13:07:49.994844+0000","last_undegraded":"2024-02-14T13:07:49.994844+0000","last_fullsized":"2024-02-14T13:07:49.994844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:24:59.528305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.991495+0000","last_change":"2024-02-14T13:06:49.822862+0000","last_active":"2024-02-14T13:07:49.991495+0000","last_peered":"2024-02-14T13:07:49.991495+0000","last_clean":"2024-02-14T13:07:49.991495+0000","last_became_active":"2024-02-14T13:06:49.822279+0000","last_became_peered":"2024-02-14T13:06:49.822279+0000","last_unstale":"2024-02-14T13:07:49.991495+0000","last_undegraded":"2024-02-14T13:07:49.991495+0000","last_fullsized":"2024-02-14T13:07:49.991495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-16T00:46:06.005807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.990836+0000","last_change":"2024-02-14T13:06:49.816902+0000","last_active":"2024-02-14T13:07:49.990836+0000","last_peered":"2024-02-14T13:07:49.990836+0000","last_clean":"2024-02-14T13:07:49.990836+0000","last_became_active":"2024-02-14T13:06:49.816528+0000","last_became_peered":"2024-02-14T13:06:49.816528+0000","last_unstale":"2024-02-14T13:07:49.990836+0000","last_undegraded":"2024-02-14T13:07:49.990836+0000","last_fullsized":"2024-02-14T13:07:49.990836+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T18:27:21.465567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.289137+0000","last_change":"2024-02-14T13:06:49.811990+0000","last_active":"2024-02-14T13:07:50.289137+0000","last_peered":"2024-02-14T13:07:50.289137+0000","last_clean":"2024-02-14T13:07:50.289137+0000","last_became_active":"2024-02-14T13:06:49.811655+0000","last_became_peered":"2024-02-14T13:06:49.811655+0000","last_unstale":"2024-02-14T13:07:50.289137+0000","last_undegraded":"2024-02-14T13:07:50.289137+0000","last_fullsized":"2024-02-14T13:07:50.289137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:33:41.122395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.989912+0000","last_change":"2024-02-14T13:06:49.819554+0000","last_active":"2024-02-14T13:07:49.989912+0000","last_peered":"2024-02-14T13:07:49.989912+0000","last_clean":"2024-02-14T13:07:49.989912+0000","last_became_active":"2024-02-14T13:06:49.818512+0000","last_became_peered":"2024-02-14T13:06:49.818512+0000","last_unstale":"2024-02-14T13:07:49.989912+0000","last_undegraded":"2024-02-14T13:07:49.989912+0000","last_fullsized":"2024-02-14T13:07:49.989912+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:25:37.709104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:50.288907+0000","last_change":"2024-02-14T13:06:49.812733+0000","last_active":"2024-02-14T13:07:50.288907+0000","last_peered":"2024-02-14T13:07:50.288907+0000","last_clean":"2024-02-14T13:07:50.288907+0000","last_became_active":"2024-02-14T13:06:49.811998+0000","last_became_peered":"2024-02-14T13:06:49.811998+0000","last_unstale":"2024-02-14T13:07:50.288907+0000","last_undegraded":"2024-02-14T13:07:50.288907+0000","last_fullsized":"2024-02-14T13:07:50.288907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T21:04:06.483820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994953+0000","last_change":"2024-02-14T13:06:49.821961+0000","last_active":"2024-02-14T13:07:49.994953+0000","last_peered":"2024-02-14T13:07:49.994953+0000","last_clean":"2024-02-14T13:07:49.994953+0000","last_became_active":"2024-02-14T13:06:49.821461+0000","last_became_peered":"2024-02-14T13:06:49.821461+0000","last_unstale":"2024-02-14T13:07:49.994953+0000","last_undegraded":"2024-02-14T13:07:49.994953+0000","last_fullsized":"2024-02-14T13:07:49.994953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:52:23.059141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.994679+0000","last_change":"2024-02-14T13:06:49.814057+0000","last_active":"2024-02-14T13:07:49.994679+0000","last_peered":"2024-02-14T13:07:49.994679+0000","last_clean":"2024-02-14T13:07:49.994679+0000","last_became_active":"2024-02-14T13:06:49.813689+0000","last_became_peered":"2024-02-14T13:06:49.813689+0000","last_unstale":"2024-02-14T13:07:49.994679+0000","last_undegraded":"2024-02-14T13:07:49.994679+0000","last_fullsized":"2024-02-14T13:07:49.994679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T19:49:07.408161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-02-14T13:07:49.992174+0000","last_change":"2024-02-14T13:06:49.814288+0000","last_active":"2024-02-14T13:07:49.992174+0000","last_peered":"2024-02-14T13:07:49.992174+0000","last_clean":"2024-02-14T13:07:49.992174+0000","last_became_active":"2024-02-14T13:06:49.813930+0000","last_became_peered":"2024-02-14T13:06:49.813930+0000","last_unstale":"2024-02-14T13:07:49.992174+0000","last_undegraded":"2024-02-14T13:07:49.992174+0000","last_fullsized":"2024-02-14T13:07:49.992174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-14T13:06:48.779091+0000","last_clean_scrub_stamp":"2024-02-14T13:06:48.779091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T14:39:46.815947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61844,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":161,"num_read_kb":142,"num_write":75,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":185532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":82,"seq":352187318301,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":462278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70899999999999996,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.432}]},{"osd":1,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.78300000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82599999999999996,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70199999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.625},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.68600000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.53700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.495,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65300000000000002}]},{"osd":5,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.35399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83999999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84699999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.54600000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.75,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.58299999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.92000000000000004,"5min":1.018,"15min":1.018},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.54900000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95699999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80900000000000005}]},{"osd":8,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.68600000000000005}]},{"osd":9,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71499999999999997},"min":{"1min":0.629,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.874,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.75},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.67000000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67200000000000004}]},{"osd":10,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76500000000000001,"15min":0.76200000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.91500000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.872}]}]},{"osd":10,"up_from":74,"seq":317827579938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1114003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:53 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.503},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.58699999999999997}]},{"osd":2,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68500000000000005,"15min":0.68700000000000006},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.754},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88500000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76600000000000001}]},{"osd":3,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.65900000000000003,"15min":0.67900000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.878,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59999999999999998,"15min":0.60699999999999998},"min":{"1min":0.315,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.76500000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.877,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.77000000000000002},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":1.083,"15min":1.083},"last":0.82399999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":5.9729999999999999,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86499999999999999,"5min":1.05,"15min":1.05},"last":0.67000000000000004}]},{"osd":7,"last update":"Wed Feb 14 13:06:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":1.077,"15min":1.077},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.6299999999999999,"15min":1.77},"min":{"1min":0.53100000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93000000000000005,"5min":16.844999999999999,"15min":16.844999999999999},"last":0.79000000000000004}]},{"osd":9,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":0.86699999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.85099999999999998,"15min":0.86699999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.97999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.86599999999999999}]},{"osd":11,"last update":"Wed Feb 14 13:08:05 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.01,"5min":1.056,"15min":1.056},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.88300000000000001}]}]},{"osd":9,"up_from":69,"seq":296352743463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.439,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.46000000000000002,"15min":0.46200000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.32300000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.74399999999999999,"15min":0.69199999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":11.996,"5min":11.996,"15min":11.996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.66100000000000003,"15min":0.66900000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76400000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.36499999999999999}]},{"osd":4,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68200000000000005,"15min":0.68600000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.495},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.69099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.871,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.81599999999999995,"15min":0.77800000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":11.965999999999999,"5min":11.965999999999999,"15min":11.965999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.113,"5min":0.82099999999999995,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":12.087,"5min":12.087,"15min":12.087},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.68700000000000006,"15min":0.70299999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89400000000000002,"5min":1.133,"15min":1.133},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97399999999999998,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.42299999999999999}]},{"osd":7,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0640000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":1.296,"15min":1.296},"last":0.61399999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.80500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.004,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0149999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.64700000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81999999999999995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66200000000000003}]}]},{"osd":8,"up_from":61,"seq":261993005099,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":462882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57499999999999996,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.495},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.434,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.50800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.438},"min":{"1min":0.38,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.45700000000000002},"min":{"1min":0.35999999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34499999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84599999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.46400000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.879,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.52800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.45300000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.58599999999999997,"15min":0.57499999999999996},"min":{"1min":0.39900000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.40899999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.48099999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.54100000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.626,"5min":0.503,"15min":0.503},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.628},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.71899999999999997,"15min":0.70299999999999996},"min":{"1min":0.63900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59599999999999997}]},{"osd":9,"last update":"Wed Feb 14 13:07:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.73299999999999998,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.58099999999999996}]},{"osd":10,"last update":"Wed Feb 14 13:07:38 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.73699999999999999,"15min":0.72099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.67300000000000004}]},{"osd":11,"last update":"Wed Feb 14 13:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.61799999999999999}]}]},{"osd":7,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28552,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716600,"statfs":{"total":95995035648,"available":95965798400,"internally_reserved":0,"allocated":1564672,"data_stored":1053345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.46899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.51400000000000001,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.46400000000000002,"15min":0.46200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75700000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90000000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86599999999999999,"5min":0.873,"15min":0.873},"last":0.78200000000000003}]},{"osd":3,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72999999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.61199999999999999,"15min":0.58999999999999997},"min":{"1min":0.46300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.75800000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.55300000000000005,"15min":0.56100000000000005},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84099999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"min":{"1min":0.50600000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.84399999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:07:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":0.68999999999999995},"min":{"1min":0.52700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.879,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.749},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.51200000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.624,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81299999999999994,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82099999999999995}]},{"osd":9,"last update":"Wed Feb 14 13:07:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.99399999999999999,"5min":1.069,"15min":1.069},"last":0.871},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76200000000000001,"15min":0.76800000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89800000000000002}]},{"osd":10,"last update":"Wed Feb 14 13:07:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.61799999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.90000000000000002,"5min":1.087,"15min":1.087},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.54900000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94599999999999995,"5min":1.069,"15min":1.069},"last":0.92900000000000005}]},{"osd":11,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.97499999999999998}]}]},{"osd":6,"up_from":48,"seq":206158430262,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":462395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.378},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.499,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.56399999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81200000000000006,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.378,"15min":0.378},"max":{"1min":0.78100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.93500000000000005,"15min":1.2989999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76400000000000001,"5min":18.571999999999999,"15min":18.571999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.69699999999999995,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.621}]},{"osd":3,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74099999999999999,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.32200000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63600000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.436}]},{"osd":4,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.41099999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.81499999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.999,"15min":1.359},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.72599999999999998,"5min":18.521000000000001,"15min":18.521000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":0.996},"last":0.71099999999999997}]},{"osd":7,"last update":"Wed Feb 14 13:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.503,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85999999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.69499999999999995},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95699999999999996,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64700000000000002}]},{"osd":8,"last update":"Wed Feb 14 13:07:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70399999999999996,"15min":0.71499999999999997},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.94599999999999995,"5min":1.006,"15min":1.006},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.5900000000000001,"5min":0.91200000000000003,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":16.891999999999999,"5min":16.891999999999999,"15min":16.891999999999999},"last":0.72099999999999997}]},{"osd":9,"last update":"Wed Feb 14 13:07:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.85299999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.751,"15min":0.77400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98899999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.51300000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:07:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.77000000000000002,"15min":0.78000000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.81399999999999995,"5min":1.091,"15min":1.091},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.745,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.90500000000000003,"5min":1.05,"15min":1.05},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":523324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:59 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55200000000000005,"15min":0.49299999999999999},"min":{"1min":0.46700000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.496},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.32000000000000001},"max":{"1min":0.86599999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.504}]},{"osd":2,"last update":"Wed Feb 14 13:07:20 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57599999999999996,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.81200000000000006,"5min":0.998,"15min":0.998},"last":0.63},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.57199999999999995,"15min":0.53200000000000003},"min":{"1min":0.47199999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.74399999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56799999999999995,"15min":0.52700000000000002},"min":{"1min":0.41799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.55700000000000005,"15min":0.51100000000000001},"min":{"1min":0.379,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.47599999999999998,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.44600000000000001},"min":{"1min":0.34899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Wed Feb 14 13:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.66300000000000003,"15min":0.623},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.53900000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Wed Feb 14 13:07:59 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":0.84499999999999997,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":17.373999999999999,"5min":17.373999999999999,"15min":17.373999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69699999999999995,"15min":0.66200000000000003},"min":{"1min":0.52300000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.41299999999999998}]},{"osd":7,"last update":"Wed Feb 14 13:07:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.441,"5min":0.37,"15min":0.37},"max":{"1min":1.024,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68500000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0069999999999999,"5min":1.157,"15min":1.157},"last":0.68300000000000005}]},{"osd":8,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.80500000000000005,"15min":0.79900000000000004},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.625,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.86199999999999999}]},{"osd":9,"last update":"Wed Feb 14 13:07:11 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79300000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77300000000000002,"15min":0.77100000000000002},"min":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72399999999999998}]},{"osd":10,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.626,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88700000000000001,"15min":0.879},"min":{"1min":0.69199999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.66500000000000004}]},{"osd":11,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.84399999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 14 13:07:58 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84599999999999997,"5min":1.103,"15min":1.103},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60599999999999998,"15min":0.54200000000000004},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:07:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81799999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.50700000000000001},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.56399999999999995},"min":{"1min":0.38100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.90600000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.439},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71899999999999997,"15min":0.86799999999999999},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":8.4740000000000002,"15min":8.4740000000000002},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed Feb 14 13:07:33 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.50800000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.629},{"interface":"front","average":{"1min":1.6879999999999999,"5min":0.83899999999999997,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":19.623999999999999,"5min":19.623999999999999,"15min":19.623999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Wed Feb 14 13:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.29699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.877,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.50800000000000001}]},{"osd":7,"last update":"Wed Feb 14 13:06:20 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.68899999999999995,"15min":0.67900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.48799999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93999999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.224,"15min":1.224},"last":0.71699999999999997}]},{"osd":9,"last update":"Wed Feb 14 13:07:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.67400000000000004,"15min":0.68999999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.73499999999999999,"15min":0.75800000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.57799999999999996}]},{"osd":10,"last update":"Wed Feb 14 13:07:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.79900000000000004,"15min":0.81899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97399999999999998,"5min":1.284,"15min":1.284},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96199999999999997,"5min":1.131,"15min":1.131},"last":0.59499999999999997}]},{"osd":11,"last update":"Wed Feb 14 13:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.749},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69099999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1036288,"data_stored":523358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77400000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.504},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.623,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Wed Feb 14 13:07:19 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.748,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.39400000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.86799999999999999}]},{"osd":3,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.42699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.379,"5min":0.71899999999999997,"15min":0.60699999999999998},"min":{"1min":0.371,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":17.402999999999999,"5min":17.402999999999999,"15min":17.402999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79000000000000004}]},{"osd":5,"last update":"Wed Feb 14 13:07:33 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.47299999999999998,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.47899999999999998,"15min":0.437},"min":{"1min":0.31,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59599999999999997}]},{"osd":6,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56399999999999995,"15min":0.53600000000000003},"min":{"1min":0.44700000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.621},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.63100000000000001,"15min":0.58699999999999997},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Wed Feb 14 13:06:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58799999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92500000000000004,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.52100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.752}]},{"osd":9,"last update":"Wed Feb 14 13:07:14 2024","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":0.878,"15min":0.75},"min":{"1min":0.51000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":17.344000000000001,"5min":17.344000000000001,"15min":17.344000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97099999999999997,"5min":1.01,"15min":1.01},"last":0.63400000000000001}]},{"osd":10,"last update":"Wed Feb 14 13:07:41 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.70899999999999996,"15min":0.68700000000000006},"min":{"1min":0.63700000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.59199999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.84599999999999997}]},{"osd":11,"last update":"Wed Feb 14 13:07:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.73699999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117061,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":462616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.32300000000000001},"min":{"1min":0.26000000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.59999999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.437},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.53300000000000003,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.54300000000000004,"5min":16.736999999999998,"15min":16.736999999999998},"last":0.46800000000000003}]},{"osd":1,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59799999999999998,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.752,"5min":5.1159999999999997,"15min":5.1159999999999997},"last":0.754},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60099999999999998,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.72399999999999998}]},{"osd":2,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.746,"15min":0.57799999999999996},"min":{"1min":0.44,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79300000000000004,"5min":20.550000000000001,"15min":20.550000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.53900000000000003},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80300000000000005,"5min":6.0540000000000003,"15min":6.0540000000000003},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Feb 14 13:07:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55100000000000005,"15min":0.52500000000000002},"min":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.60799999999999998,"15min":0.56599999999999995},"min":{"1min":0.35399999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":0.69999999999999996,"15min":0.59099999999999997},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":13.26,"5min":13.26,"15min":13.26},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.599,"5min":0.78300000000000003,"15min":0.60799999999999998},"min":{"1min":0.47299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":22.808,"5min":22.808,"15min":22.808},"last":0.80800000000000005}]},{"osd":6,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.66100000000000003,"15min":0.55400000000000005},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66500000000000004,"5min":16.702999999999999,"15min":16.702999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.54100000000000004,"15min":0.52100000000000002},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.746,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Feb 14 13:07:22 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.63700000000000001},"min":{"1min":0.46999999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.246,"5min":0.79400000000000004,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":13.172000000000001,"5min":13.172000000000001,"15min":13.172000000000001},"last":0.63600000000000001}]},{"osd":8,"last update":"Wed Feb 14 13:05:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 14 13:07:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":0.86399999999999999,"15min":0.78800000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":16.648,"5min":16.648,"15min":16.648},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":5.048,"5min":5.048,"15min":5.048},"last":0.68000000000000005}]},{"osd":10,"last update":"Wed Feb 14 13:07:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76800000000000002,"15min":0.75800000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.9409999999999998,"5min":3.9409999999999998,"15min":3.9409999999999998},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.498,"5min":0.93799999999999994,"15min":0.84399999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":16.771000000000001,"5min":16.771000000000001,"15min":16.771000000000001},"last":0.77000000000000002}]},{"osd":11,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.752,"15min":1.752},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":20.504999999999999,"5min":20.504999999999999,"15min":20.504999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.468,"5min":5.468,"15min":5.468},"last":0.81899999999999995}]}]},{"osd":4,"up_from":35,"seq":150323855424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:06:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.45400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.57299999999999995,"15min":0.51900000000000002},"min":{"1min":0.42299999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":0.38700000000000001}]},{"osd":1,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.41399999999999998,"15min":0.39100000000000001},"min":{"1min":0.317,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.75,"5min":0.753,"15min":0.753},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.439,"15min":0.40899999999999997},"min":{"1min":0.28799999999999998,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58899999999999997,"15min":0.55400000000000005},"min":{"1min":0.56100000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.73399999999999999,"15min":0.86599999999999999},"min":{"1min":0.36199999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.91300000000000003,"5min":10.204000000000001,"15min":10.204000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Feb 14 13:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68200000000000005,"15min":0.63600000000000001},"min":{"1min":0.53100000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.80400000000000005,"15min":0.85299999999999998},"min":{"1min":0.69499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98199999999999998,"5min":6.327,"15min":6.327},"last":0.37}]},{"osd":6,"last update":"Wed Feb 14 13:08:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66600000000000004,"15min":0.64100000000000001},"min":{"1min":0.44600000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.64700000000000002,"15min":0.622},"min":{"1min":0.46100000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Feb 14 13:07:29 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60499999999999998,"15min":0.57699999999999996},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.66600000000000004,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73899999999999999}]},{"osd":8,"last update":"Wed Feb 14 13:07:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.71499999999999997,"15min":0.68899999999999995},"min":{"1min":0.60599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80800000000000005,"15min":0.78800000000000003},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.52600000000000002}]},{"osd":9,"last update":"Wed Feb 14 13:07:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.997,"15min":1.032},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0860000000000001,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.626}]},{"osd":10,"last update":"Wed Feb 14 13:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82599999999999996,"15min":0.83599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98799999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1299999999999999,"5min":1.151,"15min":1.151},"last":0.78600000000000003}]},{"osd":11,"last update":"Wed Feb 14 13:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55500000000000005}]}]},{"osd":5,"up_from":40,"seq":171798691899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1572864,"data_stored":1052945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52300000000000002,"15min":0.495},"min":{"1min":0.43099999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.52500000000000002,"15min":0.495},"min":{"1min":0.34399999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.77100000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72599999999999998}]},{"osd":1,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.57399999999999995,"15min":0.55600000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79700000000000004,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.54300000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.94099999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":2,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36299999999999999},"min":{"1min":0.27400000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.502}]},{"osd":3,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.54300000000000004,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55300000000000005,"15min":0.52400000000000002},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79700000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Feb 14 13:07:36 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.82099999999999995,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.746},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60199999999999998,"15min":0.57199999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88500000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59999999999999998}]},{"osd":6,"last update":"Wed Feb 14 13:08:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85199999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.76900000000000002}]},{"osd":7,"last update":"Wed Feb 14 13:07:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66200000000000003,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85399999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67600000000000005,"15min":0.67700000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86899999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.83599999999999997}]},{"osd":8,"last update":"Wed Feb 14 13:07:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36399999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.626},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.877,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63800000000000001}]},{"osd":9,"last update":"Wed Feb 14 13:07:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91700000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.874}]},{"osd":10,"last update":"Wed Feb 14 13:07:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72699999999999998,"15min":0.71699999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":61080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-14T13:08:10.624 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-14T13:08:10.624 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-14T13:08:10.624 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-14T13:08:10.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph health --format=json 2024-02-14T13:08:10.870 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:11.287 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:11 smithi012 ceph-mon[32370]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:08:11.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:11 smithi055 ceph-mon[36853]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:08:11.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:11 smithi103 ceph-mon[36921]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-14T13:08:12.215 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:12 smithi012 ceph-mon[32370]: pgmap v330: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 -- 172.21.15.12:0/2560975383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c101860 msgr2=0x7f690c105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 --2- 172.21.15.12:0/2560975383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c101860 0x7f690c105850 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009990 tx=0x7f68fc009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 -- 172.21.15.12:0/2560975383 shutdown_connections 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 --2- 172.21.15.12:0/2560975383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690c105f30 0x7f690c10db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 --2- 172.21.15.12:0/2560975383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c100eb0 0x7f690c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 --2- 172.21.15.12:0/2560975383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c101860 0x7f690c105850 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 -- 172.21.15.12:0/2560975383 >> 172.21.15.12:0/2560975383 conn(0x7f690c076c60 msgr2=0x7f690c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 -- 172.21.15.12:0/2560975383 shutdown_connections 2024-02-14T13:08:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 -- 172.21.15.12:0/2560975383 wait complete. 2024-02-14T13:08:12.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 Processor -- start 2024-02-14T13:08:12.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.438+0000 7f6913870700 1 -- start start 2024-02-14T13:08:12.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 0x7f690c1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:12.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690c101860 0x7f690c199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:12.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c105f30 0x7f690c1a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:12.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c199ec0 con 0x7f690c100eb0 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1a46a0 con 0x7f690c105f30 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c1a47e0 con 0x7f690c101860 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 0x7f690c1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 0x7f690c1990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43734/0 (socket says 172.21.15.12:43734) 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 -- 172.21.15.12:0/2396648382 learned_addr learned my addr 172.21.15.12:0/2396648382 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6910e0b700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690c101860 0x7f690c199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6911e0d700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c105f30 0x7f690c1a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 -- 172.21.15.12:0/2396648382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690c101860 msgr2=0x7f690c199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690c101860 0x7f690c199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 -- 172.21.15.12:0/2396648382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c105f30 msgr2=0x7f690c1a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c105f30 0x7f690c1a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 -- 172.21.15.12:0/2396648382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0095f0 con 0x7f690c100eb0 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6911e0d700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c105f30 0x7f690c1a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f691160c700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 0x7f690c1990e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f690800c950 tx=0x7f690800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800cea0 con 0x7f690c100eb0 2024-02-14T13:08:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6908004830 con 0x7f690c100eb0 2024-02-14T13:08:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908005580 con 0x7f690c100eb0 2024-02-14T13:08:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.439+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c1a4a90 con 0x7f690c100eb0 2024-02-14T13:08:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.440+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c1a4f60 con 0x7f690c100eb0 2024-02-14T13:08:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.441+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c1091e0 con 0x7f690c100eb0 2024-02-14T13:08:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.441+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f69080049a0 con 0x7f690c100eb0 2024-02-14T13:08:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.442+0000 7f69027fc700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f68f80a21e0 0x7f68f80a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.442+0000 7f6910e0b700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f68f80a21e0 0x7f68f80a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.442+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f69080cda00 con 0x7f690c100eb0 2024-02-14T13:08:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.443+0000 7f6910e0b700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f68f80a21e0 0x7f68f80a46a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68fc006010 tx=0x7f68fc005960 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:12.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.447+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6908096850 con 0x7f690c100eb0 2024-02-14T13:08:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:12 smithi103 ceph-mon[36921]: pgmap v330: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:12.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:12 smithi055 ceph-mon[36853]: pgmap v330: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:12.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.694+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f690c0689e0 con 0x7f690c100eb0 2024-02-14T13:08:12.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.694+0000 7f69027fc700 1 -- 172.21.15.12:0/2396648382 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6908099f10 con 0x7f690c100eb0 2024-02-14T13:08:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:12.696 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f68f80a21e0 msgr2=0x7f68f80a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f68f80a21e0 0x7f68f80a46a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68fc006010 tx=0x7f68fc005960 comp rx=0 tx=0).stop 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 msgr2=0x7f690c1990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 0x7f690c1990e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f690800c950 tx=0x7f690800cc60 comp rx=0 tx=0).stop 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 shutdown_connections 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f690c105f30 0x7f690c1a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f68f80a21e0 0x7f68f80a46a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f690c100eb0 0x7f690c1990e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 --2- 172.21.15.12:0/2396648382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f690c101860 0x7f690c199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 >> 172.21.15.12:0/2396648382 conn(0x7f690c076c60 msgr2=0x7f690c1070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 shutdown_connections 2024-02-14T13:08:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:12.696+0000 7f6913870700 1 -- 172.21.15.12:0/2396648382 wait complete. 2024-02-14T13:08:13.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:13 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2396648382' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-14T13:08:13.342 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-14T13:08:13.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 -- 172.21.15.12:0/3294803709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 msgr2=0x7fbd841069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 --2- 172.21.15.12:0/3294803709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd841069f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009900 tx=0x7fbd7402bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 -- 172.21.15.12:0/3294803709 shutdown_connections 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 --2- 172.21.15.12:0/3294803709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd84106f30 0x7fbd84109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 --2- 172.21.15.12:0/3294803709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd841069f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 --2- 172.21.15.12:0/3294803709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd84101cd0 0x7fbd841040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 -- 172.21.15.12:0/3294803709 >> 172.21.15.12:0/3294803709 conn(0x7fbd840fb6c0 msgr2=0x7fbd840fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 -- 172.21.15.12:0/3294803709 shutdown_connections 2024-02-14T13:08:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.449+0000 7fbd8a240640 1 -- 172.21.15.12:0/3294803709 wait complete. 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 Processor -- start 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 -- start start 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd84101cd0 0x7fbd84101640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd840ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd84106f30 0x7fbd841001c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84100920 con 0x7fbd84104600 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84100a90 con 0x7fbd84101cd0 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd8a240640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd841a13e0 con 0x7fbd84106f30 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd840ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd840ffc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43758/0 (socket says 172.21.15.12:43758) 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 -- 172.21.15.12:0/1137867816 learned_addr learned my addr 172.21.15.12:0/1137867816 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd837fe640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd84101cd0 0x7fbd84101640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 -- 172.21.15.12:0/1137867816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd84106f30 msgr2=0x7fbd841001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd83fff640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd84106f30 0x7fbd841001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd84106f30 0x7fbd841001c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 -- 172.21.15.12:0/1137867816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd84101cd0 msgr2=0x7fbd84101640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd84101cd0 0x7fbd84101640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.450+0000 7fbd82ffd640 1 -- 172.21.15.12:0/1137867816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009560 con 0x7fbd84104600 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.451+0000 7fbd82ffd640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd840ffc80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbd74036040 tx=0x7fbd74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.451+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74004df0 con 0x7fbd84104600 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.451+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd841a1630 con 0x7fbd84104600 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.451+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fbd74005430 con 0x7fbd84104600 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.451+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74003e80 con 0x7fbd84104600 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.451+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd841a1c10 con 0x7fbd84104600 2024-02-14T13:08:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.452+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd840fd1b0 con 0x7fbd84104600 2024-02-14T13:08:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.453+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fbd74005160 con 0x7fbd84104600 2024-02-14T13:08:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.453+0000 7fbd80ff9640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbd6c0a2150 0x7fbd6c0a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.454+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fbd740f08a0 con 0x7fbd84104600 2024-02-14T13:08:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.454+0000 7fbd837fe640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbd6c0a2150 0x7fbd6c0a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.454+0000 7fbd837fe640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbd6c0a2150 0x7fbd6c0a4610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009990 tx=0x7fbd78009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.461+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbd740b9800 con 0x7fbd84104600 2024-02-14T13:08:13.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:13 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2396648382' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-14T13:08:13.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:13 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2396648382' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-14T13:08:13.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.647+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd8410cea0 con 0x7fbd84104600 2024-02-14T13:08:13.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.649+0000 7fbd80ff9640 1 -- 172.21.15.12:0/1137867816 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22638 (secure 0 0 0) 0x7fbd740bcec0 con 0x7fbd84104600 2024-02-14T13:08:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:07:49.983197+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:08:13.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.651+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbd6c0a2150 msgr2=0x7fbd6c0a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.651+0000 7fbd8a240640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbd6c0a2150 0x7fbd6c0a4610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009990 tx=0x7fbd78009110 comp rx=0 tx=0).stop 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.651+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 msgr2=0x7fbd840ffc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.651+0000 7fbd8a240640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd840ffc80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbd74036040 tx=0x7fbd74004270 comp rx=0 tx=0).stop 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 shutdown_connections 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fbd6c0a2150 0x7fbd6c0a4610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd84106f30 0x7fbd841001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbd84104600 0x7fbd840ffc80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 --2- 172.21.15.12:0/1137867816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd84101cd0 0x7fbd84101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 >> 172.21.15.12:0/1137867816 conn(0x7fbd840fb6c0 msgr2=0x7fbd84102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 shutdown_connections 2024-02-14T13:08:13.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.652+0000 7fbd8a240640 1 -- 172.21.15.12:0/1137867816 wait complete. 2024-02-14T13:08:13.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-14T13:06:47.668699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-14T13:06:48.352208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:08:13.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:08:13.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 -- 172.21.15.12:0/3960169479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec281045e0 msgr2=0x7fec281069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 --2- 172.21.15.12:0/3960169479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec281045e0 0x7fec281069d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fec18009900 tx=0x7fec1802bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 -- 172.21.15.12:0/3960169479 shutdown_connections 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 --2- 172.21.15.12:0/3960169479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec28106f10 0x7fec28109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 --2- 172.21.15.12:0/3960169479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec281045e0 0x7fec281069d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 --2- 172.21.15.12:0/3960169479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec28101cb0 0x7fec281040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 -- 172.21.15.12:0/3960169479 >> 172.21.15.12:0/3960169479 conn(0x7fec280fb6c0 msgr2=0x7fec280fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 -- 172.21.15.12:0/3960169479 shutdown_connections 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.782+0000 7fec3016b640 1 -- 172.21.15.12:0/3960169479 wait complete. 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 Processor -- start 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 -- start start 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 0x7fec28197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec281045e0 0x7fec281978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec28106f10 0x7fec2819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2819ee60 con 0x7fec28101cb0 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2819efd0 con 0x7fec281045e0 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec3016b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2819f190 con 0x7fec28106f10 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 0x7fec28197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 0x7fec28197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43790/0 (socket says 172.21.15.12:43790) 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 -- 172.21.15.12:0/224005273 learned_addr learned my addr 172.21.15.12:0/224005273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2d706640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec281045e0 0x7fec281978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2e708640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec28106f10 0x7fec2819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 -- 172.21.15.12:0/224005273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec28106f10 msgr2=0x7fec2819e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec28106f10 0x7fec2819e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 -- 172.21.15.12:0/224005273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec281045e0 msgr2=0x7fec281978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec281045e0 0x7fec281978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.783+0000 7fec2df07640 1 -- 172.21.15.12:0/224005273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18009560 con 0x7fec28101cb0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.784+0000 7fec2df07640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 0x7fec28197370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fec2400d950 tx=0x7fec2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.784+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24009a30 con 0x7fec28101cb0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.784+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2819f470 con 0x7fec28101cb0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.784+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fec24009b90 con 0x7fec28101cb0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.784+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24004a00 con 0x7fec28101cb0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.784+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2819f9a0 con 0x7fec28101cb0 2024-02-14T13:08:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.785+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec280fd1b0 con 0x7fec28101cb0 2024-02-14T13:08:13.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.786+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fec24009d00 con 0x7fec28101cb0 2024-02-14T13:08:13.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.786+0000 7fec1effd640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fec140a2150 0x7fec140a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:13.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.786+0000 7fec2d706640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fec140a2150 0x7fec140a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:13.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.786+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fec240cd910 con 0x7fec28101cb0 2024-02-14T13:08:13.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.787+0000 7fec2d706640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fec140a2150 0x7fec140a4610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec18005ab0 tx=0x7fec18005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:13.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.791+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fec24096760 con 0x7fec28101cb0 2024-02-14T13:08:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.973+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec2810cc80 con 0x7fec28101cb0 2024-02-14T13:08:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.973+0000 7fec1effd640 1 -- 172.21.15.12:0/224005273 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec24099e20 con 0x7fec28101cb0 2024-02-14T13:08:13.975 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:08:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fec140a2150 msgr2=0x7fec140a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fec140a2150 0x7fec140a4610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec18005ab0 tx=0x7fec18005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 msgr2=0x7fec28197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 0x7fec28197370 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fec2400d950 tx=0x7fec2400de10 comp rx=0 tx=0).stop 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 shutdown_connections 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fec140a2150 0x7fec140a4610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec28106f10 0x7fec2819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec281045e0 0x7fec281978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 --2- 172.21.15.12:0/224005273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec28101cb0 0x7fec28197370 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 >> 172.21.15.12:0/224005273 conn(0x7fec280fb6c0 msgr2=0x7fec28102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 shutdown_connections 2024-02-14T13:08:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:13.975+0000 7fec3016b640 1 -- 172.21.15.12:0/224005273 wait complete. 2024-02-14T13:08:13.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-14T13:08:14.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2540444667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102df0 msgr2=0x7f54c8109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2540444667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102df0 0x7f54c8109680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009ca0 tx=0x7f54c002c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2540444667 shutdown_connections 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2540444667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102df0 0x7f54c8109680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2540444667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102430 0x7f54c81028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2540444667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c8101240 0x7f54c8101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2540444667 >> 172.21.15.12:0/2540444667 conn(0x7f54c80fc790 msgr2=0x7f54c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2540444667 shutdown_connections 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.109+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2540444667 wait complete. 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 Processor -- start 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 -- start start 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c8101240 0x7f54c8074fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 0x7f54c8073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102df0 0x7f54c8073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80742c0 con 0x7f54c8102430 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8074430 con 0x7f54c8102df0 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c81a1210 con 0x7f54c8101240 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 0x7f54c8073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 0x7f54c8073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43810/0 (socket says 172.21.15.12:43810) 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 -- 172.21.15.12:0/2372470381 learned_addr learned my addr 172.21.15.12:0/2372470381 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54ce02c640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102df0 0x7f54c8073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 -- 172.21.15.12:0/2372470381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c8101240 msgr2=0x7f54c8074fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c8101240 0x7f54c8074fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 -- 172.21.15.12:0/2372470381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102df0 msgr2=0x7f54c8073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102df0 0x7f54c8073b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 -- 172.21.15.12:0/2372470381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009900 con 0x7f54c8102430 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54ce02c640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102df0 0x7f54c8073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:14.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cd02a640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 0x7f54c8073620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c950 tx=0x7f54b800ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:14.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8007c70 con 0x7f54c8102430 2024-02-14T13:08:14.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c81a14c0 con 0x7f54c8102430 2024-02-14T13:08:14.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f54b8007dd0 con 0x7f54c8102430 2024-02-14T13:08:14.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.110+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80188c0 con 0x7f54c8102430 2024-02-14T13:08:14.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.111+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c81a1a20 con 0x7f54c8102430 2024-02-14T13:08:14.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.112+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c8108560 con 0x7f54c8102430 2024-02-14T13:08:14.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.113+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f54b8018a20 con 0x7f54c8102430 2024-02-14T13:08:14.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.114+0000 7f54beffd640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54b40a2150 0x7f54b40a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.114+0000 7f54cd82b640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54b40a2150 0x7f54b40a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.114+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f54b80ce110 con 0x7f54c8102430 2024-02-14T13:08:14.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.114+0000 7f54cd82b640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54b40a2150 0x7f54b40a4610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005fd0 tx=0x7f54c400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:14.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.118+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f54b8096f00 con 0x7f54c8102430 2024-02-14T13:08:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.299+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54c810cc50 con 0x7f54c8102430 2024-02-14T13:08:14.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.299+0000 7f54beffd640 1 -- 172.21.15.12:0/2372470381 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54b809a5c0 con 0x7f54c8102430 2024-02-14T13:08:14.301 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-02-14T13:08:14.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54b40a2150 msgr2=0x7f54b40a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54b40a2150 0x7f54b40a4610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005fd0 tx=0x7f54c400b410 comp rx=0 tx=0).stop 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 msgr2=0x7f54c8073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 0x7f54c8073620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c950 tx=0x7f54b800ce10 comp rx=0 tx=0).stop 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 shutdown_connections 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f54b40a2150 0x7f54b40a4610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c8102df0 0x7f54c8073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54c8102430 0x7f54c8073620 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 --2- 172.21.15.12:0/2372470381 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c8101240 0x7f54c8074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 >> 172.21.15.12:0/2372470381 conn(0x7f54c80fc790 msgr2=0x7f54c8105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 shutdown_connections 2024-02-14T13:08:14.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.301+0000 7f54cfa8f640 1 -- 172.21.15.12:0/2372470381 wait complete. 2024-02-14T13:08:14.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:14 smithi012 ceph-mon[32370]: pgmap v331: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:14.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:14 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1137867816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:14.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:14 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/224005273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:14.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-14T13:08:14.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 -- 172.21.15.12:0/240447651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70100130 msgr2=0x7f5c70100550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 --2- 172.21.15.12:0/240447651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70100130 0x7f5c70100550 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009900 tx=0x7f5c6002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:14.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 -- 172.21.15.12:0/240447651 shutdown_connections 2024-02-14T13:08:14.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 --2- 172.21.15.12:0/240447651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c70101ce0 0x7f5c70108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 --2- 172.21.15.12:0/240447651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101320 0x7f5c701017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 --2- 172.21.15.12:0/240447651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70100130 0x7f5c70100550 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 -- 172.21.15.12:0/240447651 >> 172.21.15.12:0/240447651 conn(0x7f5c700fb6c0 msgr2=0x7f5c700fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 -- 172.21.15.12:0/240447651 shutdown_connections 2024-02-14T13:08:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.419+0000 7f5c75c40640 1 -- 172.21.15.12:0/240447651 wait complete. 2024-02-14T13:08:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 Processor -- start 2024-02-14T13:08:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 -- start start 2024-02-14T13:08:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c70100130 0x7f5c70197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 0x7f5c70197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101ce0 0x7f5c7019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7019ed10 con 0x7f5c70101320 2024-02-14T13:08:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7019ee80 con 0x7f5c70100130 2024-02-14T13:08:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c75c40640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7019f040 con 0x7f5c70101ce0 2024-02-14T13:08:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 0x7f5c70197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 0x7f5c70197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33096/0 (socket says 172.21.15.12:33096) 2024-02-14T13:08:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 -- 172.21.15.12:0/2205180721 learned_addr learned my addr 172.21.15.12:0/2205180721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6f7fe640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c70100130 0x7f5c70197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6ffff640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101ce0 0x7f5c7019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 -- 172.21.15.12:0/2205180721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101ce0 msgr2=0x7f5c7019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101ce0 0x7f5c7019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 -- 172.21.15.12:0/2205180721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c70100130 msgr2=0x7f5c70197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c70100130 0x7f5c70197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 -- 172.21.15.12:0/2205180721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c60009560 con 0x7f5c70101320 2024-02-14T13:08:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6ffff640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101ce0 0x7f5c7019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.420+0000 7f5c6effd640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 0x7f5c70197760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c920 tx=0x7f5c6400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.421+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64007c70 con 0x7f5c70101320 2024-02-14T13:08:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.421+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7019f320 con 0x7f5c70101320 2024-02-14T13:08:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.421+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5c64007dd0 con 0x7f5c70101320 2024-02-14T13:08:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.421+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c64018860 con 0x7f5c70101320 2024-02-14T13:08:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.421+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7019f880 con 0x7f5c70101320 2024-02-14T13:08:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.422+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7010bb00 con 0x7f5c70101320 2024-02-14T13:08:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.423+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f5c6400fac0 con 0x7f5c70101320 2024-02-14T13:08:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.423+0000 7f5c6cff9640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c580a2150 0x7f5c580a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.423+0000 7f5c6f7fe640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c580a2150 0x7f5c580a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.423+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5c640ce040 con 0x7f5c70101320 2024-02-14T13:08:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.424+0000 7f5c6f7fe640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c580a2150 0x7f5c580a4610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006010 tx=0x7f5c60000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.427+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5c64096e90 con 0x7f5c70101320 2024-02-14T13:08:14.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:14 smithi103 ceph-mon[36921]: pgmap v331: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:14 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1137867816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:14.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:14 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/224005273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:14.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:14 smithi055 ceph-mon[36853]: pgmap v331: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:14.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:14 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1137867816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:14.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:14 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/224005273' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:14.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.608+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c7019fd50 con 0x7f5c70101320 2024-02-14T13:08:14.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.609+0000 7f5c6cff9640 1 -- 172.21.15.12:0/2205180721 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c6409a550 con 0x7f5c70101320 2024-02-14T13:08:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c580a2150 msgr2=0x7f5c580a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c580a2150 0x7f5c580a4610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006010 tx=0x7f5c60000bc0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 msgr2=0x7f5c70197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 0x7f5c70197760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c920 tx=0x7f5c6400cde0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 shutdown_connections 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5c580a2150 0x7f5c580a4610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c70101ce0 0x7f5c7019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c70101320 0x7f5c70197760 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 --2- 172.21.15.12:0/2205180721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c70100130 0x7f5c70197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 >> 172.21.15.12:0/2205180721 conn(0x7f5c700fb6c0 msgr2=0x7f5c70068390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:14.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 shutdown_connections 2024-02-14T13:08:14.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.611+0000 7f5c75c40640 1 -- 172.21.15.12:0/2205180721 wait complete. 2024-02-14T13:08:14.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:08:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.724+0000 7f3a443b5640 1 -- 172.21.15.12:0/3949822086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 msgr2=0x7f3a3c109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.724+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3949822086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c109690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009ca0 tx=0x7f3a3402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- 172.21.15.12:0/3949822086 shutdown_connections 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3949822086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c109690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3949822086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c102440 0x7f3a3c1028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3949822086 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a3c101250 0x7f3a3c101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- 172.21.15.12:0/3949822086 >> 172.21.15.12:0/3949822086 conn(0x7f3a3c0fc7e0 msgr2=0x7f3a3c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- 172.21.15.12:0/3949822086 shutdown_connections 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- 172.21.15.12:0/3949822086 wait complete. 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 Processor -- start 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- start start 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c101250 0x7f3a3c074fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a3c102440 0x7f3a3c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0742c0 con 0x7f3a3c102e00 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c074430 con 0x7f3a3c101250 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a443b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c1a1250 con 0x7f3a3c102440 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a42952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a42952640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33118/0 (socket says 172.21.15.12:33118) 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.725+0000 7f3a42952640 1 -- 172.21.15.12:0/3373714876 learned_addr learned my addr 172.21.15.12:0/3373714876 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a41950640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a3c102440 0x7f3a3c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42151640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c101250 0x7f3a3c074fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42952640 1 -- 172.21.15.12:0/3373714876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a3c102440 msgr2=0x7f3a3c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42952640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a3c102440 0x7f3a3c073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42952640 1 -- 172.21.15.12:0/3373714876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c101250 msgr2=0x7f3a3c074fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42952640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c101250 0x7f3a3c074fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42952640 1 -- 172.21.15.12:0/3373714876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009900 con 0x7f3a3c102e00 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42151640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c101250 0x7f3a3c074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a42952640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c073b60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a34034d20 tx=0x7f3a34034d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34003970 con 0x7f3a3c102e00 2024-02-14T13:08:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3a34004040 con 0x7f3a3c102e00 2024-02-14T13:08:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340406b0 con 0x7f3a3c102e00 2024-02-14T13:08:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c1a14a0 con 0x7f3a3c102e00 2024-02-14T13:08:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.726+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c1a1950 con 0x7f3a3c102e00 2024-02-14T13:08:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.727+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c108510 con 0x7f3a3c102e00 2024-02-14T13:08:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.728+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f3a3400a040 con 0x7f3a3c102e00 2024-02-14T13:08:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.729+0000 7f3a2f7fe640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a280a2150 0x7f3a280a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.729+0000 7f3a42151640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a280a2150 0x7f3a280a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.729+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3a340f10d0 con 0x7f3a3c102e00 2024-02-14T13:08:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.729+0000 7f3a42151640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a280a2150 0x7f3a280a4610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a380058c0 tx=0x7f3a38005d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.733+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3a340ba060 con 0x7f3a3c102e00 2024-02-14T13:08:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.952+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a3c02ce50 con 0x7f3a3c102e00 2024-02-14T13:08:14.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.953+0000 7f3a2f7fe640 1 -- 172.21.15.12:0/3373714876 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7f3a34008220 con 0x7f3a3c102e00 2024-02-14T13:08:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:08:14.955 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.954+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a280a2150 msgr2=0x7f3a280a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.954+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a280a2150 0x7f3a280a4610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a380058c0 tx=0x7f3a38005d50 comp rx=0 tx=0).stop 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.954+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 msgr2=0x7f3a3c073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.954+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c073b60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a34034d20 tx=0x7f3a34034d50 comp rx=0 tx=0).stop 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 shutdown_connections 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3a280a2150 0x7f3a280a4610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a3c102e00 0x7f3a3c073b60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a3c102440 0x7f3a3c073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 --2- 172.21.15.12:0/3373714876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a3c101250 0x7f3a3c074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 >> 172.21.15.12:0/3373714876 conn(0x7f3a3c0fc7e0 msgr2=0x7f3a3c1056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:14.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 shutdown_connections 2024-02-14T13:08:14.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:14.955+0000 7f3a443b5640 1 -- 172.21.15.12:0/3373714876 wait complete. 2024-02-14T13:08:14.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 -- 172.21.15.12:0/3228169198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0101250 msgr2=0x7fe3d0101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/3228169198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0101250 0x7fe3d0101670 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009900 tx=0x7fe3c002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 -- 172.21.15.12:0/3228169198 shutdown_connections 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/3228169198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 0x7fe3d0109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/3228169198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d0102440 0x7fe3d01028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/3228169198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0101250 0x7fe3d0101670 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 -- 172.21.15.12:0/3228169198 >> 172.21.15.12:0/3228169198 conn(0x7fe3d00fc7e0 msgr2=0x7fe3d00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 -- 172.21.15.12:0/3228169198 shutdown_connections 2024-02-14T13:08:15.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 -- 172.21.15.12:0/3228169198 wait complete. 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.069+0000 7fe3d5c50640 1 Processor -- start 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 -- start start 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d0101250 0x7fe3d0197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 0x7fe3d0197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 0x7fe3d019ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d019ef40 con 0x7fe3d0102440 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d019f0b0 con 0x7fe3d0102e00 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3d5c50640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d019f270 con 0x7fe3d0101250 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 0x7fe3d0197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 0x7fe3d0197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33142/0 (socket says 172.21.15.12:33142) 2024-02-14T13:08:15.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 -- 172.21.15.12:0/1333141068 learned_addr learned my addr 172.21.15.12:0/1333141068 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3cf7fe640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d0101250 0x7fe3d0197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3cffff640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 0x7fe3d019ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 -- 172.21.15.12:0/1333141068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d0101250 msgr2=0x7fe3d0197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d0101250 0x7fe3d0197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 -- 172.21.15.12:0/1333141068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 msgr2=0x7fe3d019ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 0x7fe3d019ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 -- 172.21.15.12:0/1333141068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0009560 con 0x7fe3d0102440 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3cffff640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 0x7fe3d019ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ceffd640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 0x7fe3d0197990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400b4a0 tx=0x7fe3c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.070+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4010610 con 0x7fe3d0102440 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.071+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d019f550 con 0x7fe3d0102440 2024-02-14T13:08:15.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.071+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fe3c4010c50 con 0x7fe3d0102440 2024-02-14T13:08:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.071+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4017e20 con 0x7fe3d0102440 2024-02-14T13:08:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.071+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d019fa90 con 0x7fe3d0102440 2024-02-14T13:08:15.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.072+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d01085e0 con 0x7fe3d0102440 2024-02-14T13:08:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.072+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fe3c4017480 con 0x7fe3d0102440 2024-02-14T13:08:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.073+0000 7fe3ccff9640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe3b80a2150 0x7fe3b80a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.073+0000 7fe3cf7fe640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe3b80a2150 0x7fe3b80a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.073+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe3c40cd400 con 0x7fe3d0102440 2024-02-14T13:08:15.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.074+0000 7fe3cf7fe640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe3b80a2150 0x7fe3b80a4610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009230 tx=0x7fe3c0005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:15.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.078+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe3c4096360 con 0x7fe3d0102440 2024-02-14T13:08:15.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:15 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2372470381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:15.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:15 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2205180721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:15.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:15 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3373714876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:15.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.262+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3d010ced0 con 0x7fe3d0102440 2024-02-14T13:08:15.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.264+0000 7fe3ccff9640 1 -- 172.21.15.12:0/1333141068 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22638 (secure 0 0 0) 0x7fe3c4099a20 con 0x7fe3d0102440 2024-02-14T13:08:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:15.267 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:07:49.983197+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe3b80a2150 msgr2=0x7fe3b80a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe3b80a2150 0x7fe3b80a4610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009230 tx=0x7fe3c0005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 msgr2=0x7fe3d0197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 0x7fe3d0197990 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400b4a0 tx=0x7fe3c400b960 comp rx=0 tx=0).stop 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 shutdown_connections 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe3b80a2150 0x7fe3b80a4610 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3d0102e00 0x7fe3d019ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3d0102440 0x7fe3d0197990 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.266+0000 7fe3d5c50640 1 --2- 172.21.15.12:0/1333141068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d0101250 0x7fe3d0197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.267+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 >> 172.21.15.12:0/1333141068 conn(0x7fe3d00fc7e0 msgr2=0x7fe3d01057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:15.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.267+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 shutdown_connections 2024-02-14T13:08:15.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.267+0000 7fe3d5c50640 1 -- 172.21.15.12:0/1333141068 wait complete. 2024-02-14T13:08:15.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-14T13:06:47.668699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-14T13:06:48.352208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:08:15.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:08:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 -- 172.21.15.12:0/877869576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae10102ea0 msgr2=0x7fae10109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 --2- 172.21.15.12:0/877869576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae10102ea0 0x7fae10109730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fae08009ca0 tx=0x7fae0802c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 -- 172.21.15.12:0/877869576 shutdown_connections 2024-02-14T13:08:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 --2- 172.21.15.12:0/877869576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae10102ea0 0x7fae10109730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 --2- 172.21.15.12:0/877869576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae101024e0 0x7fae10102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 --2- 172.21.15.12:0/877869576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ff510 0x7fae100ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 -- 172.21.15.12:0/877869576 >> 172.21.15.12:0/877869576 conn(0x7fae100fae40 msgr2=0x7fae100fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 -- 172.21.15.12:0/877869576 shutdown_connections 2024-02-14T13:08:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 -- 172.21.15.12:0/877869576 wait complete. 2024-02-14T13:08:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 Processor -- start 2024-02-14T13:08:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.384+0000 7fae1689a640 1 -- start start 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 0x7fae101972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae101024e0 0x7fae101977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae10102ea0 0x7fae1019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1019eda0 con 0x7fae100ff510 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1019ef10 con 0x7fae101024e0 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1019f0d0 con 0x7fae10102ea0 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 0x7fae101972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 0x7fae101972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33148/0 (socket says 172.21.15.12:33148) 2024-02-14T13:08:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 -- 172.21.15.12:0/2807806017 learned_addr learned my addr 172.21.15.12:0/2807806017 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 -- 172.21.15.12:0/2807806017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae10102ea0 msgr2=0x7fae1019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae10102ea0 0x7fae1019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 -- 172.21.15.12:0/2807806017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae101024e0 msgr2=0x7fae101977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae101024e0 0x7fae101977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 -- 172.21.15.12:0/2807806017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009900 con 0x7fae100ff510 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0ffff640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 0x7fae101972b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fae0000d770 tx=0x7fae0000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00009c30 con 0x7fae100ff510 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1019f3b0 con 0x7fae100ff510 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fae0000de80 con 0x7fae100ff510 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00010460 con 0x7fae100ff510 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.385+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1019f8c0 con 0x7fae100ff510 2024-02-14T13:08:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.386+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae101085b0 con 0x7fae100ff510 2024-02-14T13:08:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.388+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fae00003f60 con 0x7fae100ff510 2024-02-14T13:08:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.388+0000 7fae0d7fa640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fadf80a2150 0x7fadf80a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.388+0000 7fae0f7fe640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fadf80a2150 0x7fadf80a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.388+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fae000cdcb0 con 0x7fae100ff510 2024-02-14T13:08:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.388+0000 7fae0f7fe640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fadf80a2150 0x7fadf80a4610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae04005fd0 tx=0x7fae04005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:15.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.392+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fae00096aa0 con 0x7fae100ff510 2024-02-14T13:08:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:15 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2372470381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:15 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2205180721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:15.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:15 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3373714876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:15.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:15 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2372470381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:15.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:15 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2205180721' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:15.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:15 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3373714876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.574+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae1010cdf0 con 0x7fae100ff510 2024-02-14T13:08:15.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.574+0000 7fae0d7fa640 1 -- 172.21.15.12:0/2807806017 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae000170a0 con 0x7fae100ff510 2024-02-14T13:08:15.576 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.576+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fadf80a2150 msgr2=0x7fadf80a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.576+0000 7fae1689a640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fadf80a2150 0x7fadf80a4610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fae04005fd0 tx=0x7fae04005850 comp rx=0 tx=0).stop 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.576+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 msgr2=0x7fae101972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.576+0000 7fae1689a640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 0x7fae101972b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fae0000d770 tx=0x7fae0000dc30 comp rx=0 tx=0).stop 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 shutdown_connections 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fadf80a2150 0x7fadf80a4610 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae10102ea0 0x7fae1019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae101024e0 0x7fae101977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 --2- 172.21.15.12:0/2807806017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae100ff510 0x7fae101972b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 >> 172.21.15.12:0/2807806017 conn(0x7fae100fae40 msgr2=0x7fae10105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:15.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 shutdown_connections 2024-02-14T13:08:15.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.577+0000 7fae1689a640 1 -- 172.21.15.12:0/2807806017 wait complete. 2024-02-14T13:08:15.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-14T13:08:15.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 -- 172.21.15.12:0/3551912471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101ce0 msgr2=0x7f28ac108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3551912471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101ce0 0x7f28ac108570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f289c009ca0 tx=0x7f289c02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 -- 172.21.15.12:0/3551912471 shutdown_connections 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3551912471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101ce0 0x7f28ac108570 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3551912471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac101320 0x7f28ac1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3551912471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac100130 0x7f28ac100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 -- 172.21.15.12:0/3551912471 >> 172.21.15.12:0/3551912471 conn(0x7f28ac0fb6c0 msgr2=0x7f28ac0fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 -- 172.21.15.12:0/3551912471 shutdown_connections 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 -- 172.21.15.12:0/3551912471 wait complete. 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 Processor -- start 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.694+0000 7f28b3b25640 1 -- start start 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac100130 0x7f28ac197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 0x7f28ac1977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac101ce0 0x7f28ac19e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19ed70 con 0x7f28ac101320 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19eee0 con 0x7f28ac101ce0 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19f0a0 con 0x7f28ac100130 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 0x7f28ac1977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 0x7f28ac1977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33166/0 (socket says 172.21.15.12:33166) 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 -- 172.21.15.12:0/3799487768 learned_addr learned my addr 172.21.15.12:0/3799487768 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b18c1640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac100130 0x7f28ac197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b20c2640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac101ce0 0x7f28ac19e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 -- 172.21.15.12:0/3799487768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac100130 msgr2=0x7f28ac197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac100130 0x7f28ac197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 -- 172.21.15.12:0/3799487768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac101ce0 msgr2=0x7f28ac19e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac101ce0 0x7f28ac19e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 -- 172.21.15.12:0/3799487768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c009900 con 0x7f28ac101320 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b10c0640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 0x7f28ac1977c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f28a000d950 tx=0x7f28a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0009c30 con 0x7f28ac101320 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f28a0009d90 con 0x7f28ac101320 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac19f380 con 0x7f28ac101320 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000f7e0 con 0x7f28ac101320 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.695+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac19f890 con 0x7f28ac101320 2024-02-14T13:08:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.697+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac107450 con 0x7f28ac101320 2024-02-14T13:08:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.698+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f28a0010ad0 con 0x7f28ac101320 2024-02-14T13:08:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.698+0000 7f28aaffd640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f28940a2150 0x7f28940a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.698+0000 7f28b18c1640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f28940a2150 0x7f28940a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.698+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f28a00cda40 con 0x7f28ac101320 2024-02-14T13:08:15.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.699+0000 7f28b18c1640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f28940a2150 0x7f28940a4610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f28ac101180 tx=0x7f28a400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.703+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f28a0096940 con 0x7f28ac101320 2024-02-14T13:08:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.885+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28ac02cdb0 con 0x7f28ac101320 2024-02-14T13:08:15.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.885+0000 7f28aaffd640 1 -- 172.21.15.12:0/3799487768 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28a009a000 con 0x7f28ac101320 2024-02-14T13:08:15.887 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-02-14T13:08:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f28940a2150 msgr2=0x7f28940a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f28940a2150 0x7f28940a4610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f28ac101180 tx=0x7f28a400a2d0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 msgr2=0x7f28ac1977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 0x7f28ac1977c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f28a000d950 tx=0x7f28a000de10 comp rx=0 tx=0).stop 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 shutdown_connections 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f28940a2150 0x7f28940a4610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28ac101ce0 0x7f28ac19e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac101320 0x7f28ac1977c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 --2- 172.21.15.12:0/3799487768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac100130 0x7f28ac197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 >> 172.21.15.12:0/3799487768 conn(0x7f28ac0fb6c0 msgr2=0x7f28ac104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 shutdown_connections 2024-02-14T13:08:15.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:15.887+0000 7f28b3b25640 1 -- 172.21.15.12:0/3799487768 wait complete. 2024-02-14T13:08:15.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 -- 172.21.15.12:0/2280848041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4008101d70 msgr2=0x7f4008104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 --2- 172.21.15.12:0/2280848041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4008101d70 0x7f4008104160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009900 tx=0x7f3ff802bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 -- 172.21.15.12:0/2280848041 shutdown_connections 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 --2- 172.21.15.12:0/2280848041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4008106fd0 0x7f40081093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 --2- 172.21.15.12:0/2280848041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40081046a0 0x7f4008106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 --2- 172.21.15.12:0/2280848041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4008101d70 0x7f4008104160 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 -- 172.21.15.12:0/2280848041 >> 172.21.15.12:0/2280848041 conn(0x7f40080fb6c0 msgr2=0x7f40080fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 -- 172.21.15.12:0/2280848041 shutdown_connections 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.003+0000 7f400dcc2640 1 -- 172.21.15.12:0/2280848041 wait complete. 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 Processor -- start 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 -- start start 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4008101d70 0x7f4008197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 0x7f40081978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4008106fd0 0x7f400819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819ee70 con 0x7f40081046a0 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819efe0 con 0x7f4008101d70 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f400dcc2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819f1a0 con 0x7f4008106fd0 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 0x7f40081978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 0x7f40081978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33180/0 (socket says 172.21.15.12:33180) 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 -- 172.21.15.12:0/733713855 learned_addr learned my addr 172.21.15.12:0/733713855 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:16.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f40077fe640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4008101d70 0x7f4008197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4007fff640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4008106fd0 0x7f400819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 -- 172.21.15.12:0/733713855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4008106fd0 msgr2=0x7f400819e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4008106fd0 0x7f400819e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 -- 172.21.15.12:0/733713855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4008101d70 msgr2=0x7f4008197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4008101d70 0x7f4008197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.004+0000 7f4006ffd640 1 -- 172.21.15.12:0/733713855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009560 con 0x7f40081046a0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.005+0000 7f4006ffd640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 0x7f40081978c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00d770 tx=0x7f3ffc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.005+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc009c30 con 0x7f40081046a0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.005+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3ffc00de80 con 0x7f40081046a0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.005+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400819f480 con 0x7f40081046a0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.005+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00f6b0 con 0x7f40081046a0 2024-02-14T13:08:16.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.005+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400819f990 con 0x7f40081046a0 2024-02-14T13:08:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.006+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40080fd1b0 con 0x7f40081046a0 2024-02-14T13:08:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.007+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f3ffc005030 con 0x7f40081046a0 2024-02-14T13:08:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.008+0000 7f4004ff9640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3ff00a21d0 0x7f3ff00a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.008+0000 7f40077fe640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3ff00a21d0 0x7f3ff00a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.008+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3ffc0cdc40 con 0x7f40081046a0 2024-02-14T13:08:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.008+0000 7f40077fe640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3ff00a21d0 0x7f3ff00a4690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009230 tx=0x7f3ff8005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.011+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ffc096a30 con 0x7f40081046a0 2024-02-14T13:08:16.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.193+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f400810ced0 con 0x7f40081046a0 2024-02-14T13:08:16.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.193+0000 7f4004ff9640 1 -- 172.21.15.12:0/733713855 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ffc0210a0 con 0x7f40081046a0 2024-02-14T13:08:16.196 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-02-14T13:08:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.195+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3ff00a21d0 msgr2=0x7f3ff00a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.195+0000 7f400dcc2640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3ff00a21d0 0x7f3ff00a4690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009230 tx=0x7f3ff8005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.195+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 msgr2=0x7f40081978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.195+0000 7f400dcc2640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 0x7f40081978c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00d770 tx=0x7f3ffc00dc30 comp rx=0 tx=0).stop 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.195+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 shutdown_connections 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.195+0000 7f400dcc2640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3ff00a21d0 0x7f3ff00a4690 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.196+0000 7f400dcc2640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4008106fd0 0x7f400819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.196+0000 7f400dcc2640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40081046a0 0x7f40081978c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.196+0000 7f400dcc2640 1 --2- 172.21.15.12:0/733713855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4008101d70 0x7f4008197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.196+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 >> 172.21.15.12:0/733713855 conn(0x7f40080fb6c0 msgr2=0x7f4008103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.196+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 shutdown_connections 2024-02-14T13:08:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.196+0000 7f400dcc2640 1 -- 172.21.15.12:0/733713855 wait complete. 2024-02-14T13:08:16.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:16 smithi012 ceph-mon[32370]: pgmap v332: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:16.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:16 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1333141068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:16.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:16 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2807806017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:16.207 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:16 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3799487768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:16.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 -- 172.21.15.12:0/2720435362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101170 msgr2=0x7f5d9c1015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/2720435362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101170 0x7f5d9c1015f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009900 tx=0x7f5d8402bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 -- 172.21.15.12:0/2720435362 shutdown_connections 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/2720435362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d9c101b30 0x7f5d9c1083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/2720435362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101170 0x7f5d9c1015f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/2720435362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 0x7f5d9c1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 -- 172.21.15.12:0/2720435362 >> 172.21.15.12:0/2720435362 conn(0x7f5d9c0fb510 msgr2=0x7f5d9c0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 -- 172.21.15.12:0/2720435362 shutdown_connections 2024-02-14T13:08:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 -- 172.21.15.12:0/2720435362 wait complete. 2024-02-14T13:08:16.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 Processor -- start 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.310+0000 7f5d9b59e640 1 -- start start 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 0x7f5d9c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d9c101170 0x7f5d9c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 0x7f5d9c19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c19ec60 con 0x7f5d9c101b30 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c19edd0 con 0x7f5d9c0fff80 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c19ef90 con 0x7f5d9c101170 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 0x7f5d9c19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 0x7f5d9c19e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33206/0 (socket says 172.21.15.12:33206) 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 -- 172.21.15.12:0/413069695 learned_addr learned my addr 172.21.15.12:0/413069695 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d93fff640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d9c101170 0x7f5d9c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9a59c640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 0x7f5d9c068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 -- 172.21.15.12:0/413069695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d9c101170 msgr2=0x7f5d9c19be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d9c101170 0x7f5d9c19be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 -- 172.21.15.12:0/413069695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 msgr2=0x7f5d9c068f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 0x7f5d9c068f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 -- 172.21.15.12:0/413069695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009560 con 0x7f5d9c101b30 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9a59c640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 0x7f5d9c068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9ad9d640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 0x7f5d9c19e480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009fd0 tx=0x7f5d9400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400bea0 con 0x7f5d9c101b30 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c19f210 con 0x7f5d9c101b30 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c19f6f0 con 0x7f5d9c101b30 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5d94009940 con 0x7f5d9c101b30 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.311+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d940106c0 con 0x7f5d9c101b30 2024-02-14T13:08:16.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.313+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c067f40 con 0x7f5d9c101b30 2024-02-14T13:08:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.313+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f5d94004240 con 0x7f5d9c101b30 2024-02-14T13:08:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.314+0000 7f5d937fe640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d880a2150 0x7f5d880a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.314+0000 7f5d9a59c640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d880a2150 0x7f5d880a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.314+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5d940cdc00 con 0x7f5d9c101b30 2024-02-14T13:08:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.315+0000 7f5d9a59c640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d880a2150 0x7f5d880a4610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c100fd0 tx=0x7f5d8c00a560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.319+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5d940969f0 con 0x7f5d9c101b30 2024-02-14T13:08:16.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:16 smithi103 ceph-mon[36921]: pgmap v332: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:16.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:16 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1333141068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:16.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:16 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2807806017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:16.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:16 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3799487768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:16.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.536+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d9c02cdb0 con 0x7f5d9c101b30 2024-02-14T13:08:16.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.537+0000 7f5d937fe640 1 -- 172.21.15.12:0/413069695 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7f5d9409a0b0 con 0x7f5d9c101b30 2024-02-14T13:08:16.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:16.539 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:08:16.539 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d880a2150 msgr2=0x7f5d880a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d880a2150 0x7f5d880a4610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c100fd0 tx=0x7f5d8c00a560 comp rx=0 tx=0).stop 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 msgr2=0x7f5d9c19e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 0x7f5d9c19e480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009fd0 tx=0x7f5d9400b260 comp rx=0 tx=0).stop 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 shutdown_connections 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f5d880a2150 0x7f5d880a4610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d9c101b30 0x7f5d9c19e480 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d9c101170 0x7f5d9c19be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 --2- 172.21.15.12:0/413069695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d9c0fff80 0x7f5d9c068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 >> 172.21.15.12:0/413069695 conn(0x7f5d9c0fb510 msgr2=0x7f5d9c104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 shutdown_connections 2024-02-14T13:08:16.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.539+0000 7f5d9b59e640 1 -- 172.21.15.12:0/413069695 wait complete. 2024-02-14T13:08:16.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:08:16.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:16 smithi055 ceph-mon[36853]: pgmap v332: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:16.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:16 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1333141068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:16.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:16 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2807806017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:16.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:16 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3799487768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 -- 172.21.15.12:0/3759789317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0101d70 msgr2=0x7f29a0104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 --2- 172.21.15.12:0/3759789317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0101d70 0x7f29a0104160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2998009900 tx=0x7f299802bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 -- 172.21.15.12:0/3759789317 shutdown_connections 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 --2- 172.21.15.12:0/3759789317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0106fd0 0x7f29a01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 --2- 172.21.15.12:0/3759789317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29a01046a0 0x7f29a0106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 --2- 172.21.15.12:0/3759789317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0101d70 0x7f29a0104160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 -- 172.21.15.12:0/3759789317 >> 172.21.15.12:0/3759789317 conn(0x7f29a00fb6c0 msgr2=0x7f29a00fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 -- 172.21.15.12:0/3759789317 shutdown_connections 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.652+0000 7f29a5450640 1 -- 172.21.15.12:0/3759789317 wait complete. 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 Processor -- start 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 -- start start 2024-02-14T13:08:16.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0101d70 0x7f29a01972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29a01046a0 0x7f29a0197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 0x7f29a019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a019ede0 con 0x7f29a0106fd0 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a019ef50 con 0x7f29a0101d70 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f29a5450640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a019f110 con 0x7f29a01046a0 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f299f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 0x7f29a019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f299f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 0x7f29a019e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33222/0 (socket says 172.21.15.12:33222) 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f299f7fe640 1 -- 172.21.15.12:0/312675271 learned_addr learned my addr 172.21.15.12:0/312675271 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.653+0000 7f299effd640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0101d70 0x7f29a01972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299e7fc640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29a01046a0 0x7f29a0197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299f7fe640 1 -- 172.21.15.12:0/312675271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29a01046a0 msgr2=0x7f29a0197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299f7fe640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29a01046a0 0x7f29a0197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299f7fe640 1 -- 172.21.15.12:0/312675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0101d70 msgr2=0x7f29a01972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299f7fe640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0101d70 0x7f29a01972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299f7fe640 1 -- 172.21.15.12:0/312675271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009560 con 0x7f29a0106fd0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299effd640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0101d70 0x7f29a01972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f299f7fe640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 0x7f29a019e8a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f299000eaa0 tx=0x7f299000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000cdb0 con 0x7f29a0106fd0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a019f3f0 con 0x7f29a0106fd0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2990005020 con 0x7f29a0106fd0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900116b0 con 0x7f29a0106fd0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.654+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a019f8b0 con 0x7f29a0106fd0 2024-02-14T13:08:16.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.655+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a00fd1b0 con 0x7f29a0106fd0 2024-02-14T13:08:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.656+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f2990005520 con 0x7f29a0106fd0 2024-02-14T13:08:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.657+0000 7f2987fff640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f29880a2150 0x7f29880a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.657+0000 7f299effd640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f29880a2150 0x7f29880a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.657+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f29900ce230 con 0x7f29a0106fd0 2024-02-14T13:08:16.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.657+0000 7f299effd640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f29880a2150 0x7f29880a4610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.661+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2990097020 con 0x7f29a0106fd0 2024-02-14T13:08:16.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.844+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29a010cc80 con 0x7f29a0106fd0 2024-02-14T13:08:16.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.846+0000 7f2987fff640 1 -- 172.21.15.12:0/312675271 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22638 (secure 0 0 0) 0x7f299001f090 con 0x7f29a0106fd0 2024-02-14T13:08:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:16.848 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:07:49.983197+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f29880a2150 msgr2=0x7f29880a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f29880a2150 0x7f29880a4610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2998000c00 tx=0x7f2998005be0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 msgr2=0x7f29a019e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 0x7f29a019e8a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f299000eaa0 tx=0x7f299000ef60 comp rx=0 tx=0).stop 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 shutdown_connections 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f29880a2150 0x7f29880a4610 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a0106fd0 0x7f29a019e8a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29a01046a0 0x7f29a0197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 --2- 172.21.15.12:0/312675271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a0101d70 0x7f29a01972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 >> 172.21.15.12:0/312675271 conn(0x7f29a00fb6c0 msgr2=0x7f29a0102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 shutdown_connections 2024-02-14T13:08:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.848+0000 7f29a5450640 1 -- 172.21.15.12:0/312675271 wait complete. 2024-02-14T13:08:16.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:08:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 -- 172.21.15.12:0/1763528511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c100170 msgr2=0x7fb07c100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 --2- 172.21.15.12:0/1763528511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c100170 0x7fb07c100590 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb078009900 tx=0x7fb07802bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 -- 172.21.15.12:0/1763528511 shutdown_connections 2024-02-14T13:08:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 --2- 172.21.15.12:0/1763528511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101d20 0x7fb07c1085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 --2- 172.21.15.12:0/1763528511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb07c101360 0x7fb07c1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 --2- 172.21.15.12:0/1763528511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c100170 0x7fb07c100590 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 -- 172.21.15.12:0/1763528511 >> 172.21.15.12:0/1763528511 conn(0x7fb07c0fb6e0 msgr2=0x7fb07c0fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 -- 172.21.15.12:0/1763528511 shutdown_connections 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.961+0000 7fb083c6f640 1 -- 172.21.15.12:0/1763528511 wait complete. 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 Processor -- start 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 -- start start 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb07c100170 0x7fb07c196290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101360 0x7fb07c1967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 0x7fb07c19d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c19dd80 con 0x7fb07c101d20 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c19def0 con 0x7fb07c101360 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c19e0b0 con 0x7fb07c100170 2024-02-14T13:08:16.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 0x7fb07c19d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 0x7fb07c19d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33236/0 (socket says 172.21.15.12:33236) 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 -- 172.21.15.12:0/473842843 learned_addr learned my addr 172.21.15.12:0/473842843 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb081a0b640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb07c100170 0x7fb07c196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08120a640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101360 0x7fb07c1967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 -- 172.21.15.12:0/473842843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb07c100170 msgr2=0x7fb07c196290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb07c100170 0x7fb07c196290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 -- 172.21.15.12:0/473842843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101360 msgr2=0x7fb07c1967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101360 0x7fb07c1967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 -- 172.21.15.12:0/473842843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078009560 con 0x7fb07c101d20 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08120a640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101360 0x7fb07c1967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb08220c640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 0x7fb07c19d840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb07400b970 tx=0x7fb07400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400cb40 con 0x7fb07c101d20 2024-02-14T13:08:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fb07400cca0 con 0x7fb07c101d20 2024-02-14T13:08:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c19e390 con 0x7fb07c101d20 2024-02-14T13:08:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.962+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740077d0 con 0x7fb07c101d20 2024-02-14T13:08:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.963+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c19e8d0 con 0x7fb07c101d20 2024-02-14T13:08:16.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.963+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c107490 con 0x7fb07c101d20 2024-02-14T13:08:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.964+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7fb074014440 con 0x7fb07c101d20 2024-02-14T13:08:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.965+0000 7fb06effd640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb0680a2150 0x7fb0680a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.965+0000 7fb081a0b640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb0680a2150 0x7fb0680a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.965+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fb0740cdaa0 con 0x7fb07c101d20 2024-02-14T13:08:16.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.965+0000 7fb081a0b640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb0680a2150 0x7fb0680a4610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb078005ab0 tx=0x7fb078005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:16.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:16.969+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb074096ab0 con 0x7fb07c101d20 2024-02-14T13:08:17.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.187+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb07c10bbe0 con 0x7fb07c101d20 2024-02-14T13:08:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.188+0000 7fb06effd640 1 -- 172.21.15.12:0/473842843 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7fb07409a170 con 0x7fb07c101d20 2024-02-14T13:08:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:08:17.190 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb0680a2150 msgr2=0x7fb0680a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb0680a2150 0x7fb0680a4610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb078005ab0 tx=0x7fb078005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 msgr2=0x7fb07c19d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 0x7fb07c19d840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb07400b970 tx=0x7fb07400be30 comp rx=0 tx=0).stop 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 shutdown_connections 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fb0680a2150 0x7fb0680a4610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb07c101d20 0x7fb07c19d840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb07c101360 0x7fb07c1967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 --2- 172.21.15.12:0/473842843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb07c100170 0x7fb07c196290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 >> 172.21.15.12:0/473842843 conn(0x7fb07c0fb6e0 msgr2=0x7fb07c104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 shutdown_connections 2024-02-14T13:08:17.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.190+0000 7fb083c6f640 1 -- 172.21.15.12:0/473842843 wait complete. 2024-02-14T13:08:17.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-02-14T13:06:49.142270+0000', 'modified': '2024-02-14T13:06:52.178143+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24505}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.55:6839/3549809563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6838', 'nonce': 3549809563}, {'type': 'v1', 'addr': '172.21.15.55:6839', 'nonce': 3549809563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.103:6839/2266124957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 2266124957}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 2266124957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-14T13:08:17.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-14T13:08:17.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- 172.21.15.12:0/2448568819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 msgr2=0x7f6c741028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/2448568819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741028b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009900 tx=0x7f6c6002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- 172.21.15.12:0/2448568819 shutdown_connections 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/2448568819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c74102df0 0x7f6c74109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/2448568819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741028b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/2448568819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 0x7f6c74101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- 172.21.15.12:0/2448568819 >> 172.21.15.12:0/2448568819 conn(0x7f6c740fc7d0 msgr2=0x7f6c740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- 172.21.15.12:0/2448568819 shutdown_connections 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- 172.21.15.12:0/2448568819 wait complete. 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 Processor -- start 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- start start 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 0x7f6c74197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c74102df0 0x7f6c7419ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7419ef70 con 0x7f6c74102430 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7419f0e0 con 0x7f6c74102df0 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c7aecf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7419f2a0 con 0x7f6c74101240 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33250/0 (socket says 172.21.15.12:33250) 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.305+0000 7f6c73fff640 1 -- 172.21.15.12:0/135564557 learned_addr learned my addr 172.21.15.12:0/135564557 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:17.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c7946c640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c74102df0 0x7f6c7419ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 0x7f6c74197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c73fff640 1 -- 172.21.15.12:0/135564557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 msgr2=0x7f6c74197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c73fff640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 0x7f6c74197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c73fff640 1 -- 172.21.15.12:0/135564557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c74102df0 msgr2=0x7f6c7419ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c73fff640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c74102df0 0x7f6c7419ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c73fff640 1 -- 172.21.15.12:0/135564557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009560 con 0x7f6c74102430 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 0x7f6c74197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c73fff640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741979c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6c60005ab0 tx=0x7f6c600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c71ffb640 1 -- 172.21.15.12:0/135564557 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600044e0 con 0x7f6c74102430 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7419f520 con 0x7f6c74102430 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c71ffb640 1 -- 172.21.15.12:0/135564557 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6c600054e0 con 0x7f6c74102430 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c71ffb640 1 -- 172.21.15.12:0/135564557 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6003e450 con 0x7f6c74102430 2024-02-14T13:08:17.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.306+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7419fb00 con 0x7f6c74102430 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.308+0000 7f6c71ffb640 1 -- 172.21.15.12:0/135564557 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f6c600035f0 con 0x7f6c74102430 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 Processor -- start 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 -- start start 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f586c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f58bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f58e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f53efd0 con 0x564e7f586870 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f4f1cb0 con 0x564e7f58c3d0 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7db70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f4ef1e0 con 0x564e7f587260 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c71ffb640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c640a2150 0x7f6c640a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f586c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f586c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33258/0 (socket says 172.21.15.12:33258) 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 -- 172.21.15.12:0/257684854 learned_addr learned my addr 172.21.15.12:0/257684854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f58bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c640a2150 0x7f6c640a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c71ffb640 1 -- 172.21.15.12:0/135564557 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6c600f02d0 con 0x7f6c74102430 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c73fff640 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f58e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 -- 172.21.15.12:0/257684854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 msgr2=0x564e7f58bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f58bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 -- 172.21.15.12:0/257684854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 msgr2=0x564e7f58e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f58e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 -- 172.21.15.12:0/257684854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e7f4ad100 con 0x564e7f586870 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.309+0000 7f6c7946c640 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f586c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00a990 tx=0x7f6c6c00ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7410c3aaa0fa8e15 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c5effd640 1 -- 172.21.15.12:0/257684854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00a440 con 0x564e7f586870 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c5effd640 1 -- 172.21.15.12:0/257684854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6c6c015c60 con 0x564e7f586870 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c5effd640 1 -- 172.21.15.12:0/257684854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0213c0 con 0x564e7f586870 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7946c640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c640a2150 0x7f6c640a4610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c020000 tx=0x7f6c6c01e000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 -- 172.21.15.12:0/257684854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 msgr2=0x564e7f586c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f586c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00a990 tx=0x7f6c6c00ae50 comp rx=0 tx=0).stop 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 -- 172.21.15.12:0/257684854 shutdown_connections 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f58e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f58bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 --2- 172.21.15.12:0/257684854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f586c90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 -- 172.21.15.12:0/257684854 >> 172.21.15.12:0/257684854 conn(0x564e7f57d9d0 msgr2=0x564e7f57ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 -- 172.21.15.12:0/257684854 shutdown_connections 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.310+0000 7f6c7db70740 1 -- 172.21.15.12:0/257684854 wait complete. 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 -- start start 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 Processor -- start 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f58c3d0 0x564e7f598000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f4ea9c0 con 0x564e7f587260 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f48fcd0 con 0x564e7f586870 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f1be310 con 0x564e7f58c3d0 2024-02-14T13:08:17.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7db70740 10 client.0 _ll_register_callbacks cb 0x564e7f1fbac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33274/0 (socket says 172.21.15.12:33274) 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 -- 172.21.15.12:0/4140560126 learned_addr learned my addr 172.21.15.12:0/4140560126 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c7946c640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f58c3d0 0x564e7f598000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 -- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f58c3d0 msgr2=0x564e7f598000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f58c3d0 0x564e7f598000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 -- 172.21.15.12:0/4140560126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 msgr2=0x564e7f590a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.311+0000 7f6c73fff640 1 -- 172.21.15.12:0/4140560126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c013040 con 0x564e7f587260 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c73fff640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 0x564e7f590fc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6c600bcec0 tx=0x7f6c600bd6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e037f68d7711c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c53fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c53fff640 1 -- 172.21.15.12:0/4140560126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600c56d0 con 0x564e7f587260 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c53fff640 1 -- 172.21.15.12:0/4140560126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6c600c5240 con 0x564e7f587260 2024-02-14T13:08:17.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e7f1ea6c0 con 0x564e7f587260 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c53fff640 1 -- 172.21.15.12:0/4140560126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c600c5400 con 0x564e7f587260 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 10 client.15048 fetch_fsmap learned FSMap version 18 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x564e7f4e9040 con 0x564e7f587260 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c53fff640 1 -- 172.21.15.12:0/4140560126 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x564e7f1ea6c0 con 0x564e7f587260 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c53fff640 1 -- 172.21.15.12:0/4140560126 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c6003c070 con 0x564e7f587260 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 10 client.15048 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 10 client.15048 resolve_mds: resolved name 'i' to daemon mds.i 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 20 client.15048 populate_metadata read hostname 'smithi012' 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f59c160 0x564e7f5a1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 4 client.15048 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.312+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e7f23b270 con 0x564e7f59c160 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.313+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f59c160 0x564e7f5a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.313+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f59c160 0x564e7f5a1260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e261b839f1886777 server_cookie=d085252a6884e42a in_seq=0 out_seq=0 2024-02-14T13:08:17.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.313+0000 7f6c53fff640 10 client.15048 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c53fff640 1 -- 172.21.15.12:0/4140560126 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564e7f23b270 con 0x564e7f59c160 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c53fff640 10 client.15048 handle_command_reply: tid=0 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 client.15048 shutdown 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 msgr2=0x564e7f590fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 0x564e7f590fc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6c600bcec0 tx=0x7f6c600bd6f0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 shutdown_connections 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f59c160 0x564e7f5a1260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f58c3d0 0x564e7f598000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c53fff640 0 client.15048 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 --2- 172.21.15.12:0/4140560126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 >> 172.21.15.12:0/4140560126 conn(0x564e7f57d9d0 msgr2=0x564e7f57cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 shutdown_connections 2024-02-14T13:08:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 1 -- 172.21.15.12:0/4140560126 wait complete. 2024-02-14T13:08:17.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.314+0000 7f6c7db70740 20 client.15048 trim_cache size 0 max 16384 2024-02-14T13:08:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 Processor -- start 2024-02-14T13:08:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 -- start start 2024-02-14T13:08:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 0x564e7f597fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f470490 con 0x564e7f58c3d0 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f5794b0 con 0x564e7f586870 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7db70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f59e330 con 0x564e7f587260 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7946c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 0x564e7f597fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7946c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 0x564e7f597fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33280/0 (socket says 172.21.15.12:33280) 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7946c640 1 -- 172.21.15.12:0/2456136121 learned_addr learned my addr 172.21.15.12:0/2456136121 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c7946c640 1 -- 172.21.15.12:0/2456136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 msgr2=0x564e7f590fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.330+0000 7f6c73fff640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7946c640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7946c640 1 -- 172.21.15.12:0/2456136121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 msgr2=0x564e7f590a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7946c640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7946c640 1 -- 172.21.15.12:0/2456136121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e7f485a90 con 0x564e7f58c3d0 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c73fff640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7946c640 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 0x564e7f597fc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c004a80 tx=0x7f6c6c009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b883ceda48f6651e server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c5e7fc640 1 -- 172.21.15.12:0/2456136121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c021440 con 0x564e7f58c3d0 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c5e7fc640 1 -- 172.21.15.12:0/2456136121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6c6c00a420 con 0x564e7f58c3d0 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c5e7fc640 1 -- 172.21.15.12:0/2456136121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c02aa10 con 0x564e7f58c3d0 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7db70740 1 -- 172.21.15.12:0/2456136121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 msgr2=0x564e7f597fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.331+0000 7f6c7db70740 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 0x564e7f597fc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c004a80 tx=0x7f6c6c009cb0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- 172.21.15.12:0/2456136121 shutdown_connections 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f58c3d0 0x564e7f597fc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f590fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 --2- 172.21.15.12:0/2456136121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f586870 0x564e7f590a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- 172.21.15.12:0/2456136121 >> 172.21.15.12:0/2456136121 conn(0x564e7f57d9d0 msgr2=0x564e7f588780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- 172.21.15.12:0/2456136121 shutdown_connections 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- 172.21.15.12:0/2456136121 wait complete. 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- start start 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 Processor -- start 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f595500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f595a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f5969b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f5988c0 con 0x564e7f586870 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f58bfb0 con 0x564e7f58c3d0 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7f59d010 con 0x564e7f587260 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7db70740 10 client.0 _ll_register_callbacks cb 0x7f6c6c009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c78c6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f595500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c78c6b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f595500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33288/0 (socket says 172.21.15.12:33288) 2024-02-14T13:08:17.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c78c6b640 1 -- 172.21.15.12:0/1613631188 learned_addr learned my addr 172.21.15.12:0/1613631188 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.332+0000 7f6c7946c640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f5969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c78c6b640 1 -- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 msgr2=0x564e7f595a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f595a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c78c6b640 1 -- 172.21.15.12:0/1613631188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 msgr2=0x564e7f5969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f5969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c78c6b640 1 -- 172.21.15.12:0/1613631188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e7f4ad100 con 0x564e7f586870 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7946c640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f5969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c78c6b640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f595500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800aa40 tx=0x7f6c6801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4917093feb4455 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c53fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c53fff640 1 -- 172.21.15.12:0/1613631188 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68024480 con 0x564e7f586870 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c53fff640 1 -- 172.21.15.12:0/1613631188 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6c680245e0 con 0x564e7f586870 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e7f59e470 con 0x564e7f586870 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c53fff640 1 -- 172.21.15.12:0/1613631188 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c680247a0 con 0x564e7f586870 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 10 client.15054 fetch_fsmap learned FSMap version 18 2024-02-14T13:08:17.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x564e7f4ab960 con 0x564e7f586870 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c53fff640 1 -- 172.21.15.12:0/1613631188 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x564e7f59e470 con 0x564e7f586870 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c53fff640 1 -- 172.21.15.12:0/1613631188 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c6802d050 con 0x564e7f586870 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 10 client.15054 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 10 client.15054 resolve_mds: resolved name 'i' to daemon mds.i 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 20 client.15054 populate_metadata read hostname 'smithi012' 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f5f8c50 0x564e7f5f5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 4 client.15054 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.333+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564e7f59d150 con 0x564e7f5f8c50 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c73fff640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f5f8c50 0x564e7f5f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c53fff640 10 client.15054 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c73fff640 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f5f8c50 0x564e7f5f5050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0c7199c1bab9153 server_cookie=b85c0312602e2525 in_seq=0 out_seq=0 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c53fff640 1 -- 172.21.15.12:0/1613631188 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x564e7f59d150 con 0x564e7f5f8c50 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c53fff640 10 client.15054 handle_command_reply: tid=0 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 client.15054 shutdown 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 msgr2=0x564e7f595500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f595500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800aa40 tx=0x7f6c6801bed0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 shutdown_connections 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e7f5f8c50 0x564e7f5f5050 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e7f58c3d0 0x564e7f5969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e7f587260 0x564e7f595a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 --2- 172.21.15.12:0/1613631188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e7f586870 0x564e7f595500 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c53fff640 0 client.15054 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.334+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 >> 172.21.15.12:0/1613631188 conn(0x564e7f57d9d0 msgr2=0x564e7f5909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 shutdown_connections 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7db70740 1 -- 172.21.15.12:0/1613631188 wait complete. 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7db70740 20 client.15054 trim_cache size 0 max 16384 2024-02-14T13:08:17.343 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "ab42aa14-cb38-11ee-95b9-87774f69a715", 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24505, 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 87.544686466000002, 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 18, 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 87, 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 101.304293503 2024-02-14T13:08:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c640a2150 msgr2=0x7f6c640a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c640a2150 0x7f6c640a4610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c020000 tx=0x7f6c6c01e000 comp rx=0 tx=0).stop 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 msgr2=0x7f6c741979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741979c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6c60005ab0 tx=0x7f6c600042f0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 shutdown_connections 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c640a2150 0x7f6c640a4610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c74102df0 0x7f6c7419ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c74102430 0x7f6c741979c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 --2- 172.21.15.12:0/135564557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c74101240 0x7f6c74197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 >> 172.21.15.12:0/135564557 conn(0x7f6c740fc7d0 msgr2=0x7f6c74105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 shutdown_connections 2024-02-14T13:08:17.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:17.335+0000 7f6c7aecf640 1 -- 172.21.15.12:0/135564557 wait complete. 2024-02-14T13:08:17.348 INFO:tasks.cephadm:Setup complete, yielding 2024-02-14T13:08:17.348 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-14T13:08:17.357 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T13:08:17.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph orch status' 2024-02-14T13:08:17.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:17 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/733713855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:17.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:17 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/413069695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:17.381 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:17 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/312675271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:17.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:17 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/733713855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:17.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:17 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/413069695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:17.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:17 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/312675271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:17.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:17 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/733713855' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:17.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:17 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/413069695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:17.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:17 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/312675271' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:17.601 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:18.372 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:18 smithi012 ceph-mon[32370]: pgmap v333: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:18.372 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:18 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/473842843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:18.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:18 smithi103 ceph-mon[36921]: pgmap v333: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:18.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:18 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/473842843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:18.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:18 smithi055 ceph-mon[36853]: pgmap v333: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:18.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:18 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/473842843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 -- 172.21.15.12:0/1196400268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914075cf0 msgr2=0x7f1914074150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 --2- 172.21.15.12:0/1196400268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914075cf0 0x7f1914074150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1904009990 tx=0x7f1904009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 -- 172.21.15.12:0/1196400268 shutdown_connections 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 --2- 172.21.15.12:0/1196400268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1914109c40 0x7f191410c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 --2- 172.21.15.12:0/1196400268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914075cf0 0x7f1914074150 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 --2- 172.21.15.12:0/1196400268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914074720 0x7f1914074ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 -- 172.21.15.12:0/1196400268 >> 172.21.15.12:0/1196400268 conn(0x7f19140fd2c0 msgr2=0x7f19140ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 -- 172.21.15.12:0/1196400268 shutdown_connections 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.185+0000 7f191a033700 1 -- 172.21.15.12:0/1196400268 wait complete. 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 Processor -- start 2024-02-14T13:08:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 -- start start 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1914074720 0x7f1914199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914075cf0 0x7f191419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 0x7f19141a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19141a1ab0 con 0x7f1914109c40 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19141a1bf0 con 0x7f1914075cf0 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f191a033700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19141a1d80 con 0x7f1914074720 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f1913fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 0x7f19141a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f1913fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 0x7f19141a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33308/0 (socket says 172.21.15.12:33308) 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f1913fff700 1 -- 172.21.15.12:0/3001945043 learned_addr learned my addr 172.21.15.12:0/3001945043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f19137fe700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1914074720 0x7f1914199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.186+0000 7f1912ffd700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914075cf0 0x7f191419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1913fff700 1 -- 172.21.15.12:0/3001945043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1914074720 msgr2=0x7f1914199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1913fff700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1914074720 0x7f1914199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1913fff700 1 -- 172.21.15.12:0/3001945043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914075cf0 msgr2=0x7f191419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1913fff700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914075cf0 0x7f191419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1913fff700 1 -- 172.21.15.12:0/3001945043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040095f0 con 0x7f1914109c40 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1913fff700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 0x7f19141a14e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f190c00b9a0 tx=0x7f190c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00d850 con 0x7f1914109c40 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f190c00de90 con 0x7f1914109c40 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c017420 con 0x7f1914109c40 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19141a2060 con 0x7f1914109c40 2024-02-14T13:08:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.187+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19141a2510 con 0x7f1914109c40 2024-02-14T13:08:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.188+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1914108a50 con 0x7f1914109c40 2024-02-14T13:08:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.189+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 136819+0+0 (secure 0 0 0) 0x7f190c00e6b0 con 0x7f1914109c40 2024-02-14T13:08:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.189+0000 7f1910ff9700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f18fc0a21e0 0x7f18fc0a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.190+0000 7f19137fe700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f18fc0a21e0 0x7f18fc0a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.190+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f190c006e40 con 0x7f1914109c40 2024-02-14T13:08:19.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.190+0000 7f19137fe700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f18fc0a21e0 0x7f18fc0a46a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1904003790 tx=0x7f1904005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.193+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f190c096a40 con 0x7f1914109c40 2024-02-14T13:08:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.414+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f191402d810 con 0x7f18fc0a21e0 2024-02-14T13:08:19.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.415+0000 7f1910ff9700 1 -- 172.21.15.12:0/3001945043 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f191402d810 con 0x7f18fc0a21e0 2024-02-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:Backend: cephadm 2024-02-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:Available: Yes 2024-02-14T13:08:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:Paused: No 2024-02-14T13:08:19.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f18fc0a21e0 msgr2=0x7f18fc0a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:19.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f18fc0a21e0 0x7f18fc0a46a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1904003790 tx=0x7f1904005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 msgr2=0x7f19141a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:19.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 0x7f19141a14e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f190c00b9a0 tx=0x7f190c00bcb0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 shutdown_connections 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f18fc0a21e0 0x7f18fc0a46a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1914109c40 0x7f19141a14e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1914074720 0x7f1914199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 --2- 172.21.15.12:0/3001945043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1914075cf0 0x7f191419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 >> 172.21.15.12:0/3001945043 conn(0x7f19140fd2c0 msgr2=0x7f1914105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.417+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 shutdown_connections 2024-02-14T13:08:19.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:19.418+0000 7f191a033700 1 -- 172.21.15.12:0/3001945043 wait complete. 2024-02-14T13:08:20.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-14T13:08:20.386 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:20.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:20 smithi012 ceph-mon[32370]: pgmap v334: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:20.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:20 smithi103 ceph-mon[36921]: pgmap v334: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:20.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:20 smithi055 ceph-mon[36853]: pgmap v334: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:21.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:21 smithi012 ceph-mon[32370]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:21.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:21 smithi012 ceph-mon[32370]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-02-14T13:08:21.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:21 smithi103 ceph-mon[36921]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:21.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:21 smithi103 ceph-mon[36921]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-02-14T13:08:21.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:21 smithi055 ceph-mon[36853]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:21.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:21 smithi055 ceph-mon[36853]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-02-14T13:08:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 -- 172.21.15.12:0/29911625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c101f90 msgr2=0x7f642c108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 --2- 172.21.15.12:0/29911625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c101f90 0x7f642c108840 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c240 tx=0x7f641c00c550 comp rx=0 tx=0).stop 2024-02-14T13:08:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 -- 172.21.15.12:0/29911625 shutdown_connections 2024-02-14T13:08:21.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 --2- 172.21.15.12:0/29911625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c101f90 0x7f642c108840 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 --2- 172.21.15.12:0/29911625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c1003f0 0x7f642c100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 --2- 172.21.15.12:0/29911625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f642c1015f0 0x7f642c101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 -- 172.21.15.12:0/29911625 >> 172.21.15.12:0/29911625 conn(0x7f642c0fb970 msgr2=0x7f642c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 -- 172.21.15.12:0/29911625 shutdown_connections 2024-02-14T13:08:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.859+0000 7f64314be700 1 -- 172.21.15.12:0/29911625 wait complete. 2024-02-14T13:08:21.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 Processor -- start 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 -- start start 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f642c1003f0 0x7f642c195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 0x7f642c196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c101f90 0x7f642c19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c19d7a0 con 0x7f642c1015f0 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c19d8e0 con 0x7f642c1003f0 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f64314be700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c19daa0 con 0x7f642c101f90 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 0x7f642c196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 0x7f642c196190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33328/0 (socket says 172.21.15.12:33328) 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 -- 172.21.15.12:0/3150417581 learned_addr learned my addr 172.21.15.12:0/3150417581 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642affd700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f642c1003f0 0x7f642c195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642b7fe700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c101f90 0x7f642c19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:21.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 -- 172.21.15.12:0/3150417581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c101f90 msgr2=0x7f642c19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c101f90 0x7f642c19d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 -- 172.21.15.12:0/3150417581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f642c1003f0 msgr2=0x7f642c195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f642c1003f0 0x7f642c195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.860+0000 7f642a7fc700 1 -- 172.21.15.12:0/3150417581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c00ae10 con 0x7f642c1015f0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.861+0000 7f642a7fc700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 0x7f642c196190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f641400b530 tx=0x7f641400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.861+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414011830 con 0x7f642c1015f0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.861+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c19dd80 con 0x7f642c1015f0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.861+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6414011e70 con 0x7f642c1015f0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.861+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400f300 con 0x7f642c1015f0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.861+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c19e290 con 0x7f642c1015f0 2024-02-14T13:08:21.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.862+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642c107750 con 0x7f642c1015f0 2024-02-14T13:08:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.863+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f64140106d0 con 0x7f642c1015f0 2024-02-14T13:08:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.864+0000 7f6423fff700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64180a2150 0x7f64180a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.864+0000 7f642affd700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64180a2150 0x7f64180a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.864+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f64140cdcf0 con 0x7f642c1015f0 2024-02-14T13:08:21.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.864+0000 7f642affd700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64180a2150 0x7f64180a4610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f642c197130 tx=0x7f642400a380 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:21.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:21.867+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6414096c40 con 0x7f642c1015f0 2024-02-14T13:08:22.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.079+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f642c02d9a0 con 0x7f64180a2150 2024-02-14T13:08:22.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.093+0000 7f6423fff700 1 -- 172.21.15.12:0/3150417581 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f642c02d9a0 con 0x7f64180a2150 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (100s) 15s ago 100s 13.8M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf f898943ab558 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi055 running (97s) 31s ago 97s 17.9M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 8fab6c33dbaa 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.c smithi103 running (111s) 31s ago 111s 15.2M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 8b7df7fb9332 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.d smithi012 running (119s) 15s ago 119s 13.0M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 442697aca767 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.e smithi055 running (117s) 31s ago 116s 13.9M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf ebb61be33b7c 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.f smithi103 running (114s) 31s ago 114s 15.2M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 01ae42641540 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.g smithi012 running (103s) 15s ago 102s 13.9M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf a8d6fda58bb7 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.h smithi055 running (108s) 31s ago 108s 13.8M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 9b98252fd188 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.i smithi103 running (106s) 31s ago 106s 25.1M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 95594a237f21 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.j smithi012 running (2m) 15s ago 2m 14.0M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 74ea97825c3a 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.k smithi055 running (2m) 31s ago 2m 13.6M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 12e32b172797 2024-02-14T13:08:22.095 INFO:teuthology.orchestra.run.smithi012.stdout:mds.l smithi103 running (2m) 31s ago 2m 13.6M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 3d198de07545 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi012 *:9283,8765 running (9m) 15s ago 9m 512M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 454a9a83b62c 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi055 *:8443,8765 running (7m) 31s ago 7m 453M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf dea078cbb750 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.z smithi103 *:8443,8765 running (7m) 31s ago 7m 450M - 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 4f809dedbe9a 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 15s ago 9m 51.1M 2048M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 3413393e3874 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi055 running (7m) 31s ago 7m 40.1M 2048M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 820f66574326 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi103 running (7m) 31s ago 7m 41.0M 2048M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 0dc130bedece 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (7m) 15s ago 7m 50.2M 4273M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf e9d1c5c971c7 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi055 running (6m) 31s ago 6m 55.4M 4271M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 85c01ef01cdb 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi103 running (6m) 31s ago 6m 60.4M 4270M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf a36c3e35e226 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (5m) 15s ago 5m 57.0M 4273M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 73735b70d229 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi055 running (5m) 31s ago 5m 46.1M 4271M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 0ff73ce9dcd9 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi103 running (5m) 31s ago 5m 54.2M 4270M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf e2cc7d9ea225 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi012 running (4m) 15s ago 4m 52.2M 4273M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 30d444498c96 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi055 running (4m) 31s ago 4m 47.1M 4271M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 074dfb978772 2024-02-14T13:08:22.096 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 smithi103 running (3m) 31s ago 3m 46.5M 4270M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 62b348cb3bf4 2024-02-14T13:08:22.097 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 smithi012 running (3m) 15s ago 3m 43.7M 4273M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 9006916e4128 2024-02-14T13:08:22.097 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 smithi055 running (2m) 31s ago 2m 49.8M 4271M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf e0650ae78cda 2024-02-14T13:08:22.097 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 smithi103 running (2m) 31s ago 2m 51.3M 4270M 19.0.0-1280-ga6fe3fa3 87bb2d90c3bf 7631a49f8f22 2024-02-14T13:08:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64180a2150 msgr2=0x7f64180a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64180a2150 0x7f64180a4610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f642c197130 tx=0x7f642400a380 comp rx=0 tx=0).stop 2024-02-14T13:08:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 msgr2=0x7f642c196190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 0x7f642c196190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f641400b530 tx=0x7f641400b840 comp rx=0 tx=0).stop 2024-02-14T13:08:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 shutdown_connections 2024-02-14T13:08:22.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f642c101f90 0x7f642c19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:22.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f642c1003f0 0x7f642c195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:22.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64180a2150 0x7f64180a4610 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:22.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 --2- 172.21.15.12:0/3150417581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1015f0 0x7f642c196190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:22.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 >> 172.21.15.12:0/3150417581 conn(0x7f642c0fb970 msgr2=0x7f642c104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:22.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 shutdown_connections 2024-02-14T13:08:22.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:22.096+0000 7f64314be700 1 -- 172.21.15.12:0/3150417581 wait complete. 2024-02-14T13:08:22.425 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:22 smithi012 ceph-mon[32370]: pgmap v335: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-02-14T13:08:22.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:22 smithi103 ceph-mon[36921]: pgmap v335: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-02-14T13:08:22.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:22 smithi055 ceph-mon[36853]: pgmap v335: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-02-14T13:08:22.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-14T13:08:23.107 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:23.446 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:23 smithi012 ceph-mon[32370]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:23.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:23 smithi103 ceph-mon[36921]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:23.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:23 smithi055 ceph-mon[36853]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:24.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:24 smithi012 ceph-mon[32370]: pgmap v336: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:24.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:24 smithi103 ceph-mon[36921]: pgmap v336: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:24.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:24 smithi055 ceph-mon[36853]: pgmap v336: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 -- 172.21.15.12:0/2540026983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c103030 msgr2=0x7fd25c103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 --2- 172.21.15.12:0/2540026983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c103030 0x7fd25c103490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009990 tx=0x7fd24c009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 -- 172.21.15.12:0/2540026983 shutdown_connections 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 --2- 172.21.15.12:0/2540026983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25c1039d0 0x7fd25c10a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 --2- 172.21.15.12:0/2540026983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c100050 0x7fd25c100470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 --2- 172.21.15.12:0/2540026983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c103030 0x7fd25c103490 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 -- 172.21.15.12:0/2540026983 >> 172.21.15.12:0/2540026983 conn(0x7fd25c0fb9b0 msgr2=0x7fd25c0fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 -- 172.21.15.12:0/2540026983 shutdown_connections 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.720+0000 7fd2619e1700 1 -- 172.21.15.12:0/2540026983 wait complete. 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 Processor -- start 2024-02-14T13:08:24.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 -- start start 2024-02-14T13:08:24.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 0x7fd25c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:24.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c103030 0x7fd25c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25c1039d0 0x7fd25c19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c19f950 con 0x7fd25c100050 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c19fa90 con 0x7fd25c103030 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd2619e1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c19fc20 con 0x7fd25c1039d0 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd25affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 0x7fd25c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd25affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 0x7fd25c197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48110/0 (socket says 172.21.15.12:48110) 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd25affd700 1 -- 172.21.15.12:0/3211744000 learned_addr learned my addr 172.21.15.12:0/3211744000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd25a7fc700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c103030 0x7fd25c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.721+0000 7fd25b7fe700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25c1039d0 0x7fd25c19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:24.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd25affd700 1 -- 172.21.15.12:0/3211744000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25c1039d0 msgr2=0x7fd25c19f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd25affd700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25c1039d0 0x7fd25c19f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd25affd700 1 -- 172.21.15.12:0/3211744000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c103030 msgr2=0x7fd25c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd25affd700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c103030 0x7fd25c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd25affd700 1 -- 172.21.15.12:0/3211744000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0095f0 con 0x7fd25c100050 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd25affd700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 0x7fd25c197dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd25000b530 tx=0x7fd25000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250011830 con 0x7fd25c100050 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd250011e70 con 0x7fd25c100050 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c19ff00 con 0x7fd25c100050 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250010e50 con 0x7fd25c100050 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.722+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c1a0390 con 0x7fd25c100050 2024-02-14T13:08:24.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.723+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c1091f0 con 0x7fd25c100050 2024-02-14T13:08:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.724+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fd2500104f0 con 0x7fd25c100050 2024-02-14T13:08:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.725+0000 7fd2609df700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2440a2150 0x7fd2440a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:24.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.725+0000 7fd25a7fc700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2440a2150 0x7fd2440a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.725+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd2500cdac0 con 0x7fd25c100050 2024-02-14T13:08:24.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.725+0000 7fd25a7fc700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2440a2150 0x7fd2440a4610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd24c003790 tx=0x7fd24c005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:24.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.728+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd250096a70 con 0x7fd25c100050 2024-02-14T13:08:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.941+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd25c02da30 con 0x7fd2440a2150 2024-02-14T13:08:24.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.947+0000 7fd2609df700 1 -- 172.21.15.12:0/3211744000 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fd25c02da30 con 0x7fd2440a2150 2024-02-14T13:08:24.950 INFO:teuthology.orchestra.run.smithi012.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-14T13:08:24.950 INFO:teuthology.orchestra.run.smithi012.stdout:mds.all 12/12 34s ago 2m smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi055=b;smithi055=e;smithi055=h;smithi055=k;smithi103=c;smithi103=f;smithi103=i;smithi103=l;count:12 2024-02-14T13:08:24.950 INFO:teuthology.orchestra.run.smithi012.stdout:mgr 3/3 34s ago 7m smithi012=x;smithi055=y;smithi103=z;count:3 2024-02-14T13:08:24.950 INFO:teuthology.orchestra.run.smithi012.stdout:mon 3/3 34s ago 7m smithi012:172.21.15.12=a;smithi055:172.21.15.55=b;smithi103:172.21.15.103=c;count:3 2024-02-14T13:08:24.950 INFO:teuthology.orchestra.run.smithi012.stdout:osd 12 34s ago - 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2440a2150 msgr2=0x7fd2440a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2440a2150 0x7fd2440a4610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd24c003790 tx=0x7fd24c005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 msgr2=0x7fd25c197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 0x7fd25c197dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd25000b530 tx=0x7fd25000b840 comp rx=0 tx=0).stop 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 shutdown_connections 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd25c1039d0 0x7fd25c19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd2440a2150 0x7fd2440a4610 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd25c100050 0x7fd25c197dc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 --2- 172.21.15.12:0/3211744000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd25c103030 0x7fd25c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 >> 172.21.15.12:0/3211744000 conn(0x7fd25c0fb9b0 msgr2=0x7fd25c106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 shutdown_connections 2024-02-14T13:08:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:24.950+0000 7fd2619e1700 1 -- 172.21.15.12:0/3211744000 wait complete. 2024-02-14T13:08:25.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-14T13:08:25.855 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:26.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:26 smithi012 ceph-mon[32370]: pgmap v337: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:26.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:26 smithi012 ceph-mon[32370]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:26.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:26 smithi103 ceph-mon[36921]: pgmap v337: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:26.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:26 smithi103 ceph-mon[36921]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:26 smithi055 ceph-mon[36853]: pgmap v337: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:26 smithi055 ceph-mon[36853]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:27.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 -- 172.21.15.12:0/96494499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 msgr2=0x7ff0bc1033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:27.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 --2- 172.21.15.12:0/96494499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc1033d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00099c0 tx=0x7ff0b0009cd0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 -- 172.21.15.12:0/96494499 shutdown_connections 2024-02-14T13:08:27.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 --2- 172.21.15.12:0/96494499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0bc103910 0x7ff0bc10a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 --2- 172.21.15.12:0/96494499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0bc101d70 0x7ff0bc102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 --2- 172.21.15.12:0/96494499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc1033d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 -- 172.21.15.12:0/96494499 >> 172.21.15.12:0/96494499 conn(0x7ff0bc0fd2d0 msgr2=0x7ff0bc0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 -- 172.21.15.12:0/96494499 shutdown_connections 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.513+0000 7ff0c4791700 1 -- 172.21.15.12:0/96494499 wait complete. 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 Processor -- start 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 -- start start 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0bc101d70 0x7ff0bc197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0bc103910 0x7ff0bc19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc19f960 con 0x7ff0bc102f70 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc19faa0 con 0x7ff0bc101d70 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c4791700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc19fc30 con 0x7ff0bc103910 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48124/0 (socket says 172.21.15.12:48124) 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 -- 172.21.15.12:0/3419152287 learned_addr learned my addr 172.21.15.12:0/3419152287 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c252d700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0bc101d70 0x7ff0bc197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 -- 172.21.15.12:0/3419152287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0bc103910 msgr2=0x7ff0bc19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c2d2e700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0bc103910 0x7ff0bc19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0bc103910 0x7ff0bc19f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 -- 172.21.15.12:0/3419152287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0bc101d70 msgr2=0x7ff0bc197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0bc101d70 0x7ff0bc197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.514+0000 7ff0c1d2c700 1 -- 172.21.15.12:0/3419152287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00095f0 con 0x7ff0bc102f70 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.515+0000 7ff0c1d2c700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc198310 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0005910 tx=0x7ff0b00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.515+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b001d070 con 0x7ff0bc102f70 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.515+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc19feb0 con 0x7ff0bc102f70 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.515+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff0b0022470 con 0x7ff0bc102f70 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.515+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000f6c0 con 0x7ff0bc102f70 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.515+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc1a0340 con 0x7ff0bc102f70 2024-02-14T13:08:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.516+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc109130 con 0x7ff0bc102f70 2024-02-14T13:08:27.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.517+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff0b00225e0 con 0x7ff0bc102f70 2024-02-14T13:08:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.517+0000 7ff0bb7fe700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff0a40a2150 0x7ff0a40a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.517+0000 7ff0c252d700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff0a40a2150 0x7ff0a40a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.517+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff0b00cf210 con 0x7ff0bc102f70 2024-02-14T13:08:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.518+0000 7ff0c252d700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff0a40a2150 0x7ff0a40a4610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc102dd0 tx=0x7ff0ac00d040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.522+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff0b005dd20 con 0x7ff0bc102f70 2024-02-14T13:08:27.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.733+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0bc02da30 con 0x7ff0a40a2150 2024-02-14T13:08:27.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.735+0000 7ff0bb7fe700 1 -- 172.21.15.12:0/3419152287 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7ff0bc02da30 con 0x7ff0a40a2150 2024-02-14T13:08:27.737 INFO:teuthology.orchestra.run.smithi012.stdout:HOST ADDR LABELS STATUS 2024-02-14T13:08:27.737 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 172.21.15.12 2024-02-14T13:08:27.737 INFO:teuthology.orchestra.run.smithi012.stdout:smithi055 172.21.15.55 2024-02-14T13:08:27.737 INFO:teuthology.orchestra.run.smithi012.stdout:smithi103 172.21.15.103 2024-02-14T13:08:27.737 INFO:teuthology.orchestra.run.smithi012.stdout:3 hosts in cluster 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff0a40a2150 msgr2=0x7ff0a40a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff0a40a2150 0x7ff0a40a4610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc102dd0 tx=0x7ff0ac00d040 comp rx=0 tx=0).stop 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 msgr2=0x7ff0bc198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc198310 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0005910 tx=0x7ff0b00047b0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 shutdown_connections 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0bc103910 0x7ff0bc19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0bc101d70 0x7ff0bc197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff0a40a2150 0x7ff0a40a4610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 --2- 172.21.15.12:0/3419152287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0bc102f70 0x7ff0bc198310 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 >> 172.21.15.12:0/3419152287 conn(0x7ff0bc0fd2d0 msgr2=0x7ff0bc106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 shutdown_connections 2024-02-14T13:08:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:27.737+0000 7ff0c4791700 1 -- 172.21.15.12:0/3419152287 wait complete. 2024-02-14T13:08:28.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:28 smithi012 ceph-mon[32370]: pgmap v338: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:28.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:28 smithi103 ceph-mon[36921]: pgmap v338: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:28.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-14T13:08:28.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:28 smithi055 ceph-mon[36853]: pgmap v338: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:28.776 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:29.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:29 smithi012 ceph-mon[32370]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:29.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:29 smithi103 ceph-mon[36921]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:29.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:29 smithi055 ceph-mon[36853]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:30.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 -- 172.21.15.12:0/3230659575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 msgr2=0x7f51d8102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:30.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 --2- 172.21.15.12:0/3230659575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8102360 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009990 tx=0x7f51cc009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 -- 172.21.15.12:0/3230659575 shutdown_connections 2024-02-14T13:08:30.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 --2- 172.21.15.12:0/3230659575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d81028a0 0x7f51d8109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 --2- 172.21.15.12:0/3230659575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81011c0 0x7f51d81015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 --2- 172.21.15.12:0/3230659575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8102360 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 -- 172.21.15.12:0/3230659575 >> 172.21.15.12:0/3230659575 conn(0x7f51d80fb9c0 msgr2=0x7f51d80fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:30.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 -- 172.21.15.12:0/3230659575 shutdown_connections 2024-02-14T13:08:30.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 -- 172.21.15.12:0/3230659575 wait complete. 2024-02-14T13:08:30.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.350+0000 7f51ddda7700 1 Processor -- start 2024-02-14T13:08:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 -- start start 2024-02-14T13:08:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d81011c0 0x7f51d8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81028a0 0x7f51d819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d819f990 con 0x7f51d8101ee0 2024-02-14T13:08:30.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d819fad0 con 0x7f51d81011c0 2024-02-14T13:08:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51ddda7700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d819fc60 con 0x7f51d81028a0 2024-02-14T13:08:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48142/0 (socket says 172.21.15.12:48142) 2024-02-14T13:08:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 -- 172.21.15.12:0/2862985249 learned_addr learned my addr 172.21.15.12:0/2862985249 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:30.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d77fe700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d81011c0 0x7f51d8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d7fff700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81028a0 0x7f51d819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 -- 172.21.15.12:0/2862985249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81028a0 msgr2=0x7f51d819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81028a0 0x7f51d819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 -- 172.21.15.12:0/2862985249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d81011c0 msgr2=0x7f51d8197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d81011c0 0x7f51d8197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 -- 172.21.15.12:0/2862985249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0095f0 con 0x7f51d8101ee0 2024-02-14T13:08:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d7fff700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81028a0 0x7f51d819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.351+0000 7f51d6ffd700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8198340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00b2e0 tx=0x7f51cc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.352+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc01d070 con 0x7f51d8101ee0 2024-02-14T13:08:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.352+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f51cc021410 con 0x7f51d8101ee0 2024-02-14T13:08:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.352+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d819fee0 con 0x7f51d8101ee0 2024-02-14T13:08:30.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.352+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc017650 con 0x7f51d8101ee0 2024-02-14T13:08:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.352+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d81a02c0 con 0x7f51d8101ee0 2024-02-14T13:08:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.353+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d810c6a0 con 0x7f51d8101ee0 2024-02-14T13:08:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.354+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f51cc021910 con 0x7f51d8101ee0 2024-02-14T13:08:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.354+0000 7f51d4ff9700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f51c00a2150 0x7f51c00a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.354+0000 7f51d77fe700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f51c00a2150 0x7f51c00a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:30.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.354+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f51cc0cef30 con 0x7f51d8101ee0 2024-02-14T13:08:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.355+0000 7f51d77fe700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f51c00a2150 0x7f51c00a4610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51d8069fb0 tx=0x7f51c8009190 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.359+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f51cc05cd20 con 0x7f51d8101ee0 2024-02-14T13:08:30.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:30 smithi012 ceph-mon[32370]: pgmap v339: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:30.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:30 smithi103 ceph-mon[36921]: pgmap v339: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:30.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:30 smithi055 ceph-mon[36853]: pgmap v339: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:30.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.569+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 --> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f51d80fdb00 con 0x7f51c00a2150 2024-02-14T13:08:30.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.570+0000 7f51d4ff9700 1 -- 172.21.15.12:0/2862985249 <== mgr.14148 v2:172.21.15.12:6800/1684027624 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f51d80fdb00 con 0x7f51c00a2150 2024-02-14T13:08:30.572 INFO:teuthology.orchestra.run.smithi012.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-14T13:08:30.572 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005J400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-02-14T13:08:30.572 INFO:teuthology.orchestra.run.smithi012.stdout:smithi055 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102VS4P0KGN 3726G No 2m ago Has a FileSystem, LVM detected 2024-02-14T13:08:30.573 INFO:teuthology.orchestra.run.smithi012.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f51c00a2150 msgr2=0x7f51c00a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f51c00a2150 0x7f51c00a4610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51d8069fb0 tx=0x7f51c8009190 comp rx=0 tx=0).stop 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 msgr2=0x7f51d8198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8198340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00b2e0 tx=0x7f51cc009580 comp rx=0 tx=0).stop 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 shutdown_connections 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51d81028a0 0x7f51d819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d81011c0 0x7f51d8197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f51c00a2150 0x7f51c00a4610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 --2- 172.21.15.12:0/2862985249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51d8101ee0 0x7f51d8198340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 >> 172.21.15.12:0/2862985249 conn(0x7f51d80fb9c0 msgr2=0x7f51d80fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:30.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 shutdown_connections 2024-02-14T13:08:30.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:30.573+0000 7f51ddda7700 1 -- 172.21.15.12:0/2862985249 wait complete. 2024-02-14T13:08:31.350 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-14T13:08:31.360 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T13:08:31.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-14T13:08:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:32.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:32 smithi012 ceph-mon[32370]: pgmap v340: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:32.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:32 smithi012 ceph-mon[32370]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:32 smithi103 ceph-mon[36921]: pgmap v340: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:32 smithi103 ceph-mon[36921]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:32.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:32 smithi055 ceph-mon[36853]: pgmap v340: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:32.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:32 smithi055 ceph-mon[36853]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-14T13:08:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 -- 172.21.15.12:0/1643220695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c41027e0 msgr2=0x7fc4c4104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/1643220695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c41027e0 0x7fc4c4104bd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009990 tx=0x7fc4b4009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 -- 172.21.15.12:0/1643220695 shutdown_connections 2024-02-14T13:08:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/1643220695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4c4107a40 0x7fc4c4109eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/1643220695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c41027e0 0x7fc4c4104bd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/1643220695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c4105110 0x7fc4c4107500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 -- 172.21.15.12:0/1643220695 >> 172.21.15.12:0/1643220695 conn(0x7fc4c40fc1f0 msgr2=0x7fc4c40fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 -- 172.21.15.12:0/1643220695 shutdown_connections 2024-02-14T13:08:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.126+0000 7fc4c9c25700 1 -- 172.21.15.12:0/1643220695 wait complete. 2024-02-14T13:08:33.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 Processor -- start 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 -- start start 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c41027e0 0x7fc4c4102140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 0x7fc4c4100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4c4107a40 0x7fc4c4100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c4101450 con 0x7fc4c4105110 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41015c0 con 0x7fc4c41027e0 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c9c25700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41a1e50 con 0x7fc4c4107a40 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 0x7fc4c4100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 0x7fc4c4100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48158/0 (socket says 172.21.15.12:48158) 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c2ffd700 1 -- 172.21.15.12:0/2371996447 learned_addr learned my addr 172.21.15.12:0/2371996447 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c37fe700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c41027e0 0x7fc4c4102140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.127+0000 7fc4c3fff700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4c4107a40 0x7fc4c4100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c2ffd700 1 -- 172.21.15.12:0/2371996447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4c4107a40 msgr2=0x7fc4c4100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c2ffd700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4c4107a40 0x7fc4c4100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c2ffd700 1 -- 172.21.15.12:0/2371996447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c41027e0 msgr2=0x7fc4c4102140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c2ffd700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c41027e0 0x7fc4c4102140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c2ffd700 1 -- 172.21.15.12:0/2371996447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b40095f0 con 0x7fc4c4105110 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c2ffd700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 0x7fc4c4100790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800b530 tx=0x7fc4b800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8011830 con 0x7fc4c4105110 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc4b8011e70 con 0x7fc4c4105110 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c41a2130 con 0x7fc4c4105110 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800f340 con 0x7fc4c4105110 2024-02-14T13:08:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.128+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c41a26b0 con 0x7fc4c4105110 2024-02-14T13:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.129+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c40fdd70 con 0x7fc4c4105110 2024-02-14T13:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.130+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fc4b80106d0 con 0x7fc4c4105110 2024-02-14T13:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.131+0000 7fc4c0ff9700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4ac0a2150 0x7fc4ac0a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.131+0000 7fc4c37fe700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4ac0a2150 0x7fc4ac0a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.131+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc4b80cd8a0 con 0x7fc4c4105110 2024-02-14T13:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.131+0000 7fc4c37fe700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4ac0a2150 0x7fc4ac0a4610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b5c0 tx=0x7fc4b4003860 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.135+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc4b80967f0 con 0x7fc4c4105110 2024-02-14T13:08:33.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.383+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4c40fd750 con 0x7fc4c4105110 2024-02-14T13:08:33.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.383+0000 7fc4c0ff9700 1 -- 172.21.15.12:0/2371996447 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+2905 (secure 0 0 0) 0x7fc4b8015b70 con 0x7fc4c4105110 2024-02-14T13:08:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:e18 2024-02-14T13:08:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-14T13:08:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:legacy client fscid: 1 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:Filesystem 'cephfs' (1) 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:fs_name cephfs 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 18 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-02-14T13:06:49.142270+0000 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-02-14T13:06:52.178143+0000 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:tableserver 0 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:root 0 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:session_timeout 300 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:session_autoclose 300 2024-02-14T13:08:33.386 INFO:teuthology.orchestra.run.smithi012.stdout:max_file_size 1099511627776 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:max_xattr_size 65536 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:required_client_features {} 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure 0 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure_osd_epoch 0 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:max_mds 1 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:in 0 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:up {0=24505} 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:failed 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:damaged 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:stopped 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:data_pools [3] 2024-02-14T13:08:33.387 INFO:teuthology.orchestra.run.smithi012.stdout:metadata_pool 2 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:inline_data disabled 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:balancer 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:bal_rank_mask -1 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:standby_count_wanted 0 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.i{0:24505} state up:active seq 5 addr [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b{0:24503} state up:standby-replay seq 1 addr [v2:172.21.15.55:6838/3549809563,v1:172.21.15.55:6839/3549809563] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:Standby daemons: 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:33.388 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.12:6834/4009779912,v1:172.21.15.12:6835/4009779912] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.12:6836/186215076,v1:172.21.15.12:6837/186215076] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.g{-1:14604} state up:standby seq 1 addr [v2:172.21.15.12:6838/1039817926,v1:172.21.15.12:6839/1039817926] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a{-1:14616} state up:standby seq 1 addr [v2:172.21.15.12:6840/2782336879,v1:172.21.15.12:6841/2782336879] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.k{-1:24410} state up:standby seq 1 addr [v2:172.21.15.55:6832/3784712131,v1:172.21.15.55:6833/3784712131] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.l{-1:24430} state up:standby seq 1 addr [v2:172.21.15.103:6832/11363714,v1:172.21.15.103:6833/11363714] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e{-1:24449} state up:standby seq 1 addr [v2:172.21.15.55:6834/403501220,v1:172.21.15.55:6835/403501220] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.h{-1:24470} state up:standby seq 1 addr [v2:172.21.15.55:6836/3553342942,v1:172.21.15.55:6837/3553342942] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f{-1:24481} state up:standby seq 1 addr [v2:172.21.15.103:6834/3937333390,v1:172.21.15.103:6835/3937333390] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.389 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c{-1:24493} state up:standby seq 1 addr [v2:172.21.15.103:6836/2795037448,v1:172.21.15.103:6837/2795037448] compat {c=[1],r=[1],i=[fff]}] 2024-02-14T13:08:33.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4ac0a2150 msgr2=0x7fc4ac0a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:33.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4ac0a2150 0x7fc4ac0a4610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b5c0 tx=0x7fc4b4003860 comp rx=0 tx=0).stop 2024-02-14T13:08:33.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 msgr2=0x7fc4c4100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:33.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 0x7fc4c4100790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800b530 tx=0x7fc4b800b840 comp rx=0 tx=0).stop 2024-02-14T13:08:33.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 shutdown_connections 2024-02-14T13:08:33.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4c4107a40 0x7fc4c4100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4c41027e0 0x7fc4c4102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4ac0a2150 0x7fc4ac0a4610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 --2- 172.21.15.12:0/2371996447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4c4105110 0x7fc4c4100790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 >> 172.21.15.12:0/2371996447 conn(0x7fc4c40fc1f0 msgr2=0x7fc4c41030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 shutdown_connections 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:33.385+0000 7fc4c9c25700 1 -- 172.21.15.12:0/2371996447 wait complete. 2024-02-14T13:08:33.391 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:08:34.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- bash -c 'ceph osd dump' 2024-02-14T13:08:34.289 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:34.410 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:34 smithi012 ceph-mon[32370]: pgmap v341: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:34.410 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:34 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2371996447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-14T13:08:34.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:34 smithi103 ceph-mon[36921]: pgmap v341: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:34.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:34 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2371996447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-14T13:08:34.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:34 smithi055 ceph-mon[36853]: pgmap v341: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:08:34.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:34 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2371996447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-14T13:08:36.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 -- 172.21.15.12:0/974108151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c101d80 msgr2=0x7f1c0c1021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:36.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 --2- 172.21.15.12:0/974108151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c101d80 0x7f1c0c1021a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0099c0 tx=0x7f1bfc009cd0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 -- 172.21.15.12:0/974108151 shutdown_connections 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 --2- 172.21.15.12:0/974108151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c103920 0x7f1c0c10a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 --2- 172.21.15.12:0/974108151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c101d80 0x7f1c0c1021a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 --2- 172.21.15.12:0/974108151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0c102f80 0x7f1c0c1033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 -- 172.21.15.12:0/974108151 >> 172.21.15.12:0/974108151 conn(0x7f1c0c0fd320 msgr2=0x7f1c0c0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 -- 172.21.15.12:0/974108151 shutdown_connections 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.015+0000 7f1c12505700 1 -- 172.21.15.12:0/974108151 wait complete. 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 Processor -- start 2024-02-14T13:08:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 -- start start 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c101d80 0x7f1c0c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0c102f80 0x7f1c0c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 0x7f1c0c19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c19f960 con 0x7f1c0c103920 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c19faa0 con 0x7f1c0c102f80 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c12505700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c19fc30 con 0x7f1c0c101d80 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 0x7f1c0c19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 0x7f1c0c19f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60414/0 (socket says 172.21.15.12:60414) 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 -- 172.21.15.12:0/3293290206 learned_addr learned my addr 172.21.15.12:0/3293290206 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c0b7fe700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0c102f80 0x7f1c0c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c0bfff700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c101d80 0x7f1c0c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 -- 172.21.15.12:0/3293290206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c101d80 msgr2=0x7f1c0c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c101d80 0x7f1c0c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 -- 172.21.15.12:0/3293290206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0c102f80 msgr2=0x7f1c0c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0c102f80 0x7f1c0c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c10aa2700 1 -- 172.21.15.12:0/3293290206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0095f0 con 0x7f1c0c103920 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.016+0000 7f1c0bfff700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c101d80 0x7f1c0c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.017+0000 7f1c10aa2700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 0x7f1c0c19f390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400b9a0 tx=0x7f1c0400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.017+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400c930 con 0x7f1c0c103920 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.017+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1c04014440 con 0x7f1c0c103920 2024-02-14T13:08:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.017+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c040075d0 con 0x7f1c0c103920 2024-02-14T13:08:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.017+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c19ff10 con 0x7f1c0c103920 2024-02-14T13:08:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.017+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c1a03b0 con 0x7f1c0c103920 2024-02-14T13:08:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.018+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c109140 con 0x7f1c0c103920 2024-02-14T13:08:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.019+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f1c04014920 con 0x7f1c0c103920 2024-02-14T13:08:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.019+0000 7f1c097fa700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1bf40a2150 0x7f1bf40a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.020+0000 7f1c0bfff700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1bf40a2150 0x7f1bf40a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.020+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1c04006e40 con 0x7f1c0c103920 2024-02-14T13:08:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.020+0000 7f1c0bfff700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1bf40a2150 0x7f1bf40a4610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0038c0 tx=0x7f1bfc000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.024+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c040962b0 con 0x7f1c0c103920 2024-02-14T13:08:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.229+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f1c0c068a30 con 0x7f1c0c103920 2024-02-14T13:08:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.229+0000 7f1c097fa700 1 -- 172.21.15.12:0/3293290206 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) v1 ==== 56+0+5299 (secure 0 0 0) 0x7f1c040145b0 con 0x7f1c0c103920 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 89 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:fsid ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-02-14T12:58:53.704063+0000 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-02-14T13:07:49.983197+0000 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:crush_version 26 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:full_ratio 0.95 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:backfillfull_ratio 0.9 2024-02-14T13:08:36.232 INFO:teuthology.orchestra.run.smithi012.stdout:nearfull_ratio 0.85 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:require_min_compat_client luminous 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:min_compat_client luminous 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:require_osd_release squid 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:stretch_mode_enabled false 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 87 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:max_osd 12 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6802/389227292,v1:172.21.15.12:6803/389227292] [v2:172.21.15.12:6804/389227292,v1:172.21.15.12:6805/389227292] exists,up baab6740-5c44-4b37-a37b-47e3bc605f46 2024-02-14T13:08:36.233 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6800/2858711523,v1:172.21.15.55:6801/2858711523] [v2:172.21.15.55:6802/2858711523,v1:172.21.15.55:6803/2858711523] exists,up 578b4ffb-958f-47ee-b59c-174e3c36865b 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6800/3794024283,v1:172.21.15.103:6801/3794024283] [v2:172.21.15.103:6802/3794024283,v1:172.21.15.103:6803/3794024283] exists,up fa0a5301-f06a-43e3-9451-a8991fda5a4f 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 up in weight 1 up_from 27 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6810/95002866,v1:172.21.15.12:6811/95002866] [v2:172.21.15.12:6812/95002866,v1:172.21.15.12:6813/95002866] exists,up abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 up in weight 1 up_from 35 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6808/59815868,v1:172.21.15.55:6809/59815868] [v2:172.21.15.55:6810/59815868,v1:172.21.15.55:6811/59815868] exists,up aab18809-48a8-4c56-b06a-fc56396a0246 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 up in weight 1 up_from 40 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6808/67358017,v1:172.21.15.103:6809/67358017] [v2:172.21.15.103:6810/67358017,v1:172.21.15.103:6811/67358017] exists,up 04b0e92e-887f-4551-a3b8-a0df3d9de9a6 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 up in weight 1 up_from 48 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6818/677900962,v1:172.21.15.12:6819/677900962] [v2:172.21.15.12:6820/677900962,v1:172.21.15.12:6821/677900962] exists,up 6290f434-6daf-4e1f-b599-8478726c0696 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 up in weight 1 up_from 53 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6816/4145865981,v1:172.21.15.55:6817/4145865981] [v2:172.21.15.55:6818/4145865981,v1:172.21.15.55:6819/4145865981] exists,up 60c4850a-411e-4fbf-944d-9c9530ae5dcf 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 up in weight 1 up_from 61 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6816/1363317081,v1:172.21.15.103:6817/1363317081] [v2:172.21.15.103:6818/1363317081,v1:172.21.15.103:6819/1363317081] exists,up c3da844e-9ab0-422d-89da-3d369ed494a5 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 up in weight 1 up_from 69 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6826/4020892296,v1:172.21.15.12:6827/4020892296] [v2:172.21.15.12:6828/4020892296,v1:172.21.15.12:6829/4020892296] exists,up 220ec4cc-7468-4e46-aada-4e4edeb7bcb2 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 up in weight 1 up_from 74 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.55:6824/3825680100,v1:172.21.15.55:6825/3825680100] [v2:172.21.15.55:6826/3825680100,v1:172.21.15.55:6827/3825680100] exists,up 7c9ebf61-379a-4730-a7da-9f031671d4af 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 up in weight 1 up_from 82 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6824/4052235474,v1:172.21.15.103:6825/4052235474] [v2:172.21.15.103:6826/4052235474,v1:172.21.15.103:6827/4052235474] exists,up 5bc702e3-9dd4-469c-8d35-1addfce5dbf3 2024-02-14T13:08:36.234 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.0 [7,11] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.10 [2,4] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1a [8,4] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1c [8,11] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1d [2,1] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.6 [4,6] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.17 [4,8] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.2d [3,9] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.36 [4,9] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.39 [5,8] 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/3839639122 expires 2024-02-15T12:59:48.272127+0000 2024-02-14T13:08:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/305486509 expires 2024-02-15T12:59:48.272127+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2684526403 expires 2024-02-15T12:59:48.272127+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/955464513 expires 2024-02-15T12:59:48.272127+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/2867303975 expires 2024-02-15T12:59:21.651055+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/1478984094 expires 2024-02-15T12:59:21.651055+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/3222670253 expires 2024-02-15T12:59:21.651055+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1960111540 expires 2024-02-15T12:59:21.651055+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/1478984094 expires 2024-02-15T12:59:21.651055+0000 2024-02-14T13:08:36.236 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/955464513 expires 2024-02-15T12:59:48.272127+0000 2024-02-14T13:08:36.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.231+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1bf40a2150 msgr2=0x7f1bf40a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:36.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.231+0000 7f1c12505700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1bf40a2150 0x7f1bf40a4610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0038c0 tx=0x7f1bfc000bc0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.231+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 msgr2=0x7f1c0c19f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:36.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.231+0000 7f1c12505700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 0x7f1c0c19f390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400b9a0 tx=0x7f1c0400bcb0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 shutdown_connections 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f1bf40a2150 0x7f1bf40a4610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c103920 0x7f1c0c19f390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c0c101d80 0x7f1c0c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 --2- 172.21.15.12:0/3293290206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0c102f80 0x7f1c0c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 >> 172.21.15.12:0/3293290206 conn(0x7f1c0c0fd320 msgr2=0x7f1c0c106280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 shutdown_connections 2024-02-14T13:08:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:36.232+0000 7f1c12505700 1 -- 172.21.15.12:0/3293290206 wait complete. 2024-02-14T13:08:36.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:36 smithi012 ceph-mon[32370]: pgmap v342: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:36.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:36 smithi103 ceph-mon[36921]: pgmap v342: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:36.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:36 smithi055 ceph-mon[36853]: pgmap v342: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:36.903 INFO:teuthology.run_tasks:Running task fs.ready... 2024-02-14T13:08:36.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/1804921160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101d00 msgr2=0x7fd1e8108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/1804921160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101d00 0x7fd1e8108590 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009ca0 tx=0x7fd1e002c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/1804921160 shutdown_connections 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/1804921160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101d00 0x7fd1e8108590 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/1804921160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8101340 0x7fd1e81017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/1804921160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8100150 0x7fd1e8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/1804921160 >> 172.21.15.12:0/1804921160 conn(0x7fd1e80fb6c0 msgr2=0x7fd1e80fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/1804921160 shutdown_connections 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.020+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/1804921160 wait complete. 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 Processor -- start 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 -- start start 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8100150 0x7fd1e810aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 0x7fd1e8109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8101d00 0x7fd1e8109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8109cf0 con 0x7fd1e8101340 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8109e60 con 0x7fd1e8101d00 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1ed7b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81a13f0 con 0x7fd1e8100150 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 0x7fd1e8109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 0x7fd1e8109050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60434/0 (socket says 172.21.15.12:60434) 2024-02-14T13:08:37.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 -- 172.21.15.12:0/4267774592 learned_addr learned my addr 172.21.15.12:0/4267774592 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1e77fe640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8101d00 0x7fd1e8109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1e6ffd640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8100150 0x7fd1e810aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 -- 172.21.15.12:0/4267774592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8100150 msgr2=0x7fd1e810aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8100150 0x7fd1e810aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 -- 172.21.15.12:0/4267774592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8101d00 msgr2=0x7fd1e8109590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8101d00 0x7fd1e8109590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1dffff640 1 -- 172.21.15.12:0/4267774592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0009900 con 0x7fd1e8101340 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.021+0000 7fd1e77fe640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8101d00 0x7fd1e8109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.022+0000 7fd1dffff640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 0x7fd1e8109050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b4d0 tx=0x7fd1d000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.022+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0010870 con 0x7fd1e8101340 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.022+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fd1d000f3c0 con 0x7fd1e8101340 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.022+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e81a16a0 con 0x7fd1e8101340 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.022+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00175c0 con 0x7fd1e8101340 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.022+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e81a1c30 con 0x7fd1e8101340 2024-02-14T13:08:37.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.023+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8107410 con 0x7fd1e8101340 2024-02-14T13:08:37.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.024+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fd1d000f8c0 con 0x7fd1e8101340 2024-02-14T13:08:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.025+0000 7fd1e4ff9640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd1d40a2140 0x7fd1d40a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.025+0000 7fd1e6ffd640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd1d40a2140 0x7fd1d40a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.025+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd1d00cdb60 con 0x7fd1e8101340 2024-02-14T13:08:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.025+0000 7fd1e6ffd640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd1d40a2140 0x7fd1d40a4600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd1e81011a0 tx=0x7fd1d8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.028+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd1d0096ab0 con 0x7fd1e8101340 2024-02-14T13:08:37.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.211+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1e810cd40 con 0x7fd1e8101340 2024-02-14T13:08:37.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.213+0000 7fd1e4ff9640 1 -- 172.21.15.12:0/4267774592 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22638 (secure 0 0 0) 0x7fd1d009a170 con 0x7fd1e8101340 2024-02-14T13:08:37.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:37.215 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:07:49.983197+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:08:37.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.214+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd1d40a2140 msgr2=0x7fd1d40a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.214+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd1d40a2140 0x7fd1d40a4600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd1e81011a0 tx=0x7fd1d8008040 comp rx=0 tx=0).stop 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.214+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 msgr2=0x7fd1e8109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.214+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 0x7fd1e8109050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b4d0 tx=0x7fd1d000b990 comp rx=0 tx=0).stop 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 shutdown_connections 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fd1d40a2140 0x7fd1d40a4600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e8101d00 0x7fd1e8109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd1e8101340 0x7fd1e8109050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 --2- 172.21.15.12:0/4267774592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1e8100150 0x7fd1e810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 >> 172.21.15.12:0/4267774592 conn(0x7fd1e80fb6c0 msgr2=0x7fd1e81045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 shutdown_connections 2024-02-14T13:08:37.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.215+0000 7fd1ed7b5640 1 -- 172.21.15.12:0/4267774592 wait complete. 2024-02-14T13:08:37.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-14T13:06:47.668699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-14T13:06:48.352208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:08:37.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 -- 172.21.15.12:0/2397083490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101340 msgr2=0x7f3c201017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 --2- 172.21.15.12:0/2397083490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101340 0x7f3c201017c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009900 tx=0x7f3c0802bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 -- 172.21.15.12:0/2397083490 shutdown_connections 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 --2- 172.21.15.12:0/2397083490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c20101d00 0x7f3c20108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 --2- 172.21.15.12:0/2397083490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101340 0x7f3c201017c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 --2- 172.21.15.12:0/2397083490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 0x7f3c20100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 -- 172.21.15.12:0/2397083490 >> 172.21.15.12:0/2397083490 conn(0x7f3c200fb6e0 msgr2=0x7f3c200fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 -- 172.21.15.12:0/2397083490 shutdown_connections 2024-02-14T13:08:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 -- 172.21.15.12:0/2397083490 wait complete. 2024-02-14T13:08:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 Processor -- start 2024-02-14T13:08:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.332+0000 7f3c2484e640 1 -- start start 2024-02-14T13:08:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 0x7f3c201994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c20101340 0x7f3c201999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 0x7f3c201a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201a0fa0 con 0x7f3c20101d00 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201a1110 con 0x7f3c20101340 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201a12d0 con 0x7f3c20100150 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 0x7f3c201a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 0x7f3c201a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60448/0 (socket says 172.21.15.12:60448) 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 -- 172.21.15.12:0/453914053 learned_addr learned my addr 172.21.15.12:0/453914053 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1dd9b640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c20101340 0x7f3c201999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1e59c640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 0x7f3c201994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 -- 172.21.15.12:0/453914053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 msgr2=0x7f3c201994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 0x7f3c201994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 -- 172.21.15.12:0/453914053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c20101340 msgr2=0x7f3c201999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c20101340 0x7f3c201999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 -- 172.21.15.12:0/453914053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009560 con 0x7f3c20101d00 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1e59c640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 0x7f3c201994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c1ed9d640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 0x7f3c201a0a60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c970 tx=0x7f3c1000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10007bb0 con 0x7f3c20101d00 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c201a15b0 con 0x7f3c20101d00 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3c10007d10 con 0x7f3c20101d00 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000f450 con 0x7f3c20101d00 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.333+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c201a1a40 con 0x7f3c20101d00 2024-02-14T13:08:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.334+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2010bb60 con 0x7f3c20101d00 2024-02-14T13:08:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.336+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f3c10004ee0 con 0x7f3c20101d00 2024-02-14T13:08:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.336+0000 7f3c177fe640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3c0c0a20c0 0x7f3c0c0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.336+0000 7f3c1e59c640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3c0c0a20c0 0x7f3c0c0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.336+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3c100cdda0 con 0x7f3c20101d00 2024-02-14T13:08:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.337+0000 7f3c1e59c640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3c0c0a20c0 0x7f3c0c0a4580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c201011a0 tx=0x7f3c18007870 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.340+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3c10096d50 con 0x7f3c20101d00 2024-02-14T13:08:37.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:37 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3293290206' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-14T13:08:37.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:37 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3293290206' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-14T13:08:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.521+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c201a1cc0 con 0x7f3c20101d00 2024-02-14T13:08:37.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.521+0000 7f3c177fe640 1 -- 172.21.15.12:0/453914053 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c201a1cc0 con 0x7f3c20101d00 2024-02-14T13:08:37.523 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:08:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3c0c0a20c0 msgr2=0x7f3c0c0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3c0c0a20c0 0x7f3c0c0a4580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c201011a0 tx=0x7f3c18007870 comp rx=0 tx=0).stop 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 msgr2=0x7f3c201a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 0x7f3c201a0a60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000c970 tx=0x7f3c1000ce30 comp rx=0 tx=0).stop 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 shutdown_connections 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3c0c0a20c0 0x7f3c0c0a4580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c20101d00 0x7f3c201a0a60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c20101340 0x7f3c201999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 --2- 172.21.15.12:0/453914053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c20100150 0x7f3c201994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 >> 172.21.15.12:0/453914053 conn(0x7f3c200fb6e0 msgr2=0x7f3c200fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 shutdown_connections 2024-02-14T13:08:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.523+0000 7f3c2484e640 1 -- 172.21.15.12:0/453914053 wait complete. 2024-02-14T13:08:37.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-14T13:08:37.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:37 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3293290206' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-14T13:08:37.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 -- 172.21.15.12:0/4045636258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d0102ea0 msgr2=0x7f05d0109730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/4045636258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d0102ea0 0x7f05d0109730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009ca0 tx=0x7f05c802c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 -- 172.21.15.12:0/4045636258 shutdown_connections 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/4045636258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d0102ea0 0x7f05d0109730 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/4045636258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05d01024e0 0x7f05d0102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/4045636258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d00ff510 0x7f05d00ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 -- 172.21.15.12:0/4045636258 >> 172.21.15.12:0/4045636258 conn(0x7f05d00fae60 msgr2=0x7f05d00fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 -- 172.21.15.12:0/4045636258 shutdown_connections 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.640+0000 7f05d4fc7640 1 -- 172.21.15.12:0/4045636258 wait complete. 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 Processor -- start 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 -- start start 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 0x7f05d0101e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d01024e0 0x7f05d0100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05d0102ea0 0x7f05d01009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0101130 con 0x7f05d00ff510 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01012a0 con 0x7f05d01024e0 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05d4fc7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01a13c0 con 0x7f05d0102ea0 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 0x7f05d0101e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 0x7f05d0101e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60458/0 (socket says 172.21.15.12:60458) 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 -- 172.21.15.12:0/2550302805 learned_addr learned my addr 172.21.15.12:0/2550302805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ced9d640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05d0102ea0 0x7f05d01009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05c5d9b640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d01024e0 0x7f05d0100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 -- 172.21.15.12:0/2550302805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05d0102ea0 msgr2=0x7f05d01009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05d0102ea0 0x7f05d01009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 -- 172.21.15.12:0/2550302805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d01024e0 msgr2=0x7f05d0100490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d01024e0 0x7f05d0100490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.641+0000 7f05ce59c640 1 -- 172.21.15.12:0/2550302805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8009900 con 0x7f05d00ff510 2024-02-14T13:08:37.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.642+0000 7f05ce59c640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 0x7f05d0101e50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f05c000b480 tx=0x7f05c000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.642+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0010870 con 0x7f05d00ff510 2024-02-14T13:08:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.642+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d01a1670 con 0x7f05d00ff510 2024-02-14T13:08:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.642+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f05c000f3c0 con 0x7f05d00ff510 2024-02-14T13:08:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.642+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c00175c0 con 0x7f05d00ff510 2024-02-14T13:08:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.642+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d01a1b80 con 0x7f05d00ff510 2024-02-14T13:08:37.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.643+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d01085b0 con 0x7f05d00ff510 2024-02-14T13:08:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.644+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f05c000f8c0 con 0x7f05d00ff510 2024-02-14T13:08:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.644+0000 7f05c7fff640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f05bc0a20c0 0x7f05bc0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.644+0000 7f05c5d9b640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f05bc0a20c0 0x7f05bc0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.644+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f05c00cd720 con 0x7f05d00ff510 2024-02-14T13:08:37.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.645+0000 7f05c5d9b640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f05bc0a20c0 0x7f05bc0a4580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f05b8005fd0 tx=0x7f05b8005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.649+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f05c0096760 con 0x7f05d00ff510 2024-02-14T13:08:37.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.828+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05d002cdb0 con 0x7f05d00ff510 2024-02-14T13:08:37.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.828+0000 7f05c7fff640 1 -- 172.21.15.12:0/2550302805 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05c0099e20 con 0x7f05d00ff510 2024-02-14T13:08:37.830 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.830+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f05bc0a20c0 msgr2=0x7f05bc0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.830+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f05bc0a20c0 0x7f05bc0a4580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f05b8005fd0 tx=0x7f05b8005850 comp rx=0 tx=0).stop 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.830+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 msgr2=0x7f05d0101e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.830+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 0x7f05d0101e50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f05c000b480 tx=0x7f05c000b940 comp rx=0 tx=0).stop 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 shutdown_connections 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f05bc0a20c0 0x7f05bc0a4580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05d0102ea0 0x7f05d01009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05d01024e0 0x7f05d0100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 --2- 172.21.15.12:0/2550302805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00ff510 0x7f05d0101e50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 >> 172.21.15.12:0/2550302805 conn(0x7f05d00fae60 msgr2=0x7f05d0105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 shutdown_connections 2024-02-14T13:08:37.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.831+0000 7f05d4fc7640 1 -- 172.21.15.12:0/2550302805 wait complete. 2024-02-14T13:08:37.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 -- 172.21.15.12:0/542594293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c102df0 msgr2=0x7f215c109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 --2- 172.21.15.12:0/542594293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c102df0 0x7f215c109680 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2154009ca0 tx=0x7f215402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 -- 172.21.15.12:0/542594293 shutdown_connections 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 --2- 172.21.15.12:0/542594293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c102df0 0x7f215c109680 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 --2- 172.21.15.12:0/542594293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c102430 0x7f215c1028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 --2- 172.21.15.12:0/542594293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f215c101240 0x7f215c101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 -- 172.21.15.12:0/542594293 >> 172.21.15.12:0/542594293 conn(0x7f215c0fc7d0 msgr2=0x7f215c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:37.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 -- 172.21.15.12:0/542594293 shutdown_connections 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.947+0000 7f21625c9640 1 -- 172.21.15.12:0/542594293 wait complete. 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 Processor -- start 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 -- start start 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 0x7f215c197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f215c102430 0x7f215c197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c102df0 0x7f215c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c19ee10 con 0x7f215c101240 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c19ef80 con 0x7f215c102df0 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f21625c9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c19f140 con 0x7f215c102430 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 0x7f215c197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 0x7f215c197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60478/0 (socket says 172.21.15.12:60478) 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215bfff640 1 -- 172.21.15.12:0/1681486918 learned_addr learned my addr 172.21.15.12:0/1681486918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215b7fe640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f215c102430 0x7f215c197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f2160b66640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c102df0 0x7f215c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215bfff640 1 -- 172.21.15.12:0/1681486918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f215c102430 msgr2=0x7f215c197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215bfff640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f215c102430 0x7f215c197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.948+0000 7f215bfff640 1 -- 172.21.15.12:0/1681486918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c102df0 msgr2=0x7f215c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f215bfff640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c102df0 0x7f215c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f215bfff640 1 -- 172.21.15.12:0/1681486918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154009900 con 0x7f215c101240 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f215bfff640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 0x7f215c197320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f214c00b450 tx=0x7f214c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c011890 con 0x7f215c101240 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f214c0103e0 con 0x7f215c101240 2024-02-14T13:08:37.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c19f420 con 0x7f215c101240 2024-02-14T13:08:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00f580 con 0x7f215c101240 2024-02-14T13:08:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.949+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c19f930 con 0x7f215c101240 2024-02-14T13:08:37.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.950+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c1085e0 con 0x7f215c101240 2024-02-14T13:08:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.951+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f214c0108e0 con 0x7f215c101240 2024-02-14T13:08:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.952+0000 7f21597fa640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f21480a20c0 0x7f21480a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.952+0000 7f215b7fe640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f21480a20c0 0x7f21480a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.952+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f214c0cdec0 con 0x7f215c101240 2024-02-14T13:08:37.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.952+0000 7f215b7fe640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f21480a20c0 0x7f21480a4580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f215c198830 tx=0x7f214400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:37.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:37.955+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f214c096e10 con 0x7f215c101240 2024-02-14T13:08:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.138+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f215c10ccb0 con 0x7f215c101240 2024-02-14T13:08:38.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.138+0000 7f21597fa640 1 -- 172.21.15.12:0/1681486918 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f214c09a4d0 con 0x7f215c101240 2024-02-14T13:08:38.143 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f21480a20c0 msgr2=0x7f21480a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f21480a20c0 0x7f21480a4580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f215c198830 tx=0x7f214400b390 comp rx=0 tx=0).stop 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 msgr2=0x7f215c197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 0x7f215c197320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f214c00b450 tx=0x7f214c00b910 comp rx=0 tx=0).stop 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 shutdown_connections 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f21480a20c0 0x7f21480a4580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f215c102df0 0x7f215c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f215c102430 0x7f215c197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 --2- 172.21.15.12:0/1681486918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f215c101240 0x7f215c197320 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 >> 172.21.15.12:0/1681486918 conn(0x7f215c0fc7d0 msgr2=0x7f215c1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 shutdown_connections 2024-02-14T13:08:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.140+0000 7f21625c9640 1 -- 172.21.15.12:0/1681486918 wait complete. 2024-02-14T13:08:38.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:08:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 -- 172.21.15.12:0/3598597545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 msgr2=0x7fac2c1028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 --2- 172.21.15.12:0/3598597545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c1028d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac20009900 tx=0x7fac2002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 -- 172.21.15.12:0/3598597545 shutdown_connections 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 --2- 172.21.15.12:0/3598597545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c102e10 0x7fac2c1096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 --2- 172.21.15.12:0/3598597545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c1028d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 --2- 172.21.15.12:0/3598597545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c101260 0x7fac2c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 -- 172.21.15.12:0/3598597545 >> 172.21.15.12:0/3598597545 conn(0x7fac2c0fc7d0 msgr2=0x7fac2c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 -- 172.21.15.12:0/3598597545 shutdown_connections 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.254+0000 7fac338c9640 1 -- 172.21.15.12:0/3598597545 wait complete. 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 Processor -- start 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 -- start start 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c101260 0x7fac2c074fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c102e10 0x7fac2c073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0742c0 con 0x7fac2c102450 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c074430 con 0x7fac2c102e10 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1a12e0 con 0x7fac2c101260 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60490/0 (socket says 172.21.15.12:60490) 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 -- 172.21.15.12:0/3044185404 learned_addr learned my addr 172.21.15.12:0/3044185404 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac31665640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c101260 0x7fac2c074fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac31e66640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c102e10 0x7fac2c073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 -- 172.21.15.12:0/3044185404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c101260 msgr2=0x7fac2c074fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c101260 0x7fac2c074fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 -- 172.21.15.12:0/3044185404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c102e10 msgr2=0x7fac2c073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c102e10 0x7fac2c073b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 -- 172.21.15.12:0/3044185404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009560 con 0x7fac2c102450 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac31665640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c101260 0x7fac2c074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac31e66640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c102e10 0x7fac2c073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac30e64640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c073620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fac20036040 tx=0x7fac200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200044e0 con 0x7fac2c102450 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fac200054e0 con 0x7fac2c102450 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.255+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c1a1530 con 0x7fac2c102450 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.256+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20003ec0 con 0x7fac2c102450 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.256+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c1a1a90 con 0x7fac2c102450 2024-02-14T13:08:38.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.257+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c108600 con 0x7fac2c102450 2024-02-14T13:08:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.258+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fac200035f0 con 0x7fac2c102450 2024-02-14T13:08:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.258+0000 7fac2a7fc640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fac140a2140 0x7fac140a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.258+0000 7fac31665640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fac140a2140 0x7fac140a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.258+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fac200efff0 con 0x7fac2c102450 2024-02-14T13:08:38.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.259+0000 7fac31665640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fac140a2140 0x7fac140a4600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac2c1022b0 tx=0x7fac24005d30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:38.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.262+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac200b9040 con 0x7fac2c102450 2024-02-14T13:08:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:38 smithi012 ceph-mon[32370]: pgmap v343: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/4267774592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/453914053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2550302805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1681486918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.482+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac2c108070 con 0x7fac2c102450 2024-02-14T13:08:38.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.483+0000 7fac2a7fc640 1 -- 172.21.15.12:0/3044185404 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7fac200bc700 con 0x7fac2c102450 2024-02-14T13:08:38.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:38.485 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:08:38.485 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:08:38.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fac140a2140 msgr2=0x7fac140a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fac140a2140 0x7fac140a4600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fac2c1022b0 tx=0x7fac24005d30 comp rx=0 tx=0).stop 2024-02-14T13:08:38.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 msgr2=0x7fac2c073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c073620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fac20036040 tx=0x7fac200042f0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 shutdown_connections 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fac140a2140 0x7fac140a4600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c102e10 0x7fac2c073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac2c102450 0x7fac2c073620 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 --2- 172.21.15.12:0/3044185404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac2c101260 0x7fac2c074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 >> 172.21.15.12:0/3044185404 conn(0x7fac2c0fc7d0 msgr2=0x7fac2c1057d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 shutdown_connections 2024-02-14T13:08:38.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.485+0000 7fac338c9640 1 -- 172.21.15.12:0/3044185404 wait complete. 2024-02-14T13:08:38.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:38 smithi103 ceph-mon[36921]: pgmap v343: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:38.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/4267774592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:38.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/453914053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2550302805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1681486918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:08:38.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:38 smithi055 ceph-mon[36853]: pgmap v343: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:38.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/4267774592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:38.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/453914053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2550302805' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1681486918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 -- 172.21.15.12:0/4031894799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101360 msgr2=0x7fa8841017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 --2- 172.21.15.12:0/4031894799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101360 0x7fa8841017e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa878009900 tx=0x7fa87802bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 -- 172.21.15.12:0/4031894799 shutdown_connections 2024-02-14T13:08:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 --2- 172.21.15.12:0/4031894799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa884101d20 0x7fa8841085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 --2- 172.21.15.12:0/4031894799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101360 0x7fa8841017e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 --2- 172.21.15.12:0/4031894799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884100170 0x7fa884100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 -- 172.21.15.12:0/4031894799 >> 172.21.15.12:0/4031894799 conn(0x7fa8840fb6e0 msgr2=0x7fa8840fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 -- 172.21.15.12:0/4031894799 shutdown_connections 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.599+0000 7fa889f81640 1 -- 172.21.15.12:0/4031894799 wait complete. 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 Processor -- start 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 -- start start 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa884100170 0x7fa88406a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884101360 0x7fa88419c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 0x7fa88419e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88419ee00 con 0x7fa884101d20 2024-02-14T13:08:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88419ef70 con 0x7fa884101360 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa889f81640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88419f130 con 0x7fa884100170 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 0x7fa88419e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 0x7fa88419e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60498/0 (socket says 172.21.15.12:60498) 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 -- 172.21.15.12:0/2872442786 learned_addr learned my addr 172.21.15.12:0/2872442786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa8837fe640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa884100170 0x7fa88406a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa882ffd640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884101360 0x7fa88419c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 -- 172.21.15.12:0/2872442786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa884100170 msgr2=0x7fa88406a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa884100170 0x7fa88406a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 -- 172.21.15.12:0/2872442786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884101360 msgr2=0x7fa88419c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884101360 0x7fa88419c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa883fff640 1 -- 172.21.15.12:0/2872442786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009560 con 0x7fa884101d20 2024-02-14T13:08:38.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.600+0000 7fa882ffd640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884101360 0x7fa88419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.601+0000 7fa883fff640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 0x7fa88419e620 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00eaa0 tx=0x7fa87c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.601+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00cdb0 con 0x7fa884101d20 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.601+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa87c005020 con 0x7fa884101d20 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.601+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88419f3b0 con 0x7fa884101d20 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.601+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0116b0 con 0x7fa884101d20 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.601+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88419f870 con 0x7fa884101d20 2024-02-14T13:08:38.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.602+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884107490 con 0x7fa884101d20 2024-02-14T13:08:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.603+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fa87c005520 con 0x7fa884101d20 2024-02-14T13:08:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.603+0000 7fa880ff9640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa86c0a20c0 0x7fa86c0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.603+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa87c0ce300 con 0x7fa884101d20 2024-02-14T13:08:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.603+0000 7fa8837fe640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa86c0a20c0 0x7fa86c0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.604+0000 7fa8837fe640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa86c0a20c0 0x7fa86c0a4580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8841011c0 tx=0x7fa87400a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.607+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa87c0972b0 con 0x7fa884101d20 2024-02-14T13:08:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.790+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa88402ce10 con 0x7fa884101d20 2024-02-14T13:08:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.792+0000 7fa880ff9640 1 -- 172.21.15.12:0/2872442786 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22638 (secure 0 0 0) 0x7fa87c01f020 con 0x7fa884101d20 2024-02-14T13:08:38.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:38.794 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:07:49.983197+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa86c0a20c0 msgr2=0x7fa86c0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa86c0a20c0 0x7fa86c0a4580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8841011c0 tx=0x7fa87400a2d0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 msgr2=0x7fa88419e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 0x7fa88419e620 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00eaa0 tx=0x7fa87c00ef60 comp rx=0 tx=0).stop 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 shutdown_connections 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa86c0a20c0 0x7fa86c0a4580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa884101d20 0x7fa88419e620 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884101360 0x7fa88419c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 --2- 172.21.15.12:0/2872442786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa884100170 0x7fa88406a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 >> 172.21.15.12:0/2872442786 conn(0x7fa8840fb6e0 msgr2=0x7fa884104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 shutdown_connections 2024-02-14T13:08:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.794+0000 7fa889f81640 1 -- 172.21.15.12:0/2872442786 wait complete. 2024-02-14T13:08:38.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-14T13:06:47.668699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-14T13:06:48.352208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:08:38.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 -- 172.21.15.12:0/1440707967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 msgr2=0x7f61841028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 --2- 172.21.15.12:0/1440707967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f61841028b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f616c009900 tx=0x7f616c02bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 -- 172.21.15.12:0/1440707967 shutdown_connections 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 --2- 172.21.15.12:0/1440707967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6184102df0 0x7f6184109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 --2- 172.21.15.12:0/1440707967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f61841028b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 --2- 172.21.15.12:0/1440707967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184101240 0x7f6184101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 -- 172.21.15.12:0/1440707967 >> 172.21.15.12:0/1440707967 conn(0x7f61840fc7d0 msgr2=0x7f61840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 -- 172.21.15.12:0/1440707967 shutdown_connections 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.911+0000 7f61893f4640 1 -- 172.21.15.12:0/1440707967 wait complete. 2024-02-14T13:08:38.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 Processor -- start 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 -- start start 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6184101240 0x7f6184197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f6184197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184102df0 0x7f618419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419ee20 con 0x7f6184102430 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419ef90 con 0x7f6184101240 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61893f4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618419f150 con 0x7f6184102df0 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f6184197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f6184197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60506/0 (socket says 172.21.15.12:60506) 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 -- 172.21.15.12:0/2180794968 learned_addr learned my addr 172.21.15.12:0/2180794968 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f6182ffd640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6184101240 0x7f6184197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61837fe640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184102df0 0x7f618419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 -- 172.21.15.12:0/2180794968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184102df0 msgr2=0x7f618419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184102df0 0x7f618419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 -- 172.21.15.12:0/2180794968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6184101240 msgr2=0x7f6184197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6184101240 0x7f6184197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 -- 172.21.15.12:0/2180794968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c009560 con 0x7f6184102430 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f61837fe640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184102df0 0x7f618419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.912+0000 7f617bfff640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f6184197870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f616c006010 tx=0x7f616c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.913+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0044e0 con 0x7f6184102430 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.913+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f616c0054e0 con 0x7f6184102430 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.913+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c03e450 con 0x7f6184102430 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.913+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618419f3d0 con 0x7f6184102430 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.913+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618419f8e0 con 0x7f6184102430 2024-02-14T13:08:38.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.914+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6184108630 con 0x7f6184102430 2024-02-14T13:08:38.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.915+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f616c0035f0 con 0x7f6184102430 2024-02-14T13:08:38.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.915+0000 7f6180ff9640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61700a20c0 0x7f61700a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:38.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.915+0000 7f6182ffd640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61700a20c0 0x7f61700a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:38.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.915+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f616c0f00c0 con 0x7f6184102430 2024-02-14T13:08:38.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.916+0000 7f6182ffd640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61700a20c0 0x7f61700a4580 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6174005fd0 tx=0x7f617400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:38.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:38.920+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f616c0b9070 con 0x7f6184102430 2024-02-14T13:08:39.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.100+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f618402cde0 con 0x7f6184102430 2024-02-14T13:08:39.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.100+0000 7f6180ff9640 1 -- 172.21.15.12:0/2180794968 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f616c0bc730 con 0x7f6184102430 2024-02-14T13:08:39.102 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:08:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61700a20c0 msgr2=0x7f61700a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61700a20c0 0x7f61700a4580 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6174005fd0 tx=0x7f617400b390 comp rx=0 tx=0).stop 2024-02-14T13:08:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 msgr2=0x7f6184197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f6184197870 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f616c006010 tx=0x7f616c0042f0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 shutdown_connections 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61700a20c0 0x7f61700a4580 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6184102df0 0x7f618419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6184102430 0x7f6184197870 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 --2- 172.21.15.12:0/2180794968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6184101240 0x7f6184197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 >> 172.21.15.12:0/2180794968 conn(0x7f61840fc7d0 msgr2=0x7f6184105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 shutdown_connections 2024-02-14T13:08:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.102+0000 7f61893f4640 1 -- 172.21.15.12:0/2180794968 wait complete. 2024-02-14T13:08:39.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- 172.21.15.12:0/2354414531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc101320 msgr2=0x7f70fc1017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2354414531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc101320 0x7f70fc1017a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009900 tx=0x7f70ec02bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- 172.21.15.12:0/2354414531 shutdown_connections 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2354414531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70fc101ce0 0x7f70fc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2354414531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc101320 0x7f70fc1017a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2354414531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc100130 0x7f70fc100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- 172.21.15.12:0/2354414531 >> 172.21.15.12:0/2354414531 conn(0x7f70fc0fb6c0 msgr2=0x7f70fc0fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- 172.21.15.12:0/2354414531 shutdown_connections 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- 172.21.15.12:0/2354414531 wait complete. 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 Processor -- start 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- start start 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 0x7f70fc068f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc101320 0x7f70fc19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70fc101ce0 0x7f70fc19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc19ee80 con 0x7f70fc100130 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc19eff0 con 0x7f70fc101ce0 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.222+0000 7f7102b1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc19f1b0 con 0x7f70fc101320 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 0x7f70fc068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 0x7f70fc068f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60532/0 (socket says 172.21.15.12:60532) 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 -- 172.21.15.12:0/2029794522 learned_addr learned my addr 172.21.15.12:0/2029794522 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f70f3fff640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc101320 0x7f70fc19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 -- 172.21.15.12:0/2029794522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc101320 msgr2=0x7f70fc19c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc101320 0x7f70fc19c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 -- 172.21.15.12:0/2029794522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70fc101ce0 msgr2=0x7f70fc19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70fc101ce0 0x7f70fc19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 -- 172.21.15.12:0/2029794522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009560 con 0x7f70fc100130 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f71008ba640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 0x7f70fc068f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d950 tx=0x7f70f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8009c30 con 0x7f70fc100130 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f70f8009d90 con 0x7f70fc100130 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc19f490 con 0x7f70fc100130 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800f720 con 0x7f70fc100130 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.223+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc19f9f0 con 0x7f70fc100130 2024-02-14T13:08:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.224+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc1074d0 con 0x7f70fc100130 2024-02-14T13:08:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.225+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f70f8010a60 con 0x7f70fc100130 2024-02-14T13:08:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.226+0000 7f70f1ffb640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f70e40a2140 0x7f70e40a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.226+0000 7f70f3fff640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f70e40a2140 0x7f70e40a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.226+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f70f80cd9b0 con 0x7f70fc100130 2024-02-14T13:08:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.226+0000 7f70f3fff640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f70e40a2140 0x7f70e40a4600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009230 tx=0x7f70ec005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:39.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.230+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f70f8096960 con 0x7f70fc100130 2024-02-14T13:08:39.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.410+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70fc02ce50 con 0x7f70fc100130 2024-02-14T13:08:39.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.410+0000 7f70f1ffb640 1 -- 172.21.15.12:0/2029794522 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70f809a020 con 0x7f70fc100130 2024-02-14T13:08:39.412 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-02-14T13:08:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f70e40a2140 msgr2=0x7f70e40a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f70e40a2140 0x7f70e40a4600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009230 tx=0x7f70ec005fd0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 msgr2=0x7f70fc068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 0x7f70fc068f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d950 tx=0x7f70f800de10 comp rx=0 tx=0).stop 2024-02-14T13:08:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 shutdown_connections 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f70e40a2140 0x7f70e40a4600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70fc101ce0 0x7f70fc19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70fc101320 0x7f70fc19c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 --2- 172.21.15.12:0/2029794522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70fc100130 0x7f70fc068f20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 >> 172.21.15.12:0/2029794522 conn(0x7f70fc0fb6c0 msgr2=0x7f70fc1046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 shutdown_connections 2024-02-14T13:08:39.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.412+0000 7f7102b1e640 1 -- 172.21.15.12:0/2029794522 wait complete. 2024-02-14T13:08:39.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3044185404' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:39.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2872442786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:39.424 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2180794968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:39.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-14T13:08:39.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:39 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3044185404' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:39.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:39 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2872442786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:39.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:39 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2180794968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 -- 172.21.15.12:0/4124648883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 msgr2=0x7faf38109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 --2- 172.21.15.12:0/4124648883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf38109360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faf30009900 tx=0x7faf3002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 -- 172.21.15.12:0/4124648883 shutdown_connections 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 --2- 172.21.15.12:0/4124648883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf38109360 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 --2- 172.21.15.12:0/4124648883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf381045e0 0x7faf381069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 --2- 172.21.15.12:0/4124648883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf38101cb0 0x7faf381040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 -- 172.21.15.12:0/4124648883 >> 172.21.15.12:0/4124648883 conn(0x7faf380fb6c0 msgr2=0x7faf380fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 -- 172.21.15.12:0/4124648883 shutdown_connections 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.528+0000 7faf400ae640 1 -- 172.21.15.12:0/4124648883 wait complete. 2024-02-14T13:08:39.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 Processor -- start 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 -- start start 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf38101cb0 0x7faf381972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf381045e0 0x7faf38197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf3819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3819edb0 con 0x7faf38106f10 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3819ef20 con 0x7faf38101cb0 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf400ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3819f0e0 con 0x7faf381045e0 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf3819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf3819e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60548/0 (socket says 172.21.15.12:60548) 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 -- 172.21.15.12:0/1962333936 learned_addr learned my addr 172.21.15.12:0/1962333936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3d649640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf381045e0 0x7faf38197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3de4a640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf38101cb0 0x7faf381972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 -- 172.21.15.12:0/1962333936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf381045e0 msgr2=0x7faf38197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf381045e0 0x7faf38197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 -- 172.21.15.12:0/1962333936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf38101cb0 msgr2=0x7faf381972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf38101cb0 0x7faf381972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 -- 172.21.15.12:0/1962333936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30009560 con 0x7faf38106f10 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.529+0000 7faf3e64b640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf3819e870 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf30009230 tx=0x7faf30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.530+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30004df0 con 0x7faf38106f10 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.530+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3819f360 con 0x7faf38106f10 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.530+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7faf30005430 con 0x7faf38106f10 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.530+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30003de0 con 0x7faf38106f10 2024-02-14T13:08:39.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.530+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3819f870 con 0x7faf38106f10 2024-02-14T13:08:39.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.531+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf380fd1b0 con 0x7faf38106f10 2024-02-14T13:08:39.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.532+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7faf300055a0 con 0x7faf38106f10 2024-02-14T13:08:39.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.532+0000 7faf2effd640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7faf240a20c0 0x7faf240a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.532+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7faf300f09b0 con 0x7faf38106f10 2024-02-14T13:08:39.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.532+0000 7faf3de4a640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7faf240a20c0 0x7faf240a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.533+0000 7faf3de4a640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7faf240a20c0 0x7faf240a4580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf34005fd0 tx=0x7faf34009440 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:39.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.536+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faf300b9a80 con 0x7faf38106f10 2024-02-14T13:08:39.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:39 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3044185404' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:39.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:39 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2872442786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:39.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:39 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2180794968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:08:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.716+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf3810cc40 con 0x7faf38106f10 2024-02-14T13:08:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.717+0000 7faf2effd640 1 -- 172.21.15.12:0/1962333936 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf30043020 con 0x7faf38106f10 2024-02-14T13:08:39.718 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7faf240a20c0 msgr2=0x7faf240a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7faf240a20c0 0x7faf240a4580 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faf34005fd0 tx=0x7faf34009440 comp rx=0 tx=0).stop 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 msgr2=0x7faf3819e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf3819e870 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faf30009230 tx=0x7faf30004270 comp rx=0 tx=0).stop 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 shutdown_connections 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7faf240a20c0 0x7faf240a4580 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf38106f10 0x7faf3819e870 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf381045e0 0x7faf38197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.718+0000 7faf400ae640 1 --2- 172.21.15.12:0/1962333936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf38101cb0 0x7faf381972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.719+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 >> 172.21.15.12:0/1962333936 conn(0x7faf380fb6c0 msgr2=0x7faf38102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.719+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 shutdown_connections 2024-02-14T13:08:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.719+0000 7faf400ae640 1 -- 172.21.15.12:0/1962333936 wait complete. 2024-02-14T13:08:39.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:08:39.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 -- 172.21.15.12:0/1432802022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102450 msgr2=0x7f1a081028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/1432802022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102450 0x7f1a081028d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009900 tx=0x7f19f402bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:39.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 -- 172.21.15.12:0/1432802022 shutdown_connections 2024-02-14T13:08:39.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/1432802022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a08102e10 0x7f1a081096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/1432802022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102450 0x7f1a081028d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/1432802022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a08101260 0x7f1a08101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 -- 172.21.15.12:0/1432802022 >> 172.21.15.12:0/1432802022 conn(0x7f1a080fc810 msgr2=0x7f1a080fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 -- 172.21.15.12:0/1432802022 shutdown_connections 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 -- 172.21.15.12:0/1432802022 wait complete. 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.832+0000 7f1a0ee40640 1 Processor -- start 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 -- start start 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a08101260 0x7f1a08197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a08102450 0x7f1a081978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 0x7f1a0819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819ee70 con 0x7f1a08102e10 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819efe0 con 0x7f1a08102450 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819f1a0 con 0x7f1a08101260 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 0x7f1a0819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 0x7f1a0819e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60570/0 (socket says 172.21.15.12:60570) 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 -- 172.21.15.12:0/2546417033 learned_addr learned my addr 172.21.15.12:0/2546417033 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a07fff640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a08102450 0x7f1a081978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0cbdc640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a08101260 0x7f1a08197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 -- 172.21.15.12:0/2546417033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a08101260 msgr2=0x7f1a08197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a08101260 0x7f1a08197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 -- 172.21.15.12:0/2546417033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a08102450 msgr2=0x7f1a081978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a08102450 0x7f1a081978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 -- 172.21.15.12:0/2546417033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4009560 con 0x7f1a08102e10 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0d3dd640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 0x7f1a0819e930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000b970 tx=0x7f1a0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000cb40 con 0x7f1a08102e10 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0819f480 con 0x7f1a08102e10 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f1a0000cca0 con 0x7f1a08102e10 2024-02-14T13:08:39.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.833+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000077d0 con 0x7f1a08102e10 2024-02-14T13:08:39.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.834+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0819f9e0 con 0x7f1a08102e10 2024-02-14T13:08:39.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.835+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08108580 con 0x7f1a08102e10 2024-02-14T13:08:39.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.835+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f1a00014440 con 0x7f1a08102e10 2024-02-14T13:08:39.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.836+0000 7f1a05ffb640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f19f80a20c0 0x7f19f80a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:39.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.836+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1a000cd570 con 0x7f1a08102e10 2024-02-14T13:08:39.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.836+0000 7f1a0cbdc640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f19f80a20c0 0x7f19f80a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:39.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.837+0000 7f1a0cbdc640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f19f80a20c0 0x7f19f80a4580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0058c0 tx=0x7f19fc005c80 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:39.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:39.840+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a0004fd20 con 0x7f1a08102e10 2024-02-14T13:08:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.058+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a08107ff0 con 0x7f1a08102e10 2024-02-14T13:08:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.059+0000 7f1a05ffb640 1 -- 172.21.15.12:0/2546417033 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7f1a000965d0 con 0x7f1a08102e10 2024-02-14T13:08:40.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:40.061 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:08:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:08:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f19f80a20c0 msgr2=0x7f19f80a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f19f80a20c0 0x7f19f80a4580 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0058c0 tx=0x7f19fc005c80 comp rx=0 tx=0).stop 2024-02-14T13:08:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 msgr2=0x7f1a0819e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 0x7f1a0819e930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000b970 tx=0x7f1a0000be30 comp rx=0 tx=0).stop 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 shutdown_connections 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f19f80a20c0 0x7f19f80a4580 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a08102e10 0x7f1a0819e930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a08102450 0x7f1a081978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 --2- 172.21.15.12:0/2546417033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a08101260 0x7f1a08197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 >> 172.21.15.12:0/2546417033 conn(0x7f1a080fc810 msgr2=0x7f1a08105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 shutdown_connections 2024-02-14T13:08:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.061+0000 7f1a0ee40640 1 -- 172.21.15.12:0/2546417033 wait complete. 2024-02-14T13:08:40.074 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/4243457428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b540ff510 msgr2=0x7f7b540ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/4243457428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b540ff510 0x7f7b540ff930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009900 tx=0x7f7b5002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/4243457428 shutdown_connections 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/4243457428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b54102ea0 0x7f7b54109730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/4243457428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b541024e0 0x7f7b54102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/4243457428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b540ff510 0x7f7b540ff930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/4243457428 >> 172.21.15.12:0/4243457428 conn(0x7f7b540fae60 msgr2=0x7f7b540fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/4243457428 shutdown_connections 2024-02-14T13:08:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.175+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/4243457428 wait complete. 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 Processor -- start 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 -- start start 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540ff510 0x7f7b54197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b541024e0 0x7f7b541978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 0x7f7b5419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5419ee00 con 0x7f7b54102ea0 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5419ef70 con 0x7f7b540ff510 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b5b9ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5419f130 con 0x7f7b541024e0 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 0x7f7b5419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 0x7f7b5419e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60586/0 (socket says 172.21.15.12:60586) 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 -- 172.21.15.12:0/80709197 learned_addr learned my addr 172.21.15.12:0/80709197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b58f47640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b541024e0 0x7f7b541978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59748640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540ff510 0x7f7b54197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 -- 172.21.15.12:0/80709197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b541024e0 msgr2=0x7f7b541978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b541024e0 0x7f7b541978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 -- 172.21.15.12:0/80709197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540ff510 msgr2=0x7f7b54197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540ff510 0x7f7b54197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.176+0000 7f7b59f49640 1 -- 172.21.15.12:0/80709197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b50009560 con 0x7f7b54102ea0 2024-02-14T13:08:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.177+0000 7f7b59f49640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 0x7f7b5419e8c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00b970 tx=0x7f7b4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.178+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00cb40 con 0x7f7b54102ea0 2024-02-14T13:08:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.178+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f7b4c00cca0 con 0x7f7b54102ea0 2024-02-14T13:08:40.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.178+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0077d0 con 0x7f7b54102ea0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.178+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5419f410 con 0x7f7b54102ea0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.178+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5419f920 con 0x7f7b54102ea0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.179+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b54108690 con 0x7f7b54102ea0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.180+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f7b4c014440 con 0x7f7b54102ea0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.180+0000 7f7b4a7fc640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7b400a2140 0x7f7b400a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.181+0000 7f7b59748640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7b400a2140 0x7f7b400a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.181+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7b4c0cd4c0 con 0x7f7b54102ea0 2024-02-14T13:08:40.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.181+0000 7f7b59748640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7b400a2140 0x7f7b400a4600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b50006010 tx=0x7f7b50000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.185+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7b4c04fd20 con 0x7f7b54102ea0 2024-02-14T13:08:40.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.370+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b5410ccb0 con 0x7f7b54102ea0 2024-02-14T13:08:40.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.372+0000 7f7b4a7fc640 1 -- 172.21.15.12:0/80709197 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+22638 (secure 0 0 0) 0x7f7b4c096520 con 0x7f7b54102ea0 2024-02-14T13:08:40.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:08:40.374 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":89,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:07:49.983197+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7b400a2140 msgr2=0x7f7b400a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7b400a2140 0x7f7b400a4600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b50006010 tx=0x7f7b50000bc0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 msgr2=0x7f7b5419e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 0x7f7b5419e8c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00b970 tx=0x7f7b4c00be30 comp rx=0 tx=0).stop 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 shutdown_connections 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f7b400a2140 0x7f7b400a4600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b54102ea0 0x7f7b5419e8c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b541024e0 0x7f7b541978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 --2- 172.21.15.12:0/80709197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540ff510 0x7f7b54197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 >> 172.21.15.12:0/80709197 conn(0x7f7b540fae60 msgr2=0x7f7b54105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 shutdown_connections 2024-02-14T13:08:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.374+0000 7f7b5b9ac640 1 -- 172.21.15.12:0/80709197 wait complete. 2024-02-14T13:08:40.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:40 smithi012 ceph-mon[32370]: pgmap v344: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:40.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2029794522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:40.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1962333936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:40.385 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:40 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2546417033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:40.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-02-14T13:06:49.142270+0000', 'modified': '2024-02-14T13:06:52.178143+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24505}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.55:6839/3549809563', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6838', 'nonce': 3549809563}, {'type': 'v1', 'addr': '172.21.15.55:6839', 'nonce': 3549809563}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.103:6839/2266124957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 2266124957}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 2266124957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-14T13:08:40.387 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-14T13:08:40.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- 172.21.15.12:0/96997030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340100140 msgr2=0x7f1340100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- 172.21.15.12:0/96997030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340100140 0x7f1340100560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1330009900 tx=0x7f133002bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- 172.21.15.12:0/96997030 shutdown_connections 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- 172.21.15.12:0/96997030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1340101cf0 0x7f1340108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- 172.21.15.12:0/96997030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1340101330 0x7f13401017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- 172.21.15.12:0/96997030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340100140 0x7f1340100560 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- 172.21.15.12:0/96997030 >> 172.21.15.12:0/96997030 conn(0x7f13400fb6d0 msgr2=0x7f13400fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- 172.21.15.12:0/96997030 shutdown_connections 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- 172.21.15.12:0/96997030 wait complete. 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 Processor -- start 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- start start 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1340100140 0x7f13401973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1340101330 0x7f1340197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 0x7f134019e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.489+0000 7f1346f81640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134019eeb0 con 0x7f1340101cf0 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f1346f81640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134019f020 con 0x7f1340101330 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f1346f81640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134019f1e0 con 0x7f1340100140 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 0x7f134019e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 0x7f134019e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60606/0 (socket says 172.21.15.12:60606) 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 -- 172.21.15.12:0/2849892683 learned_addr learned my addr 172.21.15.12:0/2849892683 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f1344d1d640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1340100140 0x7f13401973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f133ffff640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1340101330 0x7f1340197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 -- 172.21.15.12:0/2849892683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1340100140 msgr2=0x7f13401973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1340100140 0x7f13401973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 -- 172.21.15.12:0/2849892683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1340101330 msgr2=0x7f1340197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1340101330 0x7f1340197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 -- 172.21.15.12:0/2849892683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009560 con 0x7f1340101cf0 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f134551e640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 0x7f134019e970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f133800b970 tx=0x7f133800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f133dffb640 1 -- 172.21.15.12:0/2849892683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800cb40 con 0x7f1340101cf0 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f133dffb640 1 -- 172.21.15.12:0/2849892683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f133800cca0 con 0x7f1340101cf0 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134019f4c0 con 0x7f1340101cf0 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f133dffb640 1 -- 172.21.15.12:0/2849892683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380077d0 con 0x7f1340101cf0 2024-02-14T13:08:40.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.490+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134019fa00 con 0x7f1340101cf0 2024-02-14T13:08:40.496 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:40 smithi103 ceph-mon[36921]: pgmap v344: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:40.496 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2029794522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:40.496 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1962333936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:40.496 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:40 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2546417033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.492+0000 7f133dffb640 1 -- 172.21.15.12:0/2849892683 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f1338014440 con 0x7f1340101cf0 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 Processor -- start 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 -- start start 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f133dffb640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13280a20c0 0x7f13280a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac189880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189e50 0x55c3ac18e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac191450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac145fd0 con 0x55c3ac18efc0 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac0f8cb0 con 0x55c3ac189e50 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1349c2b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac0f61e0 con 0x55c3ac189460 2024-02-14T13:08:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f133ffff640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13280a20c0 0x7f13280a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f133dffb640 1 -- 172.21.15.12:0/2849892683 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f13380cd5d0 con 0x7f1340101cf0 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac191450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac191450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60618/0 (socket says 172.21.15.12:60618) 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 -- 172.21.15.12:0/1140276744 learned_addr learned my addr 172.21.15.12:0/1140276744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f133ffff640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189e50 0x55c3ac18e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f1344d1d640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac189880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 -- 172.21.15.12:0/1140276744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 msgr2=0x55c3ac189880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac189880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 -- 172.21.15.12:0/1140276744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189e50 msgr2=0x55c3ac18e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189e50 0x55c3ac18e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.493+0000 7f134551e640 1 -- 172.21.15.12:0/1140276744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3ac0b4100 con 0x55c3ac18efc0 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1344d1d640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac189880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f133ffff640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189e50 0x55c3ac18e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f133ffff640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13280a20c0 0x7f13280a4580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13401988d0 tx=0x7f13340138e0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f134551e640 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac191450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1338096d00 tx=0x7f133809a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3730bca3e5e3d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1326ffd640 1 -- 172.21.15.12:0/1140276744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338094ea0 con 0x55c3ac18efc0 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1326ffd640 1 -- 172.21.15.12:0/1140276744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f13380a2a20 con 0x55c3ac18efc0 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1326ffd640 1 -- 172.21.15.12:0/1140276744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380969a0 con 0x55c3ac18efc0 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 -- 172.21.15.12:0/1140276744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 msgr2=0x55c3ac191450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac191450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1338096d00 tx=0x7f133809a330 comp rx=0 tx=0).stop 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 -- 172.21.15.12:0/1140276744 shutdown_connections 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac191450 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189e50 0x55c3ac18e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1140276744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac189880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.494+0000 7f1349c2b740 1 -- 172.21.15.12:0/1140276744 >> 172.21.15.12:0/1140276744 conn(0x55c3ac1849d0 msgr2=0x55c3ac184dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 -- 172.21.15.12:0/1140276744 shutdown_connections 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 -- 172.21.15.12:0/1140276744 wait complete. 2024-02-14T13:08:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 -- start start 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 Processor -- start 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac193520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac193a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac18efc0 0x55c3ac19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac0f19c0 con 0x55c3ac189e50 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac096cd0 con 0x55c3ac189460 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3abdc5310 con 0x55c3ac18efc0 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1349c2b740 10 client.0 _ll_register_callbacks cb 0x55c3abe02ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f133ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac193a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f133ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac193a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60632/0 (socket says 172.21.15.12:60632) 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f133ffff640 1 -- 172.21.15.12:0/4135588997 learned_addr learned my addr 172.21.15.12:0/4135588997 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.495+0000 7f1344d1d640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac193520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f134551e640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac18efc0 0x55c3ac19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f133ffff640 1 -- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac18efc0 msgr2=0x55c3ac19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f133ffff640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac18efc0 0x55c3ac19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f133ffff640 1 -- 172.21.15.12:0/4135588997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 msgr2=0x55c3ac193520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f133ffff640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac193520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f133ffff640 1 -- 172.21.15.12:0/4135588997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134019fa00 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f133ffff640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac193a60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f13340116f0 tx=0x7f1334004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d35c2a1b423eaea server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f131ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f131ffff640 1 -- 172.21.15.12:0/4135588997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400e760 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f131ffff640 1 -- 172.21.15.12:0/4135588997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f133400e8c0 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3abdf16c0 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f131ffff640 1 -- 172.21.15.12:0/4135588997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f133400ea80 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f1349c2b740 10 client.15174 fetch_fsmap learned FSMap version 18 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55c3ac0f0040 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.496+0000 7f131ffff640 1 -- 172.21.15.12:0/4135588997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x55c3abdf16c0 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f131ffff640 1 -- 172.21.15.12:0/4135588997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1334020c60 con 0x55c3ac189e50 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1349c2b740 10 client.15174 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1349c2b740 10 client.15174 resolve_mds: resolved name 'i' to daemon mds.i 2024-02-14T13:08:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1349c2b740 20 client.15174 populate_metadata read hostname 'smithi012' 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1349c2b740 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac19fb20 0x55c3ac19ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1349c2b740 4 client.15174 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3abe42270 con 0x55c3ac19fb20 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1344d1d640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac19fb20 0x55c3ac19ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f131ffff640 10 client.15174 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.497+0000 7f1344d1d640 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac19fb20 0x55c3ac19ed50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bdef04323645c41 server_cookie=8ef842f7de0aa1e2 in_seq=0 out_seq=0 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f131ffff640 1 -- 172.21.15.12:0/4135588997 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3abe42270 con 0x55c3ac19fb20 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f131ffff640 10 client.15174 handle_command_reply: tid=0 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 client.15174 shutdown 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 msgr2=0x55c3ac193a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac193a60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f13340116f0 tx=0x7f1334004730 comp rx=0 tx=0).stop 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 shutdown_connections 2024-02-14T13:08:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac19fb20 0x55c3ac19ed50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac18efc0 0x55c3ac19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f131ffff640 0 client.15174 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac193a60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 --2- 172.21.15.12:0/4135588997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac193520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.498+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 >> 172.21.15.12:0/4135588997 conn(0x55c3ac1849d0 msgr2=0x55c3ac183c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.499+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 shutdown_connections 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.499+0000 7f1349c2b740 1 -- 172.21.15.12:0/4135588997 wait complete. 2024-02-14T13:08:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.499+0000 7f1349c2b740 20 client.15174 trim_cache size 0 max 16384 2024-02-14T13:08:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 Processor -- start 2024-02-14T13:08:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 -- start start 2024-02-14T13:08:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac192b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189e50 0x55c3ac19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac18b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac077490 con 0x55c3ac18efc0 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac189020 con 0x55c3ac189460 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f1349c2b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac193360 con 0x55c3ac189e50 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.514+0000 7f134551e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac18b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac18b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60644/0 (socket says 172.21.15.12:60644) 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 -- 172.21.15.12:0/1072832854 learned_addr learned my addr 172.21.15.12:0/1072832854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 -- 172.21.15.12:0/1072832854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189e50 msgr2=0x55c3ac19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f133ffff640 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189e50 0x55c3ac19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189e50 0x55c3ac19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 -- 172.21.15.12:0/1072832854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 msgr2=0x55c3ac192b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f1344d1d640 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac192b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac192b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 -- 172.21.15.12:0/1072832854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3ac08ca90 con 0x55c3ac18efc0 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f133ffff640 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189e50 0x55c3ac19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f134551e640 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac18b230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f13380a24f0 tx=0x7f133800c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6f9e788a5c2b43 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f13267fc640 1 -- 172.21.15.12:0/1072832854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338094ea0 con 0x55c3ac18efc0 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f13267fc640 1 -- 172.21.15.12:0/1072832854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f133809e120 con 0x55c3ac18efc0 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.515+0000 7f13267fc640 1 -- 172.21.15.12:0/1072832854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a2590 con 0x55c3ac18efc0 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- 172.21.15.12:0/1072832854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 msgr2=0x55c3ac18b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac18b230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f13380a24f0 tx=0x7f133800c600 comp rx=0 tx=0).stop 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- 172.21.15.12:0/1072832854 shutdown_connections 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac18efc0 0x55c3ac18b230 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189e50 0x55c3ac19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- 172.21.15.12:0/1072832854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac189460 0x55c3ac192b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- 172.21.15.12:0/1072832854 >> 172.21.15.12:0/1072832854 conn(0x55c3ac1849d0 msgr2=0x55c3ac184db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- 172.21.15.12:0/1072832854 shutdown_connections 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- 172.21.15.12:0/1072832854 wait complete. 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- start start 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 Processor -- start 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac198400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac18efc0 0x55c3ac199410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac199950 con 0x55c3ac189e50 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac199ac0 con 0x55c3ac18efc0 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3ac199c80 con 0x55c3ac189460 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f1349c2b740 10 client.0 _ll_register_callbacks cb 0x7f133400bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f133ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f133ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60658/0 (socket says 172.21.15.12:60658) 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.516+0000 7f133ffff640 1 -- 172.21.15.12:0/40479610 learned_addr learned my addr 172.21.15.12:0/40479610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f134551e640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac18efc0 0x55c3ac199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f1344d1d640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f133ffff640 1 -- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 msgr2=0x55c3ac197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f133ffff640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f133ffff640 1 -- 172.21.15.12:0/40479610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac18efc0 msgr2=0x55c3ac199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f133ffff640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac18efc0 0x55c3ac199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f133ffff640 1 -- 172.21.15.12:0/40479610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3ac0b4100 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f134551e640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac18efc0 0x55c3ac199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f133ffff640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac198400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f133400c010 tx=0x7f133400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed880e7548d735d server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f131ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f131ffff640 1 -- 172.21.15.12:0/40479610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133400b880 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f131ffff640 1 -- 172.21.15.12:0/40479610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1334011500 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3ac19f830 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f131ffff640 1 -- 172.21.15.12:0/40479610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f133400ee10 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f1349c2b740 10 client.15180 fetch_fsmap learned FSMap version 18 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55c3ac0b2960 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f131ffff640 1 -- 172.21.15.12:0/40479610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x55c3ac19f830 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f131ffff640 1 -- 172.21.15.12:0/40479610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1334020620 con 0x55c3ac189e50 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.517+0000 7f1349c2b740 10 client.15180 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 10 client.15180 resolve_mds: resolved name 'i' to daemon mds.i 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 20 client.15180 populate_metadata read hostname 'smithi012' 2024-02-14T13:08:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac1fb510 0x55c3ac1f7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 4 client.15180 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f13380a2a20 con 0x55c3ac1fb510 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1344d1d640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac1fb510 0x55c3ac1f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1344d1d640 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac1fb510 0x55c3ac1f7990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf128c2fb91be70f server_cookie=9b419b67f37f8edc in_seq=0 out_seq=0 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f131ffff640 10 client.15180 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f131ffff640 1 -- 172.21.15.12:0/40479610 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x7f13380a2a20 con 0x55c3ac1fb510 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f131ffff640 10 client.15180 handle_command_reply: tid=0 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 client.15180 shutdown 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 msgr2=0x55c3ac198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac198400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f133400c010 tx=0x7f133400ea10 comp rx=0 tx=0).stop 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 shutdown_connections 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55c3ac1fb510 0x55c3ac1f7990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c3ac18efc0 0x55c3ac199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3ac189e50 0x55c3ac198400 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 --2- 172.21.15.12:0/40479610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3ac189460 0x55c3ac197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f131ffff640 0 client.15180 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.518+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 >> 172.21.15.12:0/40479610 conn(0x55c3ac1849d0 msgr2=0x55c3ac18b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 shutdown_connections 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1349c2b740 1 -- 172.21.15.12:0/40479610 wait complete. 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1349c2b740 20 client.15180 trim_cache size 0 max 16384 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "ab42aa14-cb38-11ee-95b9-87774f69a715", 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24505, 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-02-14T13:08:40.528 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 110.728740452, 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 18, 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 89, 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 87, 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 124.488347019 2024-02-14T13:08:40.529 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13280a20c0 msgr2=0x7f13280a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13280a20c0 0x7f13280a4580 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f13401988d0 tx=0x7f13340138e0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 msgr2=0x7f134019e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 0x7f134019e970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f133800b970 tx=0x7f133800be30 comp rx=0 tx=0).stop 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 shutdown_connections 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f13280a20c0 0x7f13280a4580 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1340101cf0 0x7f134019e970 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1340101330 0x7f1340197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 --2- 172.21.15.12:0/2849892683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1340100140 0x7f13401973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 >> 172.21.15.12:0/2849892683 conn(0x7f13400fb6d0 msgr2=0x7f13401046b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 shutdown_connections 2024-02-14T13:08:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:40.519+0000 7f1346f81640 1 -- 172.21.15.12:0/2849892683 wait complete. 2024-02-14T13:08:40.532 INFO:teuthology.run_tasks:Running task kclient... 2024-02-14T13:08:40.556 INFO:tasks.kclient:Mounting kernel clients... 2024-02-14T13:08:40.557 INFO:tasks.kclient:config is {'client.0': {}} 2024-02-14T13:08:40.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:40.557 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-02-14T13:08:40.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:40 smithi055 ceph-mon[36853]: pgmap v344: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:40.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:40 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2029794522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:08:40.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:40 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1962333936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:08:40.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:40 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2546417033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:08:40.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:40.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-02-14T13:08:40.640 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-02-14T13:08:40.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:08:40.642 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-02-14T13:08:40.642 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-14T13:08:40.642 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:40.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 shell --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 -- ceph fs ls 2024-02-14T13:08:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/mon.a/config 2024-02-14T13:08:41.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:41 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/80709197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:41.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:41 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/80709197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:41.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/80709197' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:08:42.405 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:42 smithi012 ceph-mon[32370]: pgmap v345: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:42.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:42 smithi103 ceph-mon[36921]: pgmap v345: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:42.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:42 smithi055 ceph-mon[36853]: pgmap v345: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 -- 172.21.15.12:0/3824028148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee001015c0 msgr2=0x7fee0010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 --2- 172.21.15.12:0/3824028148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee001015c0 0x7fee0010daa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009990 tx=0x7fedf0009ca0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 -- 172.21.15.12:0/3824028148 shutdown_connections 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 --2- 172.21.15.12:0/3824028148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee001015c0 0x7fee0010daa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 --2- 172.21.15.12:0/3824028148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee00106c60 0x7fee00107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 --2- 172.21.15.12:0/3824028148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee00100c20 0x7fee00101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 -- 172.21.15.12:0/3824028148 >> 172.21.15.12:0/3824028148 conn(0x7fee00077b50 msgr2=0x7fee00077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 -- 172.21.15.12:0/3824028148 shutdown_connections 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.602+0000 7fee076fe700 1 -- 172.21.15.12:0/3824028148 wait complete. 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 Processor -- start 2024-02-14T13:08:42.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 -- start start 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee00100c20 0x7fee00198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee001015c0 0x7fee001987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 0x7fee0019cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0019d140 con 0x7fee00106c60 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0019d2b0 con 0x7fee00100c20 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee076fe700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0019d470 con 0x7fee001015c0 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 0x7fee0019cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 0x7fee0019cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60678/0 (socket says 172.21.15.12:60678) 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 -- 172.21.15.12:0/1686101825 learned_addr learned my addr 172.21.15.12:0/1686101825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee0549a700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee00100c20 0x7fee00198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee04c99700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee001015c0 0x7fee001987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 -- 172.21.15.12:0/1686101825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee001015c0 msgr2=0x7fee001987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:42.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee001015c0 0x7fee001987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 -- 172.21.15.12:0/1686101825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee00100c20 msgr2=0x7fee00198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee00100c20 0x7fee00198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 -- 172.21.15.12:0/1686101825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00095f0 con 0x7fee00106c60 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee04c99700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee001015c0 0x7fee001987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.603+0000 7fee05c9b700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 0x7fee0019cb30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fedf000f690 tx=0x7fedf000f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.604+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf001d070 con 0x7fee00106c60 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.604+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fedf0003680 con 0x7fee00106c60 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.604+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0019d6f0 con 0x7fee00106c60 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.604+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0017650 con 0x7fee00106c60 2024-02-14T13:08:42.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.604+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee001a4fb0 con 0x7fee00106c60 2024-02-14T13:08:42.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.605+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee000689e0 con 0x7fee00106c60 2024-02-14T13:08:42.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.606+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fedf000fc90 con 0x7fee00106c60 2024-02-14T13:08:42.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.606+0000 7fedfe7fc700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fede80a21d0 0x7fede80a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:42.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.606+0000 7fee0549a700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fede80a21d0 0x7fede80a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:42.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.606+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fedf00cf740 con 0x7fee00106c60 2024-02-14T13:08:42.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.607+0000 7fee0549a700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fede80a21d0 0x7fede80a4690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009f20 tx=0x7fedf80094f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:42.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.610+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fedf0098780 con 0x7fee00106c60 2024-02-14T13:08:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.859+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee001995c0 con 0x7fee00106c60 2024-02-14T13:08:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.859+0000 7fedfe7fc700 1 -- 172.21.15.12:0/1686101825 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fedf009be40 con 0x7fee00106c60 2024-02-14T13:08:42.861 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-02-14T13:08:42.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.861+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fede80a21d0 msgr2=0x7fede80a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:42.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.861+0000 7fee076fe700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fede80a21d0 0x7fede80a4690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009f20 tx=0x7fedf80094f0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.861+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 msgr2=0x7fee0019cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:42.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.861+0000 7fee076fe700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 0x7fee0019cb30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fedf000f690 tx=0x7fedf000f770 comp rx=0 tx=0).stop 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 shutdown_connections 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fede80a21d0 0x7fede80a4690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee00106c60 0x7fee0019cb30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee00100c20 0x7fee00198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 --2- 172.21.15.12:0/1686101825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee001015c0 0x7fee001987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 >> 172.21.15.12:0/1686101825 conn(0x7fee00077b50 msgr2=0x7fee000ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 shutdown_connections 2024-02-14T13:08:42.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:08:42.862+0000 7fee076fe700 1 -- 172.21.15.12:0/1686101825 wait complete. 2024-02-14T13:08:43.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:43 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1686101825' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-14T13:08:43.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:43 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1686101825' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-14T13:08:43.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:43 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1686101825' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-14T13:08:43.627 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-14T13:08:43.627 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-14T13:08:43.628 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-14T13:08:43.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:43.628 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-14T13:08:43.645 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42153sec preferred_lft 42153sec 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-02-14T13:08:43.646 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-02-14T13:08:43.647 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-14T13:08:43.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-14T13:08:43.647 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-02-14T13:08:43.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:43.807 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-14T13:08:43.834 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-02-14T13:08:43.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:43.836 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-02-14T13:08:43.907 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-02-14T13:08:43.907 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-14T13:08:43.907 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-14T13:08:43.907 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-14T13:08:43.907 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-14T13:08:43.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:43.908 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2024-02-14T13:08:43.908 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-02-14T13:08:43.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-14T13:08:43.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-14T13:08:43.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-14T13:08:43.908 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-02-14T13:08:44.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.154 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-02-14T13:08:44.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.169 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-02-14T13:08:44.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.224 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2024-02-14T13:08:44.224 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-02-14T13:08:44.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-14T13:08:44.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-14T13:08:44.224 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-02-14T13:08:44.306 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-14T13:08:44.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.306 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2024-02-14T13:08:44.306 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-02-14T13:08:44.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-14T13:08:44.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-14T13:08:44.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-14T13:08:44.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-14T13:08:44.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-14T13:08:44.307 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-02-14T13:08:44.445 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:44 smithi012 ceph-mon[32370]: pgmap v346: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:44.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.478 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2024-02-14T13:08:44.478 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-02-14T13:08:44.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-02-14T13:08:44.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-02-14T13:08:44.478 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-02-14T13:08:44.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:44 smithi103 ceph-mon[36921]: pgmap v346: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:44.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-14T13:08:44.520 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:44.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:44 smithi055 ceph-mon[36853]: pgmap v346: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-14T13:08:44.574 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-14T13:08:44.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-14T13:08:44.574 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:44.628 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-02-14T13:08:44.628 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-02-14T13:08:44.628 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/682b67f3-11e4-4b9e-8737-fd8c68c6bf89 2024-02-14T13:08:44.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/682b67f3-11e4-4b9e-8737-fd8c68c6bf89 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-02-14T13:08:44.712 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-02-14T13:08:44.712 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-02-14T13:08:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-02-14T13:08:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-02-14T13:08:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.55:6789,172.21.15.103:6789" 2024-02-14T13:08:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@ab42aa14-cb38-11ee-95b9-87774f69a715.cephfs=/volumes/qa/sv_1/682b67f3-11e4-4b9e-8737-fd8c68c6bf89 2024-02-14T13:08:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.12:6789/172.21.15.55:6789/172.21.15.103:6789" will pass to kernel 2024-02-14T13:08:44.838 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-14T13:08:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-02-14T13:08:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-14T13:08:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-02-14T13:08:44.838 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-14T13:08:44.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-14T13:08:44.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:44.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.870 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-14T13:08:44.926 INFO:teuthology.orchestra.run.smithi012.stdout:client24871 2024-02-14T13:08:44.926 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:08:44.926 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-14T13:08:44.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:44.982 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-14T13:08:45.039 INFO:teuthology.orchestra.run.smithi012.stdout:client24871 2024-02-14T13:08:45.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:45.039 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-14T13:08:45.095 INFO:teuthology.orchestra.run.smithi012.stdout:client24871 2024-02-14T13:08:45.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:08:45.096 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715.client24871/status') 2024-02-14T13:08:45.162 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.24871 (3)172.21.15.12:0/3410049658 2024-02-14T13:08:45.162 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-02-14T13:08:45.163 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-02-14T13:08:45.163 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-02-14T13:08:45.163 INFO:teuthology.orchestra.run.smithi012.stderr:71 bytes copied, 2.1806e-05 s, 3.3 MB/s 2024-02-14T13:08:45.164 INFO:teuthology.run_tasks:Running task check-counter... 2024-02-14T13:08:45.174 INFO:teuthology.run_tasks:Running task background_exec... 2024-02-14T13:08:45.192 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T13:08:45.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-02-14T13:08:45.206 INFO:teuthology.run_tasks:Running task workunit... 2024-02-14T13:08:45.217 INFO:tasks.workunit:Pulling workunits from ref a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T13:08:45.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-14T13:08:45.218 INFO:tasks.workunit:timeout=6h 2024-02-14T13:08:45.218 INFO:tasks.workunit:cleanup=True 2024-02-14T13:08:45.218 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:45.232 INFO:teuthology.orchestra.run.smithi012.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-02-14 13:06:54.247358025 +0000 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-02-14 13:06:54.247358025 +0000 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-02-14 13:08:44.865229545 +0000 2024-02-14T13:08:45.233 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-02-14 13:06:54.247358025 +0000 2024-02-14T13:08:45.233 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-14T13:08:45.233 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-14T13:08:45.304 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 2024-02-14T13:08:45.360 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-14T13:08:46.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:46 smithi012 ceph-mon[32370]: pgmap v347: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:46.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:46 smithi103 ceph-mon[36921]: pgmap v347: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:46.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:46 smithi055 ceph-mon[36853]: pgmap v347: 97 pgs: 97 active+clean; 637 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:08:48.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:48 smithi012 ceph-mon[32370]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-14T13:08:48.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:48 smithi103 ceph-mon[36921]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-14T13:08:48.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:48 smithi055 ceph-mon[36853]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 853 B/s wr, 2 op/s 2024-02-14T13:08:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:49 smithi012 ceph-mon[32370]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 853 B/s wr, 1 op/s 2024-02-14T13:08:49.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:49 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-02-14T13:08:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:49 smithi103 ceph-mon[36921]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 853 B/s wr, 1 op/s 2024-02-14T13:08:49.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:49 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-02-14T13:08:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:49 smithi055 ceph-mon[36853]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 853 B/s wr, 1 op/s 2024-02-14T13:08:50.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:49 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-02-14T13:08:50.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:50 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-02-14T13:08:50.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:50 smithi012 ceph-mon[32370]: osdmap e90: 12 total, 12 up, 12 in 2024-02-14T13:08:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:50 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-02-14T13:08:50.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:50 smithi103 ceph-mon[36921]: osdmap e90: 12 total, 12 up, 12 in 2024-02-14T13:08:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:50 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-02-14T13:08:51.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:50 smithi055 ceph-mon[36853]: osdmap e90: 12 total, 12 up, 12 in 2024-02-14T13:08:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:51 smithi012 ceph-mon[32370]: pgmap v351: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-14T13:08:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:51 smithi012 ceph-mon[32370]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-14T13:08:51.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:51 smithi012 ceph-mon[32370]: osdmap e91: 12 total, 12 up, 12 in 2024-02-14T13:08:51.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:51 smithi103 ceph-mon[36921]: pgmap v351: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-14T13:08:51.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:51 smithi103 ceph-mon[36921]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-14T13:08:51.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:51 smithi103 ceph-mon[36921]: osdmap e91: 12 total, 12 up, 12 in 2024-02-14T13:08:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:51 smithi055 ceph-mon[36853]: pgmap v351: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-14T13:08:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:51 smithi055 ceph-mon[36853]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-14T13:08:52.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:51 smithi055 ceph-mon[36853]: osdmap e91: 12 total, 12 up, 12 in 2024-02-14T13:08:53.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:53 smithi012 ceph-mon[32370]: pgmap v353: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-14T13:08:53.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:53 smithi103 ceph-mon[36921]: pgmap v353: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-14T13:08:54.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:53 smithi055 ceph-mon[36853]: pgmap v353: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-14T13:08:55.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:55 smithi012 ceph-mon[32370]: pgmap v354: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 127 B/s wr, 1 op/s 2024-02-14T13:08:55.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:55 smithi103 ceph-mon[36921]: pgmap v354: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 127 B/s wr, 1 op/s 2024-02-14T13:08:56.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:55 smithi055 ceph-mon[36853]: pgmap v354: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 127 B/s wr, 1 op/s 2024-02-14T13:08:56.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:56 smithi012 ceph-mon[32370]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-14T13:08:56.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:56 smithi012 ceph-mon[32370]: Cluster is now healthy 2024-02-14T13:08:56.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:56 smithi103 ceph-mon[36921]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-14T13:08:56.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:56 smithi103 ceph-mon[36921]: Cluster is now healthy 2024-02-14T13:08:57.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:56 smithi055 ceph-mon[36853]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-14T13:08:57.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:56 smithi055 ceph-mon[36853]: Cluster is now healthy 2024-02-14T13:08:57.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:57 smithi012 ceph-mon[32370]: pgmap v355: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 3 op/s 2024-02-14T13:08:57.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:57 smithi103 ceph-mon[36921]: pgmap v355: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 3 op/s 2024-02-14T13:08:58.063 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:57 smithi055 ceph-mon[36853]: pgmap v355: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 639 B/s wr, 3 op/s 2024-02-14T13:08:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 -- 172.21.15.12:0/583288654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 msgr2=0x7ff3a4104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 --2- 172.21.15.12:0/583288654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4104100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff394009900 tx=0x7ff39402bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 -- 172.21.15.12:0/583288654 shutdown_connections 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 --2- 172.21.15.12:0/583288654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4106f70 0x7ff3a41093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 --2- 172.21.15.12:0/583288654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4104640 0x7ff3a4106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 --2- 172.21.15.12:0/583288654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4104100 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 -- 172.21.15.12:0/583288654 >> 172.21.15.12:0/583288654 conn(0x7ff3a40fb700 msgr2=0x7ff3a40fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 -- 172.21.15.12:0/583288654 shutdown_connections 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 -- 172.21.15.12:0/583288654 wait complete. 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 Processor -- start 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.349+0000 7ff3a8965640 1 -- start start 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a8965640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a8965640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4104640 0x7ff3a4197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a8965640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4106f70 0x7ff3a419e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a8965640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a419ed40 con 0x7ff3a4101d10 2024-02-14T13:08:58.354 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a8965640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a419eeb0 con 0x7ff3a4106f70 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a8965640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a419f070 con 0x7ff3a4104640 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34894/0 (socket says 172.21.15.12:34894) 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 -- 172.21.15.12:0/1776326780 learned_addr learned my addr 172.21.15.12:0/1776326780 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff39bfff640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4104640 0x7ff3a4197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 -- 172.21.15.12:0/1776326780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4104640 msgr2=0x7ff3a4197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4104640 0x7ff3a4197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 -- 172.21.15.12:0/1776326780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4106f70 msgr2=0x7ff3a419e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4106f70 0x7ff3a419e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4106f70 0x7ff3a419e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 -- 172.21.15.12:0/1776326780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009560 con 0x7ff3a4101d10 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4106f70 0x7ff3a419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:08:58.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.350+0000 7ff3a259c640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4197250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff394006010 tx=0x7ff394005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.351+0000 7ff39b7fe640 1 -- 172.21.15.12:0/1776326780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940043d0 con 0x7ff3a4101d10 2024-02-14T13:08:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.351+0000 7ff39b7fe640 1 -- 172.21.15.12:0/1776326780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff3940052d0 con 0x7ff3a4101d10 2024-02-14T13:08:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.351+0000 7ff39b7fe640 1 -- 172.21.15.12:0/1776326780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394003cc0 con 0x7ff3a4101d10 2024-02-14T13:08:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.351+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a419f2f0 con 0x7ff3a4101d10 2024-02-14T13:08:58.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.351+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a419f800 con 0x7ff3a4101d10 2024-02-14T13:08:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.353+0000 7ff39b7fe640 1 -- 172.21.15.12:0/1776326780 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff394005440 con 0x7ff3a4101d10 2024-02-14T13:08:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.353+0000 7ff3ab614740 1 Processor -- start 2024-02-14T13:08:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.353+0000 7ff3ab614740 1 -- start start 2024-02-14T13:08:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6dab50 0x55903b6daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff39b7fe640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3900a2160 0x7ff3900a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6e0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6e06b0 0x55903b6e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3ab614740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b6459e0 con 0x55903b6db540 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3ab614740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b642f10 con 0x55903b6e06b0 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3ab614740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b63e6f0 con 0x55903b6dab50 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff39b7fe640 1 -- 172.21.15.12:0/1776326780 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7ff3940efff0 con 0x7ff3a4101d10 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a259c640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3900a2160 0x7ff3900a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6e0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34910/0 (socket says 172.21.15.12:34910) 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6dab50 0x55903b6daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff39bfff640 1 -- 172.21.15.12:0/2522259554 learned_addr learned my addr 172.21.15.12:0/2522259554 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6e06b0 0x55903b6e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/2522259554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6e06b0 msgr2=0x55903b6e2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6e06b0 0x55903b6e2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/2522259554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 msgr2=0x55903b6e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/2522259554 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55903b34f920 con 0x55903b6dab50 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff39bfff640 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.354+0000 7ff3a259c640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3900a2160 0x7ff3900a4620 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff394000c00 tx=0x7ff39402bc30 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.355+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6dab50 0x55903b6daf70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff39c014bb0 tx=0x7ff39c009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b49dc8def368f3eb server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.355+0000 7ff398ff9640 1 -- 172.21.15.12:0/2522259554 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0140d0 con 0x55903b6dab50 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.355+0000 7ff398ff9640 1 -- 172.21.15.12:0/2522259554 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff39c01a070 con 0x55903b6dab50 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.355+0000 7ff398ff9640 1 -- 172.21.15.12:0/2522259554 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c004290 con 0x55903b6dab50 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.355+0000 7ff3ab614740 1 -- 172.21.15.12:0/2522259554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6dab50 msgr2=0x55903b6daf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.355+0000 7ff3ab614740 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6dab50 0x55903b6daf70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff39c014bb0 tx=0x7ff39c009980 comp rx=0 tx=0).stop 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- 172.21.15.12:0/2522259554 shutdown_connections 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6e06b0 0x55903b6e2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 --2- 172.21.15.12:0/2522259554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6dab50 0x55903b6daf70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- 172.21.15.12:0/2522259554 >> 172.21.15.12:0/2522259554 conn(0x55903b6d1cb0 msgr2=0x55903b6d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- 172.21.15.12:0/2522259554 shutdown_connections 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- 172.21.15.12:0/2522259554 wait complete. 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- start start 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 Processor -- start 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6db540 0x55903b6e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 0x55903b6ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b5dafa0 con 0x55903b6e06b0 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b312250 con 0x55903b6dab50 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b5c4200 con 0x55903b6db540 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3ab614740 10 client.0 _ll_register_callbacks cb 0x55903b633b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:08:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3a2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 0x55903b6ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3a2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 0x55903b6ebfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34912/0 (socket says 172.21.15.12:34912) 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3110544530 learned_addr learned my addr 172.21.15.12:0/3110544530 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.356+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6db540 0x55903b6e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6db540 msgr2=0x55903b6e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6db540 0x55903b6e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3110544530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 msgr2=0x55903b6e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6e4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3110544530 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c014890 con 0x55903b6e06b0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 0x55903b6ebfc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff39c014f80 tx=0x7ff39c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bc5818a789c172 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff389ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff389ffb640 1 -- 172.21.15.12:0/3110544530 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c023070 con 0x55903b6e06b0 2024-02-14T13:08:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff389ffb640 1 -- 172.21.15.12:0/3110544530 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7ff39c004a40 con 0x55903b6e06b0 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55903b33e600 con 0x55903b6e06b0 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff389ffb640 1 -- 172.21.15.12:0/3110544530 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff39c004c00 con 0x55903b6e06b0 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3ab614740 10 client.15198 fetch_fsmap learned FSMap version 18 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55903b63cd70 con 0x55903b6e06b0 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.357+0000 7ff389ffb640 1 -- 172.21.15.12:0/3110544530 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff39c034020 con 0x55903b6e06b0 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff389ffb640 1 -- 172.21.15.12:0/3110544530 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff39c0045d0 con 0x55903b6e06b0 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff3ab614740 10 client.15198 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff3ab614740 10 client.15198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff3ab614740 20 client.15198 populate_metadata read hostname 'smithi012' 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b6f0820 0x55903b6f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff3ab614740 4 client.15198 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55903b38f1b0 con 0x55903b6f0820 2024-02-14T13:08:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b6f0820 0x55903b6f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff389ffb640 10 client.15198 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.358+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b6f0820 0x55903b6f2c40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4afd2905395e7dd server_cookie=d7ff0261edf24460 in_seq=0 out_seq=0 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff389ffb640 1 -- 172.21.15.12:0/3110544530 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55903b38f1b0 con 0x55903b6f0820 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff389ffb640 10 client.15198 handle_command_reply: tid=0 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 client.15198 shutdown 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 msgr2=0x55903b6ebfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 0x55903b6ebfc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff39c014f80 tx=0x7ff39c009ee0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 shutdown_connections 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b6f0820 0x55903b6f2c40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6e06b0 0x55903b6ebfc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6db540 0x55903b6e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff389ffb640 0 client.15198 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3110544530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 >> 172.21.15.12:0/3110544530 conn(0x55903b6d1cb0 msgr2=0x55903b6d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 shutdown_connections 2024-02-14T13:08:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 1 -- 172.21.15.12:0/3110544530 wait complete. 2024-02-14T13:08:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.359+0000 7ff3ab614740 20 client.15198 trim_cache size 0 max 16384 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 Processor -- start 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 -- start start 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6dbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 0x55903b6dc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b6ecab0 con 0x55903b6db540 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b6cd5a0 con 0x55903b6dab50 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff3ab614740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b6db970 con 0x55903b6e06b0 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6ebee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34926/0 (socket says 172.21.15.12:34926) 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 -- 172.21.15.12:0/3515200965 learned_addr learned my addr 172.21.15.12:0/3515200965 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 -- 172.21.15.12:0/3515200965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 msgr2=0x55903b6dc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 0x55903b6dc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 -- 172.21.15.12:0/3515200965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 msgr2=0x55903b6dbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6dbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 -- 172.21.15.12:0/3515200965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55903b5d9820 con 0x55903b6db540 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6ebee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55903b6d2c20 tx=0x7ff38c014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893e64e119aaa45c server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.373+0000 7ff38bfff640 1 -- 172.21.15.12:0/3515200965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c018040 con 0x55903b6db540 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff38bfff640 1 -- 172.21.15.12:0/3515200965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff38c021020 con 0x55903b6db540 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff38bfff640 1 -- 172.21.15.12:0/3515200965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012d80 con 0x55903b6db540 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 -- 172.21.15.12:0/3515200965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 msgr2=0x55903b6ebee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6ebee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55903b6d2c20 tx=0x7ff38c014840 comp rx=0 tx=0).stop 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 -- 172.21.15.12:0/3515200965 shutdown_connections 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 0x55903b6dc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6db540 0x55903b6ebee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3515200965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6dab50 0x55903b6dbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 -- 172.21.15.12:0/3515200965 >> 172.21.15.12:0/3515200965 conn(0x55903b6d1cb0 msgr2=0x55903b6e4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 -- 172.21.15.12:0/3515200965 shutdown_connections 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 -- 172.21.15.12:0/3515200965 wait complete. 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 -- start start 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.374+0000 7ff3ab614740 1 Processor -- start 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 0x55903b6ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6db540 0x55903b6ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 0x55903b6eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b6eb160 con 0x55903b6dab50 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b6eb2d0 con 0x55903b6db540 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903b746d10 con 0x55903b6e06b0 2024-02-14T13:08:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 10 client.0 _ll_register_callbacks cb 0x7ff39c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 0x55903b6ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 0x55903b6ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34928/0 (socket says 172.21.15.12:34928) 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3463676439 learned_addr learned my addr 172.21.15.12:0/3463676439 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 msgr2=0x55903b6eaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 0x55903b6eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3463676439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6db540 msgr2=0x55903b6ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6db540 0x55903b6ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 -- 172.21.15.12:0/3463676439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c009530 con 0x55903b6dab50 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3a2d9d640 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 0x55903b6ebe60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff39c014520 tx=0x7ff39c014ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d80d531747a3b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff389ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff389ffb640 1 -- 172.21.15.12:0/3463676439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c023070 con 0x55903b6dab50 2024-02-14T13:08:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff389ffb640 1 -- 172.21.15.12:0/3463676439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7ff39c035080 con 0x55903b6dab50 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff39c01a070 con 0x55903b6dab50 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.375+0000 7ff389ffb640 1 -- 172.21.15.12:0/3463676439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff39c009ba0 con 0x55903b6dab50 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 10 client.15204 fetch_fsmap learned FSMap version 18 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55903b5ff720 con 0x55903b6dab50 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff389ffb640 1 -- 172.21.15.12:0/3463676439 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff39c01a070 con 0x55903b6dab50 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff389ffb640 1 -- 172.21.15.12:0/3463676439 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff39c005040 con 0x55903b6dab50 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 10 client.15204 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 10 client.15204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 20 client.15204 populate_metadata read hostname 'smithi012' 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b748600 0x55903b74aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 4 client.15204 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55903b37b550 con 0x55903b748600 2024-02-14T13:08:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.376+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b748600 0x55903b74aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:08:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.377+0000 7ff389ffb640 10 client.15204 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.377+0000 7ff39bfff640 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b748600 0x55903b74aa20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b847e3b20f3163 server_cookie=e79c7158813ccccb in_seq=0 out_seq=0 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff389ffb640 1 -- 172.21.15.12:0/3463676439 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55903b37b550 con 0x55903b748600 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff389ffb640 10 client.15204 handle_command_reply: tid=0 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff3ab614740 1 client.15204 shutdown 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 msgr2=0x55903b6ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 0x55903b6ebe60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff39c014520 tx=0x7ff39c014ab0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 shutdown_connections 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55903b748600 0x55903b74aa20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.388+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55903b6e06b0 0x55903b6eaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff389ffb640 0 client.15204 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55903b6db540 0x55903b6ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3ab614740 1 --2- 172.21.15.12:0/3463676439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55903b6dab50 0x55903b6ebe60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 >> 172.21.15.12:0/3463676439 conn(0x55903b6d1cb0 msgr2=0x55903b6d4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 shutdown_connections 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3ab614740 1 -- 172.21.15.12:0/3463676439 wait complete. 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3ab614740 20 client.15204 trim_cache size 0 max 16384 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:08:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:08:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3900a2160 msgr2=0x7ff3900a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3900a2160 0x7ff3900a4620 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff394000c00 tx=0x7ff39402bc30 comp rx=0 tx=0).stop 2024-02-14T13:08:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 msgr2=0x7ff3a4197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:08:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4197250 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff394006010 tx=0x7ff394005e80 comp rx=0 tx=0).stop 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 shutdown_connections 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff3900a2160 0x7ff3900a4620 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3a4106f70 0x7ff3a419e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4104640 0x7ff3a4197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 --2- 172.21.15.12:0/1776326780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3a4101d10 0x7ff3a4197250 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 >> 172.21.15.12:0/1776326780 conn(0x7ff3a40fb700 msgr2=0x7ff3a4102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 shutdown_connections 2024-02-14T13:08:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:08:58.389+0000 7ff3a8965640 1 -- 172.21.15.12:0/1776326780 wait complete. 2024-02-14T13:08:59.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:08:59 smithi012 ceph-mon[32370]: pgmap v356: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 584 B/s wr, 2 op/s 2024-02-14T13:08:59.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:08:59 smithi103 ceph-mon[36921]: pgmap v356: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 584 B/s wr, 2 op/s 2024-02-14T13:09:00.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:08:59 smithi055 ceph-mon[36853]: pgmap v356: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 584 B/s wr, 2 op/s 2024-02-14T13:09:01.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:01 smithi012 ceph-mon[32370]: pgmap v357: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-02-14T13:09:01.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:01 smithi103 ceph-mon[36921]: pgmap v357: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-02-14T13:09:02.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:01 smithi055 ceph-mon[36853]: pgmap v357: 97 pgs: 97 active+clean; 649 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-02-14T13:09:03.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:03 smithi012 ceph-mon[32370]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-14T13:09:03.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:03 smithi103 ceph-mon[36921]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-14T13:09:04.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:03 smithi055 ceph-mon[36853]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-14T13:09:05.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:05 smithi103 ceph-mon[36921]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-02-14T13:09:06.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:05 smithi055 ceph-mon[36853]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-02-14T13:09:06.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:05 smithi012 ceph-mon[32370]: pgmap v359: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-02-14T13:09:07.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:07 smithi103 ceph-mon[36921]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-02-14T13:09:08.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:07 smithi055 ceph-mon[36853]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-02-14T13:09:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:07 smithi012 ceph-mon[32370]: pgmap v360: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-02-14T13:09:08.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:08 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:09:09.043 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:08 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:09:09.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:08 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:09:09.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:09 smithi103 ceph-mon[36921]: pgmap v361: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-02-14T13:09:10.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:09 smithi055 ceph-mon[36853]: pgmap v361: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-02-14T13:09:10.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:09 smithi012 ceph-mon[32370]: pgmap v361: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-02-14T13:09:11.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:09:11.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:09:11.062 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:09:11.218 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:09:11.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:09:11.243 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:09:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 -- 172.21.15.12:0/3033325834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0101d50 msgr2=0x7f62a0104140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3033325834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0101d50 0x7f62a0104140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6290009900 tx=0x7f629002bc30 comp rx=0 tx=0).stop 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 -- 172.21.15.12:0/3033325834 shutdown_connections 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3033325834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62a0106fb0 0x7f62a01093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3033325834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62a0104680 0x7f62a0106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3033325834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0101d50 0x7f62a0104140 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 -- 172.21.15.12:0/3033325834 >> 172.21.15.12:0/3033325834 conn(0x7f62a00fb6c0 msgr2=0x7f62a00fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 -- 172.21.15.12:0/3033325834 shutdown_connections 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 -- 172.21.15.12:0/3033325834 wait complete. 2024-02-14T13:09:11.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 Processor -- start 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.488+0000 7f62a69a1640 1 -- start start 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62a0101d50 0x7f62a01972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 0x7f62a01977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62a0106fb0 0x7f62a019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a019ed90 con 0x7f62a0104680 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a019ef00 con 0x7f62a0106fb0 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a019f0c0 con 0x7f62a0101d50 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 0x7f62a01977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 0x7f62a01977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50520/0 (socket says 172.21.15.12:50520) 2024-02-14T13:09:11.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 -- 172.21.15.12:0/3887867389 learned_addr learned my addr 172.21.15.12:0/3887867389 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629ffff640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62a0101d50 0x7f62a01972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 -- 172.21.15.12:0/3887867389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62a0101d50 msgr2=0x7f62a01972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62a0101d50 0x7f62a01972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 -- 172.21.15.12:0/3887867389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62a0106fb0 msgr2=0x7f62a019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62a0106fb0 0x7f62a019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 -- 172.21.15.12:0/3887867389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009560 con 0x7f62a0104680 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629f7fe640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 0x7f62a01977e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6294005fd0 tx=0x7f629400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629d7fa640 1 -- 172.21.15.12:0/3887867389 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294009c30 con 0x7f62a0104680 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f629d7fa640 1 -- 172.21.15.12:0/3887867389 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6294009d90 con 0x7f62a0104680 2024-02-14T13:09:11.496 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.489+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a019f3a0 con 0x7f62a0104680 2024-02-14T13:09:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.490+0000 7f629d7fa640 1 -- 172.21.15.12:0/3887867389 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294010460 con 0x7f62a0104680 2024-02-14T13:09:11.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.490+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a019f8b0 con 0x7f62a0104680 2024-02-14T13:09:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f629d7fa640 1 -- 172.21.15.12:0/3887867389 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f6294003f20 con 0x7f62a0104680 2024-02-14T13:09:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f62a9575740 1 Processor -- start 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f62a9575740 1 -- start start 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f62a9575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbbeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f62a9575740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f62a9575740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbc6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.492+0000 7f62a9575740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bb2d9e0 con 0x56315bbbf130 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62a9575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bb2af10 con 0x56315bbbe740 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62a9575740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bb266f0 con 0x56315bbc42a0 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629d7fa640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f62880a2160 0x7f62880a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50524/0 (socket says 172.21.15.12:50524) 2024-02-14T13:09:11.505 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 -- 172.21.15.12:0/4082198993 learned_addr learned my addr 172.21.15.12:0/4082198993 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629f7fe640 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbc6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f62880a2160 0x7f62880a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbbeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629d7fa640 1 -- 172.21.15.12:0/3887867389 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f62940cda50 con 0x7f62a0104680 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 -- 172.21.15.12:0/4082198993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 msgr2=0x56315bbc6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbc6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 -- 172.21.15.12:0/4082198993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 msgr2=0x56315bbbeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbbeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 -- 172.21.15.12:0/4082198993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56315b837920 con 0x56315bbbf130 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f62880a2160 0x7f62880a4620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56315bbbf990 tx=0x7f6298009200 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f629ffff640 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc3c30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6290009900 tx=0x7f629002c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0446d80b7d3cec3 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62867fc640 1 -- 172.21.15.12:0/4082198993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629002cc40 con 0x56315bbbf130 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62867fc640 1 -- 172.21.15.12:0/4082198993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6290004030 con 0x56315bbbf130 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.493+0000 7f62867fc640 1 -- 172.21.15.12:0/4082198993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6290005390 con 0x56315bbbf130 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 -- 172.21.15.12:0/4082198993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 msgr2=0x56315bbc3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc3c30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6290009900 tx=0x7f629002c990 comp rx=0 tx=0).stop 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 -- 172.21.15.12:0/4082198993 shutdown_connections 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbc6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc3c30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 --2- 172.21.15.12:0/4082198993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbbeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 -- 172.21.15.12:0/4082198993 >> 172.21.15.12:0/4082198993 conn(0x56315bbb9cb0 msgr2=0x56315bbba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 -- 172.21.15.12:0/4082198993 shutdown_connections 2024-02-14T13:09:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.494+0000 7f62a9575740 1 -- 172.21.15.12:0/4082198993 wait complete. 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 -- start start 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 Processor -- start 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbc8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbcfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bac2fa0 con 0x56315bbbf130 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315b7fa250 con 0x56315bbbe740 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315baac200 con 0x56315bbc42a0 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a9575740 10 client.0 _ll_register_callbacks cb 0x56315bb1bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50540/0 (socket says 172.21.15.12:50540) 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f629f7fe640 1 -- 172.21.15.12:0/3876661579 learned_addr learned my addr 172.21.15.12:0/3876661579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f629ffff640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbc8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.495+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbcfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f629f7fe640 1 -- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 msgr2=0x56315bbcfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f629f7fe640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbcfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f629f7fe640 1 -- 172.21.15.12:0/3876661579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 msgr2=0x56315bbc8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f629f7fe640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbc8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f629f7fe640 1 -- 172.21.15.12:0/3876661579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a0109f60 con 0x56315bbbf130 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbcfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f629f7fe640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc8ab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f62940a2950 tx=0x7f6294065c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aebca52d0caa6 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f627f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f627f7fe640 1 -- 172.21.15.12:0/3876661579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294065c90 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f627f7fe640 1 -- 172.21.15.12:0/3876661579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f629409a6e0 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56315b826600 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f627f7fe640 1 -- 172.21.15.12:0/3876661579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f629409e830 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a9575740 10 client.15216 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x56315bb24d70 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f627f7fe640 1 -- 172.21.15.12:0/3876661579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f62940b2080 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f627f7fe640 1 -- 172.21.15.12:0/3876661579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6294022020 con 0x56315bbbf130 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a9575740 10 client.15216 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a9575740 10 client.15216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.496+0000 7f62a9575740 20 client.15216 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.497+0000 7f62a9575740 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bbd43c0 0x56315bbd67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.497+0000 7f62a9575740 4 client.15216 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.497+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56315b8771b0 con 0x56315bbd43c0 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.497+0000 7f629ffff640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bbd43c0 0x56315bbd67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.497+0000 7f629ffff640 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bbd43c0 0x56315bbd67b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13745e702bf6f1fb server_cookie=d8ded5e037df2357 in_seq=0 out_seq=0 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.497+0000 7f627f7fe640 10 client.15216 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f627f7fe640 1 -- 172.21.15.12:0/3876661579 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56315b8771b0 con 0x56315bbd43c0 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f627f7fe640 10 client.15216 handle_command_reply: tid=0 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 client.15216 shutdown 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 msgr2=0x56315bbc8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc8ab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f62940a2950 tx=0x7f6294065c20 comp rx=0 tx=0).stop 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 shutdown_connections 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bbd43c0 0x56315bbd67b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbcfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbc8ab0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f627f7fe640 0 client.15216 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 --2- 172.21.15.12:0/3876661579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbc8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 >> 172.21.15.12:0/3876661579 conn(0x56315bbb9cb0 msgr2=0x56315bbb8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 shutdown_connections 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 1 -- 172.21.15.12:0/3876661579 wait complete. 2024-02-14T13:09:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.498+0000 7f62a9575740 20 client.15216 trim_cache size 0 max 16384 2024-02-14T13:09:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.511+0000 7f62a9575740 1 Processor -- start 2024-02-14T13:09:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 -- start start 2024-02-14T13:09:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbbe740 0x56315bbb8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbcfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbc42a0 0x56315bbb8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bbc6bf0 con 0x56315bbbf130 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315b8771b0 con 0x56315bbc42a0 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a9575740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bbbf560 con 0x56315bbbe740 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbcfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbcfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50544/0 (socket says 172.21.15.12:50544) 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 -- 172.21.15.12:0/2474253366 learned_addr learned my addr 172.21.15.12:0/2474253366 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629ffff640 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbbe740 0x56315bbb8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 -- 172.21.15.12:0/2474253366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbbe740 msgr2=0x56315bbb8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbbe740 0x56315bbb8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 -- 172.21.15.12:0/2474253366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbc42a0 msgr2=0x56315bbb8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbc42a0 0x56315bbb8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbc42a0 0x56315bbb8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 -- 172.21.15.12:0/2474253366 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56315bac1820 con 0x56315bbbf130 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629ffff640 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbbe740 0x56315bbb8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f629f7fe640 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbcfab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6294096b40 tx=0x7f629401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a02da241a813ce server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f6285ffb640 1 -- 172.21.15.12:0/2474253366 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629409a040 con 0x56315bbbf130 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.512+0000 7f6285ffb640 1 -- 172.21.15.12:0/2474253366 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x56315b826600 con 0x56315bbbf130 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f6285ffb640 1 -- 172.21.15.12:0/2474253366 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940b30f0 con 0x56315bbbf130 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 -- 172.21.15.12:0/2474253366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 msgr2=0x56315bbcfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbcfab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6294096b40 tx=0x7f629401d000 comp rx=0 tx=0).stop 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 -- 172.21.15.12:0/2474253366 shutdown_connections 2024-02-14T13:09:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbc42a0 0x56315bbb8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbcfab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 --2- 172.21.15.12:0/2474253366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbbe740 0x56315bbb8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 -- 172.21.15.12:0/2474253366 >> 172.21.15.12:0/2474253366 conn(0x56315bbb9cb0 msgr2=0x56315bbc8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 -- 172.21.15.12:0/2474253366 shutdown_connections 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 -- 172.21.15.12:0/2474253366 wait complete. 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.513+0000 7f62a9575740 1 -- start start 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 Processor -- start 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bbcfe20 con 0x56315bbbf130 2024-02-14T13:09:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bc2a880 con 0x56315bbbe740 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315bc2a9f0 con 0x56315bbc42a0 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a9575740 10 client.0 _ll_register_callbacks cb 0x7f6290005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50556/0 (socket says 172.21.15.12:50556) 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 -- 172.21.15.12:0/1018971625 learned_addr learned my addr 172.21.15.12:0/1018971625 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f62a4f3e640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 -- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 msgr2=0x56315bbced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629ffff640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 -- 172.21.15.12:0/1018971625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 msgr2=0x56315bbce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 -- 172.21.15.12:0/1018971625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56315bb24d70 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f629f7fe640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbce850 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6294009610 tx=0x7f62940a2f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cbd9978945c240 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.514+0000 7f627f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f627f7fe640 1 -- 172.21.15.12:0/1018971625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294014070 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f627f7fe640 1 -- 172.21.15.12:0/1018971625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f629409a6e0 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6290004030 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f627f7fe640 1 -- 172.21.15.12:0/1018971625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6294096d50 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 10 client.15222 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x56315bae7720 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f627f7fe640 1 -- 172.21.15.12:0/1018971625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f629407d020 con 0x56315bbbf130 2024-02-14T13:09:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f627f7fe640 1 -- 172.21.15.12:0/1018971625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6294022070 con 0x56315bbbf130 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 10 client.15222 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 10 client.15222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 20 client.15222 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bc2bf80 0x56315bc2e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 4 client.15222 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56315b863550 con 0x56315bc2bf80 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.515+0000 7f629ffff640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bc2bf80 0x56315bc2e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.516+0000 7f629ffff640 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bc2bf80 0x56315bc2e370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee3654ce291db407 server_cookie=e7865560aa88cf04 in_seq=0 out_seq=0 2024-02-14T13:09:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.516+0000 7f627f7fe640 10 client.15222 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f627f7fe640 1 -- 172.21.15.12:0/1018971625 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56315b863550 con 0x56315bc2bf80 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f627f7fe640 10 client.15222 handle_command_reply: tid=0 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 client.15222 shutdown 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 msgr2=0x56315bbce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbce850 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6294009610 tx=0x7f62940a2f60 comp rx=0 tx=0).stop 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 shutdown_connections 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x56315bc2bf80 0x56315bc2e370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56315bbc42a0 0x56315bbced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56315bbbf130 0x56315bbce850 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f627f7fe640 0 client.15222 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 --2- 172.21.15.12:0/1018971625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56315bbbe740 0x56315bbce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 >> 172.21.15.12:0/1018971625 conn(0x56315bbb9cb0 msgr2=0x56315bbbcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 shutdown_connections 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 1 -- 172.21.15.12:0/1018971625 wait complete. 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a9575740 20 client.15222 trim_cache size 0 max 16384 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:09:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:09:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f62880a2160 msgr2=0x7f62880a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f62880a2160 0x7f62880a4620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x56315bbbf990 tx=0x7f6298009200 comp rx=0 tx=0).stop 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 msgr2=0x7f62a01977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 0x7f62a01977e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6294005fd0 tx=0x7f629400dde0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 shutdown_connections 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f62880a2160 0x7f62880a4620 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62a0106fb0 0x7f62a019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a0104680 0x7f62a01977e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 --2- 172.21.15.12:0/3887867389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62a0101d50 0x7f62a01972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 >> 172.21.15.12:0/3887867389 conn(0x7f62a00fb6c0 msgr2=0x7f62a0102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 shutdown_connections 2024-02-14T13:09:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:11.523+0000 7f62a69a1640 1 -- 172.21.15.12:0/3887867389 wait complete. 2024-02-14T13:09:12.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:11 smithi012 ceph-mon[32370]: pgmap v362: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-02-14T13:09:12.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:11 smithi103 ceph-mon[36921]: pgmap v362: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-02-14T13:09:12.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:11 smithi055 ceph-mon[36853]: pgmap v362: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-02-14T13:09:14.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:13 smithi012 ceph-mon[32370]: pgmap v363: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-14T13:09:14.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:13 smithi103 ceph-mon[36921]: pgmap v363: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-14T13:09:14.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:13 smithi055 ceph-mon[36853]: pgmap v363: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-14T13:09:16.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:15 smithi012 ceph-mon[32370]: pgmap v364: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-02-14T13:09:16.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:15 smithi103 ceph-mon[36921]: pgmap v364: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-02-14T13:09:16.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:15 smithi055 ceph-mon[36853]: pgmap v364: 97 pgs: 97 active+clean; 652 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-02-14T13:09:18.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:17 smithi012 ceph-mon[32370]: pgmap v365: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-14T13:09:18.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:17 smithi103 ceph-mon[36921]: pgmap v365: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-14T13:09:18.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:17 smithi055 ceph-mon[36853]: pgmap v365: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-14T13:09:20.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:19 smithi012 ceph-mon[32370]: pgmap v366: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 2 op/s 2024-02-14T13:09:20.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:19 smithi103 ceph-mon[36921]: pgmap v366: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 2 op/s 2024-02-14T13:09:20.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:19 smithi055 ceph-mon[36853]: pgmap v366: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 2 op/s 2024-02-14T13:09:22.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:21 smithi012 ceph-mon[32370]: pgmap v367: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 511 B/s wr, 2 op/s 2024-02-14T13:09:22.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:21 smithi103 ceph-mon[36921]: pgmap v367: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 511 B/s wr, 2 op/s 2024-02-14T13:09:22.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:21 smithi055 ceph-mon[36853]: pgmap v367: 97 pgs: 97 active+clean; 653 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 511 B/s wr, 2 op/s 2024-02-14T13:09:24.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:23 smithi012 ceph-mon[32370]: pgmap v368: 97 pgs: 97 active+clean; 662 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-14T13:09:24.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:23 smithi103 ceph-mon[36921]: pgmap v368: 97 pgs: 97 active+clean; 662 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-14T13:09:24.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:23 smithi055 ceph-mon[36853]: pgmap v368: 97 pgs: 97 active+clean; 662 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-14T13:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- 172.21.15.12:0/2006976456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c101340 msgr2=0x7f336c1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2006976456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c101340 0x7f336c1017c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f335c009900 tx=0x7f335c02bc30 comp rx=0 tx=0).stop 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- 172.21.15.12:0/2006976456 shutdown_connections 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2006976456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101d00 0x7f336c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2006976456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c101340 0x7f336c1017c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2006976456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c100150 0x7f336c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- 172.21.15.12:0/2006976456 >> 172.21.15.12:0/2006976456 conn(0x7f336c0fb6c0 msgr2=0x7f336c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- 172.21.15.12:0/2006976456 shutdown_connections 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- 172.21.15.12:0/2006976456 wait complete. 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 Processor -- start 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- start start 2024-02-14T13:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 0x7f336c069440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101340 0x7f336c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c101d00 0x7f336c19e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c19ed70 con 0x7f336c100150 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c19eee0 con 0x7f336c101340 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.627+0000 7f3373f7a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c19f0a0 con 0x7f336c101d00 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 0x7f336c069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 0x7f336c069440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52062/0 (socket says 172.21.15.12:52062) 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 -- 172.21.15.12:0/2876868094 learned_addr learned my addr 172.21.15.12:0/2876868094 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371515640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101340 0x7f336c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3372517640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c101d00 0x7f336c19e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 -- 172.21.15.12:0/2876868094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c101d00 msgr2=0x7f336c19e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c101d00 0x7f336c19e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 -- 172.21.15.12:0/2876868094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101340 msgr2=0x7f336c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101340 0x7f336c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 -- 172.21.15.12:0/2876868094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009560 con 0x7f336c100150 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371515640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101340 0x7f336c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3371d16640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 0x7f336c069440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f336800d950 tx=0x7f336800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3362ffd640 1 -- 172.21.15.12:0/2876868094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368009c30 con 0x7f336c100150 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3362ffd640 1 -- 172.21.15.12:0/2876868094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3368009d90 con 0x7f336c100150 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c19f380 con 0x7f336c100150 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3362ffd640 1 -- 172.21.15.12:0/2876868094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800f720 con 0x7f336c100150 2024-02-14T13:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.628+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c19f840 con 0x7f336c100150 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3362ffd640 1 -- 172.21.15.12:0/2876868094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f3368010a60 con 0x7f336c100150 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 Processor -- start 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 -- start start 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3362ffd640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f33580a2160 0x7f33580a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a6ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a6fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a72730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa219d99e0 con 0x55fa21a6a740 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa219d6f10 con 0x55fa21a6b130 2024-02-14T13:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.631+0000 7f3376c26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa219d26f0 con 0x55fa21a702a0 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3362ffd640 1 -- 172.21.15.12:0/2876868094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f33680cdae0 con 0x7f336c100150 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3372517640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f33580a2160 0x7f33580a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a6ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a6ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52064/0 (socket says 172.21.15.12:52064) 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 -- 172.21.15.12:0/1823434459 learned_addr learned my addr 172.21.15.12:0/1823434459 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3372517640 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a72730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371515640 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a6fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 -- 172.21.15.12:0/1823434459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 msgr2=0x55fa21a72730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a72730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 -- 172.21.15.12:0/1823434459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 msgr2=0x55fa21a6fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a6fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 -- 172.21.15.12:0/1823434459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa216e3920 con 0x55fa21a6a740 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3372517640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f33580a2160 0x7f33580a4620 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f33640125f0 tx=0x7f33640129f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3371d16640 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a6ab60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f33680971a0 tx=0x7f3368096b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f779c95adcb29a server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3357fff640 1 -- 172.21.15.12:0/1823434459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336809aed0 con 0x55fa21a6a740 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3357fff640 1 -- 172.21.15.12:0/1823434459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f336806ec50 con 0x55fa21a6a740 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.632+0000 7f3357fff640 1 -- 172.21.15.12:0/1823434459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680a2f70 con 0x55fa21a6a740 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 -- 172.21.15.12:0/1823434459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 msgr2=0x55fa21a6ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a6ab60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f33680971a0 tx=0x7f3368096b90 comp rx=0 tx=0).stop 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 -- 172.21.15.12:0/1823434459 shutdown_connections 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a72730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a6fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 --2- 172.21.15.12:0/1823434459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a6ab60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 -- 172.21.15.12:0/1823434459 >> 172.21.15.12:0/1823434459 conn(0x55fa21a65cb0 msgr2=0x55fa21a660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 -- 172.21.15.12:0/1823434459 shutdown_connections 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.633+0000 7f3376c26740 1 -- 172.21.15.12:0/1823434459 wait complete. 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 -- start start 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 Processor -- start 2024-02-14T13:09:24.642 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a74770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a74cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2196efa0 con 0x55fa21a6b130 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa216a6250 con 0x55fa21a6a740 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa21958200 con 0x55fa21a702a0 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3376c26740 10 client.0 _ll_register_callbacks cb 0x55fa219c7b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a74cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a74cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52068/0 (socket says 172.21.15.12:52068) 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 -- 172.21.15.12:0/2701639379 learned_addr learned my addr 172.21.15.12:0/2701639379 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371d16640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a74770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3372517640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 -- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 msgr2=0x55fa21a7bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 -- 172.21.15.12:0/2701639379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 msgr2=0x55fa21a74770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a74770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.634+0000 7f3371515640 1 -- 172.21.15.12:0/2701639379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c19f840 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3371515640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a74cb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f335c000c00 tx=0x7f335c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4987f16e51d865d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f33557fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f33557fa640 1 -- 172.21.15.12:0/2701639379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c004450 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f33557fa640 1 -- 172.21.15.12:0/2701639379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f335c004df0 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa216d2600 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f33557fa640 1 -- 172.21.15.12:0/2701639379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f335c04d020 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 10 client.15234 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55fa219d0d70 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f33557fa640 1 -- 172.21.15.12:0/2701639379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x55fa216d2600 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f33557fa640 1 -- 172.21.15.12:0/2701639379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f335c003bb0 con 0x55fa21a6b130 2024-02-14T13:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 10 client.15234 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 10 client.15234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 20 client.15234 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21a82a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 4 client.15234 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.635+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa217231b0 con 0x55fa21a805e0 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.636+0000 7f3371d16640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21a82a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.636+0000 7f33557fa640 10 client.15234 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.636+0000 7f3371d16640 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21a82a00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=934cbcc758cb0ace server_cookie=3d19e6356a4aadf0 in_seq=0 out_seq=0 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f33557fa640 1 -- 172.21.15.12:0/2701639379 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fa217231b0 con 0x55fa21a805e0 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f33557fa640 10 client.15234 handle_command_reply: tid=0 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 client.15234 shutdown 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 msgr2=0x55fa21a74cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a74cb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f335c000c00 tx=0x7f335c004ab0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 shutdown_connections 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21a82a00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f33557fa640 0 client.15234 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a74cb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 --2- 172.21.15.12:0/2701639379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a74770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 >> 172.21.15.12:0/2701639379 conn(0x55fa21a65cb0 msgr2=0x55fa21a64ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 shutdown_connections 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 1 -- 172.21.15.12:0/2701639379 wait complete. 2024-02-14T13:09:24.646 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.637+0000 7f3376c26740 20 client.15234 trim_cache size 0 max 16384 2024-02-14T13:09:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 Processor -- start 2024-02-14T13:09:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 -- start start 2024-02-14T13:09:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a6bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a7bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa21a745b0 con 0x55fa21a6b130 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa217231b0 con 0x55fa21a6a740 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3376c26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa216d2600 con 0x55fa21a702a0 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3371515640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a7bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3371515640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a7bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52082/0 (socket says 172.21.15.12:52082) 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.650+0000 7f3371515640 1 -- 172.21.15.12:0/814415796 learned_addr learned my addr 172.21.15.12:0/814415796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371d16640 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a6bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371515640 1 -- 172.21.15.12:0/814415796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 msgr2=0x55fa21a6c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3372517640 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371515640 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a6c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371515640 1 -- 172.21.15.12:0/814415796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 msgr2=0x55fa21a6bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371515640 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a6bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371515640 1 -- 172.21.15.12:0/814415796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2196d820 con 0x55fa21a6b130 2024-02-14T13:09:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371d16640 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a6bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:09:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f3371515640 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a7bc40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f335c02c320 tx=0x7f335c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae87ac58e06c1cf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f33577fe640 1 -- 172.21.15.12:0/814415796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c004b20 con 0x55fa21a6b130 2024-02-14T13:09:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f33577fe640 1 -- 172.21.15.12:0/814415796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f335c034e40 con 0x55fa21a6b130 2024-02-14T13:09:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.651+0000 7f33577fe640 1 -- 172.21.15.12:0/814415796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c003b50 con 0x55fa21a6b130 2024-02-14T13:09:24.658 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 -- 172.21.15.12:0/814415796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 msgr2=0x55fa21a7bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a7bc40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f335c02c320 tx=0x7f335c0058b0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 -- 172.21.15.12:0/814415796 shutdown_connections 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a6c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6b130 0x55fa21a7bc40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 --2- 172.21.15.12:0/814415796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6a740 0x55fa21a6bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 -- 172.21.15.12:0/814415796 >> 172.21.15.12:0/814415796 conn(0x55fa21a65cb0 msgr2=0x55fa21a66090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 -- 172.21.15.12:0/814415796 shutdown_connections 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 -- 172.21.15.12:0/814415796 wait complete. 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.652+0000 7f3376c26740 1 -- start start 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 Processor -- start 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a7a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.659 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa21a7b700 con 0x55fa21a6a740 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa21a7b870 con 0x55fa21a6b130 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa21a7ba30 con 0x55fa21a702a0 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3376c26740 10 client.0 _ll_register_callbacks cb 0x7f3368010d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a79d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52086/0 (socket says 172.21.15.12:52086) 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 -- 172.21.15.12:0/3062513148 learned_addr learned my addr 172.21.15.12:0/3062513148 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3372517640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371515640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a7a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 -- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 msgr2=0x55fa21a7b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 -- 172.21.15.12:0/3062513148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 msgr2=0x55fa21a7a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a7a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371d16640 1 -- 172.21.15.12:0/3062513148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa219d0d70 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3371515640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a7a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.653+0000 7f3372517640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3371d16640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a79d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33680a2a40 tx=0x7f3368096440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbb0940edcda1ff server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f33557fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f33557fa640 1 -- 172.21.15.12:0/3062513148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680b2070 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f33557fa640 1 -- 172.21.15.12:0/3062513148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f33680a2f70 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f336806ec50 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f33557fa640 1 -- 172.21.15.12:0/3062513148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f336809a130 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 10 client.15240 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55fa21993720 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f33557fa640 1 -- 172.21.15.12:0/3062513148 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f336806ec50 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f33557fa640 1 -- 172.21.15.12:0/3062513148 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3368096e40 con 0x55fa21a6a740 2024-02-14T13:09:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 10 client.15240 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 10 client.15240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 20 client.15240 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21ad9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 4 client.15240 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.654+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fa2170f550 con 0x55fa21a805e0 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.655+0000 7f3371515640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21ad9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.655+0000 7f3371515640 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21ad9a00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332ac9c12f9ccc92 server_cookie=20c15c646a2c85cd in_seq=0 out_seq=0 2024-02-14T13:09:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.655+0000 7f33557fa640 10 client.15240 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.662+0000 7f33557fa640 1 -- 172.21.15.12:0/3062513148 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fa2170f550 con 0x55fa21a805e0 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.662+0000 7f33557fa640 10 client.15240 handle_command_reply: tid=0 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.662+0000 7f3376c26740 1 client.15240 shutdown 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.662+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 msgr2=0x55fa21a79d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.662+0000 7f3376c26740 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a79d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33680a2a40 tx=0x7f3368096440 comp rx=0 tx=0).stop 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 shutdown_connections 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fa21a805e0 0x55fa21ad9a00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa21a702a0 0x55fa21a7b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa21a6b130 0x55fa21a7a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f33557fa640 0 client.15240 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 --2- 172.21.15.12:0/3062513148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa21a6a740 0x55fa21a79d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 >> 172.21.15.12:0/3062513148 conn(0x55fa21a65cb0 msgr2=0x55fa21a68f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 shutdown_connections 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 1 -- 172.21.15.12:0/3062513148 wait complete. 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3376c26740 20 client.15240 trim_cache size 0 max 16384 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:09:24.666 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f33580a2160 msgr2=0x7f33580a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f33580a2160 0x7f33580a4620 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f33640125f0 tx=0x7f33640129f0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 msgr2=0x7f336c069440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 0x7f336c069440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f336800d950 tx=0x7f336800de10 comp rx=0 tx=0).stop 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 shutdown_connections 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f33580a2160 0x7f33580a4620 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f336c101d00 0x7f336c19e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f336c101340 0x7f336c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.667 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 --2- 172.21.15.12:0/2876868094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f336c100150 0x7f336c069440 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.663+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 >> 172.21.15.12:0/2876868094 conn(0x7f336c0fb6c0 msgr2=0x7f336c104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.664+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 shutdown_connections 2024-02-14T13:09:24.668 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:24.664+0000 7f3373f7a640 1 -- 172.21.15.12:0/2876868094 wait complete. 2024-02-14T13:09:26.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:25 smithi012 ceph-mon[32370]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-14T13:09:26.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:25 smithi103 ceph-mon[36921]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-14T13:09:26.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:25 smithi055 ceph-mon[36853]: pgmap v369: 97 pgs: 97 active+clean; 662 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-14T13:09:28.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:27 smithi012 ceph-mon[32370]: pgmap v370: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-14T13:09:28.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:27 smithi103 ceph-mon[36921]: pgmap v370: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-14T13:09:28.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:27 smithi055 ceph-mon[36853]: pgmap v370: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-14T13:09:30.124 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:29 smithi055 ceph-mon[36853]: pgmap v371: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-02-14T13:09:30.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:29 smithi012 ceph-mon[32370]: pgmap v371: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-02-14T13:09:30.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:29 smithi103 ceph-mon[36921]: pgmap v371: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-02-14T13:09:32.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:31 smithi012 ceph-mon[32370]: pgmap v372: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-14T13:09:32.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:31 smithi103 ceph-mon[36921]: pgmap v372: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-14T13:09:32.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:31 smithi055 ceph-mon[36853]: pgmap v372: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-14T13:09:34.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:33 smithi012 ceph-mon[32370]: pgmap v373: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-02-14T13:09:34.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:33 smithi103 ceph-mon[36921]: pgmap v373: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-02-14T13:09:34.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:33 smithi055 ceph-mon[36853]: pgmap v373: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-02-14T13:09:36.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:35 smithi012 ceph-mon[32370]: pgmap v374: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 767 B/s wr, 3 op/s 2024-02-14T13:09:36.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:35 smithi103 ceph-mon[36921]: pgmap v374: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 767 B/s wr, 3 op/s 2024-02-14T13:09:36.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:35 smithi055 ceph-mon[36853]: pgmap v374: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 767 B/s wr, 3 op/s 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 -- 172.21.15.12:0/3744895608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4106fb0 msgr2=0x7f74c41093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 --2- 172.21.15.12:0/3744895608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4106fb0 0x7f74c41093a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009ca0 tx=0x7f74bc02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 -- 172.21.15.12:0/3744895608 shutdown_connections 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 --2- 172.21.15.12:0/3744895608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4106fb0 0x7f74c41093a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 --2- 172.21.15.12:0/3744895608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c4104680 0x7f74c4106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 --2- 172.21.15.12:0/3744895608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4101d50 0x7f74c4104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 -- 172.21.15.12:0/3744895608 >> 172.21.15.12:0/3744895608 conn(0x7f74c40fb6c0 msgr2=0x7f74c40fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.797+0000 7f74ca040640 1 -- 172.21.15.12:0/3744895608 shutdown_connections 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 -- 172.21.15.12:0/3744895608 wait complete. 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 Processor -- start 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 -- start start 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 0x7f74c4197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c4104680 0x7f74c4197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4106fb0 0x7f74c419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c419ed20 con 0x7f74c4101d50 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c419ee90 con 0x7f74c4106fb0 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.798+0000 7f74ca040640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c419f050 con 0x7f74c4104680 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 0x7f74c4197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 0x7f74c4197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53492/0 (socket says 172.21.15.12:53492) 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 -- 172.21.15.12:0/2534820118 learned_addr learned my addr 172.21.15.12:0/2534820118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c4104680 0x7f74c4197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c3fff640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4106fb0 0x7f74c419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 -- 172.21.15.12:0/2534820118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c4104680 msgr2=0x7f74c4197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c4104680 0x7f74c4197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 -- 172.21.15.12:0/2534820118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4106fb0 msgr2=0x7f74c419e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4106fb0 0x7f74c419e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 -- 172.21.15.12:0/2534820118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc009900 con 0x7f74c4101d50 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c37fe640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 0x7f74c4197230 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e9f0 tx=0x7f74b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c0ff9640 1 -- 172.21.15.12:0/2534820118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4009700 con 0x7f74c4101d50 2024-02-14T13:09:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74c0ff9640 1 -- 172.21.15.12:0/2534820118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f74b400cd80 con 0x7f74c4101d50 2024-02-14T13:09:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.799+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c419f330 con 0x7f74c4101d50 2024-02-14T13:09:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.800+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c419f840 con 0x7f74c4101d50 2024-02-14T13:09:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.800+0000 7f74c0ff9640 1 -- 172.21.15.12:0/2534820118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4018920 con 0x7f74c4101d50 2024-02-14T13:09:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74c0ff9640 1 -- 172.21.15.12:0/2534820118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f74b4018b60 con 0x7f74c4101d50 2024-02-14T13:09:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 Processor -- start 2024-02-14T13:09:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 -- start start 2024-02-14T13:09:37.805 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f30b50 0x55a4f5f30f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f36040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f38b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5e9b9e0 con 0x55a4f5f366b0 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5e98f10 con 0x55a4f5f31540 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5e946f0 con 0x55a4f5f30b50 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f36040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f30b50 0x55a4f5f30f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74c2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f38b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f30b50 0x55a4f5f30f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:33110/0 (socket says 172.21.15.12:33110) 2024-02-14T13:09:37.806 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.803+0000 7f74c3fff640 1 -- 172.21.15.12:0/823351544 learned_addr learned my addr 172.21.15.12:0/823351544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:37.807 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c37fe640 1 -- 172.21.15.12:0/823351544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f30b50 msgr2=0x55a4f5f30f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c37fe640 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f30b50 0x55a4f5f30f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c37fe640 1 -- 172.21.15.12:0/823351544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 msgr2=0x55a4f5f38b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c37fe640 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f38b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c37fe640 1 -- 172.21.15.12:0/823351544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4f5ba5920 con 0x55a4f5f31540 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f38b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c0ff9640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f74ac0a2350 0x7f74ac0a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c3fff640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f74ac0a2350 0x7f74ac0a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c0ff9640 1 -- 172.21.15.12:0/2534820118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f74b4014070 con 0x7f74c4101d50 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.804+0000 7f74c37fe640 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f36040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74b40cb910 tx=0x7f74b40d66e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c574e22d6389c309 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.805+0000 7f74a9ffb640 1 -- 172.21.15.12:0/823351544 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4096ef0 con 0x55a4f5f31540 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.805+0000 7f74a9ffb640 1 -- 172.21.15.12:0/823351544 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f74b409aa20 con 0x55a4f5f31540 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.805+0000 7f74a9ffb640 1 -- 172.21.15.12:0/823351544 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b409ace0 con 0x55a4f5f31540 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.805+0000 7f74ccc0d740 1 -- 172.21.15.12:0/823351544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 msgr2=0x55a4f5f36040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.805+0000 7f74c3fff640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f74ac0a2350 0x7f74ac0a4810 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74bc006010 tx=0x7f74bc0326b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.805+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f36040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74b40cb910 tx=0x7f74b40d66e0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 -- 172.21.15.12:0/823351544 shutdown_connections 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f38b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f36040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/823351544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f30b50 0x55a4f5f30f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 -- 172.21.15.12:0/823351544 >> 172.21.15.12:0/823351544 conn(0x55a4f5f27cb0 msgr2=0x55a4f5f280b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 -- 172.21.15.12:0/823351544 shutdown_connections 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 -- 172.21.15.12:0/823351544 wait complete. 2024-02-14T13:09:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 -- start start 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 Processor -- start 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.806+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f3aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f3afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f42010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5e30fa0 con 0x55a4f5f366b0 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5b68250 con 0x55a4f5f30b50 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5e1a200 con 0x55a4f5f31540 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74ccc0d740 10 client.0 _ll_register_callbacks cb 0x55a4f5e89b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f42010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f42010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53518/0 (socket says 172.21.15.12:53518) 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c3fff640 1 -- 172.21.15.12:0/3996529119 learned_addr learned my addr 172.21.15.12:0/3996529119 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f3afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.813 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c37fe640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f3aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c2ffd640 1 -- 172.21.15.12:0/3996529119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 msgr2=0x55a4f5f3aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f3aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c2ffd640 1 -- 172.21.15.12:0/3996529119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 msgr2=0x55a4f5f42010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f42010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c2ffd640 1 -- 172.21.15.12:0/3996529119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c419f840 con 0x55a4f5f31540 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.807+0000 7f74c3fff640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f3afd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74c4198740 tx=0x7f74b8012b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f4e53b6c181b35 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74a2ffd640 1 -- 172.21.15.12:0/3996529119 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8017070 con 0x55a4f5f31540 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74a2ffd640 1 -- 172.21.15.12:0/3996529119 <== mon.1 v2:172.21.15.103:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f74b8004050 con 0x55a4f5f31540 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4f5b94600 con 0x55a4f5f31540 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74a2ffd640 1 -- 172.21.15.12:0/3996529119 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74b8021020 con 0x55a4f5f31540 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74ccc0d740 10 client.24919 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55a4f5e92d70 con 0x55a4f5f31540 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.808+0000 7f74a2ffd640 1 -- 172.21.15.12:0/3996529119 <== mon.1 v2:172.21.15.103:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f74b800fd70 con 0x55a4f5f31540 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74a2ffd640 1 -- 172.21.15.12:0/3996529119 <== mon.1 v2:172.21.15.103:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f74b80039a0 con 0x55a4f5f31540 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74ccc0d740 10 client.24919 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74ccc0d740 10 client.24919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74ccc0d740 20 client.24919 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f46a10 0x55a4f5f48e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74ccc0d740 4 client.24919 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4f5b94600 con 0x55a4f5f46a10 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74c37fe640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f46a10 0x55a4f5f48e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74a2ffd640 10 client.24919 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.809+0000 7f74c37fe640 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f46a10 0x55a4f5f48e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c576f81af57895e server_cookie=93e8a19a4bf3296c in_seq=0 out_seq=0 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74a2ffd640 1 -- 172.21.15.12:0/3996529119 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a4f5b94600 con 0x55a4f5f46a10 2024-02-14T13:09:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74a2ffd640 10 client.24919 handle_command_reply: tid=0 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 client.24919 shutdown 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 msgr2=0x55a4f5f3afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f3afd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74c4198740 tx=0x7f74b8012b40 comp rx=0 tx=0).stop 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 shutdown_connections 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f46a10 0x55a4f5f48e70 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f3afd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/3996529119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f3aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 >> 172.21.15.12:0/3996529119 conn(0x55a4f5f27cb0 msgr2=0x55a4f5f26ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.810+0000 7f74a2ffd640 0 client.24919 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.811+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 shutdown_connections 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.811+0000 7f74ccc0d740 1 -- 172.21.15.12:0/3996529119 wait complete. 2024-02-14T13:09:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.811+0000 7f74ccc0d740 20 client.24919 trim_cache size 0 max 16384 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 Processor -- start 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 -- start start 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f30b50 0x55a4f5f39910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f41fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f366b0 0x55a4f5f39e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5f28c50 con 0x55a4f5f30b50 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5f31920 con 0x55a4f5f31540 2024-02-14T13:09:37.830 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5f44f30 con 0x55a4f5f366b0 2024-02-14T13:09:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f41fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f41fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.12:34548/0 (socket says 172.21.15.12:34548) 2024-02-14T13:09:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74c2ffd640 1 -- 172.21.15.12:0/2769711576 learned_addr learned my addr 172.21.15.12:0/2769711576 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74c37fe640 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f30b50 0x55a4f5f39910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.828+0000 7f74c3fff640 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f366b0 0x55a4f5f39e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c2ffd640 1 -- 172.21.15.12:0/2769711576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f366b0 msgr2=0x55a4f5f39e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f366b0 0x55a4f5f39e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c2ffd640 1 -- 172.21.15.12:0/2769711576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f30b50 msgr2=0x55a4f5f39910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f30b50 0x55a4f5f39910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c2ffd640 1 -- 172.21.15.12:0/2769711576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4f5e2f820 con 0x55a4f5f31540 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c37fe640 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f30b50 0x55a4f5f39910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f41fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f74b800a010 tx=0x7f74b8009d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944260d252be17f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74a97fa640 1 -- 172.21.15.12:0/2769711576 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8017040 con 0x55a4f5f31540 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74a97fa640 1 -- 172.21.15.12:0/2769711576 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f74b8003ad0 con 0x55a4f5f31540 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.829+0000 7f74a97fa640 1 -- 172.21.15.12:0/2769711576 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8010a40 con 0x55a4f5f31540 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 -- 172.21.15.12:0/2769711576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 msgr2=0x55a4f5f41fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f41fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f74b800a010 tx=0x7f74b8009d60 comp rx=0 tx=0).stop 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 -- 172.21.15.12:0/2769711576 shutdown_connections 2024-02-14T13:09:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f366b0 0x55a4f5f39e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f31540 0x55a4f5f41fd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/2769711576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f30b50 0x55a4f5f39910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 -- 172.21.15.12:0/2769711576 >> 172.21.15.12:0/2769711576 conn(0x55a4f5f27cb0 msgr2=0x55a4f5f3aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 -- 172.21.15.12:0/2769711576 shutdown_connections 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 -- 172.21.15.12:0/2769711576 wait complete. 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.830+0000 7f74ccc0d740 1 -- start start 2024-02-14T13:09:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 Processor -- start 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f41b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5f42380 con 0x55a4f5f366b0 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5f40c20 con 0x55a4f5f30b50 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4f5f40de0 con 0x55a4f5f31540 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74ccc0d740 10 client.0 _ll_register_callbacks cb 0x7f74b40d15a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f41b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74c3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f41b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.12:34564/0 (socket says 172.21.15.12:34564) 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74c2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.837 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.831+0000 7f74c37fe640 1 -- 172.21.15.12:0/1607116574 learned_addr learned my addr 172.21.15.12:0/1607116574 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c37fe640 1 -- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 msgr2=0x55a4f5f401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c37fe640 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c37fe640 1 -- 172.21.15.12:0/1607116574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 msgr2=0x55a4f5f406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c37fe640 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c37fe640 1 -- 172.21.15.12:0/1607116574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b40d0040 con 0x55a4f5f30b50 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74c37fe640 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f41b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e9c0 tx=0x7f74b4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97fe0156ea7d74 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74a2ffd640 1 -- 172.21.15.12:0/1607116574 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40d6ee0 con 0x55a4f5f30b50 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74a2ffd640 1 -- 172.21.15.12:0/1607116574 <== mon.2 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f74b409ecf0 con 0x55a4f5f30b50 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74b409aa20 con 0x55a4f5f30b50 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74a2ffd640 1 -- 172.21.15.12:0/1607116574 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74b409a790 con 0x55a4f5f30b50 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74ccc0d740 10 client.24872 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55a4f5e92d70 con 0x55a4f5f30b50 2024-02-14T13:09:37.838 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.832+0000 7f74a2ffd640 1 -- 172.21.15.12:0/1607116574 <== mon.2 v2:172.21.15.55:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f74b409aa20 con 0x55a4f5f30b50 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74a2ffd640 1 -- 172.21.15.12:0/1607116574 <== mon.2 v2:172.21.15.55:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f74b40972c0 con 0x55a4f5f30b50 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74ccc0d740 10 client.24872 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74ccc0d740 10 client.24872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74ccc0d740 20 client.24872 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f9e370 0x55a4f5fa0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74ccc0d740 4 client.24872 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a4f5be51b0 con 0x55a4f5f9e370 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f9e370 0x55a4f5fa0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74c2ffd640 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f9e370 0x55a4f5fa0790 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7cc58dd128e86c9 server_cookie=247bde766ea59a7a in_seq=0 out_seq=0 2024-02-14T13:09:37.839 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.833+0000 7f74a2ffd640 10 client.24872 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74a2ffd640 1 -- 172.21.15.12:0/1607116574 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a4f5be51b0 con 0x55a4f5f9e370 2024-02-14T13:09:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74a2ffd640 10 client.24872 handle_command_reply: tid=0 2024-02-14T13:09:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 client.24872 shutdown 2024-02-14T13:09:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 msgr2=0x55a4f5f41b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f41b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e9c0 tx=0x7f74b4000bc0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.840 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 shutdown_connections 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55a4f5f9e370 0x55a4f5fa0790 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a4f5f366b0 0x55a4f5f406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a4f5f31540 0x55a4f5f401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 --2- 172.21.15.12:0/1607116574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a4f5f30b50 0x55a4f5f41b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74a2ffd640 0 client.24872 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 >> 172.21.15.12:0/1607116574 conn(0x55a4f5f27cb0 msgr2=0x55a4f5f39910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.837+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 shutdown_connections 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ccc0d740 1 -- 172.21.15.12:0/1607116574 wait complete. 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ccc0d740 20 client.24872 trim_cache size 0 max 16384 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:09:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f74ac0a2350 msgr2=0x7f74ac0a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f74ac0a2350 0x7f74ac0a4810 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74bc006010 tx=0x7f74bc0326b0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 msgr2=0x7f74c4197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 0x7f74c4197230 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e9f0 tx=0x7f74b400eeb0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 shutdown_connections 2024-02-14T13:09:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f74ac0a2350 0x7f74ac0a4810 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4106fb0 0x7f74c419e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74c4104680 0x7f74c4197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 --2- 172.21.15.12:0/2534820118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74c4101d50 0x7f74c4197230 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 >> 172.21.15.12:0/2534820118 conn(0x7f74c40fb6c0 msgr2=0x7f74c4102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 shutdown_connections 2024-02-14T13:09:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:37.838+0000 7f74ca040640 1 -- 172.21.15.12:0/2534820118 wait complete. 2024-02-14T13:09:38.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:37 smithi012 ceph-mon[32370]: pgmap v375: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-14T13:09:38.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:37 smithi103 ceph-mon[36921]: pgmap v375: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-14T13:09:38.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:37 smithi055 ceph-mon[36853]: pgmap v375: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-14T13:09:40.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:39 smithi012 ceph-mon[32370]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-02-14T13:09:40.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:39 smithi103 ceph-mon[36921]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-02-14T13:09:40.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:39 smithi055 ceph-mon[36853]: pgmap v376: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-02-14T13:09:42.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:41 smithi012 ceph-mon[32370]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-02-14T13:09:42.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:41 smithi103 ceph-mon[36921]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-02-14T13:09:42.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:41 smithi055 ceph-mon[36853]: pgmap v377: 97 pgs: 97 active+clean; 663 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-02-14T13:09:44.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:43 smithi012 ceph-mon[32370]: pgmap v378: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:44.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:43 smithi103 ceph-mon[36921]: pgmap v378: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:44.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:43 smithi055 ceph-mon[36853]: pgmap v378: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:46.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:45 smithi012 ceph-mon[32370]: pgmap v379: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:46.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:45 smithi103 ceph-mon[36921]: pgmap v379: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:46.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:45 smithi055 ceph-mon[36853]: pgmap v379: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:48.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:47 smithi012 ceph-mon[32370]: pgmap v380: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:48.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:47 smithi103 ceph-mon[36921]: pgmap v380: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:48.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:47 smithi055 ceph-mon[36853]: pgmap v380: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:50.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:49 smithi012 ceph-mon[32370]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:50.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:49 smithi103 ceph-mon[36921]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:50.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:49 smithi055 ceph-mon[36853]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:50.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 -- 172.21.15.12:0/2385827544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc64100150 msgr2=0x7efc64100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:50.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 --2- 172.21.15.12:0/2385827544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc64100150 0x7efc64100570 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efc58009900 tx=0x7efc5802bc30 comp rx=0 tx=0).stop 2024-02-14T13:09:50.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 -- 172.21.15.12:0/2385827544 shutdown_connections 2024-02-14T13:09:50.977 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 --2- 172.21.15.12:0/2385827544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 0x7efc64108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 --2- 172.21.15.12:0/2385827544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 0x7efc641017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 --2- 172.21.15.12:0/2385827544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc64100150 0x7efc64100570 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 -- 172.21.15.12:0/2385827544 >> 172.21.15.12:0/2385827544 conn(0x7efc640fb6c0 msgr2=0x7efc640fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 -- 172.21.15.12:0/2385827544 shutdown_connections 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.973+0000 7efc6ac39640 1 -- 172.21.15.12:0/2385827544 wait complete. 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 Processor -- start 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 -- start start 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 0x7efc64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 0x7efc6419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 0x7efc641a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641a15d0 con 0x7efc6419eb20 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641a1740 con 0x7efc64101d00 2024-02-14T13:09:50.978 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc6ac39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641a1900 con 0x7efc64101340 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 0x7efc641a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 0x7efc641a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43962/0 (socket says 172.21.15.12:43962) 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 -- 172.21.15.12:0/1710830555 learned_addr learned my addr 172.21.15.12:0/1710830555 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc689d5640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 0x7efc64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc63fff640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 0x7efc6419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 -- 172.21.15.12:0/1710830555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 msgr2=0x7efc64069420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 0x7efc64069420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 -- 172.21.15.12:0/1710830555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 msgr2=0x7efc6419e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 0x7efc6419e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc691d6640 1 -- 172.21.15.12:0/1710830555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009560 con 0x7efc6419eb20 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc689d5640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 0x7efc64069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.974+0000 7efc63fff640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 0x7efc6419e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:09:50.979 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.975+0000 7efc691d6640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 0x7efc641a0f10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00eb10 tx=0x7efc5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.975+0000 7efc61ffb640 1 -- 172.21.15.12:0/1710830555 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c004b20 con 0x7efc6419eb20 2024-02-14T13:09:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.975+0000 7efc61ffb640 1 -- 172.21.15.12:0/1710830555 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7efc5c004c80 con 0x7efc6419eb20 2024-02-14T13:09:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.975+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc641a1b80 con 0x7efc6419eb20 2024-02-14T13:09:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.975+0000 7efc61ffb640 1 -- 172.21.15.12:0/1710830555 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c010650 con 0x7efc6419eb20 2024-02-14T13:09:50.980 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.975+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc641a2090 con 0x7efc6419eb20 2024-02-14T13:09:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.978+0000 7efc61ffb640 1 -- 172.21.15.12:0/1710830555 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7efc5c005020 con 0x7efc6419eb20 2024-02-14T13:09:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 Processor -- start 2024-02-14T13:09:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 -- start start 2024-02-14T13:09:50.982 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aadab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aadfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aa499e0 con 0x564e5aada740 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aa46f10 con 0x564e5aae02a0 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc6d809740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aa426f0 con 0x564e5aadb130 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc61ffb640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efc540a2290 0x7efc540a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aadab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.979+0000 7efc61ffb640 1 -- 172.21.15.12:0/1710830555 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7efc5c014070 con 0x7efc6419eb20 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aadab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43968/0 (socket says 172.21.15.12:43968) 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc63fff640 1 -- 172.21.15.12:0/329049615 learned_addr learned my addr 172.21.15.12:0/329049615 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:50.983 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aadfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc691d6640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efc540a2290 0x7efc540a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 -- 172.21.15.12:0/329049615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 msgr2=0x564e5aae2730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae2730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 -- 172.21.15.12:0/329049615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 msgr2=0x564e5aadab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aadab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 -- 172.21.15.12:0/329049615 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e5a753920 con 0x564e5aadb130 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc63fff640 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aadab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc691d6640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efc540a2290 0x7efc540a4750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efc5c097990 tx=0x7efc5c009a70 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc689d5640 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aadfc30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc640ffc90 tx=0x7efc5802c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f1ddca546acb39 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.980+0000 7efc4effd640 1 -- 172.21.15.12:0/329049615 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5802cea0 con 0x564e5aadb130 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.981+0000 7efc4effd640 1 -- 172.21.15.12:0/329049615 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7efc58004040 con 0x564e5aadb130 2024-02-14T13:09:50.984 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.981+0000 7efc4effd640 1 -- 172.21.15.12:0/329049615 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58005230 con 0x564e5aadb130 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.981+0000 7efc6d809740 1 -- 172.21.15.12:0/329049615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 msgr2=0x564e5aadfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.981+0000 7efc6d809740 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aadfc30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc640ffc90 tx=0x7efc5802c8e0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 -- 172.21.15.12:0/329049615 shutdown_connections 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aadfc30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 --2- 172.21.15.12:0/329049615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aadab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 -- 172.21.15.12:0/329049615 >> 172.21.15.12:0/329049615 conn(0x564e5aad5cb0 msgr2=0x564e5aad60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:50.989 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 -- 172.21.15.12:0/329049615 shutdown_connections 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 -- 172.21.15.12:0/329049615 wait complete. 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 -- start start 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.982+0000 7efc6d809740 1 Processor -- start 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aada740 0x564e5aae4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aae4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aae02a0 0x564e5aaebba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5a9defa0 con 0x564e5aae02a0 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5a716250 con 0x564e5aadb130 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5a9c8200 con 0x564e5aada740 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc6d809740 10 client.0 _ll_register_callbacks cb 0x564e5aa37b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aae4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aae4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.12:37138/0 (socket says 172.21.15.12:37138) 2024-02-14T13:09:50.990 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 -- 172.21.15.12:0/1775098623 learned_addr learned my addr 172.21.15.12:0/1775098623 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc63fff640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aae02a0 0x564e5aaebba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 -- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aada740 msgr2=0x564e5aae4620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aada740 0x564e5aae4620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 -- 172.21.15.12:0/1775098623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aae02a0 msgr2=0x564e5aaebba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aae02a0 0x564e5aaebba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc689d5640 1 -- 172.21.15.12:0/1775098623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc64108e90 con 0x564e5aadb130 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.983+0000 7efc63fff640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aae02a0 0x564e5aaebba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc689d5640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aae4b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc5802cdd0 tx=0x7efc580058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d24b43e14f4dbb server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc43fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc43fff640 1 -- 172.21.15.12:0/1775098623 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5802cea0 con 0x564e5aadb130 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc43fff640 1 -- 172.21.15.12:0/1775098623 <== mon.2 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7efc58004f70 con 0x564e5aadb130 2024-02-14T13:09:50.991 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e5a742600 con 0x564e5aadb130 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc43fff640 1 -- 172.21.15.12:0/1775098623 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc58005130 con 0x564e5aadb130 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc6d809740 10 client.24881 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x564e5aa40d70 con 0x564e5aadb130 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc43fff640 1 -- 172.21.15.12:0/1775098623 <== mon.2 v2:172.21.15.55:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x564e5a742600 con 0x564e5aadb130 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.984+0000 7efc43fff640 1 -- 172.21.15.12:0/1775098623 <== mon.2 v2:172.21.15.55:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc5803c040 con 0x564e5aadb130 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc6d809740 10 client.24881 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc6d809740 10 client.24881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc6d809740 20 client.24881 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc6d809740 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5aaf0020 0x564e5aaf2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc6d809740 4 client.24881 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e5a7931b0 con 0x564e5aaf0020 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc63fff640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5aaf0020 0x564e5aaf2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc63fff640 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5aaf0020 0x564e5aaf2410 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd37d78fe576629e server_cookie=99759e7d0c1c3016 in_seq=0 out_seq=0 2024-02-14T13:09:50.992 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.985+0000 7efc43fff640 10 client.24881 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc43fff640 1 -- 172.21.15.12:0/1775098623 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564e5a7931b0 con 0x564e5aaf0020 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc43fff640 10 client.24881 handle_command_reply: tid=0 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 client.24881 shutdown 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 msgr2=0x564e5aae4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aae4b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc5802cdd0 tx=0x7efc580058b0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 shutdown_connections 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5aaf0020 0x564e5aaf2410 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aae02a0 0x564e5aaebba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aae4b60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc43fff640 0 client.24881 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 --2- 172.21.15.12:0/1775098623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aada740 0x564e5aae4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.986+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 >> 172.21.15.12:0/1775098623 conn(0x564e5aad5cb0 msgr2=0x564e5aad4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.987+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 shutdown_connections 2024-02-14T13:09:50.993 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.987+0000 7efc6d809740 1 -- 172.21.15.12:0/1775098623 wait complete. 2024-02-14T13:09:50.994 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:50.987+0000 7efc6d809740 20 client.24881 trim_cache size 0 max 16384 2024-02-14T13:09:51.016 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.013+0000 7efc6d809740 1 Processor -- start 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.013+0000 7efc6d809740 1 -- start start 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.013+0000 7efc6d809740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aae3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.013+0000 7efc6d809740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aaebb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aae3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aae3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43984/0 (socket says 172.21.15.12:43984) 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 -- 172.21.15.12:0/1394610370 learned_addr learned my addr 172.21.15.12:0/1394610370 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc6d809740 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aae02a0 0x564e5aae4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aadb530 con 0x564e5aada740 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aae5810 con 0x564e5aadb130 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aae0040 con 0x564e5aae02a0 2024-02-14T13:09:51.017 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc689d5640 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aaebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 -- 172.21.15.12:0/1394610370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aae02a0 msgr2=0x564e5aae4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aae02a0 0x564e5aae4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 -- 172.21.15.12:0/1394610370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 msgr2=0x564e5aaebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aaebb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 -- 172.21.15.12:0/1394610370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e5a9dd820 con 0x564e5aada740 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc689d5640 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aaebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc63fff640 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aae3c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc50005890 tx=0x7efc50005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8595dd97cdb8e8dc server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.014+0000 7efc4e7fc640 1 -- 172.21.15.12:0/1394610370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50005220 con 0x564e5aada740 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.015+0000 7efc4e7fc640 1 -- 172.21.15.12:0/1394610370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7efc50018040 con 0x564e5aada740 2024-02-14T13:09:51.018 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.015+0000 7efc4e7fc640 1 -- 172.21.15.12:0/1394610370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500117c0 con 0x564e5aada740 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.015+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 msgr2=0x564e5aae3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.015+0000 7efc6d809740 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aae3c40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc50005890 tx=0x7efc50005f90 comp rx=0 tx=0).stop 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 shutdown_connections 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aae02a0 0x564e5aae4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aadb130 0x564e5aaebb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 --2- 172.21.15.12:0/1394610370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aae3c40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 >> 172.21.15.12:0/1394610370 conn(0x564e5aad5cb0 msgr2=0x564e5aaf6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 shutdown_connections 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 -- 172.21.15.12:0/1394610370 wait complete. 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 -- start start 2024-02-14T13:09:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.016+0000 7efc6d809740 1 Processor -- start 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc6d809740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aaeb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc6d809740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aaebb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc6d809740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aaeb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aaeb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43998/0 (socket says 172.21.15.12:43998) 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 -- 172.21.15.12:0/1393128385 learned_addr learned my addr 172.21.15.12:0/1393128385 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aaea520 con 0x564e5aada740 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aaea690 con 0x564e5aae02a0 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e5aaea850 con 0x564e5aadb130 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc689d5640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aaebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 -- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 msgr2=0x564e5aaebb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aaebb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 -- 172.21.15.12:0/1393128385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 msgr2=0x564e5aae9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.017+0000 7efc63fff640 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e5aa40d70 con 0x564e5aada740 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc63fff640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aaeb610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efc50009cc0 tx=0x7efc500095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e60b157a315d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc43fff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc6d809740 10 client.0 _ll_register_callbacks cb 0x7efc5c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc58004040 con 0x564e5aada740 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc43fff640 1 -- 172.21.15.12:0/1393128385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50004a30 con 0x564e5aada740 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc43fff640 1 -- 172.21.15.12:0/1393128385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7efc50004b90 con 0x564e5aada740 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc43fff640 1 -- 172.21.15.12:0/1393128385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc50004d50 con 0x564e5aada740 2024-02-14T13:09:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc6d809740 10 client.15276 fetch_fsmap learned FSMap version 18 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=18}) v3 -- 0x7efc50009b10 con 0x564e5aada740 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.018+0000 7efc43fff640 1 -- 172.21.15.12:0/1393128385 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc5001f040 con 0x564e5aada740 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc6d809740 10 client.15276 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc6d809740 10 client.15276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc6d809740 20 client.15276 populate_metadata read hostname 'smithi012' 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc6d809740 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5ab47730 0x564e5ab49b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc6d809740 4 client.15276 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564e5a77f550 con 0x564e5ab47730 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc689d5640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5ab47730 0x564e5ab49b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc43fff640 10 client.15276 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.019+0000 7efc689d5640 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5ab47730 0x564e5ab49b50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12261dfac085b94 server_cookie=8c62effa3568a7cf in_seq=0 out_seq=0 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.023+0000 7efc43fff640 1 -- 172.21.15.12:0/1393128385 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564e5a77f550 con 0x564e5ab47730 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.023+0000 7efc43fff640 10 client.15276 handle_command_reply: tid=0 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.023+0000 7efc6d809740 1 client.15276 shutdown 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 msgr2=0x564e5aaeb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aaeb610 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efc50009cc0 tx=0x7efc500095d0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 shutdown_connections 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x564e5ab47730 0x564e5ab49b50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564e5aae02a0 0x564e5aae9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564e5aadb130 0x564e5aaebb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 --2- 172.21.15.12:0/1393128385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564e5aada740 0x564e5aaeb610 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc43fff640 0 client.15276 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 >> 172.21.15.12:0/1393128385 conn(0x564e5aad5cb0 msgr2=0x564e5aad8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 shutdown_connections 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 1 -- 172.21.15.12:0/1393128385 wait complete. 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.024+0000 7efc6d809740 20 client.15276 trim_cache size 0 max 16384 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:09:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efc540a2290 msgr2=0x7efc540a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efc540a2290 0x7efc540a4750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efc5c097990 tx=0x7efc5c009a70 comp rx=0 tx=0).stop 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 msgr2=0x7efc641a0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 0x7efc641a0f10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00eb10 tx=0x7efc5c00c2d0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 shutdown_connections 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7efc540a2290 0x7efc540a4750 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc6419eb20 0x7efc641a0f10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64101d00 0x7efc6419e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 --2- 172.21.15.12:0/1710830555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc64101340 0x7efc64069420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:09:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 >> 172.21.15.12:0/1710830555 conn(0x7efc640fb6c0 msgr2=0x7efc64104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:09:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 shutdown_connections 2024-02-14T13:09:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:09:51.025+0000 7efc6ac39640 1 -- 172.21.15.12:0/1710830555 wait complete. 2024-02-14T13:09:52.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:51 smithi012 ceph-mon[32370]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:52.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:51 smithi103 ceph-mon[36921]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:52.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:51 smithi055 ceph-mon[36853]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:54.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:53 smithi012 ceph-mon[32370]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:54.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:53 smithi103 ceph-mon[36921]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:54.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:53 smithi055 ceph-mon[36853]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:56.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:55 smithi012 ceph-mon[32370]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:09:56.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:55 smithi103 ceph-mon[36921]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:09:56.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:55 smithi055 ceph-mon[36853]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-02-14T13:09:58.138 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 97% (11938/12222) Updating files: 98% (11978/12222) Updating files: 99% (12100/12222) Updating files: 100% (12222/12222) Updating files: 100% (12222/12222), done. 2024-02-14T13:09:58.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:57 smithi012 ceph-mon[32370]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:58.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:57 smithi103 ceph-mon[36921]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:58.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:57 smithi055 ceph-mon[36853]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:09:58.324 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to 'a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0'. 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.325 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-14T13:09:58.326 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-02-14T13:09:58.326 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at a6fe3fa3adb Merge PR #52258 into wip-vshankar-testing-20240206.051942 2024-02-14T13:09:58.328 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-14T13:09:58.394 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-14T13:09:58.396 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-14T13:09:58.396 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-14T13:09:59.129 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-14T13:09:59.195 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-14T13:09:59.236 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-14T13:09:59.238 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-14T13:09:59.238 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-14T13:09:59.277 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-14T13:09:59.280 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:09:59.280 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-14T13:09:59.335 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-14T13:09:59.336 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-14T13:09:59.336 DEBUG:teuthology.orchestra.run.smithi012:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-14T13:09:59.394 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir -p fsstress 2024-02-14T13:09:59.396 INFO:tasks.workunit.client.0.smithi012.stderr:+ pushd fsstress 2024-02-14T13:09:59.396 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-14T13:09:59.397 INFO:tasks.workunit.client.0.smithi012.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-14T13:09:59.908 INFO:tasks.workunit.client.0.smithi012.stderr:+ tar xzf ltp-full.tgz 2024-02-14T13:10:00.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:09:59 smithi012 ceph-mon[32370]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:10:00.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:09:59 smithi103 ceph-mon[36921]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:10:00.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:09:59 smithi055 ceph-mon[36853]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-02-14T13:10:01.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:00 smithi012 ceph-mon[32370]: overall HEALTH_OK 2024-02-14T13:10:01.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:00 smithi103 ceph-mon[36921]: overall HEALTH_OK 2024-02-14T13:10:01.311 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:00 smithi055 ceph-mon[36853]: overall HEALTH_OK 2024-02-14T13:10:02.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:01 smithi012 ceph-mon[32370]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-02-14T13:10:02.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:01 smithi103 ceph-mon[36921]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-02-14T13:10:02.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:01 smithi055 ceph-mon[36853]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-02-14T13:10:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 -- 172.21.15.12:0/85117562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c101d00 msgr2=0x7fef6c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.130 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 --2- 172.21.15.12:0/85117562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c101d00 0x7fef6c108590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fef64009ca0 tx=0x7fef6402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 -- 172.21.15.12:0/85117562 shutdown_connections 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 --2- 172.21.15.12:0/85117562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c101d00 0x7fef6c108590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 --2- 172.21.15.12:0/85117562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef6c101340 0x7fef6c1017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 --2- 172.21.15.12:0/85117562 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef6c100150 0x7fef6c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 -- 172.21.15.12:0/85117562 >> 172.21.15.12:0/85117562 conn(0x7fef6c0fb6c0 msgr2=0x7fef6c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 -- 172.21.15.12:0/85117562 shutdown_connections 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.126+0000 7fef7149a640 1 -- 172.21.15.12:0/85117562 wait complete. 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 Processor -- start 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 -- start start 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 0x7fef6c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef6c101340 0x7fef6c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef6c101d00 0x7fef6c19e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.131 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c19ecb0 con 0x7fef6c100150 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c19ee20 con 0x7fef6c101340 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef7149a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c19efe0 con 0x7fef6c101d00 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 0x7fef6c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 0x7fef6c1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39868/0 (socket says 172.21.15.12:39868) 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 -- 172.21.15.12:0/747872083 learned_addr learned my addr 172.21.15.12:0/747872083 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef63fff640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef6c101340 0x7fef6c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef6c101d00 0x7fef6c19e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 -- 172.21.15.12:0/747872083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef6c101d00 msgr2=0x7fef6c19e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef6c101d00 0x7fef6c19e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 -- 172.21.15.12:0/747872083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef6c101340 msgr2=0x7fef6c197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef6c101340 0x7fef6c197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 -- 172.21.15.12:0/747872083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64009900 con 0x7fef6c100150 2024-02-14T13:10:04.132 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.127+0000 7fef6affd640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 0x7fef6c1971c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00d770 tx=0x7fef5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.128+0000 7fef68ff9640 1 -- 172.21.15.12:0/747872083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c009c30 con 0x7fef6c100150 2024-02-14T13:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.128+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c19f2c0 con 0x7fef6c100150 2024-02-14T13:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.128+0000 7fef68ff9640 1 -- 172.21.15.12:0/747872083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fef5c00de80 con 0x7fef6c100150 2024-02-14T13:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.128+0000 7fef68ff9640 1 -- 172.21.15.12:0/747872083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c010460 con 0x7fef6c100150 2024-02-14T13:10:04.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.128+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c19f820 con 0x7fef6c100150 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.130+0000 7fef68ff9640 1 -- 172.21.15.12:0/747872083 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fef5c003f60 con 0x7fef6c100150 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.130+0000 7fef7406f740 1 Processor -- start 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.130+0000 7fef68ff9640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef580a2160 0x7fef580a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.130+0000 7fef7406f740 1 -- start start 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef68ff9640 1 -- 172.21.15.12:0/747872083 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fef5c0cda00 con 0x7fef6c100150 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef580a2160 0x7fef580a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef7406f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9deddf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef7406f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef7406f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9dee5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef7406f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9de489e0 con 0x562b9dede540 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef7406f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9de45f10 con 0x562b9deddb50 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef7406f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9de416f0 con 0x562b9dee36b0 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39876/0 (socket says 172.21.15.12:39876) 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 -- 172.21.15.12:0/2239380161 learned_addr learned my addr 172.21.15.12:0/2239380161 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9dee5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef6affd640 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9deddf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 -- 172.21.15.12:0/2239380161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 msgr2=0x562b9dee5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef580a2160 0x7fef580a4620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fef64006010 tx=0x7fef640326b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9dee5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 -- 172.21.15.12:0/2239380161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 msgr2=0x562b9deddf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9deddf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef63fff640 1 -- 172.21.15.12:0/2239380161 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b9db52920 con 0x562b9dede540 2024-02-14T13:10:04.141 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.131+0000 7fef6affd640 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9deddf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.132+0000 7fef63fff640 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee3040 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fef54009ca0 tx=0x7fef54011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c5be83c9a85a14 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.132+0000 7fef617fa640 1 -- 172.21.15.12:0/2239380161 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54019630 con 0x562b9dede540 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.132+0000 7fef617fa640 1 -- 172.21.15.12:0/2239380161 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fef54019c70 con 0x562b9dede540 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.132+0000 7fef617fa640 1 -- 172.21.15.12:0/2239380161 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400eb90 con 0x562b9dede540 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.132+0000 7fef7406f740 1 -- 172.21.15.12:0/2239380161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 msgr2=0x562b9dee3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.132+0000 7fef7406f740 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee3040 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fef54009ca0 tx=0x7fef54011810 comp rx=0 tx=0).stop 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- 172.21.15.12:0/2239380161 shutdown_connections 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9dee5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee3040 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 --2- 172.21.15.12:0/2239380161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9deddf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- 172.21.15.12:0/2239380161 >> 172.21.15.12:0/2239380161 conn(0x562b9ded4cb0 msgr2=0x562b9ded50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- 172.21.15.12:0/2239380161 shutdown_connections 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- 172.21.15.12:0/2239380161 wait complete. 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- start start 2024-02-14T13:10:04.142 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 Processor -- start 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9ddddfa0 con 0x562b9dede540 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9db15250 con 0x562b9deddb50 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9ddc7200 con 0x562b9dee36b0 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef7406f740 10 client.0 _ll_register_callbacks cb 0x562b9de36b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef63fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39882/0 (socket says 172.21.15.12:39882) 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.133+0000 7fef63fff640 1 -- 172.21.15.12:0/1102769717 learned_addr learned my addr 172.21.15.12:0/1102769717 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef6affd640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef63fff640 1 -- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 msgr2=0x562b9deef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.143 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef63fff640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef63fff640 1 -- 172.21.15.12:0/1102769717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 msgr2=0x562b9dee7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef63fff640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef63fff640 1 -- 172.21.15.12:0/1102769717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540098d0 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef63fff640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee8070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef54009c70 tx=0x7fef5400e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4493adc5649d56e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef527fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef527fc640 1 -- 172.21.15.12:0/1102769717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54005590 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef527fc640 1 -- 172.21.15.12:0/1102769717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fef54019430 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b9db41600 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef527fc640 1 -- 172.21.15.12:0/1102769717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef540195f0 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef7406f740 10 client.15288 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x562b9de3fd70 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.134+0000 7fef527fc640 1 -- 172.21.15.12:0/1102769717 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x562b9db41600 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef527fc640 1 -- 172.21.15.12:0/1102769717 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fef54025450 con 0x562b9dede540 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef7406f740 10 client.15288 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:04.144 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef7406f740 10 client.15288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef7406f740 20 client.15288 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef7406f740 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9def3880 0x562b9def5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef7406f740 4 client.15288 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b9db921b0 con 0x562b9def3880 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef6affd640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9def3880 0x562b9def5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef6affd640 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9def3880 0x562b9def5ca0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274105569e877a11 server_cookie=8165e6e20c9cb39a in_seq=0 out_seq=0 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.135+0000 7fef527fc640 10 client.15288 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef527fc640 1 -- 172.21.15.12:0/1102769717 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562b9db921b0 con 0x562b9def3880 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef527fc640 10 client.15288 handle_command_reply: tid=0 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 client.15288 shutdown 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 msgr2=0x562b9dee8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee8070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef54009c70 tx=0x7fef5400e430 comp rx=0 tx=0).stop 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 shutdown_connections 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9def3880 0x562b9def5ca0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.145 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef527fc640 0 client.15288 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 --2- 172.21.15.12:0/1102769717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 >> 172.21.15.12:0/1102769717 conn(0x562b9ded4cb0 msgr2=0x562b9ded3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 shutdown_connections 2024-02-14T13:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 1 -- 172.21.15.12:0/1102769717 wait complete. 2024-02-14T13:10:04.146 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.136+0000 7fef7406f740 20 client.15288 trim_cache size 0 max 16384 2024-02-14T13:10:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 Processor -- start 2024-02-14T13:10:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 -- start start 2024-02-14T13:10:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9ded57a0 con 0x562b9deddb50 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9dee6200 con 0x562b9dede540 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef7406f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9db921b0 con 0x562b9dee36b0 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39892/0 (socket says 172.21.15.12:39892) 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 -- 172.21.15.12:0/3741423538 learned_addr learned my addr 172.21.15.12:0/3741423538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef63fff640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 -- 172.21.15.12:0/3741423538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 msgr2=0x562b9deef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 -- 172.21.15.12:0/3741423538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dede540 msgr2=0x562b9dee8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.150+0000 7fef6affd640 1 -- 172.21.15.12:0/3741423538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b9dddc820 con 0x562b9deddb50 2024-02-14T13:10:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef63fff640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef6affd640 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fef5c096b50 tx=0x7fef5c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe02ab22ca8c2d server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef60ff9640 1 -- 172.21.15.12:0/3741423538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0b3220 con 0x562b9deddb50 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef60ff9640 1 -- 172.21.15.12:0/3741423538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fef5c0a2e90 con 0x562b9deddb50 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef60ff9640 1 -- 172.21.15.12:0/3741423538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c098b10 con 0x562b9deddb50 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef7406f740 1 -- 172.21.15.12:0/3741423538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 msgr2=0x562b9dee7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.151+0000 7fef7406f740 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fef5c096b50 tx=0x7fef5c000bc0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- 172.21.15.12:0/3741423538 shutdown_connections 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dee36b0 0x562b9deef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dede540 0x562b9dee8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 --2- 172.21.15.12:0/3741423538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9dee7b30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- 172.21.15.12:0/3741423538 >> 172.21.15.12:0/3741423538 conn(0x562b9ded4cb0 msgr2=0x562b9ded5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- 172.21.15.12:0/3741423538 shutdown_connections 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- 172.21.15.12:0/3741423538 wait complete. 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- start start 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 Processor -- start 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9deeebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dede540 0x562b9deed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dee36b0 0x562b9deed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9deef3a0 con 0x562b9deddb50 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9deedc40 con 0x562b9dee36b0 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b9deeddd0 con 0x562b9dede540 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef7406f740 10 client.0 _ll_register_callbacks cb 0x7fef54009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9deeebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef6affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9deeebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39908/0 (socket says 172.21.15.12:39908) 2024-02-14T13:10:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef6affd640 1 -- 172.21.15.12:0/1881517499 learned_addr learned my addr 172.21.15.12:0/1881517499 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef6b7fe640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dee36b0 0x562b9deed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.152+0000 7fef63fff640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dede540 0x562b9deed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef6affd640 1 -- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dede540 msgr2=0x562b9deed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef6affd640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dede540 0x562b9deed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef6affd640 1 -- 172.21.15.12:0/1881517499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dee36b0 msgr2=0x562b9deed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef6affd640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dee36b0 0x562b9deed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef6affd640 1 -- 172.21.15.12:0/1881517499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c19f820 con 0x562b9deddb50 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef63fff640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dede540 0x562b9deed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef6affd640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9deeebb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0970c0 tx=0x7fef5c09af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9ce844ae3a4b47 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef527fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef527fc640 1 -- 172.21.15.12:0/1881517499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c07d070 con 0x562b9deddb50 2024-02-14T13:10:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef527fc640 1 -- 172.21.15.12:0/1881517499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fef5c0cb5d0 con 0x562b9deddb50 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b9ded0050 con 0x562b9deddb50 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef527fc640 1 -- 172.21.15.12:0/1881517499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef5c0a5050 con 0x562b9deddb50 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef7406f740 10 client.15294 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x562b9de02720 con 0x562b9deddb50 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef527fc640 1 -- 172.21.15.12:0/1881517499 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x562b9ded0050 con 0x562b9deddb50 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.153+0000 7fef527fc640 1 -- 172.21.15.12:0/1881517499 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fef5c080020 con 0x562b9deddb50 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef7406f740 10 client.15294 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef7406f740 10 client.15294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef7406f740 20 client.15294 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef7406f740 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9df4b0b0 0x562b9df4d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef7406f740 4 client.15294 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fef54019c70 con 0x562b9df4b0b0 2024-02-14T13:10:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef63fff640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9df4b0b0 0x562b9df4d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef527fc640 10 client.15294 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.154+0000 7fef63fff640 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9df4b0b0 0x562b9df4d4d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27022bc0e304d274 server_cookie=6657861fdef094d3 in_seq=0 out_seq=0 2024-02-14T13:10:04.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:03 smithi012 ceph-mon[32370]: pgmap v388: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 3 op/s 2024-02-14T13:10:04.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:03 smithi103 ceph-mon[36921]: pgmap v388: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 3 op/s 2024-02-14T13:10:04.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:03 smithi055 ceph-mon[36853]: pgmap v388: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 88 KiB/s wr, 3 op/s 2024-02-14T13:10:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef527fc640 1 -- 172.21.15.12:0/1881517499 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fef54019c70 con 0x562b9df4b0b0 2024-02-14T13:10:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef527fc640 10 client.15294 handle_command_reply: tid=0 2024-02-14T13:10:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 client.15294 shutdown 2024-02-14T13:10:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 msgr2=0x562b9deeebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9deeebb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0970c0 tx=0x7fef5c09af60 comp rx=0 tx=0).stop 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 shutdown_connections 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x562b9df4b0b0 0x562b9df4d4d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b9dee36b0 0x562b9deed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562b9dede540 0x562b9deed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef527fc640 0 client.15294 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 --2- 172.21.15.12:0/1881517499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562b9deddb50 0x562b9deeebb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 >> 172.21.15.12:0/1881517499 conn(0x562b9ded4cb0 msgr2=0x562b9dee7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 shutdown_connections 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.613+0000 7fef7406f740 1 -- 172.21.15.12:0/1881517499 wait complete. 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7406f740 20 client.15294 trim_cache size 0 max 16384 2024-02-14T13:10:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:10:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:10:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:10:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:10:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef580a2160 msgr2=0x7fef580a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef580a2160 0x7fef580a4620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fef64006010 tx=0x7fef640326b0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 msgr2=0x7fef6c1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 0x7fef6c1971c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00d770 tx=0x7fef5c00dc30 comp rx=0 tx=0).stop 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 shutdown_connections 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fef580a2160 0x7fef580a4620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef6c101d00 0x7fef6c19e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef6c101340 0x7fef6c197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 --2- 172.21.15.12:0/747872083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef6c100150 0x7fef6c1971c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 >> 172.21.15.12:0/747872083 conn(0x7fef6c0fb6c0 msgr2=0x7fef6c0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 shutdown_connections 2024-02-14T13:10:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:04.614+0000 7fef7149a640 1 -- 172.21.15.12:0/747872083 wait complete. 2024-02-14T13:10:06.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:05 smithi012 ceph-mon[32370]: pgmap v389: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 88 KiB/s wr, 2 op/s 2024-02-14T13:10:06.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:05 smithi103 ceph-mon[36921]: pgmap v389: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 88 KiB/s wr, 2 op/s 2024-02-14T13:10:06.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:05 smithi055 ceph-mon[36853]: pgmap v389: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 88 KiB/s wr, 2 op/s 2024-02-14T13:10:08.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:07 smithi012 ceph-mon[32370]: pgmap v390: 97 pgs: 97 active+clean; 9.6 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 881 KiB/s wr, 268 op/s 2024-02-14T13:10:08.242 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:07 smithi103 ceph-mon[36921]: pgmap v390: 97 pgs: 97 active+clean; 9.6 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 881 KiB/s wr, 268 op/s 2024-02-14T13:10:08.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:07 smithi055 ceph-mon[36853]: pgmap v390: 97 pgs: 97 active+clean; 9.6 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 881 KiB/s wr, 268 op/s 2024-02-14T13:10:10.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:09 smithi012 ceph-mon[32370]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.2 MiB/s wr, 300 op/s 2024-02-14T13:10:10.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:09 smithi103 ceph-mon[36921]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.2 MiB/s wr, 300 op/s 2024-02-14T13:10:10.344 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:09 smithi055 ceph-mon[36853]: pgmap v391: 97 pgs: 97 active+clean; 14 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.2 MiB/s wr, 300 op/s 2024-02-14T13:10:11.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:10 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:10:11.241 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:10 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:10:11.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:10 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:10:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:12 smithi012 ceph-mon[32370]: pgmap v392: 97 pgs: 97 active+clean; 24 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 2.2 MiB/s wr, 434 op/s 2024-02-14T13:10:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:10:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:10:12.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:12 smithi103 ceph-mon[36921]: pgmap v392: 97 pgs: 97 active+clean; 24 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 2.2 MiB/s wr, 434 op/s 2024-02-14T13:10:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:10:12.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:10:12.492 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:12 smithi055 ceph-mon[36853]: pgmap v392: 97 pgs: 97 active+clean; 24 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 2.2 MiB/s wr, 434 op/s 2024-02-14T13:10:12.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:12.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:10:12.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:10:12.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:10:14.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:14 smithi012 ceph-mon[32370]: pgmap v393: 97 pgs: 97 active+clean; 24 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-02-14T13:10:14.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:14 smithi103 ceph-mon[36921]: pgmap v393: 97 pgs: 97 active+clean; 24 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-02-14T13:10:14.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:14 smithi055 ceph-mon[36853]: pgmap v393: 97 pgs: 97 active+clean; 24 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 2.2 MiB/s wr, 435 op/s 2024-02-14T13:10:16.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:16 smithi012 ceph-mon[32370]: pgmap v394: 97 pgs: 97 active+clean; 28 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-02-14T13:10:16.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:16 smithi103 ceph-mon[36921]: pgmap v394: 97 pgs: 97 active+clean; 28 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-02-14T13:10:16.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:16 smithi055 ceph-mon[36853]: pgmap v394: 97 pgs: 97 active+clean; 28 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-02-14T13:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 -- 172.21.15.12:0/1885091521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730104600 msgr2=0x7f27301069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 --2- 172.21.15.12:0/1885091521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730104600 0x7f27301069f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f272c009900 tx=0x7f272c02bc30 comp rx=0 tx=0).stop 2024-02-14T13:10:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 -- 172.21.15.12:0/1885091521 shutdown_connections 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 --2- 172.21.15.12:0/1885091521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2730106f30 0x7f2730109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 --2- 172.21.15.12:0/1885091521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730104600 0x7f27301069f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 --2- 172.21.15.12:0/1885091521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2730101cd0 0x7f27301040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 -- 172.21.15.12:0/1885091521 >> 172.21.15.12:0/1885091521 conn(0x7f27300fb6c0 msgr2=0x7f27300fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 -- 172.21.15.12:0/1885091521 shutdown_connections 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 -- 172.21.15.12:0/1885091521 wait complete. 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 Processor -- start 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 -- start start 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 0x7f2730197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.711+0000 7f2737a39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2730104600 0x7f2730197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2737a39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2730106f30 0x7f273019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2737a39640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273019ed20 con 0x7f2730101cd0 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2737a39640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273019ee90 con 0x7f2730104600 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2737a39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273019f050 con 0x7f2730106f30 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 0x7f2730197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 0x7f2730197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54082/0 (socket says 172.21.15.12:54082) 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 -- 172.21.15.12:0/3299129798 learned_addr learned my addr 172.21.15.12:0/3299129798 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2735fd6640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2730106f30 0x7f273019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2730104600 0x7f2730197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 -- 172.21.15.12:0/3299129798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2730106f30 msgr2=0x7f273019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2730106f30 0x7f273019e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 -- 172.21.15.12:0/3299129798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2730104600 msgr2=0x7f2730197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2730104600 0x7f2730197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 -- 172.21.15.12:0/3299129798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009560 con 0x7f2730101cd0 2024-02-14T13:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27357d5640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 0x7f2730197230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f272000e9f0 tx=0x7f272000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27267fc640 1 -- 172.21.15.12:0/3299129798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720009700 con 0x7f2730101cd0 2024-02-14T13:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27267fc640 1 -- 172.21.15.12:0/3299129798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f272000cd80 con 0x7f2730101cd0 2024-02-14T13:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273019f330 con 0x7f2730101cd0 2024-02-14T13:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f27267fc640 1 -- 172.21.15.12:0/3299129798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720018920 con 0x7f2730101cd0 2024-02-14T13:10:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.712+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273019f840 con 0x7f2730101cd0 2024-02-14T13:10:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.714+0000 7f27267fc640 1 -- 172.21.15.12:0/3299129798 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f2720018a80 con 0x7f2730101cd0 2024-02-14T13:10:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f27267fc640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f271c0a2160 0x7f271c0a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 Processor -- start 2024-02-14T13:10:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 -- start start 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f27267fc640 1 -- 172.21.15.12:0/3299129798 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f2720014070 con 0x7f2730101cd0 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f271c0a2160 0x7f271c0a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 0x55fc08d4eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4f130 0x55fc08d53c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d56730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08cbd9e0 con 0x55fc08d4f130 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08cbaf10 con 0x55fc08d542a0 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.715+0000 7f273a606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08cb66f0 con 0x55fc08d4e740 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 0x55fc08d4eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 0x55fc08d4eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:45980/0 (socket says 172.21.15.12:45980) 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 -- 172.21.15.12:0/178742144 learned_addr learned my addr 172.21.15.12:0/178742144 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f2734fd4640 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4f130 0x55fc08d53c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f271c0a2160 0x7f271c0a4620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f272c036040 tx=0x7f272c000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 -- 172.21.15.12:0/178742144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 msgr2=0x55fc08d56730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f2735fd6640 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d56730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d56730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 -- 172.21.15.12:0/178742144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4f130 msgr2=0x55fc08d53c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4f130 0x55fc08d53c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 -- 172.21.15.12:0/178742144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc089c7920 con 0x55fc08d4e740 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f2734fd4640 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4f130 0x55fc08d53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f27357d5640 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 0x55fc08d4eb60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2720097230 tx=0x7f272009a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c10611e3e7075d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f271b7fe640 1 -- 172.21.15.12:0/178742144 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272009ef20 con 0x55fc08d4e740 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f271b7fe640 1 -- 172.21.15.12:0/178742144 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f27200a3570 con 0x55fc08d4e740 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.716+0000 7f271b7fe640 1 -- 172.21.15.12:0/178742144 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272009a480 con 0x55fc08d4e740 2024-02-14T13:10:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 -- 172.21.15.12:0/178742144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 msgr2=0x55fc08d4eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 0x55fc08d4eb60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2720097230 tx=0x7f272009a730 comp rx=0 tx=0).stop 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 -- 172.21.15.12:0/178742144 shutdown_connections 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d56730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4f130 0x55fc08d53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 --2- 172.21.15.12:0/178742144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4e740 0x55fc08d4eb60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 -- 172.21.15.12:0/178742144 >> 172.21.15.12:0/178742144 conn(0x55fc08d49cb0 msgr2=0x55fc08d4a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 -- 172.21.15.12:0/178742144 shutdown_connections 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 -- 172.21.15.12:0/178742144 wait complete. 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.717+0000 7f273a606740 1 -- start start 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 Processor -- start 2024-02-14T13:10:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 0x55fc08d5ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d63ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08c52fa0 con 0x55fc08d4e740 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0898a250 con 0x55fc08d542a0 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08c3c200 con 0x55fc08d4f130 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f273a606740 10 client.0 _ll_register_callbacks cb 0x55fc08cabb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 0x55fc08d5ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 0x55fc08d5ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54086/0 (socket says 172.21.15.12:54086) 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 -- 172.21.15.12:0/3331489535 learned_addr learned my addr 172.21.15.12:0/3331489535 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f2735fd6640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d63ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 -- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 msgr2=0x55fc08d5cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d5cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 -- 172.21.15.12:0/3331489535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 msgr2=0x55fc08d63ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d63ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f27357d5640 1 -- 172.21.15.12:0/3331489535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273019f840 con 0x55fc08d4e740 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.718+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f27357d5640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 0x55fc08d5ca70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f27200cbbf0 tx=0x7f272009af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7235d6f491fb99 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f2718ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f2718ff9640 1 -- 172.21.15.12:0/3331489535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272009ef20 con 0x55fc08d4e740 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f2718ff9640 1 -- 172.21.15.12:0/3331489535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f27200b9170 con 0x55fc08d4e740 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc089b6600 con 0x55fc08d4e740 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f2718ff9640 1 -- 172.21.15.12:0/3331489535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27200b9330 con 0x55fc08d4e740 2024-02-14T13:10:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 10 client.15306 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55fc08cb4d70 con 0x55fc08d4e740 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f2718ff9640 1 -- 172.21.15.12:0/3331489535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x55fc089b6600 con 0x55fc08d4e740 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f2718ff9640 1 -- 172.21.15.12:0/3331489535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2720099c90 con 0x55fc08d4e740 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 10 client.15306 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 10 client.15306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 20 client.15306 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08d68600 0x55fc08d6a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 4 client.15306 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.719+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc08a071b0 con 0x55fc08d68600 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.720+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08d68600 0x55fc08d6a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.720+0000 7f2718ff9640 10 client.15306 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.720+0000 7f2734fd4640 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08d68600 0x55fc08d6a9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43e43e4febddfdb7 server_cookie=b45caabb8e2a12e5 in_seq=0 out_seq=0 2024-02-14T13:10:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.720+0000 7f2718ff9640 1 -- 172.21.15.12:0/3331489535 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fc08a071b0 con 0x55fc08d68600 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.720+0000 7f2718ff9640 10 client.15306 handle_command_reply: tid=0 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 client.15306 shutdown 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 msgr2=0x55fc08d5ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 0x55fc08d5ca70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f27200cbbf0 tx=0x7f272009af50 comp rx=0 tx=0).stop 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 shutdown_connections 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08d68600 0x55fc08d6a9f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d542a0 0x55fc08d63ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 --2- 172.21.15.12:0/3331489535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d4e740 0x55fc08d5ca70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f2718ff9640 0 client.15306 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 >> 172.21.15.12:0/3331489535 conn(0x55fc08d49cb0 msgr2=0x55fc08d48ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 shutdown_connections 2024-02-14T13:10:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 1 -- 172.21.15.12:0/3331489535 wait complete. 2024-02-14T13:10:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.721+0000 7f273a606740 20 client.15306 trim_cache size 0 max 16384 2024-02-14T13:10:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 Processor -- start 2024-02-14T13:10:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 -- start start 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d5b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d63f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d5b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08d4ac50 con 0x55fc08d542a0 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08d5bb50 con 0x55fc08d4e740 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f273a606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08d482d0 con 0x55fc08d4f130 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f2735fd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d5b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f2735fd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d5b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54088/0 (socket says 172.21.15.12:54088) 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f2735fd6640 1 -- 172.21.15.12:0/2563707148 learned_addr learned my addr 172.21.15.12:0/2563707148 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.735+0000 7f2734fd4640 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d63f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f2735fd6640 1 -- 172.21.15.12:0/2563707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 msgr2=0x55fc08d63f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f2735fd6640 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d63f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f27357d5640 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d5b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f2735fd6640 1 -- 172.21.15.12:0/2563707148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 msgr2=0x55fc08d5b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f2735fd6640 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d5b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f2735fd6640 1 -- 172.21.15.12:0/2563707148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc08c51820 con 0x55fc08d542a0 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f27357d5640 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d5b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f2735fd6640 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d5b610 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2728007fb0 tx=0x7f27280118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea55ac0393f8de4 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f271affd640 1 -- 172.21.15.12:0/2563707148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728016070 con 0x55fc08d542a0 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f271affd640 1 -- 172.21.15.12:0/2563707148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f2728010640 con 0x55fc08d542a0 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.736+0000 7f271affd640 1 -- 172.21.15.12:0/2563707148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728005390 con 0x55fc08d542a0 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- 172.21.15.12:0/2563707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 msgr2=0x55fc08d5b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d5b610 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2728007fb0 tx=0x7f27280118d0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- 172.21.15.12:0/2563707148 shutdown_connections 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d5b610 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d63f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- 172.21.15.12:0/2563707148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d5b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- 172.21.15.12:0/2563707148 >> 172.21.15.12:0/2563707148 conn(0x55fc08d49cb0 msgr2=0x55fc08d6f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- 172.21.15.12:0/2563707148 shutdown_connections 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- 172.21.15.12:0/2563707148 wait complete. 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- start start 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 Processor -- start 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d63ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d62300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d62840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08d62d80 con 0x55fc08d542a0 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08d62ef0 con 0x55fc08d4e740 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc08d630b0 con 0x55fc08d4f130 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f273a606740 10 client.0 _ll_register_callbacks cb 0x7f2720096950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f2735fd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d62840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f2735fd6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d62840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54104/0 (socket says 172.21.15.12:54104) 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f2735fd6640 1 -- 172.21.15.12:0/668798930 learned_addr learned my addr 172.21.15.12:0/668798930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.737+0000 7f2734fd4640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d62300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f27357d5640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d63ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2735fd6640 1 -- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 msgr2=0x55fc08d62300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2735fd6640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d62300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2735fd6640 1 -- 172.21.15.12:0/668798930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 msgr2=0x55fc08d63ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2735fd6640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d63ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2735fd6640 1 -- 172.21.15.12:0/668798930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728007c30 con 0x55fc08d542a0 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2735fd6640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d62840 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2728004ca0 tx=0x7f2728004cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbb63bbb2377b40 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2718ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2718ff9640 1 -- 172.21.15.12:0/668798930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728016070 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2718ff9640 1 -- 172.21.15.12:0/668798930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f27280052a0 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27200a3570 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2718ff9640 1 -- 172.21.15.12:0/668798930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2728020070 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f273a606740 10 client.15312 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55fc08c77720 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.738+0000 7f2718ff9640 1 -- 172.21.15.12:0/668798930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f27200a3570 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f2718ff9640 1 -- 172.21.15.12:0/668798930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f272801b8b0 con 0x55fc08d542a0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f273a606740 10 client.15312 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f273a606740 10 client.15312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f273a606740 20 client.15312 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f273a606740 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08dc01b0 0x55fc08dc25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f273a606740 4 client.15312 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fc089f3550 con 0x55fc08dc01b0 2024-02-14T13:10:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f27357d5640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08dc01b0 0x55fc08dc25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f2718ff9640 10 client.15312 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:17.739+0000 7f27357d5640 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08dc01b0 0x55fc08dc25d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc30017af6c6832 server_cookie=4c72366c0ade543b in_seq=0 out_seq=0 2024-02-14T13:10:18.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:18 smithi012 ceph-mon[32370]: pgmap v395: 97 pgs: 97 active+clean; 33 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 446 op/s 2024-02-14T13:10:18.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:18 smithi103 ceph-mon[36921]: pgmap v395: 97 pgs: 97 active+clean; 33 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 446 op/s 2024-02-14T13:10:18.561 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:18 smithi055 ceph-mon[36853]: pgmap v395: 97 pgs: 97 active+clean; 33 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 446 op/s 2024-02-14T13:10:20.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:20 smithi012 ceph-mon[32370]: pgmap v396: 97 pgs: 97 active+clean; 33 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 180 op/s 2024-02-14T13:10:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f2718ff9640 1 -- 172.21.15.12:0/668798930 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fc089f3550 con 0x55fc08dc01b0 2024-02-14T13:10:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f2718ff9640 10 client.15312 handle_command_reply: tid=0 2024-02-14T13:10:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 client.15312 shutdown 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 msgr2=0x55fc08d62840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d62840 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2728004ca0 tx=0x7f2728004cd0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 shutdown_connections 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55fc08dc01b0 0x55fc08dc25d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fc08d542a0 0x55fc08d62840 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fc08d4f130 0x55fc08d62300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 --2- 172.21.15.12:0/668798930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc08d4e740 0x55fc08d63ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 >> 172.21.15.12:0/668798930 conn(0x55fc08d49cb0 msgr2=0x55fc08d5af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f2718ff9640 0 client.15312 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:20.356 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 shutdown_connections 2024-02-14T13:10:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 1 -- 172.21.15.12:0/668798930 wait complete. 2024-02-14T13:10:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.352+0000 7f273a606740 20 client.15312 trim_cache size 0 max 16384 2024-02-14T13:10:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:10:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:10:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:10:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:10:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f271c0a2160 msgr2=0x7f271c0a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f271c0a2160 0x7f271c0a4620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f272c036040 tx=0x7f272c000bc0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 msgr2=0x7f2730197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 0x7f2730197230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f272000e9f0 tx=0x7f272000eeb0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 shutdown_connections 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f271c0a2160 0x7f271c0a4620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2730106f30 0x7f273019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2730104600 0x7f2730197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 --2- 172.21.15.12:0/3299129798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2730101cd0 0x7f2730197230 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 >> 172.21.15.12:0/3299129798 conn(0x7f27300fb6c0 msgr2=0x7f2730102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:20.359 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 shutdown_connections 2024-02-14T13:10:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:20.353+0000 7f2737a39640 1 -- 172.21.15.12:0/3299129798 wait complete. 2024-02-14T13:10:20.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:20 smithi103 ceph-mon[36921]: pgmap v396: 97 pgs: 97 active+clean; 33 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 180 op/s 2024-02-14T13:10:20.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:20 smithi055 ceph-mon[36853]: pgmap v396: 97 pgs: 97 active+clean; 33 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 180 op/s 2024-02-14T13:10:22.429 INFO:tasks.workunit.client.0.smithi012.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-14T13:10:22.430 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-14T13:10:22.430 INFO:tasks.workunit.client.0.smithi012.stderr:+ make 2024-02-14T13:10:22.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:22 smithi012 ceph-mon[32370]: pgmap v397: 97 pgs: 97 active+clean; 36 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-02-14T13:10:22.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:22 smithi103 ceph-mon[36921]: pgmap v397: 97 pgs: 97 active+clean; 36 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-02-14T13:10:22.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:22 smithi055 ceph-mon[36853]: pgmap v397: 97 pgs: 97 active+clean; 36 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 558 op/s 2024-02-14T13:10:22.633 INFO:tasks.workunit.client.0.smithi012.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-14T13:10:22.837 INFO:tasks.workunit.client.0.smithi012.stderr:++ readlink -f fsstress 2024-02-14T13:10:22.838 INFO:tasks.workunit.client.0.smithi012.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-14T13:10:22.838 INFO:tasks.workunit.client.0.smithi012.stderr:+ popd 2024-02-14T13:10:22.838 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-14T13:10:22.838 INFO:tasks.workunit.client.0.smithi012.stderr:+ popd 2024-02-14T13:10:22.839 INFO:tasks.workunit.client.0.smithi012.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-14T13:10:22.839 INFO:tasks.workunit.client.0.smithi012.stderr:++ mktemp -d -p . 2024-02-14T13:10:22.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ T=./tmp.ipl1MsaA6v 2024-02-14T13:10:22.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ipl1MsaA6v -l 1 -n 1000 -p 10 -v 2024-02-14T13:10:22.842 INFO:tasks.workunit.client.0.smithi012.stdout:seed = 1707109723 2024-02-14T13:10:22.844 INFO:tasks.workunit.client.0.smithi012.stdout:0/0: write - no filename 2024-02-14T13:10:22.845 INFO:tasks.workunit.client.0.smithi012.stdout:1/0: dwrite - no filename 2024-02-14T13:10:22.850 INFO:tasks.workunit.client.0.smithi012.stdout:2/0: getdents . 0 2024-02-14T13:10:22.850 INFO:tasks.workunit.client.0.smithi012.stdout:0/1: creat f0 x:0 0 0 2024-02-14T13:10:22.859 INFO:tasks.workunit.client.0.smithi012.stdout:2/1: mkdir d0 0 2024-02-14T13:10:22.859 INFO:tasks.workunit.client.0.smithi012.stdout:2/2: dwrite - no filename 2024-02-14T13:10:22.859 INFO:tasks.workunit.client.0.smithi012.stdout:0/2: link f0 f1 0 2024-02-14T13:10:22.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/3: mknod d0/c1 0 2024-02-14T13:10:22.862 INFO:tasks.workunit.client.0.smithi012.stdout:0/3: creat f2 x:0 0 0 2024-02-14T13:10:22.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/4: stat d0/c1 0 2024-02-14T13:10:22.863 INFO:tasks.workunit.client.0.smithi012.stdout:3/0: dread - no filename 2024-02-14T13:10:22.865 INFO:tasks.workunit.client.0.smithi012.stdout:0/4: unlink f2 0 2024-02-14T13:10:22.865 INFO:tasks.workunit.client.0.smithi012.stdout:0/5: write f1 [884457,79829] 0 2024-02-14T13:10:22.865 INFO:tasks.workunit.client.0.smithi012.stdout:2/5: rmdir d0 39 2024-02-14T13:10:22.865 INFO:tasks.workunit.client.0.smithi012.stdout:2/6: dread - no filename 2024-02-14T13:10:22.865 INFO:tasks.workunit.client.0.smithi012.stdout:2/7: truncate - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/0: dread - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/1: read - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/2: readlink - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/3: truncate - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/4: readlink - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/5: chown . 111305 1 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/6: truncate - no filename 2024-02-14T13:10:22.868 INFO:tasks.workunit.client.0.smithi012.stdout:4/7: stat - no entries 2024-02-14T13:10:22.870 INFO:tasks.workunit.client.0.smithi012.stdout:2/8: creat d0/f2 x:0 0 0 2024-02-14T13:10:22.874 INFO:tasks.workunit.client.0.smithi012.stdout:4/8: mkdir d0 0 2024-02-14T13:10:22.874 INFO:tasks.workunit.client.0.smithi012.stdout:4/9: chown d0 306821786 1 2024-02-14T13:10:22.874 INFO:tasks.workunit.client.0.smithi012.stdout:5/0: dread - no filename 2024-02-14T13:10:22.874 INFO:tasks.workunit.client.0.smithi012.stdout:5/1: dwrite - no filename 2024-02-14T13:10:22.874 INFO:tasks.workunit.client.0.smithi012.stdout:5/2: chown . 2964024 1 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/10: mknod d0/c1 0 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/11: chown d0 7165 1 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/12: fdatasync - no filename 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/13: write - no filename 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/14: dwrite - no filename 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/15: dwrite - no filename 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/16: stat d0 0 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/17: stat d0 0 2024-02-14T13:10:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/18: write - no filename 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:4/19: chown d0 925002668 1 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:2/9: creat d0/f3 x:0 0 0 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:5/3: creat f0 x:0 0 0 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:5/4: dread - f0 zero size 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:5/5: write f0 [863838,124795] 0 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:4/20: rename d0/c1 to d0/c2 0 2024-02-14T13:10:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:6/0: creat f0 x:0 0 0 2024-02-14T13:10:22.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/0: dread - no filename 2024-02-14T13:10:22.882 INFO:tasks.workunit.client.0.smithi012.stdout:7/1: read - no filename 2024-02-14T13:10:22.882 INFO:tasks.workunit.client.0.smithi012.stdout:7/2: readlink - no filename 2024-02-14T13:10:22.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/21: rmdir d0 39 2024-02-14T13:10:22.882 INFO:tasks.workunit.client.0.smithi012.stdout:6/1: mkdir d1 0 2024-02-14T13:10:22.884 INFO:tasks.workunit.client.0.smithi012.stdout:8/0: dread - no filename 2024-02-14T13:10:22.884 INFO:tasks.workunit.client.0.smithi012.stdout:8/1: stat - no entries 2024-02-14T13:10:22.884 INFO:tasks.workunit.client.0.smithi012.stdout:8/2: write - no filename 2024-02-14T13:10:22.884 INFO:tasks.workunit.client.0.smithi012.stdout:8/3: dwrite - no filename 2024-02-14T13:10:22.885 INFO:tasks.workunit.client.0.smithi012.stdout:7/3: creat f0 x:0 0 0 2024-02-14T13:10:22.885 INFO:tasks.workunit.client.0.smithi012.stdout:7/4: stat f0 0 2024-02-14T13:10:22.885 INFO:tasks.workunit.client.0.smithi012.stdout:7/5: rmdir - no directory 2024-02-14T13:10:22.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/4: mknod c0 0 2024-02-14T13:10:22.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/5: dread - no filename 2024-02-14T13:10:22.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/0: rename - no filename 2024-02-14T13:10:22.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/1: write - no filename 2024-02-14T13:10:22.890 INFO:tasks.workunit.client.0.smithi012.stdout:7/6: link f0 f1 0 2024-02-14T13:10:22.896 INFO:tasks.workunit.client.0.smithi012.stdout:9/2: creat f0 x:0 0 0 2024-02-14T13:10:22.898 INFO:tasks.workunit.client.0.smithi012.stdout:7/7: rename f1 to f2 0 2024-02-14T13:10:22.898 INFO:tasks.workunit.client.0.smithi012.stdout:7/8: chown f2 438 1 2024-02-14T13:10:22.899 INFO:tasks.workunit.client.0.smithi012.stdout:7/9: mknod c3 0 2024-02-14T13:10:22.901 INFO:tasks.workunit.client.0.smithi012.stdout:7/10: mknod c4 0 2024-02-14T13:10:22.901 INFO:tasks.workunit.client.0.smithi012.stdout:7/11: chown c3 24 1 2024-02-14T13:10:22.901 INFO:tasks.workunit.client.0.smithi012.stdout:7/12: truncate f0 401209 0 2024-02-14T13:10:22.901 INFO:tasks.workunit.client.0.smithi012.stdout:7/13: write f2 [543062,19032] 0 2024-02-14T13:10:22.906 INFO:tasks.workunit.client.0.smithi012.stdout:7/14: rename f0 to f5 0 2024-02-14T13:10:23.070 INFO:tasks.workunit.client.0.smithi012.stdout:4/22: rmdir d0 39 2024-02-14T13:10:23.086 INFO:tasks.workunit.client.0.smithi012.stdout:9/3: getdents . 0 2024-02-14T13:10:23.259 INFO:tasks.workunit.client.0.smithi012.stdout:2/10: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:23.815 INFO:tasks.workunit.client.0.smithi012.stdout:5/6: dwrite f0 [0,4194304] 0 2024-02-14T13:10:23.884 INFO:tasks.workunit.client.0.smithi012.stdout:9/4: symlink l1 0 2024-02-14T13:10:23.920 INFO:tasks.workunit.client.0.smithi012.stdout:7/15: dread f5 [0,4194304] 0 2024-02-14T13:10:23.941 INFO:tasks.workunit.client.0.smithi012.stdout:7/16: dwrite f5 [0,4194304] 0 2024-02-14T13:10:24.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:24 smithi012 ceph-mon[32370]: pgmap v398: 97 pgs: 97 active+clean; 31 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 977 op/s 2024-02-14T13:10:24.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:24 smithi103 ceph-mon[36921]: pgmap v398: 97 pgs: 97 active+clean; 31 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 977 op/s 2024-02-14T13:10:24.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:24 smithi055 ceph-mon[36853]: pgmap v398: 97 pgs: 97 active+clean; 31 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 977 op/s 2024-02-14T13:10:24.906 INFO:tasks.workunit.client.0.smithi012.stdout:2/11: symlink d0/l4 0 2024-02-14T13:10:24.906 INFO:tasks.workunit.client.0.smithi012.stdout:2/12: fdatasync d0/f2 0 2024-02-14T13:10:24.906 INFO:tasks.workunit.client.0.smithi012.stdout:2/13: write d0/f3 [144242,66220] 0 2024-02-14T13:10:26.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:26 smithi012 ceph-mon[32370]: pgmap v399: 97 pgs: 97 active+clean; 46 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 1.48k op/s 2024-02-14T13:10:26.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:26 smithi103 ceph-mon[36921]: pgmap v399: 97 pgs: 97 active+clean; 46 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 1.48k op/s 2024-02-14T13:10:26.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:26 smithi055 ceph-mon[36853]: pgmap v399: 97 pgs: 97 active+clean; 46 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 1.48k op/s 2024-02-14T13:10:28.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:28 smithi012 ceph-mon[32370]: pgmap v400: 97 pgs: 97 active+clean; 79 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.8 MiB/s wr, 1.99k op/s 2024-02-14T13:10:28.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:28 smithi103 ceph-mon[36921]: pgmap v400: 97 pgs: 97 active+clean; 79 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.8 MiB/s wr, 1.99k op/s 2024-02-14T13:10:28.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:28 smithi055 ceph-mon[36853]: pgmap v400: 97 pgs: 97 active+clean; 79 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.8 MiB/s wr, 1.99k op/s 2024-02-14T13:10:28.769 INFO:tasks.workunit.client.0.smithi012.stdout:9/5: fsync f0 0 2024-02-14T13:10:28.769 INFO:tasks.workunit.client.0.smithi012.stdout:9/6: write f0 [218829,27020] 0 2024-02-14T13:10:29.139 INFO:tasks.workunit.client.0.smithi012.stdout:7/17: mknod c6 0 2024-02-14T13:10:30.210 INFO:tasks.workunit.client.0.smithi012.stdout:7/18: rename c4 to c7 0 2024-02-14T13:10:30.210 INFO:tasks.workunit.client.0.smithi012.stdout:7/19: fsync f5 0 2024-02-14T13:10:30.210 INFO:tasks.workunit.client.0.smithi012.stdout:7/20: fdatasync f2 0 2024-02-14T13:10:30.217 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:30 smithi012 ceph-mon[32370]: pgmap v401: 97 pgs: 97 active+clean; 89 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.1 MiB/s wr, 2.06k op/s 2024-02-14T13:10:30.281 INFO:tasks.workunit.client.0.smithi012.stdout:2/14: truncate d0/f3 57389 0 2024-02-14T13:10:30.281 INFO:tasks.workunit.client.0.smithi012.stdout:7/21: write f5 [4868553,12946] 0 2024-02-14T13:10:30.283 INFO:tasks.workunit.client.0.smithi012.stdout:2/15: mkdir d0/d5 0 2024-02-14T13:10:30.285 INFO:tasks.workunit.client.0.smithi012.stdout:2/16: mkdir d0/d6 0 2024-02-14T13:10:30.289 INFO:tasks.workunit.client.0.smithi012.stdout:7/22: write f5 [1127573,94314] 0 2024-02-14T13:10:30.289 INFO:tasks.workunit.client.0.smithi012.stdout:7/23: read f2 [4776692,20776] 0 2024-02-14T13:10:30.296 INFO:tasks.workunit.client.0.smithi012.stdout:7/24: dread f2 [0,4194304] 0 2024-02-14T13:10:30.338 INFO:tasks.workunit.client.0.smithi012.stdout:7/25: link c6 c8 0 2024-02-14T13:10:30.338 INFO:tasks.workunit.client.0.smithi012.stdout:7/26: write f5 [5257191,88992] 0 2024-02-14T13:10:30.339 INFO:tasks.workunit.client.0.smithi012.stdout:7/27: mknod c9 0 2024-02-14T13:10:30.340 INFO:tasks.workunit.client.0.smithi012.stdout:7/28: symlink la 0 2024-02-14T13:10:30.341 INFO:tasks.workunit.client.0.smithi012.stdout:7/29: creat fb x:0 0 0 2024-02-14T13:10:30.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:30 smithi103 ceph-mon[36921]: pgmap v401: 97 pgs: 97 active+clean; 89 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.1 MiB/s wr, 2.06k op/s 2024-02-14T13:10:30.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:30 smithi055 ceph-mon[36853]: pgmap v401: 97 pgs: 97 active+clean; 89 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.1 MiB/s wr, 2.06k op/s 2024-02-14T13:10:30.568 INFO:tasks.workunit.client.0.smithi012.stdout:5/7: truncate f0 3651808 0 2024-02-14T13:10:30.569 INFO:tasks.workunit.client.0.smithi012.stdout:5/8: mknod c1 0 2024-02-14T13:10:30.571 INFO:tasks.workunit.client.0.smithi012.stdout:2/17: fsync d0/f3 0 2024-02-14T13:10:30.571 INFO:tasks.workunit.client.0.smithi012.stdout:2/18: fsync d0/f3 0 2024-02-14T13:10:30.593 INFO:tasks.workunit.client.0.smithi012.stdout:5/9: fsync f0 0 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:3/1: sync 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:3/2: rename - no filename 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:1/1: sync 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:1/2: write - no filename 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:4/23: sync 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:6/2: sync 2024-02-14T13:10:30.595 INFO:tasks.workunit.client.0.smithi012.stdout:2/19: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:30.596 INFO:tasks.workunit.client.0.smithi012.stdout:3/3: chown . 0 1 2024-02-14T13:10:30.596 INFO:tasks.workunit.client.0.smithi012.stdout:1/3: chown . 1931 1 2024-02-14T13:10:30.596 INFO:tasks.workunit.client.0.smithi012.stdout:3/4: chown . 24489 1 2024-02-14T13:10:30.596 INFO:tasks.workunit.client.0.smithi012.stdout:3/5: write - no filename 2024-02-14T13:10:30.596 INFO:tasks.workunit.client.0.smithi012.stdout:3/6: dwrite - no filename 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/3: dread - f0 zero size 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:0/6: sync 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:7/30: sync 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:0/7: fsync f1 0 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:9/7: sync 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:8/6: sync 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:8/7: dread - no filename 2024-02-14T13:10:30.597 INFO:tasks.workunit.client.0.smithi012.stdout:8/8: truncate - no filename 2024-02-14T13:10:30.598 INFO:tasks.workunit.client.0.smithi012.stdout:8/9: truncate - no filename 2024-02-14T13:10:30.598 INFO:tasks.workunit.client.0.smithi012.stdout:8/10: dread - no filename 2024-02-14T13:10:30.599 INFO:tasks.workunit.client.0.smithi012.stdout:4/24: rmdir d0 39 2024-02-14T13:10:30.599 INFO:tasks.workunit.client.0.smithi012.stdout:3/7: creat f0 x:0 0 0 2024-02-14T13:10:30.599 INFO:tasks.workunit.client.0.smithi012.stdout:3/8: truncate f0 342052 0 2024-02-14T13:10:30.599 INFO:tasks.workunit.client.0.smithi012.stdout:1/4: symlink l0 0 2024-02-14T13:10:30.599 INFO:tasks.workunit.client.0.smithi012.stdout:1/5: dwrite - no filename 2024-02-14T13:10:30.600 INFO:tasks.workunit.client.0.smithi012.stdout:6/4: creat d1/f2 x:0 0 0 2024-02-14T13:10:30.601 INFO:tasks.workunit.client.0.smithi012.stdout:0/8: mknod c3 0 2024-02-14T13:10:30.602 INFO:tasks.workunit.client.0.smithi012.stdout:9/8: creat f2 x:0 0 0 2024-02-14T13:10:30.602 INFO:tasks.workunit.client.0.smithi012.stdout:8/11: mknod c1 0 2024-02-14T13:10:30.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/31: symlink lc 0 2024-02-14T13:10:30.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/32: write f2 [2333690,126158] 0 2024-02-14T13:10:30.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/33: chown c3 1542 1 2024-02-14T13:10:30.605 INFO:tasks.workunit.client.0.smithi012.stdout:4/25: creat d0/f3 x:0 0 0 2024-02-14T13:10:30.605 INFO:tasks.workunit.client.0.smithi012.stdout:4/26: rename d0 to d0/d4 22 2024-02-14T13:10:30.605 INFO:tasks.workunit.client.0.smithi012.stdout:3/9: rename f0 to f1 0 2024-02-14T13:10:30.606 INFO:tasks.workunit.client.0.smithi012.stdout:6/5: creat d1/f3 x:0 0 0 2024-02-14T13:10:30.606 INFO:tasks.workunit.client.0.smithi012.stdout:6/6: truncate f0 204490 0 2024-02-14T13:10:30.607 INFO:tasks.workunit.client.0.smithi012.stdout:0/9: unlink c3 0 2024-02-14T13:10:30.607 INFO:tasks.workunit.client.0.smithi012.stdout:5/10: read f0 [122250,128561] 0 2024-02-14T13:10:30.608 INFO:tasks.workunit.client.0.smithi012.stdout:8/12: creat f2 x:0 0 0 2024-02-14T13:10:30.609 INFO:tasks.workunit.client.0.smithi012.stdout:7/34: creat fd x:0 0 0 2024-02-14T13:10:30.610 INFO:tasks.workunit.client.0.smithi012.stdout:1/6: getdents . 0 2024-02-14T13:10:30.612 INFO:tasks.workunit.client.0.smithi012.stdout:0/10: mknod c4 0 2024-02-14T13:10:30.613 INFO:tasks.workunit.client.0.smithi012.stdout:9/9: symlink l3 0 2024-02-14T13:10:30.614 INFO:tasks.workunit.client.0.smithi012.stdout:2/20: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:30.615 INFO:tasks.workunit.client.0.smithi012.stdout:5/11: symlink l2 0 2024-02-14T13:10:30.615 INFO:tasks.workunit.client.0.smithi012.stdout:5/12: chown l2 7 1 2024-02-14T13:10:30.616 INFO:tasks.workunit.client.0.smithi012.stdout:8/13: rename c1 to c3 0 2024-02-14T13:10:30.617 INFO:tasks.workunit.client.0.smithi012.stdout:0/11: dread f0 [0,4194304] 0 2024-02-14T13:10:30.617 INFO:tasks.workunit.client.0.smithi012.stdout:0/12: chown f0 1807835 1 2024-02-14T13:10:30.617 INFO:tasks.workunit.client.0.smithi012.stdout:7/35: link fb fe 0 2024-02-14T13:10:30.620 INFO:tasks.workunit.client.0.smithi012.stdout:1/7: creat f1 x:0 0 0 2024-02-14T13:10:30.620 INFO:tasks.workunit.client.0.smithi012.stdout:1/8: write f1 [981361,36732] 0 2024-02-14T13:10:30.621 INFO:tasks.workunit.client.0.smithi012.stdout:9/10: creat f4 x:0 0 0 2024-02-14T13:10:30.623 INFO:tasks.workunit.client.0.smithi012.stdout:8/14: creat f4 x:0 0 0 2024-02-14T13:10:30.623 INFO:tasks.workunit.client.0.smithi012.stdout:8/15: chown c3 7623 1 2024-02-14T13:10:30.623 INFO:tasks.workunit.client.0.smithi012.stdout:8/16: dread - f4 zero size 2024-02-14T13:10:30.623 INFO:tasks.workunit.client.0.smithi012.stdout:6/7: getdents d1 0 2024-02-14T13:10:30.625 INFO:tasks.workunit.client.0.smithi012.stdout:0/13: unlink f1 0 2024-02-14T13:10:30.627 INFO:tasks.workunit.client.0.smithi012.stdout:1/9: dread f1 [0,4194304] 0 2024-02-14T13:10:30.628 INFO:tasks.workunit.client.0.smithi012.stdout:8/17: symlink l5 0 2024-02-14T13:10:30.628 INFO:tasks.workunit.client.0.smithi012.stdout:8/18: readlink l5 0 2024-02-14T13:10:30.628 INFO:tasks.workunit.client.0.smithi012.stdout:8/19: write f2 [1005904,30355] 0 2024-02-14T13:10:30.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/36: fsync fe 0 2024-02-14T13:10:30.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/37: truncate fe 296229 0 2024-02-14T13:10:30.632 INFO:tasks.workunit.client.0.smithi012.stdout:0/14: dread f0 [0,4194304] 0 2024-02-14T13:10:30.633 INFO:tasks.workunit.client.0.smithi012.stdout:3/10: truncate f1 214684 0 2024-02-14T13:10:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:9/11: link l3 l5 0 2024-02-14T13:10:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:9/12: chown l3 251095 1 2024-02-14T13:10:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:9/13: chown f0 451560 1 2024-02-14T13:10:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:9/14: readlink l3 0 2024-02-14T13:10:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:9/15: stat l1 0 2024-02-14T13:10:30.635 INFO:tasks.workunit.client.0.smithi012.stdout:1/10: readlink l0 0 2024-02-14T13:10:30.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/21: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:30.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/22: rename d0/d6 to d0/d6/d7 22 2024-02-14T13:10:30.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/23: write d0/f3 [647589,12873] 0 2024-02-14T13:10:30.636 INFO:tasks.workunit.client.0.smithi012.stdout:8/20: mkdir d6 0 2024-02-14T13:10:30.637 INFO:tasks.workunit.client.0.smithi012.stdout:7/38: mkdir df 0 2024-02-14T13:10:30.638 INFO:tasks.workunit.client.0.smithi012.stdout:3/11: symlink l2 0 2024-02-14T13:10:30.638 INFO:tasks.workunit.client.0.smithi012.stdout:4/27: dwrite d0/f3 [0,4194304] 0 2024-02-14T13:10:30.641 INFO:tasks.workunit.client.0.smithi012.stdout:8/21: rmdir d6 0 2024-02-14T13:10:30.641 INFO:tasks.workunit.client.0.smithi012.stdout:8/22: write f2 [1936973,64914] 0 2024-02-14T13:10:30.642 INFO:tasks.workunit.client.0.smithi012.stdout:7/39: rename c8 to df/c10 0 2024-02-14T13:10:30.646 INFO:tasks.workunit.client.0.smithi012.stdout:3/12: symlink l3 0 2024-02-14T13:10:30.647 INFO:tasks.workunit.client.0.smithi012.stdout:9/16: link l1 l6 0 2024-02-14T13:10:30.647 INFO:tasks.workunit.client.0.smithi012.stdout:9/17: dread - f4 zero size 2024-02-14T13:10:30.649 INFO:tasks.workunit.client.0.smithi012.stdout:1/11: mknod c2 0 2024-02-14T13:10:30.649 INFO:tasks.workunit.client.0.smithi012.stdout:4/28: read d0/f3 [3115856,65770] 0 2024-02-14T13:10:30.650 INFO:tasks.workunit.client.0.smithi012.stdout:5/13: dwrite f0 [0,4194304] 0 2024-02-14T13:10:30.650 INFO:tasks.workunit.client.0.smithi012.stdout:8/23: mknod c7 0 2024-02-14T13:10:30.651 INFO:tasks.workunit.client.0.smithi012.stdout:1/12: dread f1 [0,4194304] 0 2024-02-14T13:10:30.651 INFO:tasks.workunit.client.0.smithi012.stdout:7/40: rename fb to df/f11 0 2024-02-14T13:10:30.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/13: symlink l4 0 2024-02-14T13:10:30.653 INFO:tasks.workunit.client.0.smithi012.stdout:9/18: creat f7 x:0 0 0 2024-02-14T13:10:30.653 INFO:tasks.workunit.client.0.smithi012.stdout:9/19: truncate f4 41666 0 2024-02-14T13:10:30.653 INFO:tasks.workunit.client.0.smithi012.stdout:9/20: chown l6 551080792 1 2024-02-14T13:10:30.653 INFO:tasks.workunit.client.0.smithi012.stdout:0/15: dwrite f0 [0,4194304] 0 2024-02-14T13:10:30.653 INFO:tasks.workunit.client.0.smithi012.stdout:0/16: chown c4 15356 1 2024-02-14T13:10:30.654 INFO:tasks.workunit.client.0.smithi012.stdout:9/21: write f0 [55354,101044] 0 2024-02-14T13:10:30.654 INFO:tasks.workunit.client.0.smithi012.stdout:9/22: write f7 [996816,116063] 0 2024-02-14T13:10:30.655 INFO:tasks.workunit.client.0.smithi012.stdout:4/29: unlink d0/c2 0 2024-02-14T13:10:30.658 INFO:tasks.workunit.client.0.smithi012.stdout:7/41: creat df/f12 x:0 0 0 2024-02-14T13:10:30.658 INFO:tasks.workunit.client.0.smithi012.stdout:7/42: write fe [458142,110624] 0 2024-02-14T13:10:30.659 INFO:tasks.workunit.client.0.smithi012.stdout:5/14: dread f0 [0,4194304] 0 2024-02-14T13:10:30.659 INFO:tasks.workunit.client.0.smithi012.stdout:5/15: readlink l2 0 2024-02-14T13:10:30.659 INFO:tasks.workunit.client.0.smithi012.stdout:5/16: stat f0 0 2024-02-14T13:10:30.659 INFO:tasks.workunit.client.0.smithi012.stdout:3/14: unlink l2 0 2024-02-14T13:10:30.659 INFO:tasks.workunit.client.0.smithi012.stdout:3/15: chown l4 741785950 1 2024-02-14T13:10:30.662 INFO:tasks.workunit.client.0.smithi012.stdout:0/17: mknod c5 0 2024-02-14T13:10:30.664 INFO:tasks.workunit.client.0.smithi012.stdout:4/30: symlink d0/l5 0 2024-02-14T13:10:30.667 INFO:tasks.workunit.client.0.smithi012.stdout:1/13: rename c2 to c3 0 2024-02-14T13:10:30.669 INFO:tasks.workunit.client.0.smithi012.stdout:5/17: symlink l3 0 2024-02-14T13:10:30.670 INFO:tasks.workunit.client.0.smithi012.stdout:4/31: creat d0/f6 x:0 0 0 2024-02-14T13:10:30.671 INFO:tasks.workunit.client.0.smithi012.stdout:1/14: creat f4 x:0 0 0 2024-02-14T13:10:30.672 INFO:tasks.workunit.client.0.smithi012.stdout:5/18: creat f4 x:0 0 0 2024-02-14T13:10:30.674 INFO:tasks.workunit.client.0.smithi012.stdout:9/23: getdents . 0 2024-02-14T13:10:30.674 INFO:tasks.workunit.client.0.smithi012.stdout:1/15: write f1 [449807,9661] 0 2024-02-14T13:10:30.674 INFO:tasks.workunit.client.0.smithi012.stdout:1/16: truncate f1 1932500 0 2024-02-14T13:10:30.674 INFO:tasks.workunit.client.0.smithi012.stdout:5/19: creat f5 x:0 0 0 2024-02-14T13:10:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/24: fdatasync f7 0 2024-02-14T13:10:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/25: readlink l3 0 2024-02-14T13:10:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/26: write f0 [1278950,25829] 0 2024-02-14T13:10:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/20: link f0 f6 0 2024-02-14T13:10:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/21: dread - f4 zero size 2024-02-14T13:10:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/22: write f4 [596825,10675] 0 2024-02-14T13:10:30.678 INFO:tasks.workunit.client.0.smithi012.stdout:5/23: write f4 [692542,19367] 0 2024-02-14T13:10:30.678 INFO:tasks.workunit.client.0.smithi012.stdout:5/24: fdatasync f6 0 2024-02-14T13:10:30.678 INFO:tasks.workunit.client.0.smithi012.stdout:0/18: write f0 [1216082,42846] 0 2024-02-14T13:10:30.678 INFO:tasks.workunit.client.0.smithi012.stdout:1/17: symlink l5 0 2024-02-14T13:10:30.678 INFO:tasks.workunit.client.0.smithi012.stdout:1/18: write f4 [230292,117946] 0 2024-02-14T13:10:30.680 INFO:tasks.workunit.client.0.smithi012.stdout:9/27: creat f8 x:0 0 0 2024-02-14T13:10:30.682 INFO:tasks.workunit.client.0.smithi012.stdout:8/24: truncate f2 1353751 0 2024-02-14T13:10:30.683 INFO:tasks.workunit.client.0.smithi012.stdout:1/19: mkdir d6 0 2024-02-14T13:10:30.683 INFO:tasks.workunit.client.0.smithi012.stdout:1/20: write f1 [2897334,61158] 0 2024-02-14T13:10:30.701 INFO:tasks.workunit.client.0.smithi012.stdout:4/32: dwrite d0/f6 [0,4194304] 0 2024-02-14T13:10:30.701 INFO:tasks.workunit.client.0.smithi012.stdout:4/33: fsync d0/f3 0 2024-02-14T13:10:30.704 INFO:tasks.workunit.client.0.smithi012.stdout:9/28: dwrite f2 [0,4194304] 0 2024-02-14T13:10:30.704 INFO:tasks.workunit.client.0.smithi012.stdout:9/29: dread - f8 zero size 2024-02-14T13:10:30.710 INFO:tasks.workunit.client.0.smithi012.stdout:4/34: dread d0/f6 [0,4194304] 0 2024-02-14T13:10:30.753 INFO:tasks.workunit.client.0.smithi012.stdout:8/25: creat f8 x:0 0 0 2024-02-14T13:10:30.800 INFO:tasks.workunit.client.0.smithi012.stdout:3/16: dwrite f1 [0,4194304] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/21: mkdir d6/d7 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/22: dread f4 [0,4194304] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/23: getdents d6/d7 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/24: rename d6/d7 to d6/d7/d8 22 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:5/25: dwrite f5 [0,4194304] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:4/35: dread d0/f3 [0,4194304] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:4/36: chown d0/f6 318472 1 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:7/43: dwrite f5 [0,4194304] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:7/44: chown c9 3328944 1 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:7/45: write fe [673311,93067] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/30: getdents . 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/31: write f7 [1678898,114949] 0 2024-02-14T13:10:30.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/25: dread f1 [0,4194304] 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:0/19: truncate f0 3965149 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:3/17: getdents . 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/26: getdents . 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/27: stat l2 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:4/37: symlink d0/l7 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/28: dread f4 [0,4194304] 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/29: fdatasync f4 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:9/32: creat f9 x:0 0 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:0/20: rename c5 to c6 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:3/18: rename l4 to l5 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:1/26: dwrite f4 [0,4194304] 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:4/38: rename d0/l7 to d0/l8 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:4/39: chown d0/l8 19078854 1 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/30: rename f4 to f7 0 2024-02-14T13:10:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:5/31: read f7 [375313,26350] 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:9/33: mkdir da 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:0/21: link c4 c7 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/8: sync 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/9: readlink - no filename 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/10: dread - d1/f2 zero size 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:7/46: truncate fe 416450 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:7/47: dread - fd zero size 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:7/48: readlink lc 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:7/49: dread - fd zero size 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:9/34: dread f7 [0,4194304] 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:1/27: mkdir d6/d7/d9 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:1/28: read f1 [1152143,42005] 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:1/29: rename d6 to d6/d7/da 22 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:5/32: mknod c8 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:0/22: rename c4 to c8 0 2024-02-14T13:10:30.803 INFO:tasks.workunit.client.0.smithi012.stdout:3/19: symlink l6 0 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:9/35: write f2 [3966936,115062] 0 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:9/36: stat da 0 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:4/40: link d0/l8 d0/l9 0 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/11: rename d1/f2 to d1/f4 0 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:6/12: chown d1/f3 13879256 1 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:7/50: symlink df/l13 0 2024-02-14T13:10:30.804 INFO:tasks.workunit.client.0.smithi012.stdout:5/33: mknod c9 0 2024-02-14T13:10:30.805 INFO:tasks.workunit.client.0.smithi012.stdout:4/41: dread d0/f6 [0,4194304] 0 2024-02-14T13:10:30.805 INFO:tasks.workunit.client.0.smithi012.stdout:9/37: mknod da/cb 0 2024-02-14T13:10:30.805 INFO:tasks.workunit.client.0.smithi012.stdout:9/38: write f9 [665422,115682] 0 2024-02-14T13:10:30.805 INFO:tasks.workunit.client.0.smithi012.stdout:7/51: mknod df/c14 0 2024-02-14T13:10:30.806 INFO:tasks.workunit.client.0.smithi012.stdout:7/52: write df/f11 [1240353,119283] 0 2024-02-14T13:10:30.806 INFO:tasks.workunit.client.0.smithi012.stdout:7/53: fsync f5 0 2024-02-14T13:10:30.806 INFO:tasks.workunit.client.0.smithi012.stdout:7/54: write fd [251449,11921] 0 2024-02-14T13:10:30.807 INFO:tasks.workunit.client.0.smithi012.stdout:5/34: rename l2 to la 0 2024-02-14T13:10:30.808 INFO:tasks.workunit.client.0.smithi012.stdout:4/42: creat d0/fa x:0 0 0 2024-02-14T13:10:30.808 INFO:tasks.workunit.client.0.smithi012.stdout:4/43: write d0/f6 [4945602,20604] 0 2024-02-14T13:10:30.809 INFO:tasks.workunit.client.0.smithi012.stdout:4/44: rename d0 to d0/db 22 2024-02-14T13:10:30.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/20: write f1 [1324810,35613] 0 2024-02-14T13:10:30.810 INFO:tasks.workunit.client.0.smithi012.stdout:0/23: link c8 c9 0 2024-02-14T13:10:30.810 INFO:tasks.workunit.client.0.smithi012.stdout:7/55: dread fd [0,4194304] 0 2024-02-14T13:10:30.811 INFO:tasks.workunit.client.0.smithi012.stdout:9/39: creat da/fc x:0 0 0 2024-02-14T13:10:30.811 INFO:tasks.workunit.client.0.smithi012.stdout:9/40: stat f4 0 2024-02-14T13:10:30.812 INFO:tasks.workunit.client.0.smithi012.stdout:7/56: write f2 [5103749,106646] 0 2024-02-14T13:10:30.813 INFO:tasks.workunit.client.0.smithi012.stdout:9/41: dread f4 [0,4194304] 0 2024-02-14T13:10:30.813 INFO:tasks.workunit.client.0.smithi012.stdout:9/42: fdatasync f0 0 2024-02-14T13:10:30.813 INFO:tasks.workunit.client.0.smithi012.stdout:5/35: write f0 [1655838,85185] 0 2024-02-14T13:10:30.813 INFO:tasks.workunit.client.0.smithi012.stdout:5/36: readlink la 0 2024-02-14T13:10:30.814 INFO:tasks.workunit.client.0.smithi012.stdout:6/13: link d1/f4 d1/f5 0 2024-02-14T13:10:30.814 INFO:tasks.workunit.client.0.smithi012.stdout:6/14: truncate d1/f3 236847 0 2024-02-14T13:10:30.817 INFO:tasks.workunit.client.0.smithi012.stdout:0/24: creat fa x:0 0 0 2024-02-14T13:10:30.817 INFO:tasks.workunit.client.0.smithi012.stdout:0/25: write f0 [4369161,87989] 0 2024-02-14T13:10:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/43: dread f2 [0,4194304] 0 2024-02-14T13:10:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/44: stat l3 0 2024-02-14T13:10:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:7/57: creat df/f15 x:0 0 0 2024-02-14T13:10:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:7/58: read f5 [4669837,64197] 0 2024-02-14T13:10:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:9/45: write f4 [98451,120702] 0 2024-02-14T13:10:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:5/37: creat fb x:0 0 0 2024-02-14T13:10:30.819 INFO:tasks.workunit.client.0.smithi012.stdout:6/15: creat d1/f6 x:0 0 0 2024-02-14T13:10:30.821 INFO:tasks.workunit.client.0.smithi012.stdout:3/21: mknod c7 0 2024-02-14T13:10:30.821 INFO:tasks.workunit.client.0.smithi012.stdout:3/22: chown c7 355047 1 2024-02-14T13:10:30.823 INFO:tasks.workunit.client.0.smithi012.stdout:4/45: getdents d0 0 2024-02-14T13:10:30.823 INFO:tasks.workunit.client.0.smithi012.stdout:4/46: dread - d0/fa zero size 2024-02-14T13:10:30.825 INFO:tasks.workunit.client.0.smithi012.stdout:7/59: rename lc to df/l16 0 2024-02-14T13:10:30.825 INFO:tasks.workunit.client.0.smithi012.stdout:7/60: write df/f15 [853810,15761] 0 2024-02-14T13:10:30.825 INFO:tasks.workunit.client.0.smithi012.stdout:7/61: chown f2 213557793 1 2024-02-14T13:10:30.826 INFO:tasks.workunit.client.0.smithi012.stdout:9/46: rmdir da 39 2024-02-14T13:10:30.828 INFO:tasks.workunit.client.0.smithi012.stdout:5/38: mkdir dc 0 2024-02-14T13:10:30.829 INFO:tasks.workunit.client.0.smithi012.stdout:5/39: fdatasync f7 0 2024-02-14T13:10:30.829 INFO:tasks.workunit.client.0.smithi012.stdout:5/40: read f6 [2011854,37645] 0 2024-02-14T13:10:30.829 INFO:tasks.workunit.client.0.smithi012.stdout:5/41: chown c1 0 1 2024-02-14T13:10:30.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/62: dread f2 [4194304,4194304] 0 2024-02-14T13:10:30.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/63: truncate fd 504312 0 2024-02-14T13:10:30.831 INFO:tasks.workunit.client.0.smithi012.stdout:6/16: link d1/f5 d1/f7 0 2024-02-14T13:10:30.834 INFO:tasks.workunit.client.0.smithi012.stdout:4/47: symlink d0/lc 0 2024-02-14T13:10:30.836 INFO:tasks.workunit.client.0.smithi012.stdout:9/47: mkdir da/dd 0 2024-02-14T13:10:30.836 INFO:tasks.workunit.client.0.smithi012.stdout:9/48: read f2 [3747223,113839] 0 2024-02-14T13:10:30.836 INFO:tasks.workunit.client.0.smithi012.stdout:9/49: write da/fc [615946,37156] 0 2024-02-14T13:10:30.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/42: truncate f5 820292 0 2024-02-14T13:10:30.838 INFO:tasks.workunit.client.0.smithi012.stdout:0/26: truncate f0 732233 0 2024-02-14T13:10:30.840 INFO:tasks.workunit.client.0.smithi012.stdout:9/50: dread f0 [0,4194304] 0 2024-02-14T13:10:30.844 INFO:tasks.workunit.client.0.smithi012.stdout:7/64: rename f2 to df/f17 0 2024-02-14T13:10:30.849 INFO:tasks.workunit.client.0.smithi012.stdout:3/23: symlink l8 0 2024-02-14T13:10:30.850 INFO:tasks.workunit.client.0.smithi012.stdout:6/17: dwrite d1/f4 [0,4194304] 0 2024-02-14T13:10:30.851 INFO:tasks.workunit.client.0.smithi012.stdout:0/27: symlink lb 0 2024-02-14T13:10:30.851 INFO:tasks.workunit.client.0.smithi012.stdout:0/28: write f0 [401126,51318] 0 2024-02-14T13:10:30.851 INFO:tasks.workunit.client.0.smithi012.stdout:0/29: dread - fa zero size 2024-02-14T13:10:30.853 INFO:tasks.workunit.client.0.smithi012.stdout:9/51: symlink da/le 0 2024-02-14T13:10:30.855 INFO:tasks.workunit.client.0.smithi012.stdout:7/65: getdents df 0 2024-02-14T13:10:30.856 INFO:tasks.workunit.client.0.smithi012.stdout:4/48: mknod d0/cd 0 2024-02-14T13:10:30.859 INFO:tasks.workunit.client.0.smithi012.stdout:6/18: write d1/f4 [1926932,16601] 0 2024-02-14T13:10:30.859 INFO:tasks.workunit.client.0.smithi012.stdout:0/30: creat fc x:0 0 0 2024-02-14T13:10:30.860 INFO:tasks.workunit.client.0.smithi012.stdout:9/52: symlink da/lf 0 2024-02-14T13:10:30.861 INFO:tasks.workunit.client.0.smithi012.stdout:3/24: mkdir d9 0 2024-02-14T13:10:30.863 INFO:tasks.workunit.client.0.smithi012.stdout:7/66: rename c7 to df/c18 0 2024-02-14T13:10:30.866 INFO:tasks.workunit.client.0.smithi012.stdout:6/19: creat d1/f8 x:0 0 0 2024-02-14T13:10:30.866 INFO:tasks.workunit.client.0.smithi012.stdout:6/20: chown d1/f4 1283 1 2024-02-14T13:10:30.867 INFO:tasks.workunit.client.0.smithi012.stdout:0/31: creat fd x:0 0 0 2024-02-14T13:10:30.868 INFO:tasks.workunit.client.0.smithi012.stdout:3/25: mknod d9/ca 0 2024-02-14T13:10:30.868 INFO:tasks.workunit.client.0.smithi012.stdout:0/32: fsync fc 0 2024-02-14T13:10:30.868 INFO:tasks.workunit.client.0.smithi012.stdout:0/33: readlink lb 0 2024-02-14T13:10:30.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/53: rename l3 to da/l10 0 2024-02-14T13:10:30.870 INFO:tasks.workunit.client.0.smithi012.stdout:7/67: fdatasync df/f17 0 2024-02-14T13:10:30.871 INFO:tasks.workunit.client.0.smithi012.stdout:3/26: dread f1 [0,4194304] 0 2024-02-14T13:10:30.872 INFO:tasks.workunit.client.0.smithi012.stdout:6/21: mkdir d1/d9 0 2024-02-14T13:10:30.872 INFO:tasks.workunit.client.0.smithi012.stdout:6/22: chown d1/f6 51170 1 2024-02-14T13:10:30.872 INFO:tasks.workunit.client.0.smithi012.stdout:9/54: dread f2 [0,4194304] 0 2024-02-14T13:10:30.875 INFO:tasks.workunit.client.0.smithi012.stdout:4/49: rename d0/l8 to d0/le 0 2024-02-14T13:10:30.876 INFO:tasks.workunit.client.0.smithi012.stdout:3/27: mknod d9/cb 0 2024-02-14T13:10:30.876 INFO:tasks.workunit.client.0.smithi012.stdout:3/28: write f1 [3789460,91385] 0 2024-02-14T13:10:30.877 INFO:tasks.workunit.client.0.smithi012.stdout:6/23: mknod d1/d9/ca 0 2024-02-14T13:10:30.878 INFO:tasks.workunit.client.0.smithi012.stdout:0/34: getdents . 0 2024-02-14T13:10:30.878 INFO:tasks.workunit.client.0.smithi012.stdout:0/35: write fc [829916,69645] 0 2024-02-14T13:10:30.878 INFO:tasks.workunit.client.0.smithi012.stdout:0/36: fsync f0 0 2024-02-14T13:10:30.881 INFO:tasks.workunit.client.0.smithi012.stdout:6/24: mknod d1/cb 0 2024-02-14T13:10:30.881 INFO:tasks.workunit.client.0.smithi012.stdout:6/25: write d1/f6 [829655,78443] 0 2024-02-14T13:10:30.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/50: symlink d0/lf 0 2024-02-14T13:10:30.883 INFO:tasks.workunit.client.0.smithi012.stdout:4/51: mkdir d0/d10 0 2024-02-14T13:10:30.886 INFO:tasks.workunit.client.0.smithi012.stdout:4/52: rename d0/cd to d0/c11 0 2024-02-14T13:10:30.892 INFO:tasks.workunit.client.0.smithi012.stdout:9/55: dwrite da/fc [0,4194304] 0 2024-02-14T13:10:30.892 INFO:tasks.workunit.client.0.smithi012.stdout:8/26: sync 2024-02-14T13:10:30.892 INFO:tasks.workunit.client.0.smithi012.stdout:4/53: write d0/f6 [558704,112013] 0 2024-02-14T13:10:30.892 INFO:tasks.workunit.client.0.smithi012.stdout:2/24: sync 2024-02-14T13:10:30.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/56: truncate f7 160905 0 2024-02-14T13:10:30.896 INFO:tasks.workunit.client.0.smithi012.stdout:9/57: write f8 [198491,38621] 0 2024-02-14T13:10:30.898 INFO:tasks.workunit.client.0.smithi012.stdout:8/27: mkdir d9 0 2024-02-14T13:10:30.900 INFO:tasks.workunit.client.0.smithi012.stdout:7/68: dwrite df/f11 [0,4194304] 0 2024-02-14T13:10:30.905 INFO:tasks.workunit.client.0.smithi012.stdout:7/69: creat df/f19 x:0 0 0 2024-02-14T13:10:30.910 INFO:tasks.workunit.client.0.smithi012.stdout:0/37: dwrite fa [0,4194304] 0 2024-02-14T13:10:30.930 INFO:tasks.workunit.client.0.smithi012.stdout:2/25: dwrite d0/f3 [0,4194304] 0 2024-02-14T13:10:30.930 INFO:tasks.workunit.client.0.smithi012.stdout:4/54: dwrite d0/fa [0,4194304] 0 2024-02-14T13:10:30.932 INFO:tasks.workunit.client.0.smithi012.stdout:2/26: mkdir d0/d8 0 2024-02-14T13:10:30.934 INFO:tasks.workunit.client.0.smithi012.stdout:4/55: write d0/f3 [4795559,61574] 0 2024-02-14T13:10:30.934 INFO:tasks.workunit.client.0.smithi012.stdout:4/56: readlink d0/lc 0 2024-02-14T13:10:30.935 INFO:tasks.workunit.client.0.smithi012.stdout:4/57: write d0/f6 [1219529,36416] 0 2024-02-14T13:10:30.937 INFO:tasks.workunit.client.0.smithi012.stdout:0/38: dwrite f0 [0,4194304] 0 2024-02-14T13:10:30.937 INFO:tasks.workunit.client.0.smithi012.stdout:8/28: dwrite f4 [0,4194304] 0 2024-02-14T13:10:30.937 INFO:tasks.workunit.client.0.smithi012.stdout:8/29: truncate f8 867333 0 2024-02-14T13:10:30.938 INFO:tasks.workunit.client.0.smithi012.stdout:8/30: write f2 [1261777,9494] 0 2024-02-14T13:10:30.948 INFO:tasks.workunit.client.0.smithi012.stdout:2/27: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:30.949 INFO:tasks.workunit.client.0.smithi012.stdout:2/28: mkdir d0/d8/d9 0 2024-02-14T13:10:30.969 INFO:tasks.workunit.client.0.smithi012.stdout:4/58: dwrite d0/f6 [0,4194304] 0 2024-02-14T13:10:30.969 INFO:tasks.workunit.client.0.smithi012.stdout:4/59: chown d0/f6 8280 1 2024-02-14T13:10:30.973 INFO:tasks.workunit.client.0.smithi012.stdout:0/39: dwrite fc [0,4194304] 0 2024-02-14T13:10:30.973 INFO:tasks.workunit.client.0.smithi012.stdout:8/31: dwrite f4 [0,4194304] 0 2024-02-14T13:10:30.975 INFO:tasks.workunit.client.0.smithi012.stdout:0/40: link c7 ce 0 2024-02-14T13:10:30.977 INFO:tasks.workunit.client.0.smithi012.stdout:0/41: unlink c7 0 2024-02-14T13:10:30.978 INFO:tasks.workunit.client.0.smithi012.stdout:4/60: dread d0/fa [0,4194304] 0 2024-02-14T13:10:30.978 INFO:tasks.workunit.client.0.smithi012.stdout:4/61: chown d0/fa 133130710 1 2024-02-14T13:10:30.985 INFO:tasks.workunit.client.0.smithi012.stdout:1/30: sync 2024-02-14T13:10:30.985 INFO:tasks.workunit.client.0.smithi012.stdout:1/31: fsync f4 0 2024-02-14T13:10:30.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/62: write d0/f6 [1926330,89596] 0 2024-02-14T13:10:30.997 INFO:tasks.workunit.client.0.smithi012.stdout:8/32: dwrite f8 [0,4194304] 0 2024-02-14T13:10:30.998 INFO:tasks.workunit.client.0.smithi012.stdout:1/32: dread f4 [0,4194304] 0 2024-02-14T13:10:30.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/42: dwrite fa [0,4194304] 0 2024-02-14T13:10:30.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/43: chown fa 78 1 2024-02-14T13:10:30.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/44: fdatasync fd 0 2024-02-14T13:10:30.999 INFO:tasks.workunit.client.0.smithi012.stdout:0/45: readlink lb 0 2024-02-14T13:10:31.001 INFO:tasks.workunit.client.0.smithi012.stdout:1/33: rmdir d6/d7/d9 0 2024-02-14T13:10:31.002 INFO:tasks.workunit.client.0.smithi012.stdout:0/46: mknod cf 0 2024-02-14T13:10:31.008 INFO:tasks.workunit.client.0.smithi012.stdout:1/34: rmdir d6/d7 0 2024-02-14T13:10:31.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/33: dread f4 [0,4194304] 0 2024-02-14T13:10:31.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/34: fdatasync f8 0 2024-02-14T13:10:31.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/35: chown c3 12 1 2024-02-14T13:10:31.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/36: stat f2 0 2024-02-14T13:10:31.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/35: dread f1 [0,4194304] 0 2024-02-14T13:10:31.014 INFO:tasks.workunit.client.0.smithi012.stdout:1/36: rename f4 to d6/fb 0 2024-02-14T13:10:31.015 INFO:tasks.workunit.client.0.smithi012.stdout:8/37: dread f4 [0,4194304] 0 2024-02-14T13:10:31.015 INFO:tasks.workunit.client.0.smithi012.stdout:1/37: creat d6/fc x:0 0 0 2024-02-14T13:10:31.015 INFO:tasks.workunit.client.0.smithi012.stdout:1/38: dread - d6/fc zero size 2024-02-14T13:10:31.016 INFO:tasks.workunit.client.0.smithi012.stdout:1/39: read f1 [87894,40066] 0 2024-02-14T13:10:31.016 INFO:tasks.workunit.client.0.smithi012.stdout:8/38: creat d9/fa x:0 0 0 2024-02-14T13:10:31.020 INFO:tasks.workunit.client.0.smithi012.stdout:1/40: getdents d6 0 2024-02-14T13:10:31.021 INFO:tasks.workunit.client.0.smithi012.stdout:8/39: rmdir d9 39 2024-02-14T13:10:31.021 INFO:tasks.workunit.client.0.smithi012.stdout:5/43: sync 2024-02-14T13:10:31.022 INFO:tasks.workunit.client.0.smithi012.stdout:8/40: truncate f4 3539320 0 2024-02-14T13:10:31.023 INFO:tasks.workunit.client.0.smithi012.stdout:8/41: truncate f8 2679201 0 2024-02-14T13:10:31.023 INFO:tasks.workunit.client.0.smithi012.stdout:8/42: read - d9/fa zero size 2024-02-14T13:10:31.023 INFO:tasks.workunit.client.0.smithi012.stdout:8/43: rename d9 to d9/db 22 2024-02-14T13:10:31.052 INFO:tasks.workunit.client.0.smithi012.stdout:1/41: dwrite d6/fb [0,4194304] 0 2024-02-14T13:10:31.052 INFO:tasks.workunit.client.0.smithi012.stdout:8/44: dwrite f4 [0,4194304] 0 2024-02-14T13:10:31.098 INFO:tasks.workunit.client.0.smithi012.stdout:1/42: link d6/fb d6/fd 0 2024-02-14T13:10:31.102 INFO:tasks.workunit.client.0.smithi012.stdout:1/43: creat d6/fe x:0 0 0 2024-02-14T13:10:31.103 INFO:tasks.workunit.client.0.smithi012.stdout:1/44: creat d6/ff x:0 0 0 2024-02-14T13:10:31.103 INFO:tasks.workunit.client.0.smithi012.stdout:1/45: truncate d6/fc 107558 0 2024-02-14T13:10:31.104 INFO:tasks.workunit.client.0.smithi012.stdout:1/46: write d6/ff [283797,54982] 0 2024-02-14T13:10:31.105 INFO:tasks.workunit.client.0.smithi012.stdout:1/47: mkdir d6/d10 0 2024-02-14T13:10:31.107 INFO:tasks.workunit.client.0.smithi012.stdout:1/48: link l0 d6/d10/l11 0 2024-02-14T13:10:31.109 INFO:tasks.workunit.client.0.smithi012.stdout:1/49: mkdir d6/d12 0 2024-02-14T13:10:31.110 INFO:tasks.workunit.client.0.smithi012.stdout:1/50: creat d6/d10/f13 x:0 0 0 2024-02-14T13:10:31.112 INFO:tasks.workunit.client.0.smithi012.stdout:1/51: symlink d6/l14 0 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:3/29: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:6/26: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:0/47: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:4/63: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:9/58: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:7/70: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:2/29: sync 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:4/64: getdents d0/d10 0 2024-02-14T13:10:31.168 INFO:tasks.workunit.client.0.smithi012.stdout:5/44: sync 2024-02-14T13:10:31.169 INFO:tasks.workunit.client.0.smithi012.stdout:9/59: symlink da/l11 0 2024-02-14T13:10:31.169 INFO:tasks.workunit.client.0.smithi012.stdout:2/30: symlink d0/d6/la 0 2024-02-14T13:10:31.170 INFO:tasks.workunit.client.0.smithi012.stdout:5/45: mknod dc/cd 0 2024-02-14T13:10:31.171 INFO:tasks.workunit.client.0.smithi012.stdout:9/60: symlink da/l12 0 2024-02-14T13:10:31.172 INFO:tasks.workunit.client.0.smithi012.stdout:2/31: symlink d0/lb 0 2024-02-14T13:10:31.173 INFO:tasks.workunit.client.0.smithi012.stdout:5/46: mknod dc/ce 0 2024-02-14T13:10:31.174 INFO:tasks.workunit.client.0.smithi012.stdout:9/61: mkdir da/d13 0 2024-02-14T13:10:31.174 INFO:tasks.workunit.client.0.smithi012.stdout:6/27: dread d1/f7 [0,4194304] 0 2024-02-14T13:10:31.175 INFO:tasks.workunit.client.0.smithi012.stdout:2/32: mkdir d0/d8/dc 0 2024-02-14T13:10:31.176 INFO:tasks.workunit.client.0.smithi012.stdout:9/62: creat da/f14 x:0 0 0 2024-02-14T13:10:31.176 INFO:tasks.workunit.client.0.smithi012.stdout:9/63: readlink l5 0 2024-02-14T13:10:31.176 INFO:tasks.workunit.client.0.smithi012.stdout:9/64: chown f0 1834321643 1 2024-02-14T13:10:31.176 INFO:tasks.workunit.client.0.smithi012.stdout:9/65: chown l5 5260 1 2024-02-14T13:10:31.177 INFO:tasks.workunit.client.0.smithi012.stdout:6/28: mkdir d1/d9/dc 0 2024-02-14T13:10:31.177 INFO:tasks.workunit.client.0.smithi012.stdout:6/29: chown f0 5340 1 2024-02-14T13:10:31.178 INFO:tasks.workunit.client.0.smithi012.stdout:2/33: creat d0/d5/fd x:0 0 0 2024-02-14T13:10:31.178 INFO:tasks.workunit.client.0.smithi012.stdout:2/34: readlink d0/l4 0 2024-02-14T13:10:31.178 INFO:tasks.workunit.client.0.smithi012.stdout:2/35: readlink d0/d6/la 0 2024-02-14T13:10:31.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/30: symlink d1/d9/dc/ld 0 2024-02-14T13:10:31.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/31: chown d1/f5 264859326 1 2024-02-14T13:10:31.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/32: chown d1/f3 36890 1 2024-02-14T13:10:31.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/33: fsync d1/f7 0 2024-02-14T13:10:31.180 INFO:tasks.workunit.client.0.smithi012.stdout:2/36: truncate d0/f3 474464 0 2024-02-14T13:10:31.181 INFO:tasks.workunit.client.0.smithi012.stdout:6/34: unlink d1/f7 0 2024-02-14T13:10:31.183 INFO:tasks.workunit.client.0.smithi012.stdout:6/35: rmdir d1/d9/dc 39 2024-02-14T13:10:31.183 INFO:tasks.workunit.client.0.smithi012.stdout:6/36: chown d1/f6 1018730 1 2024-02-14T13:10:31.183 INFO:tasks.workunit.client.0.smithi012.stdout:6/37: chown d1/f5 11 1 2024-02-14T13:10:31.188 INFO:tasks.workunit.client.0.smithi012.stdout:4/65: dwrite d0/f3 [4194304,4194304] 0 2024-02-14T13:10:31.190 INFO:tasks.workunit.client.0.smithi012.stdout:4/66: symlink d0/l12 0 2024-02-14T13:10:31.190 INFO:tasks.workunit.client.0.smithi012.stdout:4/67: chown d0/l12 55276897 1 2024-02-14T13:10:31.194 INFO:tasks.workunit.client.0.smithi012.stdout:9/66: dwrite da/f14 [0,4194304] 0 2024-02-14T13:10:31.198 INFO:tasks.workunit.client.0.smithi012.stdout:9/67: mknod da/d13/c15 0 2024-02-14T13:10:31.199 INFO:tasks.workunit.client.0.smithi012.stdout:9/68: mknod da/dd/c16 0 2024-02-14T13:10:31.200 INFO:tasks.workunit.client.0.smithi012.stdout:9/69: creat da/d13/f17 x:0 0 0 2024-02-14T13:10:31.201 INFO:tasks.workunit.client.0.smithi012.stdout:6/38: dwrite f0 [0,4194304] 0 2024-02-14T13:10:31.201 INFO:tasks.workunit.client.0.smithi012.stdout:6/39: write d1/f3 [1081713,113254] 0 2024-02-14T13:10:31.201 INFO:tasks.workunit.client.0.smithi012.stdout:6/40: stat d1 0 2024-02-14T13:10:31.204 INFO:tasks.workunit.client.0.smithi012.stdout:6/41: rename d1/f8 to d1/d9/dc/fe 0 2024-02-14T13:10:31.204 INFO:tasks.workunit.client.0.smithi012.stdout:6/42: readlink d1/d9/dc/ld 0 2024-02-14T13:10:31.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/48: dwrite fc [0,4194304] 0 2024-02-14T13:10:31.207 INFO:tasks.workunit.client.0.smithi012.stdout:0/49: mkdir d10 0 2024-02-14T13:10:31.208 INFO:tasks.workunit.client.0.smithi012.stdout:0/50: creat d10/f11 x:0 0 0 2024-02-14T13:10:31.208 INFO:tasks.workunit.client.0.smithi012.stdout:0/51: chown c6 108 1 2024-02-14T13:10:31.208 INFO:tasks.workunit.client.0.smithi012.stdout:0/52: chown cf 16407 1 2024-02-14T13:10:31.214 INFO:tasks.workunit.client.0.smithi012.stdout:4/68: dwrite d0/fa [0,4194304] 0 2024-02-14T13:10:31.214 INFO:tasks.workunit.client.0.smithi012.stdout:5/47: dwrite f7 [0,4194304] 0 2024-02-14T13:10:31.215 INFO:tasks.workunit.client.0.smithi012.stdout:2/37: read d0/f3 [455274,104670] 0 2024-02-14T13:10:31.215 INFO:tasks.workunit.client.0.smithi012.stdout:9/70: dread da/f14 [0,4194304] 0 2024-02-14T13:10:31.216 INFO:tasks.workunit.client.0.smithi012.stdout:9/71: dread f7 [0,4194304] 0 2024-02-14T13:10:31.218 INFO:tasks.workunit.client.0.smithi012.stdout:5/48: truncate f0 3754112 0 2024-02-14T13:10:31.218 INFO:tasks.workunit.client.0.smithi012.stdout:5/49: truncate fb 632985 0 2024-02-14T13:10:31.219 INFO:tasks.workunit.client.0.smithi012.stdout:4/69: mkdir d0/d10/d13 0 2024-02-14T13:10:31.220 INFO:tasks.workunit.client.0.smithi012.stdout:2/38: mkdir d0/d6/de 0 2024-02-14T13:10:31.220 INFO:tasks.workunit.client.0.smithi012.stdout:0/53: dwrite fd [0,4194304] 0 2024-02-14T13:10:31.220 INFO:tasks.workunit.client.0.smithi012.stdout:0/54: chown c9 7152310 1 2024-02-14T13:10:31.221 INFO:tasks.workunit.client.0.smithi012.stdout:9/72: mkdir da/dd/d18 0 2024-02-14T13:10:31.222 INFO:tasks.workunit.client.0.smithi012.stdout:5/50: symlink dc/lf 0 2024-02-14T13:10:31.224 INFO:tasks.workunit.client.0.smithi012.stdout:2/39: mknod d0/d6/de/cf 0 2024-02-14T13:10:31.224 INFO:tasks.workunit.client.0.smithi012.stdout:2/40: readlink d0/l4 0 2024-02-14T13:10:31.225 INFO:tasks.workunit.client.0.smithi012.stdout:2/41: readlink d0/d6/la 0 2024-02-14T13:10:31.228 INFO:tasks.workunit.client.0.smithi012.stdout:9/73: unlink l6 0 2024-02-14T13:10:31.228 INFO:tasks.workunit.client.0.smithi012.stdout:0/55: dread f0 [0,4194304] 0 2024-02-14T13:10:31.229 INFO:tasks.workunit.client.0.smithi012.stdout:4/70: mknod d0/c14 0 2024-02-14T13:10:31.230 INFO:tasks.workunit.client.0.smithi012.stdout:2/42: symlink d0/d5/l10 0 2024-02-14T13:10:31.231 INFO:tasks.workunit.client.0.smithi012.stdout:9/74: mkdir da/dd/d19 0 2024-02-14T13:10:31.232 INFO:tasks.workunit.client.0.smithi012.stdout:2/43: mkdir d0/d8/d11 0 2024-02-14T13:10:31.234 INFO:tasks.workunit.client.0.smithi012.stdout:8/45: sync 2024-02-14T13:10:31.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/75: mknod da/c1a 0 2024-02-14T13:10:31.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/76: write f2 [3170889,43482] 0 2024-02-14T13:10:31.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/77: chown f9 176033 1 2024-02-14T13:10:31.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/78: readlink da/l11 0 2024-02-14T13:10:31.235 INFO:tasks.workunit.client.0.smithi012.stdout:0/56: dread f0 [0,4194304] 0 2024-02-14T13:10:31.235 INFO:tasks.workunit.client.0.smithi012.stdout:0/57: write fa [4388551,59648] 0 2024-02-14T13:10:31.235 INFO:tasks.workunit.client.0.smithi012.stdout:2/44: mkdir d0/d8/d12 0 2024-02-14T13:10:31.235 INFO:tasks.workunit.client.0.smithi012.stdout:2/45: write d0/f3 [155664,102340] 0 2024-02-14T13:10:31.236 INFO:tasks.workunit.client.0.smithi012.stdout:9/79: creat da/dd/f1b x:0 0 0 2024-02-14T13:10:31.236 INFO:tasks.workunit.client.0.smithi012.stdout:9/80: chown da/l12 3 1 2024-02-14T13:10:31.237 INFO:tasks.workunit.client.0.smithi012.stdout:2/46: mkdir d0/d8/d9/d13 0 2024-02-14T13:10:31.239 INFO:tasks.workunit.client.0.smithi012.stdout:2/47: unlink d0/f3 0 2024-02-14T13:10:31.240 INFO:tasks.workunit.client.0.smithi012.stdout:4/71: dread d0/f3 [0,4194304] 0 2024-02-14T13:10:31.240 INFO:tasks.workunit.client.0.smithi012.stdout:2/48: mknod d0/d8/d11/c14 0 2024-02-14T13:10:31.240 INFO:tasks.workunit.client.0.smithi012.stdout:9/81: write f9 [635660,73780] 0 2024-02-14T13:10:31.242 INFO:tasks.workunit.client.0.smithi012.stdout:9/82: mknod da/d13/c1c 0 2024-02-14T13:10:31.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/43: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:31.253 INFO:tasks.workunit.client.0.smithi012.stdout:6/44: getdents d1/d9 0 2024-02-14T13:10:31.255 INFO:tasks.workunit.client.0.smithi012.stdout:6/45: mkdir d1/df 0 2024-02-14T13:10:31.256 INFO:tasks.workunit.client.0.smithi012.stdout:6/46: creat d1/d9/dc/f10 x:0 0 0 2024-02-14T13:10:31.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/47: link d1/cb d1/c11 0 2024-02-14T13:10:31.259 INFO:tasks.workunit.client.0.smithi012.stdout:6/48: mknod d1/df/c12 0 2024-02-14T13:10:31.271 INFO:tasks.workunit.client.0.smithi012.stdout:8/46: dwrite f2 [0,4194304] 0 2024-02-14T13:10:31.272 INFO:tasks.workunit.client.0.smithi012.stdout:0/58: dwrite fd [0,4194304] 0 2024-02-14T13:10:31.272 INFO:tasks.workunit.client.0.smithi012.stdout:4/72: dwrite d0/fa [0,4194304] 0 2024-02-14T13:10:31.272 INFO:tasks.workunit.client.0.smithi012.stdout:4/73: rename d0/d10/d13 to d0/d10/d13/d15 22 2024-02-14T13:10:31.273 INFO:tasks.workunit.client.0.smithi012.stdout:5/51: dwrite f0 [0,4194304] 0 2024-02-14T13:10:31.275 INFO:tasks.workunit.client.0.smithi012.stdout:5/52: getdents dc 0 2024-02-14T13:10:31.276 INFO:tasks.workunit.client.0.smithi012.stdout:5/53: dread fb [0,4194304] 0 2024-02-14T13:10:31.277 INFO:tasks.workunit.client.0.smithi012.stdout:1/52: sync 2024-02-14T13:10:31.279 INFO:tasks.workunit.client.0.smithi012.stdout:8/47: write f8 [421507,92990] 0 2024-02-14T13:10:31.279 INFO:tasks.workunit.client.0.smithi012.stdout:8/48: chown c0 460927954 1 2024-02-14T13:10:31.282 INFO:tasks.workunit.client.0.smithi012.stdout:1/53: mkdir d6/d12/d15 0 2024-02-14T13:10:31.284 INFO:tasks.workunit.client.0.smithi012.stdout:1/54: mknod d6/d10/c16 0 2024-02-14T13:10:31.286 INFO:tasks.workunit.client.0.smithi012.stdout:1/55: creat d6/d12/f17 x:0 0 0 2024-02-14T13:10:31.287 INFO:tasks.workunit.client.0.smithi012.stdout:1/56: symlink d6/l18 0 2024-02-14T13:10:31.288 INFO:tasks.workunit.client.0.smithi012.stdout:1/57: dread d6/fc [0,4194304] 0 2024-02-14T13:10:31.290 INFO:tasks.workunit.client.0.smithi012.stdout:1/58: rename d6/d10/c16 to d6/d12/d15/c19 0 2024-02-14T13:10:31.290 INFO:tasks.workunit.client.0.smithi012.stdout:5/54: dread f6 [0,4194304] 0 2024-02-14T13:10:31.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/55: read fb [410491,89402] 0 2024-02-14T13:10:31.291 INFO:tasks.workunit.client.0.smithi012.stdout:5/56: readlink la 0 2024-02-14T13:10:31.292 INFO:tasks.workunit.client.0.smithi012.stdout:1/59: creat d6/d12/f1a x:0 0 0 2024-02-14T13:10:31.292 INFO:tasks.workunit.client.0.smithi012.stdout:1/60: write f1 [47279,32561] 0 2024-02-14T13:10:31.292 INFO:tasks.workunit.client.0.smithi012.stdout:1/61: fdatasync d6/d12/f1a 0 2024-02-14T13:10:31.292 INFO:tasks.workunit.client.0.smithi012.stdout:1/62: stat d6/d10 0 2024-02-14T13:10:31.292 INFO:tasks.workunit.client.0.smithi012.stdout:1/63: write f1 [879055,50287] 0 2024-02-14T13:10:31.293 INFO:tasks.workunit.client.0.smithi012.stdout:5/57: unlink l3 0 2024-02-14T13:10:31.294 INFO:tasks.workunit.client.0.smithi012.stdout:1/64: rename f1 to d6/f1b 0 2024-02-14T13:10:31.295 INFO:tasks.workunit.client.0.smithi012.stdout:5/58: symlink dc/l10 0 2024-02-14T13:10:31.295 INFO:tasks.workunit.client.0.smithi012.stdout:5/59: chown fb 1 1 2024-02-14T13:10:31.295 INFO:tasks.workunit.client.0.smithi012.stdout:5/60: write f6 [4771053,31945] 0 2024-02-14T13:10:31.296 INFO:tasks.workunit.client.0.smithi012.stdout:1/65: mknod d6/c1c 0 2024-02-14T13:10:31.297 INFO:tasks.workunit.client.0.smithi012.stdout:5/61: mkdir dc/d11 0 2024-02-14T13:10:31.302 INFO:tasks.workunit.client.0.smithi012.stdout:9/83: dwrite f9 [0,4194304] 0 2024-02-14T13:10:31.303 INFO:tasks.workunit.client.0.smithi012.stdout:1/66: dread d6/fb [0,4194304] 0 2024-02-14T13:10:31.305 INFO:tasks.workunit.client.0.smithi012.stdout:9/84: getdents da/d13 0 2024-02-14T13:10:31.305 INFO:tasks.workunit.client.0.smithi012.stdout:9/85: fsync da/dd/f1b 0 2024-02-14T13:10:31.307 INFO:tasks.workunit.client.0.smithi012.stdout:4/74: dwrite d0/f6 [0,4194304] 0 2024-02-14T13:10:31.308 INFO:tasks.workunit.client.0.smithi012.stdout:9/86: creat da/dd/d18/f1d x:0 0 0 2024-02-14T13:10:31.309 INFO:tasks.workunit.client.0.smithi012.stdout:0/59: dwrite fc [0,4194304] 0 2024-02-14T13:10:31.309 INFO:tasks.workunit.client.0.smithi012.stdout:0/60: write d10/f11 [446967,68856] 0 2024-02-14T13:10:31.309 INFO:tasks.workunit.client.0.smithi012.stdout:8/49: dwrite f8 [0,4194304] 0 2024-02-14T13:10:31.310 INFO:tasks.workunit.client.0.smithi012.stdout:4/75: creat d0/d10/d13/f16 x:0 0 0 2024-02-14T13:10:31.312 INFO:tasks.workunit.client.0.smithi012.stdout:9/87: creat da/dd/f1e x:0 0 0 2024-02-14T13:10:31.312 INFO:tasks.workunit.client.0.smithi012.stdout:4/76: write d0/f3 [4080717,119848] 0 2024-02-14T13:10:31.312 INFO:tasks.workunit.client.0.smithi012.stdout:1/67: rmdir d6/d10 39 2024-02-14T13:10:31.312 INFO:tasks.workunit.client.0.smithi012.stdout:1/68: read - d6/d12/f1a zero size 2024-02-14T13:10:31.316 INFO:tasks.workunit.client.0.smithi012.stdout:8/50: write f8 [1721698,17093] 0 2024-02-14T13:10:31.317 INFO:tasks.workunit.client.0.smithi012.stdout:4/77: mkdir d0/d10/d13/d17 0 2024-02-14T13:10:31.317 INFO:tasks.workunit.client.0.smithi012.stdout:1/69: creat d6/d12/d15/f1d x:0 0 0 2024-02-14T13:10:31.318 INFO:tasks.workunit.client.0.smithi012.stdout:9/88: truncate f9 734032 0 2024-02-14T13:10:31.319 INFO:tasks.workunit.client.0.smithi012.stdout:9/89: stat f8 0 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:0/61: read f0 [3593264,126817] 0 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:0/62: readlink lb 0 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/51: mkdir d9/dc 0 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/52: chown c0 35 1 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/53: fdatasync f2 0 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:4/78: mknod d0/d10/d13/c18 0 2024-02-14T13:10:31.320 INFO:tasks.workunit.client.0.smithi012.stdout:1/70: truncate d6/fb 2578008 0 2024-02-14T13:10:31.321 INFO:tasks.workunit.client.0.smithi012.stdout:9/90: truncate f8 201138 0 2024-02-14T13:10:31.322 INFO:tasks.workunit.client.0.smithi012.stdout:0/63: mknod d10/c12 0 2024-02-14T13:10:31.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/54: mkdir d9/dc/dd 0 2024-02-14T13:10:31.324 INFO:tasks.workunit.client.0.smithi012.stdout:9/91: creat da/d13/f1f x:0 0 0 2024-02-14T13:10:31.324 INFO:tasks.workunit.client.0.smithi012.stdout:9/92: chown da/l12 3055 1 2024-02-14T13:10:31.326 INFO:tasks.workunit.client.0.smithi012.stdout:8/55: rmdir d9/dc/dd 0 2024-02-14T13:10:31.326 INFO:tasks.workunit.client.0.smithi012.stdout:4/79: mknod d0/c19 0 2024-02-14T13:10:31.327 INFO:tasks.workunit.client.0.smithi012.stdout:1/71: dread d6/f1b [0,4194304] 0 2024-02-14T13:10:31.327 INFO:tasks.workunit.client.0.smithi012.stdout:1/72: write d6/d12/f17 [901441,113505] 0 2024-02-14T13:10:31.327 INFO:tasks.workunit.client.0.smithi012.stdout:8/56: unlink f2 0 2024-02-14T13:10:31.328 INFO:tasks.workunit.client.0.smithi012.stdout:5/62: dwrite f6 [0,4194304] 0 2024-02-14T13:10:31.329 INFO:tasks.workunit.client.0.smithi012.stdout:8/57: mknod d9/ce 0 2024-02-14T13:10:31.329 INFO:tasks.workunit.client.0.smithi012.stdout:1/73: write d6/f1b [1852101,95561] 0 2024-02-14T13:10:31.330 INFO:tasks.workunit.client.0.smithi012.stdout:1/74: dread d6/fc [0,4194304] 0 2024-02-14T13:10:31.330 INFO:tasks.workunit.client.0.smithi012.stdout:4/80: link d0/d10/d13/f16 d0/f1a 0 2024-02-14T13:10:31.331 INFO:tasks.workunit.client.0.smithi012.stdout:0/64: dread fd [0,4194304] 0 2024-02-14T13:10:31.332 INFO:tasks.workunit.client.0.smithi012.stdout:0/65: truncate d10/f11 1489821 0 2024-02-14T13:10:31.332 INFO:tasks.workunit.client.0.smithi012.stdout:0/66: chown cf 148091 1 2024-02-14T13:10:31.332 INFO:tasks.workunit.client.0.smithi012.stdout:0/67: chown d10 1 1 2024-02-14T13:10:31.334 INFO:tasks.workunit.client.0.smithi012.stdout:5/63: rmdir dc/d11 0 2024-02-14T13:10:31.334 INFO:tasks.workunit.client.0.smithi012.stdout:7/71: sync 2024-02-14T13:10:31.334 INFO:tasks.workunit.client.0.smithi012.stdout:3/30: sync 2024-02-14T13:10:31.336 INFO:tasks.workunit.client.0.smithi012.stdout:0/68: write fd [461420,37142] 0 2024-02-14T13:10:31.337 INFO:tasks.workunit.client.0.smithi012.stdout:4/81: creat d0/d10/f1b x:0 0 0 2024-02-14T13:10:31.337 INFO:tasks.workunit.client.0.smithi012.stdout:4/82: fdatasync d0/f3 0 2024-02-14T13:10:31.338 INFO:tasks.workunit.client.0.smithi012.stdout:5/64: creat dc/f12 x:0 0 0 2024-02-14T13:10:31.341 INFO:tasks.workunit.client.0.smithi012.stdout:7/72: dread df/f15 [0,4194304] 0 2024-02-14T13:10:31.342 INFO:tasks.workunit.client.0.smithi012.stdout:8/58: dwrite d9/fa [0,4194304] 0 2024-02-14T13:10:31.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/59: chown f8 12241 1 2024-02-14T13:10:31.344 INFO:tasks.workunit.client.0.smithi012.stdout:4/83: creat d0/d10/d13/d17/f1c x:0 0 0 2024-02-14T13:10:31.345 INFO:tasks.workunit.client.0.smithi012.stdout:1/75: dread d6/fb [0,4194304] 0 2024-02-14T13:10:31.350 INFO:tasks.workunit.client.0.smithi012.stdout:4/84: symlink d0/d10/d13/l1d 0 2024-02-14T13:10:31.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/76: symlink d6/d12/d15/l1e 0 2024-02-14T13:10:31.353 INFO:tasks.workunit.client.0.smithi012.stdout:7/73: rename c6 to df/c1a 0 2024-02-14T13:10:31.354 INFO:tasks.workunit.client.0.smithi012.stdout:0/69: dwrite f0 [0,4194304] 0 2024-02-14T13:10:31.355 INFO:tasks.workunit.client.0.smithi012.stdout:4/85: creat d0/f1e x:0 0 0 2024-02-14T13:10:31.355 INFO:tasks.workunit.client.0.smithi012.stdout:4/86: write d0/f1e [589154,119269] 0 2024-02-14T13:10:31.355 INFO:tasks.workunit.client.0.smithi012.stdout:4/87: fdatasync d0/d10/f1b 0 2024-02-14T13:10:31.356 INFO:tasks.workunit.client.0.smithi012.stdout:1/77: mknod d6/d10/c1f 0 2024-02-14T13:10:31.356 INFO:tasks.workunit.client.0.smithi012.stdout:1/78: write d6/fe [696826,55721] 0 2024-02-14T13:10:31.357 INFO:tasks.workunit.client.0.smithi012.stdout:7/74: write df/f12 [250258,7132] 0 2024-02-14T13:10:31.358 INFO:tasks.workunit.client.0.smithi012.stdout:0/70: creat d10/f13 x:0 0 0 2024-02-14T13:10:31.359 INFO:tasks.workunit.client.0.smithi012.stdout:1/79: mknod d6/c20 0 2024-02-14T13:10:31.360 INFO:tasks.workunit.client.0.smithi012.stdout:8/60: dwrite f4 [0,4194304] 0 2024-02-14T13:10:31.360 INFO:tasks.workunit.client.0.smithi012.stdout:8/61: truncate d9/fa 5190539 0 2024-02-14T13:10:31.360 INFO:tasks.workunit.client.0.smithi012.stdout:8/62: dread d9/fa [4194304,4194304] 0 2024-02-14T13:10:31.361 INFO:tasks.workunit.client.0.smithi012.stdout:8/63: fdatasync d9/fa 0 2024-02-14T13:10:31.361 INFO:tasks.workunit.client.0.smithi012.stdout:1/80: dread d6/ff [0,4194304] 0 2024-02-14T13:10:31.361 INFO:tasks.workunit.client.0.smithi012.stdout:1/81: chown l0 319 1 2024-02-14T13:10:31.362 INFO:tasks.workunit.client.0.smithi012.stdout:0/71: mkdir d10/d14 0 2024-02-14T13:10:31.363 INFO:tasks.workunit.client.0.smithi012.stdout:7/75: symlink df/l1b 0 2024-02-14T13:10:31.365 INFO:tasks.workunit.client.0.smithi012.stdout:8/64: rename c3 to d9/cf 0 2024-02-14T13:10:31.367 INFO:tasks.workunit.client.0.smithi012.stdout:1/82: creat d6/d10/f21 x:0 0 0 2024-02-14T13:10:31.367 INFO:tasks.workunit.client.0.smithi012.stdout:1/83: chown d6/fd 110 1 2024-02-14T13:10:31.367 INFO:tasks.workunit.client.0.smithi012.stdout:1/84: readlink l5 0 2024-02-14T13:10:31.367 INFO:tasks.workunit.client.0.smithi012.stdout:5/65: rmdir dc 39 2024-02-14T13:10:31.367 INFO:tasks.workunit.client.0.smithi012.stdout:5/66: stat dc 0 2024-02-14T13:10:31.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/72: unlink d10/c12 0 2024-02-14T13:10:31.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/73: write fa [5272588,14930] 0 2024-02-14T13:10:31.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/74: fsync fc 0 2024-02-14T13:10:31.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/75: chown cf 7126416 1 2024-02-14T13:10:31.370 INFO:tasks.workunit.client.0.smithi012.stdout:1/85: truncate d6/ff 3710 0 2024-02-14T13:10:31.370 INFO:tasks.workunit.client.0.smithi012.stdout:1/86: fsync d6/d12/f17 0 2024-02-14T13:10:31.370 INFO:tasks.workunit.client.0.smithi012.stdout:1/87: dread - d6/d10/f13 zero size 2024-02-14T13:10:31.370 INFO:tasks.workunit.client.0.smithi012.stdout:1/88: chown l0 4183 1 2024-02-14T13:10:31.371 INFO:tasks.workunit.client.0.smithi012.stdout:5/67: unlink fb 0 2024-02-14T13:10:31.372 INFO:tasks.workunit.client.0.smithi012.stdout:0/76: link d10/f11 d10/d14/f15 0 2024-02-14T13:10:31.373 INFO:tasks.workunit.client.0.smithi012.stdout:5/68: mknod dc/c13 0 2024-02-14T13:10:31.375 INFO:tasks.workunit.client.0.smithi012.stdout:0/77: mkdir d10/d14/d16 0 2024-02-14T13:10:31.376 INFO:tasks.workunit.client.0.smithi012.stdout:5/69: mknod dc/c14 0 2024-02-14T13:10:31.378 INFO:tasks.workunit.client.0.smithi012.stdout:0/78: rename fa to d10/f17 0 2024-02-14T13:10:31.378 INFO:tasks.workunit.client.0.smithi012.stdout:0/79: stat d10/f11 0 2024-02-14T13:10:31.380 INFO:tasks.workunit.client.0.smithi012.stdout:0/80: truncate d10/d14/f15 804251 0 2024-02-14T13:10:31.381 INFO:tasks.workunit.client.0.smithi012.stdout:0/81: creat d10/d14/f18 x:0 0 0 2024-02-14T13:10:31.383 INFO:tasks.workunit.client.0.smithi012.stdout:4/88: dwrite d0/d10/f1b [0,4194304] 0 2024-02-14T13:10:31.384 INFO:tasks.workunit.client.0.smithi012.stdout:4/89: truncate d0/f3 8417254 0 2024-02-14T13:10:31.384 INFO:tasks.workunit.client.0.smithi012.stdout:7/76: dwrite df/f19 [0,4194304] 0 2024-02-14T13:10:31.384 INFO:tasks.workunit.client.0.smithi012.stdout:4/90: write d0/d10/d13/f16 [640209,75595] 0 2024-02-14T13:10:31.384 INFO:tasks.workunit.client.0.smithi012.stdout:7/77: chown df/f12 54390 1 2024-02-14T13:10:31.388 INFO:tasks.workunit.client.0.smithi012.stdout:4/91: mkdir d0/d10/d1f 0 2024-02-14T13:10:31.389 INFO:tasks.workunit.client.0.smithi012.stdout:7/78: symlink df/l1c 0 2024-02-14T13:10:31.390 INFO:tasks.workunit.client.0.smithi012.stdout:4/92: creat d0/d10/d1f/f20 x:0 0 0 2024-02-14T13:10:31.392 INFO:tasks.workunit.client.0.smithi012.stdout:8/65: dwrite f8 [4194304,4194304] 0 2024-02-14T13:10:31.393 INFO:tasks.workunit.client.0.smithi012.stdout:8/66: stat d9 0 2024-02-14T13:10:31.393 INFO:tasks.workunit.client.0.smithi012.stdout:4/93: symlink d0/d10/d13/d17/l21 0 2024-02-14T13:10:31.394 INFO:tasks.workunit.client.0.smithi012.stdout:1/89: dwrite d6/d10/f13 [0,4194304] 0 2024-02-14T13:10:31.394 INFO:tasks.workunit.client.0.smithi012.stdout:1/90: dread - d6/d10/f21 zero size 2024-02-14T13:10:31.394 INFO:tasks.workunit.client.0.smithi012.stdout:1/91: read - d6/d12/f1a zero size 2024-02-14T13:10:31.394 INFO:tasks.workunit.client.0.smithi012.stdout:7/79: rename c3 to df/c1d 0 2024-02-14T13:10:31.394 INFO:tasks.workunit.client.0.smithi012.stdout:1/92: write d6/fe [433334,105006] 0 2024-02-14T13:10:31.402 INFO:tasks.workunit.client.0.smithi012.stdout:1/93: dread d6/d10/f13 [0,4194304] 0 2024-02-14T13:10:31.404 INFO:tasks.workunit.client.0.smithi012.stdout:1/94: dread d6/d12/f17 [0,4194304] 0 2024-02-14T13:10:31.405 INFO:tasks.workunit.client.0.smithi012.stdout:5/70: dwrite f0 [0,4194304] 0 2024-02-14T13:10:31.406 INFO:tasks.workunit.client.0.smithi012.stdout:4/94: chown d0/l5 4137426 1 2024-02-14T13:10:31.412 INFO:tasks.workunit.client.0.smithi012.stdout:1/95: mkdir d6/d10/d22 0 2024-02-14T13:10:31.412 INFO:tasks.workunit.client.0.smithi012.stdout:1/96: readlink d6/l14 0 2024-02-14T13:10:31.412 INFO:tasks.workunit.client.0.smithi012.stdout:1/97: stat d6/d12 0 2024-02-14T13:10:31.412 INFO:tasks.workunit.client.0.smithi012.stdout:1/98: write d6/ff [714463,3953] 0 2024-02-14T13:10:31.413 INFO:tasks.workunit.client.0.smithi012.stdout:5/71: creat dc/f15 x:0 0 0 2024-02-14T13:10:31.413 INFO:tasks.workunit.client.0.smithi012.stdout:5/72: fdatasync f7 0 2024-02-14T13:10:31.413 INFO:tasks.workunit.client.0.smithi012.stdout:0/82: rmdir d10/d14 39 2024-02-14T13:10:31.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/95: write d0/fa [3193804,102526] 0 2024-02-14T13:10:31.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/96: read d0/fa [2849904,16142] 0 2024-02-14T13:10:31.418 INFO:tasks.workunit.client.0.smithi012.stdout:7/80: mknod df/c1e 0 2024-02-14T13:10:31.418 INFO:tasks.workunit.client.0.smithi012.stdout:7/81: write df/f12 [496694,89596] 0 2024-02-14T13:10:31.419 INFO:tasks.workunit.client.0.smithi012.stdout:1/99: creat d6/d10/f23 x:0 0 0 2024-02-14T13:10:31.420 INFO:tasks.workunit.client.0.smithi012.stdout:5/73: truncate f5 721705 0 2024-02-14T13:10:31.421 INFO:tasks.workunit.client.0.smithi012.stdout:1/100: mknod d6/d10/c24 0 2024-02-14T13:10:31.422 INFO:tasks.workunit.client.0.smithi012.stdout:0/83: read d10/f17 [1330820,68118] 0 2024-02-14T13:10:31.422 INFO:tasks.workunit.client.0.smithi012.stdout:0/84: dread - d10/f13 zero size 2024-02-14T13:10:31.422 INFO:tasks.workunit.client.0.smithi012.stdout:0/85: fsync f0 0 2024-02-14T13:10:31.423 INFO:tasks.workunit.client.0.smithi012.stdout:1/101: symlink d6/l25 0 2024-02-14T13:10:31.424 INFO:tasks.workunit.client.0.smithi012.stdout:8/67: truncate f8 6043638 0 2024-02-14T13:10:31.424 INFO:tasks.workunit.client.0.smithi012.stdout:1/102: symlink d6/d10/d22/l26 0 2024-02-14T13:10:31.424 INFO:tasks.workunit.client.0.smithi012.stdout:1/103: write d6/d10/f23 [339897,49934] 0 2024-02-14T13:10:31.425 INFO:tasks.workunit.client.0.smithi012.stdout:8/68: mknod d9/dc/c10 0 2024-02-14T13:10:31.427 INFO:tasks.workunit.client.0.smithi012.stdout:8/69: mknod d9/c11 0 2024-02-14T13:10:31.428 INFO:tasks.workunit.client.0.smithi012.stdout:2/49: sync 2024-02-14T13:10:31.428 INFO:tasks.workunit.client.0.smithi012.stdout:2/50: dread - d0/d5/fd zero size 2024-02-14T13:10:31.428 INFO:tasks.workunit.client.0.smithi012.stdout:2/51: dread - d0/d5/fd zero size 2024-02-14T13:10:31.428 INFO:tasks.workunit.client.0.smithi012.stdout:2/52: dread - d0/d5/fd zero size 2024-02-14T13:10:31.433 INFO:tasks.workunit.client.0.smithi012.stdout:4/97: dwrite d0/d10/d1f/f20 [0,4194304] 0 2024-02-14T13:10:31.439 INFO:tasks.workunit.client.0.smithi012.stdout:4/98: symlink d0/d10/l22 0 2024-02-14T13:10:31.440 INFO:tasks.workunit.client.0.smithi012.stdout:3/31: sync 2024-02-14T13:10:31.440 INFO:tasks.workunit.client.0.smithi012.stdout:9/93: sync 2024-02-14T13:10:31.440 INFO:tasks.workunit.client.0.smithi012.stdout:6/49: sync 2024-02-14T13:10:31.440 INFO:tasks.workunit.client.0.smithi012.stdout:6/50: fdatasync d1/d9/dc/fe 0 2024-02-14T13:10:31.440 INFO:tasks.workunit.client.0.smithi012.stdout:9/94: write da/dd/f1e [181810,99876] 0 2024-02-14T13:10:31.440 INFO:tasks.workunit.client.0.smithi012.stdout:9/95: chown da/dd 3009813 1 2024-02-14T13:10:31.441 INFO:tasks.workunit.client.0.smithi012.stdout:8/70: dread f4 [0,4194304] 0 2024-02-14T13:10:31.441 INFO:tasks.workunit.client.0.smithi012.stdout:8/71: fsync f4 0 2024-02-14T13:10:31.441 INFO:tasks.workunit.client.0.smithi012.stdout:8/72: write f8 [2904955,2880] 0 2024-02-14T13:10:31.443 INFO:tasks.workunit.client.0.smithi012.stdout:4/99: symlink d0/d10/d13/d17/l23 0 2024-02-14T13:10:31.443 INFO:tasks.workunit.client.0.smithi012.stdout:9/96: mkdir da/d13/d20 0 2024-02-14T13:10:31.443 INFO:tasks.workunit.client.0.smithi012.stdout:6/51: getdents d1 0 2024-02-14T13:10:31.443 INFO:tasks.workunit.client.0.smithi012.stdout:6/52: write d1/d9/dc/fe [954637,51823] 0 2024-02-14T13:10:31.443 INFO:tasks.workunit.client.0.smithi012.stdout:6/53: truncate d1/f6 1739774 0 2024-02-14T13:10:31.443 INFO:tasks.workunit.client.0.smithi012.stdout:9/97: write f8 [78692,13337] 0 2024-02-14T13:10:31.444 INFO:tasks.workunit.client.0.smithi012.stdout:8/73: mknod d9/c12 0 2024-02-14T13:10:31.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/54: rename d1/cb to d1/c13 0 2024-02-14T13:10:31.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/55: truncate d1/d9/dc/f10 539496 0 2024-02-14T13:10:31.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/56: write d1/f4 [2542590,26020] 0 2024-02-14T13:10:31.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/57: write d1/f4 [1910884,30295] 0 2024-02-14T13:10:31.447 INFO:tasks.workunit.client.0.smithi012.stdout:6/58: rename d1/d9/dc to d1/d9/dc/d14 22 2024-02-14T13:10:31.447 INFO:tasks.workunit.client.0.smithi012.stdout:1/104: dwrite d6/f1b [0,4194304] 0 2024-02-14T13:10:31.448 INFO:tasks.workunit.client.0.smithi012.stdout:8/74: mkdir d9/dc/d13 0 2024-02-14T13:10:31.450 INFO:tasks.workunit.client.0.smithi012.stdout:7/82: dwrite f5 [4194304,4194304] 0 2024-02-14T13:10:31.452 INFO:tasks.workunit.client.0.smithi012.stdout:8/75: unlink d9/c11 0 2024-02-14T13:10:31.453 INFO:tasks.workunit.client.0.smithi012.stdout:5/74: dread f5 [0,4194304] 0 2024-02-14T13:10:31.453 INFO:tasks.workunit.client.0.smithi012.stdout:5/75: fsync f5 0 2024-02-14T13:10:31.454 INFO:tasks.workunit.client.0.smithi012.stdout:7/83: chown df/l13 36170 1 2024-02-14T13:10:31.454 INFO:tasks.workunit.client.0.smithi012.stdout:2/53: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:31.456 INFO:tasks.workunit.client.0.smithi012.stdout:8/76: rmdir d9/dc/d13 0 2024-02-14T13:10:31.456 INFO:tasks.workunit.client.0.smithi012.stdout:8/77: read f8 [977739,18047] 0 2024-02-14T13:10:31.457 INFO:tasks.workunit.client.0.smithi012.stdout:4/100: truncate d0/fa 2827985 0 2024-02-14T13:10:31.458 INFO:tasks.workunit.client.0.smithi012.stdout:5/76: symlink dc/l16 0 2024-02-14T13:10:31.461 INFO:tasks.workunit.client.0.smithi012.stdout:7/84: creat df/f1f x:0 0 0 2024-02-14T13:10:31.463 INFO:tasks.workunit.client.0.smithi012.stdout:8/78: mkdir d9/dc/d14 0 2024-02-14T13:10:31.466 INFO:tasks.workunit.client.0.smithi012.stdout:4/101: unlink d0/d10/d13/d17/l21 0 2024-02-14T13:10:31.467 INFO:tasks.workunit.client.0.smithi012.stdout:7/85: creat df/f20 x:0 0 0 2024-02-14T13:10:31.469 INFO:tasks.workunit.client.0.smithi012.stdout:3/32: dwrite f1 [0,4194304] 0 2024-02-14T13:10:31.469 INFO:tasks.workunit.client.0.smithi012.stdout:8/79: link f8 d9/dc/d14/f15 0 2024-02-14T13:10:31.469 INFO:tasks.workunit.client.0.smithi012.stdout:8/80: chown c0 11 1 2024-02-14T13:10:31.471 INFO:tasks.workunit.client.0.smithi012.stdout:3/33: chown l3 17 1 2024-02-14T13:10:31.471 INFO:tasks.workunit.client.0.smithi012.stdout:3/34: chown d9 685124 1 2024-02-14T13:10:31.473 INFO:tasks.workunit.client.0.smithi012.stdout:8/81: rename d9/dc/c10 to d9/c16 0 2024-02-14T13:10:31.474 INFO:tasks.workunit.client.0.smithi012.stdout:3/35: symlink d9/lc 0 2024-02-14T13:10:31.477 INFO:tasks.workunit.client.0.smithi012.stdout:3/36: mkdir d9/dd 0 2024-02-14T13:10:31.477 INFO:tasks.workunit.client.0.smithi012.stdout:2/54: write d0/f2 [3863064,111066] 0 2024-02-14T13:10:31.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/59: truncate d1/f6 1491376 0 2024-02-14T13:10:31.477 INFO:tasks.workunit.client.0.smithi012.stdout:6/60: getdents d1/d9 0 2024-02-14T13:10:31.477 INFO:tasks.workunit.client.0.smithi012.stdout:2/55: mkdir d0/d5/d15 0 2024-02-14T13:10:31.479 INFO:tasks.workunit.client.0.smithi012.stdout:6/61: dread d1/f3 [0,4194304] 0 2024-02-14T13:10:31.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/77: dread f0 [0,4194304] 0 2024-02-14T13:10:31.487 INFO:tasks.workunit.client.0.smithi012.stdout:5/78: dread f6 [0,4194304] 0 2024-02-14T13:10:31.487 INFO:tasks.workunit.client.0.smithi012.stdout:5/79: stat f0 0 2024-02-14T13:10:31.490 INFO:tasks.workunit.client.0.smithi012.stdout:3/37: dread f1 [0,4194304] 0 2024-02-14T13:10:31.492 INFO:tasks.workunit.client.0.smithi012.stdout:3/38: mkdir d9/dd/de 0 2024-02-14T13:10:31.495 INFO:tasks.workunit.client.0.smithi012.stdout:3/39: rename c7 to d9/dd/cf 0 2024-02-14T13:10:31.496 INFO:tasks.workunit.client.0.smithi012.stdout:5/80: write f6 [3518156,62019] 0 2024-02-14T13:10:31.498 INFO:tasks.workunit.client.0.smithi012.stdout:3/40: symlink d9/dd/l10 0 2024-02-14T13:10:31.498 INFO:tasks.workunit.client.0.smithi012.stdout:4/102: dwrite d0/f1a [0,4194304] 0 2024-02-14T13:10:31.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/86: dwrite fe [0,4194304] 0 2024-02-14T13:10:31.499 INFO:tasks.workunit.client.0.smithi012.stdout:1/105: dwrite d6/d10/f23 [0,4194304] 0 2024-02-14T13:10:31.499 INFO:tasks.workunit.client.0.smithi012.stdout:9/98: dwrite f4 [0,4194304] 0 2024-02-14T13:10:31.499 INFO:tasks.workunit.client.0.smithi012.stdout:9/99: dread - da/d13/f17 zero size 2024-02-14T13:10:31.499 INFO:tasks.workunit.client.0.smithi012.stdout:9/100: fdatasync f4 0 2024-02-14T13:10:31.499 INFO:tasks.workunit.client.0.smithi012.stdout:9/101: chown l1 0 1 2024-02-14T13:10:31.501 INFO:tasks.workunit.client.0.smithi012.stdout:3/41: creat d9/dd/f11 x:0 0 0 2024-02-14T13:10:31.502 INFO:tasks.workunit.client.0.smithi012.stdout:7/87: creat df/f21 x:0 0 0 2024-02-14T13:10:31.506 INFO:tasks.workunit.client.0.smithi012.stdout:9/102: symlink da/dd/d19/l21 0 2024-02-14T13:10:31.506 INFO:tasks.workunit.client.0.smithi012.stdout:9/103: fsync da/fc 0 2024-02-14T13:10:31.506 INFO:tasks.workunit.client.0.smithi012.stdout:3/42: symlink d9/dd/l12 0 2024-02-14T13:10:31.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/43: mkdir d9/d13 0 2024-02-14T13:10:31.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/44: rename d9/dd to d9/dd/d14 22 2024-02-14T13:10:31.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/45: write d9/dd/f11 [256551,69233] 0 2024-02-14T13:10:31.509 INFO:tasks.workunit.client.0.smithi012.stdout:7/88: link df/f11 df/f22 0 2024-02-14T13:10:31.515 INFO:tasks.workunit.client.0.smithi012.stdout:5/81: dread f6 [0,4194304] 0 2024-02-14T13:10:31.517 INFO:tasks.workunit.client.0.smithi012.stdout:5/82: mkdir dc/d17 0 2024-02-14T13:10:31.517 INFO:tasks.workunit.client.0.smithi012.stdout:5/83: chown dc 4 1 2024-02-14T13:10:31.520 INFO:tasks.workunit.client.0.smithi012.stdout:5/84: symlink dc/l18 0 2024-02-14T13:10:31.525 INFO:tasks.workunit.client.0.smithi012.stdout:5/85: write f5 [634436,34117] 0 2024-02-14T13:10:31.525 INFO:tasks.workunit.client.0.smithi012.stdout:5/86: write dc/f15 [10661,82651] 0 2024-02-14T13:10:31.528 INFO:tasks.workunit.client.0.smithi012.stdout:5/87: rename dc/cd to dc/c19 0 2024-02-14T13:10:31.531 INFO:tasks.workunit.client.0.smithi012.stdout:6/62: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:31.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/63: creat d1/d9/dc/f15 x:0 0 0 2024-02-14T13:10:31.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/64: write d1/f4 [1755364,4127] 0 2024-02-14T13:10:31.534 INFO:tasks.workunit.client.0.smithi012.stdout:1/106: dwrite d6/ff [0,4194304] 0 2024-02-14T13:10:31.534 INFO:tasks.workunit.client.0.smithi012.stdout:6/65: unlink d1/d9/dc/ld 0 2024-02-14T13:10:31.535 INFO:tasks.workunit.client.0.smithi012.stdout:8/82: dwrite d9/dc/d14/f15 [4194304,4194304] 0 2024-02-14T13:10:31.537 INFO:tasks.workunit.client.0.smithi012.stdout:9/104: dwrite da/f14 [0,4194304] 0 2024-02-14T13:10:31.537 INFO:tasks.workunit.client.0.smithi012.stdout:9/105: chown da/fc 78438 1 2024-02-14T13:10:31.537 INFO:tasks.workunit.client.0.smithi012.stdout:9/106: stat da/c1a 0 2024-02-14T13:10:31.537 INFO:tasks.workunit.client.0.smithi012.stdout:1/107: getdents d6/d12/d15 0 2024-02-14T13:10:31.537 INFO:tasks.workunit.client.0.smithi012.stdout:1/108: mknod d6/d12/c27 0 2024-02-14T13:10:31.538 INFO:tasks.workunit.client.0.smithi012.stdout:1/109: truncate d6/fb 1698461 0 2024-02-14T13:10:31.539 INFO:tasks.workunit.client.0.smithi012.stdout:2/56: dwrite d0/f2 [4194304,4194304] 0 2024-02-14T13:10:31.539 INFO:tasks.workunit.client.0.smithi012.stdout:4/103: dwrite d0/f1e [0,4194304] 0 2024-02-14T13:10:31.540 INFO:tasks.workunit.client.0.smithi012.stdout:8/83: write f4 [1393067,40296] 0 2024-02-14T13:10:31.541 INFO:tasks.workunit.client.0.smithi012.stdout:1/110: symlink d6/d10/d22/l28 0 2024-02-14T13:10:31.542 INFO:tasks.workunit.client.0.smithi012.stdout:3/46: dwrite f1 [0,4194304] 0 2024-02-14T13:10:31.542 INFO:tasks.workunit.client.0.smithi012.stdout:3/47: chown d9/dd 162661949 1 2024-02-14T13:10:31.542 INFO:tasks.workunit.client.0.smithi012.stdout:6/66: fdatasync d1/d9/dc/fe 0 2024-02-14T13:10:31.543 INFO:tasks.workunit.client.0.smithi012.stdout:7/89: dwrite fd [0,4194304] 0 2024-02-14T13:10:31.544 INFO:tasks.workunit.client.0.smithi012.stdout:4/104: rename d0/d10/f1b to d0/d10/f24 0 2024-02-14T13:10:31.547 INFO:tasks.workunit.client.0.smithi012.stdout:5/88: dread f5 [0,4194304] 0 2024-02-14T13:10:31.547 INFO:tasks.workunit.client.0.smithi012.stdout:5/89: chown dc/f12 3318 1 2024-02-14T13:10:31.547 INFO:tasks.workunit.client.0.smithi012.stdout:5/90: stat dc/l16 0 2024-02-14T13:10:31.547 INFO:tasks.workunit.client.0.smithi012.stdout:5/91: fsync f7 0 2024-02-14T13:10:31.547 INFO:tasks.workunit.client.0.smithi012.stdout:5/92: truncate f7 4586298 0 2024-02-14T13:10:31.547 INFO:tasks.workunit.client.0.smithi012.stdout:1/111: getdents d6 0 2024-02-14T13:10:31.548 INFO:tasks.workunit.client.0.smithi012.stdout:1/112: dread - d6/d10/f21 zero size 2024-02-14T13:10:31.555 INFO:tasks.workunit.client.0.smithi012.stdout:8/84: dread d9/fa [0,4194304] 0 2024-02-14T13:10:31.556 INFO:tasks.workunit.client.0.smithi012.stdout:3/48: read f1 [684129,567] 0 2024-02-14T13:10:31.558 INFO:tasks.workunit.client.0.smithi012.stdout:9/107: dwrite f2 [4194304,4194304] 0 2024-02-14T13:10:31.558 INFO:tasks.workunit.client.0.smithi012.stdout:9/108: write da/d13/f1f [692014,119006] 0 2024-02-14T13:10:31.558 INFO:tasks.workunit.client.0.smithi012.stdout:9/109: fsync da/dd/f1b 0 2024-02-14T13:10:31.560 INFO:tasks.workunit.client.0.smithi012.stdout:8/85: dread f4 [0,4194304] 0 2024-02-14T13:10:31.560 INFO:tasks.workunit.client.0.smithi012.stdout:8/86: chown d9/c16 212918758 1 2024-02-14T13:10:31.560 INFO:tasks.workunit.client.0.smithi012.stdout:8/87: readlink l5 0 2024-02-14T13:10:31.565 INFO:tasks.workunit.client.0.smithi012.stdout:6/67: rmdir d1 39 2024-02-14T13:10:31.567 INFO:tasks.workunit.client.0.smithi012.stdout:7/90: creat df/f23 x:0 0 0 2024-02-14T13:10:31.567 INFO:tasks.workunit.client.0.smithi012.stdout:1/113: creat d6/d12/f29 x:0 0 0 2024-02-14T13:10:31.567 INFO:tasks.workunit.client.0.smithi012.stdout:1/114: write d6/d12/f17 [1314152,39480] 0 2024-02-14T13:10:31.568 INFO:tasks.workunit.client.0.smithi012.stdout:1/115: write d6/fc [614719,11916] 0 2024-02-14T13:10:31.569 INFO:tasks.workunit.client.0.smithi012.stdout:3/49: link f1 d9/dd/f15 0 2024-02-14T13:10:31.572 INFO:tasks.workunit.client.0.smithi012.stdout:2/57: dwrite d0/d5/fd [0,4194304] 0 2024-02-14T13:10:31.572 INFO:tasks.workunit.client.0.smithi012.stdout:9/110: rename da/dd/d18/f1d to da/dd/d18/f22 0 2024-02-14T13:10:31.572 INFO:tasks.workunit.client.0.smithi012.stdout:9/111: fsync da/fc 0 2024-02-14T13:10:31.573 INFO:tasks.workunit.client.0.smithi012.stdout:8/88: creat d9/dc/d14/f17 x:0 0 0 2024-02-14T13:10:31.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/116: creat d6/d10/d22/f2a x:0 0 0 2024-02-14T13:10:31.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/117: getdents d6/d12/d15 0 2024-02-14T13:10:31.576 INFO:tasks.workunit.client.0.smithi012.stdout:2/58: mknod d0/d8/c16 0 2024-02-14T13:10:31.577 INFO:tasks.workunit.client.0.smithi012.stdout:9/112: creat da/f23 x:0 0 0 2024-02-14T13:10:31.577 INFO:tasks.workunit.client.0.smithi012.stdout:5/93: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:31.583 INFO:tasks.workunit.client.0.smithi012.stdout:5/94: mknod dc/c1a 0 2024-02-14T13:10:31.583 INFO:tasks.workunit.client.0.smithi012.stdout:5/95: truncate dc/f15 939398 0 2024-02-14T13:10:31.583 INFO:tasks.workunit.client.0.smithi012.stdout:0/86: sync 2024-02-14T13:10:31.584 INFO:tasks.workunit.client.0.smithi012.stdout:5/96: unlink dc/l10 0 2024-02-14T13:10:31.584 INFO:tasks.workunit.client.0.smithi012.stdout:6/68: dwrite d1/f4 [0,4194304] 0 2024-02-14T13:10:31.585 INFO:tasks.workunit.client.0.smithi012.stdout:0/87: truncate d10/f11 284440 0 2024-02-14T13:10:31.585 INFO:tasks.workunit.client.0.smithi012.stdout:0/88: write d10/d14/f18 [375737,39693] 0 2024-02-14T13:10:31.585 INFO:tasks.workunit.client.0.smithi012.stdout:0/89: stat d10/f13 0 2024-02-14T13:10:31.586 INFO:tasks.workunit.client.0.smithi012.stdout:5/97: mknod dc/c1b 0 2024-02-14T13:10:31.587 INFO:tasks.workunit.client.0.smithi012.stdout:6/69: mkdir d1/df/d16 0 2024-02-14T13:10:31.589 INFO:tasks.workunit.client.0.smithi012.stdout:0/90: mknod d10/d14/d16/c19 0 2024-02-14T13:10:31.589 INFO:tasks.workunit.client.0.smithi012.stdout:0/91: fdatasync d10/f13 0 2024-02-14T13:10:31.590 INFO:tasks.workunit.client.0.smithi012.stdout:6/70: unlink d1/d9/dc/f10 0 2024-02-14T13:10:31.591 INFO:tasks.workunit.client.0.smithi012.stdout:5/98: dread f6 [0,4194304] 0 2024-02-14T13:10:31.591 INFO:tasks.workunit.client.0.smithi012.stdout:0/92: symlink d10/d14/l1a 0 2024-02-14T13:10:31.592 INFO:tasks.workunit.client.0.smithi012.stdout:8/89: getdents d9/dc/d14 0 2024-02-14T13:10:31.594 INFO:tasks.workunit.client.0.smithi012.stdout:1/118: rmdir d6/d10/d22 39 2024-02-14T13:10:31.595 INFO:tasks.workunit.client.0.smithi012.stdout:0/93: getdents d10 0 2024-02-14T13:10:31.596 INFO:tasks.workunit.client.0.smithi012.stdout:2/59: write d0/d5/fd [4575989,68140] 0 2024-02-14T13:10:31.598 INFO:tasks.workunit.client.0.smithi012.stdout:8/90: rename d9/c12 to d9/dc/d14/c18 0 2024-02-14T13:10:31.598 INFO:tasks.workunit.client.0.smithi012.stdout:8/91: write f8 [3940616,34967] 0 2024-02-14T13:10:31.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/119: creat d6/d12/f2b x:0 0 0 2024-02-14T13:10:31.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/99: dread f7 [0,4194304] 0 2024-02-14T13:10:31.601 INFO:tasks.workunit.client.0.smithi012.stdout:9/113: rmdir da 39 2024-02-14T13:10:31.602 INFO:tasks.workunit.client.0.smithi012.stdout:2/60: creat d0/d8/d11/f17 x:0 0 0 2024-02-14T13:10:31.602 INFO:tasks.workunit.client.0.smithi012.stdout:2/61: rename d0/d8/d9/d13 to d0/d8/d9/d13/d18 22 2024-02-14T13:10:31.602 INFO:tasks.workunit.client.0.smithi012.stdout:2/62: chown d0/d6/la 24 1 2024-02-14T13:10:31.605 INFO:tasks.workunit.client.0.smithi012.stdout:1/120: getdents d6/d10 0 2024-02-14T13:10:31.605 INFO:tasks.workunit.client.0.smithi012.stdout:1/121: chown d6/d10/d22/f2a 149 1 2024-02-14T13:10:31.605 INFO:tasks.workunit.client.0.smithi012.stdout:1/122: dread - d6/d12/f1a zero size 2024-02-14T13:10:31.605 INFO:tasks.workunit.client.0.smithi012.stdout:8/92: fdatasync d9/dc/d14/f15 0 2024-02-14T13:10:31.606 INFO:tasks.workunit.client.0.smithi012.stdout:5/100: symlink dc/l1c 0 2024-02-14T13:10:31.607 INFO:tasks.workunit.client.0.smithi012.stdout:9/114: creat da/d13/f24 x:0 0 0 2024-02-14T13:10:31.608 INFO:tasks.workunit.client.0.smithi012.stdout:2/63: creat d0/d8/dc/f19 x:0 0 0 2024-02-14T13:10:31.608 INFO:tasks.workunit.client.0.smithi012.stdout:2/64: getdents d0/d8/d9/d13 0 2024-02-14T13:10:31.609 INFO:tasks.workunit.client.0.smithi012.stdout:1/123: stat c3 0 2024-02-14T13:10:31.609 INFO:tasks.workunit.client.0.smithi012.stdout:1/124: fsync d6/d10/d22/f2a 0 2024-02-14T13:10:31.610 INFO:tasks.workunit.client.0.smithi012.stdout:0/94: rename d10/d14/d16 to d10/d14/d1b 0 2024-02-14T13:10:31.610 INFO:tasks.workunit.client.0.smithi012.stdout:0/95: fdatasync d10/d14/f18 0 2024-02-14T13:10:31.611 INFO:tasks.workunit.client.0.smithi012.stdout:5/101: mknod dc/d17/c1d 0 2024-02-14T13:10:31.612 INFO:tasks.workunit.client.0.smithi012.stdout:9/115: mknod da/dd/c25 0 2024-02-14T13:10:31.612 INFO:tasks.workunit.client.0.smithi012.stdout:9/116: write f0 [2157687,43197] 0 2024-02-14T13:10:31.613 INFO:tasks.workunit.client.0.smithi012.stdout:1/125: dread d6/d10/f13 [0,4194304] 0 2024-02-14T13:10:31.613 INFO:tasks.workunit.client.0.smithi012.stdout:1/126: write d6/fd [2557186,99233] 0 2024-02-14T13:10:31.613 INFO:tasks.workunit.client.0.smithi012.stdout:1/127: truncate d6/fb 3481616 0 2024-02-14T13:10:31.613 INFO:tasks.workunit.client.0.smithi012.stdout:2/65: mkdir d0/d1a 0 2024-02-14T13:10:31.613 INFO:tasks.workunit.client.0.smithi012.stdout:2/66: write d0/d8/d11/f17 [42471,2265] 0 2024-02-14T13:10:31.614 INFO:tasks.workunit.client.0.smithi012.stdout:8/93: rename d9/dc/d14/f17 to d9/dc/f19 0 2024-02-14T13:10:31.615 INFO:tasks.workunit.client.0.smithi012.stdout:0/96: mknod d10/d14/d1b/c1c 0 2024-02-14T13:10:31.617 INFO:tasks.workunit.client.0.smithi012.stdout:0/97: dread d10/f11 [0,4194304] 0 2024-02-14T13:10:31.617 INFO:tasks.workunit.client.0.smithi012.stdout:5/102: link dc/l18 dc/d17/l1e 0 2024-02-14T13:10:31.619 INFO:tasks.workunit.client.0.smithi012.stdout:1/128: truncate d6/f1b 3642514 0 2024-02-14T13:10:31.619 INFO:tasks.workunit.client.0.smithi012.stdout:1/129: stat d6/d10/f21 0 2024-02-14T13:10:31.620 INFO:tasks.workunit.client.0.smithi012.stdout:8/94: link c0 d9/c1a 0 2024-02-14T13:10:31.622 INFO:tasks.workunit.client.0.smithi012.stdout:5/103: symlink dc/d17/l1f 0 2024-02-14T13:10:31.622 INFO:tasks.workunit.client.0.smithi012.stdout:5/104: chown dc/d17/l1e 15 1 2024-02-14T13:10:31.622 INFO:tasks.workunit.client.0.smithi012.stdout:1/130: symlink d6/d12/d15/l2c 0 2024-02-14T13:10:31.623 INFO:tasks.workunit.client.0.smithi012.stdout:8/95: stat d9/c1a 0 2024-02-14T13:10:31.630 INFO:tasks.workunit.client.0.smithi012.stdout:5/105: mkdir dc/d17/d20 0 2024-02-14T13:10:31.631 INFO:tasks.workunit.client.0.smithi012.stdout:1/131: creat d6/d12/f2d x:0 0 0 2024-02-14T13:10:31.631 INFO:tasks.workunit.client.0.smithi012.stdout:1/132: chown d6/d10/d22/f2a 478854248 1 2024-02-14T13:10:31.631 INFO:tasks.workunit.client.0.smithi012.stdout:1/133: chown d6/l25 9722318 1 2024-02-14T13:10:31.631 INFO:tasks.workunit.client.0.smithi012.stdout:1/134: readlink l5 0 2024-02-14T13:10:31.632 INFO:tasks.workunit.client.0.smithi012.stdout:8/96: mkdir d9/dc/d1b 0 2024-02-14T13:10:31.633 INFO:tasks.workunit.client.0.smithi012.stdout:5/106: truncate f0 6782916 0 2024-02-14T13:10:31.637 INFO:tasks.workunit.client.0.smithi012.stdout:8/97: dread f8 [0,4194304] 0 2024-02-14T13:10:31.637 INFO:tasks.workunit.client.0.smithi012.stdout:2/67: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:31.641 INFO:tasks.workunit.client.0.smithi012.stdout:2/68: link d0/d6/la d0/d1a/l1b 0 2024-02-14T13:10:31.641 INFO:tasks.workunit.client.0.smithi012.stdout:2/69: readlink d0/d5/l10 0 2024-02-14T13:10:31.642 INFO:tasks.workunit.client.0.smithi012.stdout:8/98: mknod d9/dc/d14/c1c 0 2024-02-14T13:10:31.643 INFO:tasks.workunit.client.0.smithi012.stdout:2/70: mknod d0/d8/dc/c1c 0 2024-02-14T13:10:31.644 INFO:tasks.workunit.client.0.smithi012.stdout:8/99: mknod d9/c1d 0 2024-02-14T13:10:31.646 INFO:tasks.workunit.client.0.smithi012.stdout:8/100: rename d9/fa to d9/dc/d1b/f1e 0 2024-02-14T13:10:31.646 INFO:tasks.workunit.client.0.smithi012.stdout:5/107: getdents dc/d17 0 2024-02-14T13:10:31.646 INFO:tasks.workunit.client.0.smithi012.stdout:5/108: chown dc/d17/c1d 1742 1 2024-02-14T13:10:31.648 INFO:tasks.workunit.client.0.smithi012.stdout:9/117: dwrite f0 [0,4194304] 0 2024-02-14T13:10:31.648 INFO:tasks.workunit.client.0.smithi012.stdout:9/118: fdatasync f9 0 2024-02-14T13:10:31.648 INFO:tasks.workunit.client.0.smithi012.stdout:8/101: creat d9/dc/d14/f1f x:0 0 0 2024-02-14T13:10:31.648 INFO:tasks.workunit.client.0.smithi012.stdout:8/102: chown c0 123 1 2024-02-14T13:10:31.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/98: dwrite fc [4194304,4194304] 0 2024-02-14T13:10:31.649 INFO:tasks.workunit.client.0.smithi012.stdout:5/109: fsync f0 0 2024-02-14T13:10:31.650 INFO:tasks.workunit.client.0.smithi012.stdout:9/119: stat l1 0 2024-02-14T13:10:31.650 INFO:tasks.workunit.client.0.smithi012.stdout:9/120: truncate da/f23 666236 0 2024-02-14T13:10:31.652 INFO:tasks.workunit.client.0.smithi012.stdout:0/99: rmdir d10/d14/d1b 39 2024-02-14T13:10:31.654 INFO:tasks.workunit.client.0.smithi012.stdout:0/100: rename d10/d14/d1b/c1c to d10/c1d 0 2024-02-14T13:10:31.654 INFO:tasks.workunit.client.0.smithi012.stdout:0/101: write d10/d14/f15 [765206,111746] 0 2024-02-14T13:10:31.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/135: dwrite d6/d12/f2d [0,4194304] 0 2024-02-14T13:10:31.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/136: chown d6/d12/f17 1351001 1 2024-02-14T13:10:31.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/137: read d6/fe [661623,38439] 0 2024-02-14T13:10:31.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/138: stat d6/d10/f21 0 2024-02-14T13:10:31.666 INFO:tasks.workunit.client.0.smithi012.stdout:1/139: creat d6/d12/f2e x:0 0 0 2024-02-14T13:10:31.667 INFO:tasks.workunit.client.0.smithi012.stdout:0/102: getdents d10/d14/d1b 0 2024-02-14T13:10:31.667 INFO:tasks.workunit.client.0.smithi012.stdout:0/103: readlink d10/d14/l1a 0 2024-02-14T13:10:31.668 INFO:tasks.workunit.client.0.smithi012.stdout:5/110: truncate f0 2139936 0 2024-02-14T13:10:31.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/111: rename dc/c1b to dc/c21 0 2024-02-14T13:10:31.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/104: dread d10/f17 [0,4194304] 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/105: creat d10/d14/f1e x:0 0 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/106: readlink d10/d14/l1a 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/107: getdents d10/d14/d1b 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/108: truncate d10/f13 431189 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/109: truncate d10/d14/f15 1674309 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:8/103: dwrite d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:31.672 INFO:tasks.workunit.client.0.smithi012.stdout:8/104: write d9/dc/f19 [546304,4784] 0 2024-02-14T13:10:31.673 INFO:tasks.workunit.client.0.smithi012.stdout:0/110: symlink d10/l1f 0 2024-02-14T13:10:31.673 INFO:tasks.workunit.client.0.smithi012.stdout:0/111: fdatasync d10/d14/f18 0 2024-02-14T13:10:31.674 INFO:tasks.workunit.client.0.smithi012.stdout:4/105: sync 2024-02-14T13:10:31.678 INFO:tasks.workunit.client.0.smithi012.stdout:1/140: write d6/ff [2115004,22511] 0 2024-02-14T13:10:31.678 INFO:tasks.workunit.client.0.smithi012.stdout:8/105: creat d9/dc/d1b/f20 x:0 0 0 2024-02-14T13:10:31.679 INFO:tasks.workunit.client.0.smithi012.stdout:0/112: mkdir d10/d14/d20 0 2024-02-14T13:10:31.683 INFO:tasks.workunit.client.0.smithi012.stdout:4/106: rmdir d0 39 2024-02-14T13:10:31.686 INFO:tasks.workunit.client.0.smithi012.stdout:1/141: rename d6/l18 to d6/d12/l2f 0 2024-02-14T13:10:31.686 INFO:tasks.workunit.client.0.smithi012.stdout:1/142: read - d6/d12/f1a zero size 2024-02-14T13:10:31.688 INFO:tasks.workunit.client.0.smithi012.stdout:8/106: link d9/dc/f19 d9/dc/d1b/f21 0 2024-02-14T13:10:31.691 INFO:tasks.workunit.client.0.smithi012.stdout:4/107: rename d0/c11 to d0/d10/d1f/c25 0 2024-02-14T13:10:31.691 INFO:tasks.workunit.client.0.smithi012.stdout:8/107: rename d9 to d9/dc/d1b/d22 22 2024-02-14T13:10:31.693 INFO:tasks.workunit.client.0.smithi012.stdout:0/113: truncate d10/f11 272071 0 2024-02-14T13:10:31.695 INFO:tasks.workunit.client.0.smithi012.stdout:4/108: creat d0/d10/d13/f26 x:0 0 0 2024-02-14T13:10:31.695 INFO:tasks.workunit.client.0.smithi012.stdout:4/109: truncate d0/d10/d13/d17/f1c 476753 0 2024-02-14T13:10:31.696 INFO:tasks.workunit.client.0.smithi012.stdout:5/112: truncate f0 2078754 0 2024-02-14T13:10:31.697 INFO:tasks.workunit.client.0.smithi012.stdout:5/113: write dc/f12 [1042991,72002] 0 2024-02-14T13:10:31.697 INFO:tasks.workunit.client.0.smithi012.stdout:5/114: readlink dc/l18 0 2024-02-14T13:10:31.698 INFO:tasks.workunit.client.0.smithi012.stdout:5/115: creat dc/d17/d20/f22 x:0 0 0 2024-02-14T13:10:31.698 INFO:tasks.workunit.client.0.smithi012.stdout:5/116: chown f5 2941 1 2024-02-14T13:10:31.700 INFO:tasks.workunit.client.0.smithi012.stdout:5/117: link c1 dc/d17/d20/c23 0 2024-02-14T13:10:31.700 INFO:tasks.workunit.client.0.smithi012.stdout:5/118: chown dc/d17/d20 0 1 2024-02-14T13:10:31.700 INFO:tasks.workunit.client.0.smithi012.stdout:5/119: fsync f5 0 2024-02-14T13:10:31.703 INFO:tasks.workunit.client.0.smithi012.stdout:5/120: creat dc/d17/f24 x:0 0 0 2024-02-14T13:10:31.704 INFO:tasks.workunit.client.0.smithi012.stdout:8/108: write d9/dc/d14/f1f [540771,69750] 0 2024-02-14T13:10:31.704 INFO:tasks.workunit.client.0.smithi012.stdout:5/121: mknod dc/c25 0 2024-02-14T13:10:31.705 INFO:tasks.workunit.client.0.smithi012.stdout:1/143: dwrite d6/f1b [0,4194304] 0 2024-02-14T13:10:31.706 INFO:tasks.workunit.client.0.smithi012.stdout:0/114: write d10/d14/f15 [541128,18332] 0 2024-02-14T13:10:31.706 INFO:tasks.workunit.client.0.smithi012.stdout:0/115: fsync d10/d14/f1e 0 2024-02-14T13:10:31.706 INFO:tasks.workunit.client.0.smithi012.stdout:0/116: chown d10/f17 598579 1 2024-02-14T13:10:31.707 INFO:tasks.workunit.client.0.smithi012.stdout:5/122: creat dc/f26 x:0 0 0 2024-02-14T13:10:31.707 INFO:tasks.workunit.client.0.smithi012.stdout:1/144: write d6/fb [858263,16860] 0 2024-02-14T13:10:31.710 INFO:tasks.workunit.client.0.smithi012.stdout:0/117: getdents d10/d14 0 2024-02-14T13:10:31.710 INFO:tasks.workunit.client.0.smithi012.stdout:0/118: stat d10/d14/f18 0 2024-02-14T13:10:31.714 INFO:tasks.workunit.client.0.smithi012.stdout:8/109: mkdir d9/dc/d14/d23 0 2024-02-14T13:10:31.714 INFO:tasks.workunit.client.0.smithi012.stdout:8/110: truncate d9/dc/d1b/f21 1010792 0 2024-02-14T13:10:31.714 INFO:tasks.workunit.client.0.smithi012.stdout:0/119: write d10/f13 [184066,52317] 0 2024-02-14T13:10:31.716 INFO:tasks.workunit.client.0.smithi012.stdout:0/120: mkdir d10/d14/d20/d21 0 2024-02-14T13:10:31.718 INFO:tasks.workunit.client.0.smithi012.stdout:0/121: creat d10/d14/d1b/f22 x:0 0 0 2024-02-14T13:10:31.719 INFO:tasks.workunit.client.0.smithi012.stdout:0/122: unlink cf 0 2024-02-14T13:10:31.721 INFO:tasks.workunit.client.0.smithi012.stdout:7/91: sync 2024-02-14T13:10:31.721 INFO:tasks.workunit.client.0.smithi012.stdout:0/123: mkdir d10/d14/d23 0 2024-02-14T13:10:31.730 INFO:tasks.workunit.client.0.smithi012.stdout:4/110: dwrite d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:31.730 INFO:tasks.workunit.client.0.smithi012.stdout:1/145: dwrite d6/d10/f13 [0,4194304] 0 2024-02-14T13:10:31.730 INFO:tasks.workunit.client.0.smithi012.stdout:1/146: chown d6/d12/d15/l2c 11914894 1 2024-02-14T13:10:31.732 INFO:tasks.workunit.client.0.smithi012.stdout:4/111: symlink d0/l27 0 2024-02-14T13:10:31.734 INFO:tasks.workunit.client.0.smithi012.stdout:4/112: mkdir d0/d10/d28 0 2024-02-14T13:10:31.734 INFO:tasks.workunit.client.0.smithi012.stdout:7/92: write df/f19 [1855820,79636] 0 2024-02-14T13:10:31.742 INFO:tasks.workunit.client.0.smithi012.stdout:5/123: dwrite dc/f15 [0,4194304] 0 2024-02-14T13:10:31.742 INFO:tasks.workunit.client.0.smithi012.stdout:8/111: dwrite f4 [0,4194304] 0 2024-02-14T13:10:31.742 INFO:tasks.workunit.client.0.smithi012.stdout:8/112: write d9/dc/d14/f1f [2402790,107724] 0 2024-02-14T13:10:31.742 INFO:tasks.workunit.client.0.smithi012.stdout:8/113: truncate d9/dc/d14/f1f 4405870 0 2024-02-14T13:10:31.745 INFO:tasks.workunit.client.0.smithi012.stdout:4/113: dread d0/f3 [0,4194304] 0 2024-02-14T13:10:31.748 INFO:tasks.workunit.client.0.smithi012.stdout:5/124: creat dc/d17/f27 x:0 0 0 2024-02-14T13:10:31.748 INFO:tasks.workunit.client.0.smithi012.stdout:5/125: readlink dc/lf 0 2024-02-14T13:10:31.748 INFO:tasks.workunit.client.0.smithi012.stdout:5/126: write dc/d17/d20/f22 [337918,106083] 0 2024-02-14T13:10:31.749 INFO:tasks.workunit.client.0.smithi012.stdout:8/114: creat d9/dc/d14/f24 x:0 0 0 2024-02-14T13:10:31.752 INFO:tasks.workunit.client.0.smithi012.stdout:5/127: getdents dc 0 2024-02-14T13:10:31.753 INFO:tasks.workunit.client.0.smithi012.stdout:7/93: dwrite df/f22 [4194304,4194304] 0 2024-02-14T13:10:31.753 INFO:tasks.workunit.client.0.smithi012.stdout:7/94: dread - df/f23 zero size 2024-02-14T13:10:31.753 INFO:tasks.workunit.client.0.smithi012.stdout:0/124: dwrite fc [0,4194304] 0 2024-02-14T13:10:31.754 INFO:tasks.workunit.client.0.smithi012.stdout:4/114: rename d0/d10/d13/l1d to d0/l29 0 2024-02-14T13:10:31.760 INFO:tasks.workunit.client.0.smithi012.stdout:4/115: link d0/d10/f24 d0/d10/f2a 0 2024-02-14T13:10:31.762 INFO:tasks.workunit.client.0.smithi012.stdout:7/95: mkdir df/d24 0 2024-02-14T13:10:31.765 INFO:tasks.workunit.client.0.smithi012.stdout:8/115: truncate d9/dc/f19 194172 0 2024-02-14T13:10:31.766 INFO:tasks.workunit.client.0.smithi012.stdout:8/116: link d9/ce d9/dc/d14/d23/c25 0 2024-02-14T13:10:31.768 INFO:tasks.workunit.client.0.smithi012.stdout:8/117: creat d9/dc/f26 x:0 0 0 2024-02-14T13:10:31.768 INFO:tasks.workunit.client.0.smithi012.stdout:2/71: sync 2024-02-14T13:10:31.768 INFO:tasks.workunit.client.0.smithi012.stdout:6/71: sync 2024-02-14T13:10:31.768 INFO:tasks.workunit.client.0.smithi012.stdout:3/50: sync 2024-02-14T13:10:31.768 INFO:tasks.workunit.client.0.smithi012.stdout:6/72: chown d1/d9/dc/fe 79817307 1 2024-02-14T13:10:31.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/73: mkdir d1/d17 0 2024-02-14T13:10:31.770 INFO:tasks.workunit.client.0.smithi012.stdout:9/121: sync 2024-02-14T13:10:31.770 INFO:tasks.workunit.client.0.smithi012.stdout:0/125: dwrite d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:31.771 INFO:tasks.workunit.client.0.smithi012.stdout:6/74: symlink d1/d9/dc/l18 0 2024-02-14T13:10:31.772 INFO:tasks.workunit.client.0.smithi012.stdout:5/128: fsync dc/d17/f27 0 2024-02-14T13:10:31.772 INFO:tasks.workunit.client.0.smithi012.stdout:0/126: dread d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:31.774 INFO:tasks.workunit.client.0.smithi012.stdout:6/75: getdents d1/df 0 2024-02-14T13:10:31.777 INFO:tasks.workunit.client.0.smithi012.stdout:7/96: rmdir df 39 2024-02-14T13:10:31.780 INFO:tasks.workunit.client.0.smithi012.stdout:5/129: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:31.780 INFO:tasks.workunit.client.0.smithi012.stdout:5/130: chown dc/lf 51 1 2024-02-14T13:10:31.785 INFO:tasks.workunit.client.0.smithi012.stdout:2/72: dread d0/d5/fd [0,4194304] 0 2024-02-14T13:10:31.785 INFO:tasks.workunit.client.0.smithi012.stdout:2/73: chown d0/d8 2643049 1 2024-02-14T13:10:31.787 INFO:tasks.workunit.client.0.smithi012.stdout:2/74: link d0/lb d0/d8/d11/l1d 0 2024-02-14T13:10:31.787 INFO:tasks.workunit.client.0.smithi012.stdout:2/75: fdatasync d0/d8/d11/f17 0 2024-02-14T13:10:31.788 INFO:tasks.workunit.client.0.smithi012.stdout:2/76: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:31.790 INFO:tasks.workunit.client.0.smithi012.stdout:5/131: dread f6 [0,4194304] 0 2024-02-14T13:10:31.790 INFO:tasks.workunit.client.0.smithi012.stdout:5/132: write f5 [1158979,122240] 0 2024-02-14T13:10:31.790 INFO:tasks.workunit.client.0.smithi012.stdout:2/77: symlink d0/d6/de/l1e 0 2024-02-14T13:10:31.790 INFO:tasks.workunit.client.0.smithi012.stdout:2/78: dread - d0/d8/dc/f19 zero size 2024-02-14T13:10:31.790 INFO:tasks.workunit.client.0.smithi012.stdout:2/79: chown d0/d6/de/l1e 23661 1 2024-02-14T13:10:31.793 INFO:tasks.workunit.client.0.smithi012.stdout:3/51: dwrite f1 [4194304,4194304] 0 2024-02-14T13:10:31.793 INFO:tasks.workunit.client.0.smithi012.stdout:3/52: stat d9/dd/de 0 2024-02-14T13:10:31.793 INFO:tasks.workunit.client.0.smithi012.stdout:5/133: creat dc/d17/f28 x:0 0 0 2024-02-14T13:10:31.793 INFO:tasks.workunit.client.0.smithi012.stdout:5/134: dread - dc/f26 zero size 2024-02-14T13:10:31.796 INFO:tasks.workunit.client.0.smithi012.stdout:3/53: unlink d9/dd/cf 0 2024-02-14T13:10:31.798 INFO:tasks.workunit.client.0.smithi012.stdout:5/135: creat dc/f29 x:0 0 0 2024-02-14T13:10:31.800 INFO:tasks.workunit.client.0.smithi012.stdout:3/54: unlink l5 0 2024-02-14T13:10:31.800 INFO:tasks.workunit.client.0.smithi012.stdout:9/122: dwrite f9 [0,4194304] 0 2024-02-14T13:10:31.800 INFO:tasks.workunit.client.0.smithi012.stdout:9/123: dread - da/d13/f24 zero size 2024-02-14T13:10:31.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/55: link d9/lc d9/d13/l16 0 2024-02-14T13:10:31.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/56: fsync f1 0 2024-02-14T13:10:31.806 INFO:tasks.workunit.client.0.smithi012.stdout:3/57: rmdir d9/d13 39 2024-02-14T13:10:31.806 INFO:tasks.workunit.client.0.smithi012.stdout:3/58: write f1 [1213545,91221] 0 2024-02-14T13:10:31.808 INFO:tasks.workunit.client.0.smithi012.stdout:7/97: dwrite df/f20 [0,4194304] 0 2024-02-14T13:10:31.808 INFO:tasks.workunit.client.0.smithi012.stdout:9/124: read da/f14 [1880479,34221] 0 2024-02-14T13:10:31.808 INFO:tasks.workunit.client.0.smithi012.stdout:9/125: chown da/dd 14407359 1 2024-02-14T13:10:31.810 INFO:tasks.workunit.client.0.smithi012.stdout:7/98: unlink c9 0 2024-02-14T13:10:31.810 INFO:tasks.workunit.client.0.smithi012.stdout:9/126: mknod da/dd/d18/c26 0 2024-02-14T13:10:31.811 INFO:tasks.workunit.client.0.smithi012.stdout:9/127: write da/f23 [551704,103527] 0 2024-02-14T13:10:31.811 INFO:tasks.workunit.client.0.smithi012.stdout:0/127: dwrite fc [0,4194304] 0 2024-02-14T13:10:31.811 INFO:tasks.workunit.client.0.smithi012.stdout:0/128: write fd [1758655,75401] 0 2024-02-14T13:10:31.811 INFO:tasks.workunit.client.0.smithi012.stdout:7/99: creat df/d24/f25 x:0 0 0 2024-02-14T13:10:31.814 INFO:tasks.workunit.client.0.smithi012.stdout:5/136: rmdir dc 39 2024-02-14T13:10:31.815 INFO:tasks.workunit.client.0.smithi012.stdout:0/129: mknod d10/d14/d23/c24 0 2024-02-14T13:10:31.819 INFO:tasks.workunit.client.0.smithi012.stdout:0/130: symlink d10/d14/d20/l25 0 2024-02-14T13:10:31.819 INFO:tasks.workunit.client.0.smithi012.stdout:0/131: dread - d10/d14/f1e zero size 2024-02-14T13:10:31.820 INFO:tasks.workunit.client.0.smithi012.stdout:2/80: dwrite d0/d8/dc/f19 [0,4194304] 0 2024-02-14T13:10:31.820 INFO:tasks.workunit.client.0.smithi012.stdout:2/81: rename d0/d8/dc to d0/d8/dc/d1f 22 2024-02-14T13:10:31.820 INFO:tasks.workunit.client.0.smithi012.stdout:0/132: dread d10/f13 [0,4194304] 0 2024-02-14T13:10:31.821 INFO:tasks.workunit.client.0.smithi012.stdout:0/133: chown d10/d14/d1b/f22 50 1 2024-02-14T13:10:31.822 INFO:tasks.workunit.client.0.smithi012.stdout:3/59: dread f1 [4194304,4194304] 0 2024-02-14T13:10:31.824 INFO:tasks.workunit.client.0.smithi012.stdout:2/82: rmdir d0 39 2024-02-14T13:10:31.824 INFO:tasks.workunit.client.0.smithi012.stdout:2/83: chown d0/d8/dc/f19 1037550962 1 2024-02-14T13:10:31.825 INFO:tasks.workunit.client.0.smithi012.stdout:0/134: truncate d10/d14/f18 2263574 0 2024-02-14T13:10:31.826 INFO:tasks.workunit.client.0.smithi012.stdout:3/60: creat d9/dd/f17 x:0 0 0 2024-02-14T13:10:31.826 INFO:tasks.workunit.client.0.smithi012.stdout:3/61: fdatasync d9/dd/f15 0 2024-02-14T13:10:31.829 INFO:tasks.workunit.client.0.smithi012.stdout:2/84: rename d0/d8/dc to d0/d20 0 2024-02-14T13:10:31.830 INFO:tasks.workunit.client.0.smithi012.stdout:3/62: mkdir d9/d18 0 2024-02-14T13:10:31.832 INFO:tasks.workunit.client.0.smithi012.stdout:3/63: link l6 d9/d18/l19 0 2024-02-14T13:10:31.832 INFO:tasks.workunit.client.0.smithi012.stdout:3/64: chown d9/dd/de 32 1 2024-02-14T13:10:31.832 INFO:tasks.workunit.client.0.smithi012.stdout:3/65: chown d9/dd/f15 495108 1 2024-02-14T13:10:31.837 INFO:tasks.workunit.client.0.smithi012.stdout:3/66: read d9/dd/f15 [4277235,99618] 0 2024-02-14T13:10:31.838 INFO:tasks.workunit.client.0.smithi012.stdout:3/67: creat d9/dd/de/f1a x:0 0 0 2024-02-14T13:10:31.838 INFO:tasks.workunit.client.0.smithi012.stdout:3/68: unlink d9/d18/l19 0 2024-02-14T13:10:31.839 INFO:tasks.workunit.client.0.smithi012.stdout:3/69: rename d9/dd to d9/dd/d1b 22 2024-02-14T13:10:31.839 INFO:tasks.workunit.client.0.smithi012.stdout:3/70: creat d9/d18/f1c x:0 0 0 2024-02-14T13:10:31.839 INFO:tasks.workunit.client.0.smithi012.stdout:3/71: dread - d9/dd/f17 zero size 2024-02-14T13:10:31.840 INFO:tasks.workunit.client.0.smithi012.stdout:3/72: symlink d9/d18/l1d 0 2024-02-14T13:10:31.841 INFO:tasks.workunit.client.0.smithi012.stdout:5/137: dwrite f7 [0,4194304] 0 2024-02-14T13:10:31.841 INFO:tasks.workunit.client.0.smithi012.stdout:9/128: dwrite da/d13/f17 [0,4194304] 0 2024-02-14T13:10:31.843 INFO:tasks.workunit.client.0.smithi012.stdout:3/73: rename l3 to d9/l1e 0 2024-02-14T13:10:31.843 INFO:tasks.workunit.client.0.smithi012.stdout:3/74: write d9/dd/f17 [186297,67880] 0 2024-02-14T13:10:31.843 INFO:tasks.workunit.client.0.smithi012.stdout:3/75: write f1 [8117076,3097] 0 2024-02-14T13:10:31.843 INFO:tasks.workunit.client.0.smithi012.stdout:3/76: chown d9/dd/de/f1a 2052107 1 2024-02-14T13:10:31.843 INFO:tasks.workunit.client.0.smithi012.stdout:2/85: read d0/d20/f19 [1713480,79767] 0 2024-02-14T13:10:31.846 INFO:tasks.workunit.client.0.smithi012.stdout:5/138: rename dc/d17/c1d to dc/d17/d20/c2a 0 2024-02-14T13:10:31.848 INFO:tasks.workunit.client.0.smithi012.stdout:3/77: mknod d9/dd/c1f 0 2024-02-14T13:10:31.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/86: mknod d0/d6/de/c21 0 2024-02-14T13:10:31.849 INFO:tasks.workunit.client.0.smithi012.stdout:2/87: truncate d0/d8/d11/f17 1003261 0 2024-02-14T13:10:31.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/135: dread d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:31.851 INFO:tasks.workunit.client.0.smithi012.stdout:9/129: rename da/c1a to da/dd/d19/c27 0 2024-02-14T13:10:31.856 INFO:tasks.workunit.client.0.smithi012.stdout:3/78: unlink d9/cb 0 2024-02-14T13:10:31.856 INFO:tasks.workunit.client.0.smithi012.stdout:3/79: chown l6 1999945 1 2024-02-14T13:10:31.856 INFO:tasks.workunit.client.0.smithi012.stdout:0/136: truncate fc 1965021 0 2024-02-14T13:10:31.857 INFO:tasks.workunit.client.0.smithi012.stdout:0/137: write d10/f17 [3541045,113917] 0 2024-02-14T13:10:31.859 INFO:tasks.workunit.client.0.smithi012.stdout:9/130: rmdir da/d13 39 2024-02-14T13:10:31.861 INFO:tasks.workunit.client.0.smithi012.stdout:3/80: creat d9/d13/f20 x:0 0 0 2024-02-14T13:10:31.862 INFO:tasks.workunit.client.0.smithi012.stdout:3/81: write d9/dd/f11 [54794,86521] 0 2024-02-14T13:10:31.862 INFO:tasks.workunit.client.0.smithi012.stdout:3/82: write d9/dd/f15 [5189017,96086] 0 2024-02-14T13:10:31.863 INFO:tasks.workunit.client.0.smithi012.stdout:9/131: creat da/d13/f28 x:0 0 0 2024-02-14T13:10:31.863 INFO:tasks.workunit.client.0.smithi012.stdout:9/132: write da/d13/f24 [970823,41803] 0 2024-02-14T13:10:31.866 INFO:tasks.workunit.client.0.smithi012.stdout:3/83: rename d9/d13/l16 to d9/d18/l21 0 2024-02-14T13:10:31.866 INFO:tasks.workunit.client.0.smithi012.stdout:3/84: truncate d9/dd/f17 818730 0 2024-02-14T13:10:31.867 INFO:tasks.workunit.client.0.smithi012.stdout:2/88: dwrite d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:31.868 INFO:tasks.workunit.client.0.smithi012.stdout:9/133: rename da/d13/f24 to da/d13/f29 0 2024-02-14T13:10:31.868 INFO:tasks.workunit.client.0.smithi012.stdout:9/134: fdatasync da/dd/f1b 0 2024-02-14T13:10:31.868 INFO:tasks.workunit.client.0.smithi012.stdout:9/135: read da/dd/f1e [15936,23303] 0 2024-02-14T13:10:31.868 INFO:tasks.workunit.client.0.smithi012.stdout:9/136: read da/f14 [2916382,32966] 0 2024-02-14T13:10:31.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/85: rename d9/dd/f11 to d9/f22 0 2024-02-14T13:10:31.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/86: write d9/f22 [42331,1217] 0 2024-02-14T13:10:31.872 INFO:tasks.workunit.client.0.smithi012.stdout:5/139: dwrite f0 [0,4194304] 0 2024-02-14T13:10:31.872 INFO:tasks.workunit.client.0.smithi012.stdout:5/140: truncate dc/d17/d20/f22 845487 0 2024-02-14T13:10:31.873 INFO:tasks.workunit.client.0.smithi012.stdout:9/137: creat da/dd/f2a x:0 0 0 2024-02-14T13:10:31.874 INFO:tasks.workunit.client.0.smithi012.stdout:5/141: read dc/f12 [143065,13019] 0 2024-02-14T13:10:31.874 INFO:tasks.workunit.client.0.smithi012.stdout:1/147: sync 2024-02-14T13:10:31.879 INFO:tasks.workunit.client.0.smithi012.stdout:3/87: dread d9/dd/f15 [4194304,4194304] 0 2024-02-14T13:10:31.879 INFO:tasks.workunit.client.0.smithi012.stdout:9/138: creat da/dd/f2b x:0 0 0 2024-02-14T13:10:31.881 INFO:tasks.workunit.client.0.smithi012.stdout:5/142: creat dc/d17/d20/f2b x:0 0 0 2024-02-14T13:10:31.881 INFO:tasks.workunit.client.0.smithi012.stdout:5/143: stat dc/d17/d20 0 2024-02-14T13:10:31.883 INFO:tasks.workunit.client.0.smithi012.stdout:1/148: mknod d6/d10/d22/c30 0 2024-02-14T13:10:31.883 INFO:tasks.workunit.client.0.smithi012.stdout:2/89: dwrite d0/f2 [4194304,4194304] 0 2024-02-14T13:10:31.884 INFO:tasks.workunit.client.0.smithi012.stdout:9/139: creat da/dd/d19/f2c x:0 0 0 2024-02-14T13:10:31.884 INFO:tasks.workunit.client.0.smithi012.stdout:9/140: write f0 [4790364,41176] 0 2024-02-14T13:10:31.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/141: link da/l11 da/d13/d20/l2d 0 2024-02-14T13:10:31.890 INFO:tasks.workunit.client.0.smithi012.stdout:2/90: dread d0/d20/f19 [0,4194304] 0 2024-02-14T13:10:31.890 INFO:tasks.workunit.client.0.smithi012.stdout:9/142: rmdir da/dd/d18 39 2024-02-14T13:10:31.892 INFO:tasks.workunit.client.0.smithi012.stdout:2/91: rename d0/d1a/l1b to d0/l22 0 2024-02-14T13:10:31.892 INFO:tasks.workunit.client.0.smithi012.stdout:9/143: dread da/f23 [0,4194304] 0 2024-02-14T13:10:31.893 INFO:tasks.workunit.client.0.smithi012.stdout:3/88: truncate d9/f22 220288 0 2024-02-14T13:10:31.894 INFO:tasks.workunit.client.0.smithi012.stdout:9/144: unlink da/dd/d19/f2c 0 2024-02-14T13:10:31.895 INFO:tasks.workunit.client.0.smithi012.stdout:3/89: creat d9/d18/f23 x:0 0 0 2024-02-14T13:10:31.896 INFO:tasks.workunit.client.0.smithi012.stdout:9/145: creat da/d13/d20/f2e x:0 0 0 2024-02-14T13:10:31.896 INFO:tasks.workunit.client.0.smithi012.stdout:9/146: write da/dd/f1e [1201634,120347] 0 2024-02-14T13:10:31.896 INFO:tasks.workunit.client.0.smithi012.stdout:9/147: fsync da/dd/d18/f22 0 2024-02-14T13:10:31.897 INFO:tasks.workunit.client.0.smithi012.stdout:3/90: rmdir d9/d13 39 2024-02-14T13:10:31.898 INFO:tasks.workunit.client.0.smithi012.stdout:9/148: write da/d13/f1f [607265,31848] 0 2024-02-14T13:10:31.900 INFO:tasks.workunit.client.0.smithi012.stdout:3/91: creat d9/dd/f24 x:0 0 0 2024-02-14T13:10:31.901 INFO:tasks.workunit.client.0.smithi012.stdout:3/92: mknod d9/dd/de/c25 0 2024-02-14T13:10:31.903 INFO:tasks.workunit.client.0.smithi012.stdout:2/92: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:31.903 INFO:tasks.workunit.client.0.smithi012.stdout:3/93: creat d9/d13/f26 x:0 0 0 2024-02-14T13:10:31.904 INFO:tasks.workunit.client.0.smithi012.stdout:2/93: creat d0/d20/f23 x:0 0 0 2024-02-14T13:10:31.905 INFO:tasks.workunit.client.0.smithi012.stdout:5/144: dwrite dc/f15 [0,4194304] 0 2024-02-14T13:10:31.906 INFO:tasks.workunit.client.0.smithi012.stdout:1/149: dwrite d6/f1b [4194304,4194304] 0 2024-02-14T13:10:31.906 INFO:tasks.workunit.client.0.smithi012.stdout:2/94: unlink d0/d6/la 0 2024-02-14T13:10:31.909 INFO:tasks.workunit.client.0.smithi012.stdout:5/145: rename dc/d17/f28 to dc/d17/f2c 0 2024-02-14T13:10:31.909 INFO:tasks.workunit.client.0.smithi012.stdout:5/146: stat dc/d17/f2c 0 2024-02-14T13:10:31.912 INFO:tasks.workunit.client.0.smithi012.stdout:1/150: mkdir d6/d10/d22/d31 0 2024-02-14T13:10:31.914 INFO:tasks.workunit.client.0.smithi012.stdout:2/95: symlink d0/d8/d9/l24 0 2024-02-14T13:10:31.917 INFO:tasks.workunit.client.0.smithi012.stdout:5/147: rmdir dc/d17/d20 39 2024-02-14T13:10:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:1/151: mknod d6/d10/d22/c32 0 2024-02-14T13:10:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:1/152: dread - d6/d12/f2e zero size 2024-02-14T13:10:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:1/153: write d6/d12/d15/f1d [618448,89891] 0 2024-02-14T13:10:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:1/154: rename d6/d10 to d6/d10/d22/d33 22 2024-02-14T13:10:31.920 INFO:tasks.workunit.client.0.smithi012.stdout:1/155: chown d6/fb 3351995 1 2024-02-14T13:10:31.921 INFO:tasks.workunit.client.0.smithi012.stdout:2/96: creat d0/d1a/f25 x:0 0 0 2024-02-14T13:10:31.923 INFO:tasks.workunit.client.0.smithi012.stdout:1/156: mkdir d6/d10/d22/d31/d34 0 2024-02-14T13:10:31.923 INFO:tasks.workunit.client.0.smithi012.stdout:3/94: dwrite d9/d13/f20 [0,4194304] 0 2024-02-14T13:10:31.925 INFO:tasks.workunit.client.0.smithi012.stdout:2/97: mkdir d0/d8/d12/d26 0 2024-02-14T13:10:31.925 INFO:tasks.workunit.client.0.smithi012.stdout:2/98: write d0/d20/f23 [21642,28108] 0 2024-02-14T13:10:31.925 INFO:tasks.workunit.client.0.smithi012.stdout:2/99: stat d0/d8/d11 0 2024-02-14T13:10:31.925 INFO:tasks.workunit.client.0.smithi012.stdout:2/100: stat d0/d6/de 0 2024-02-14T13:10:31.927 INFO:tasks.workunit.client.0.smithi012.stdout:1/157: truncate d6/fe 169607 0 2024-02-14T13:10:31.927 INFO:tasks.workunit.client.0.smithi012.stdout:1/158: fdatasync d6/d12/f29 0 2024-02-14T13:10:31.927 INFO:tasks.workunit.client.0.smithi012.stdout:1/159: write d6/d10/d22/f2a [1007821,119655] 0 2024-02-14T13:10:31.928 INFO:tasks.workunit.client.0.smithi012.stdout:5/148: dread f0 [0,4194304] 0 2024-02-14T13:10:31.937 INFO:tasks.workunit.client.0.smithi012.stdout:4/116: sync 2024-02-14T13:10:31.938 INFO:tasks.workunit.client.0.smithi012.stdout:5/149: read f0 [3828024,8499] 0 2024-02-14T13:10:31.948 INFO:tasks.workunit.client.0.smithi012.stdout:3/95: dwrite d9/d18/f1c [0,4194304] 0 2024-02-14T13:10:31.949 INFO:tasks.workunit.client.0.smithi012.stdout:3/96: write d9/dd/f15 [1037918,75987] 0 2024-02-14T13:10:31.949 INFO:tasks.workunit.client.0.smithi012.stdout:3/97: chown d9/d18 735219 1 2024-02-14T13:10:31.950 INFO:tasks.workunit.client.0.smithi012.stdout:4/117: read d0/f6 [2288466,70650] 0 2024-02-14T13:10:31.950 INFO:tasks.workunit.client.0.smithi012.stdout:4/118: chown d0/c19 23747146 1 2024-02-14T13:10:31.950 INFO:tasks.workunit.client.0.smithi012.stdout:4/119: chown d0/d10/d13/d17/l23 13318231 1 2024-02-14T13:10:31.953 INFO:tasks.workunit.client.0.smithi012.stdout:4/120: link d0/d10/l22 d0/d10/d28/l2b 0 2024-02-14T13:10:31.953 INFO:tasks.workunit.client.0.smithi012.stdout:4/121: write d0/f3 [1147290,89823] 0 2024-02-14T13:10:31.980 INFO:tasks.workunit.client.0.smithi012.stdout:3/98: dwrite d9/d13/f26 [0,4194304] 0 2024-02-14T13:10:31.980 INFO:tasks.workunit.client.0.smithi012.stdout:5/150: dwrite dc/d17/d20/f22 [0,4194304] 0 2024-02-14T13:10:31.980 INFO:tasks.workunit.client.0.smithi012.stdout:3/99: chown d9/f22 1 1 2024-02-14T13:10:31.980 INFO:tasks.workunit.client.0.smithi012.stdout:5/151: write dc/d17/f24 [335281,122490] 0 2024-02-14T13:10:31.980 INFO:tasks.workunit.client.0.smithi012.stdout:4/122: dwrite d0/fa [0,4194304] 0 2024-02-14T13:10:31.984 INFO:tasks.workunit.client.0.smithi012.stdout:5/152: truncate dc/f15 312307 0 2024-02-14T13:10:31.985 INFO:tasks.workunit.client.0.smithi012.stdout:5/153: creat dc/d17/d20/f2d x:0 0 0 2024-02-14T13:10:31.985 INFO:tasks.workunit.client.0.smithi012.stdout:5/154: fsync f6 0 2024-02-14T13:10:31.986 INFO:tasks.workunit.client.0.smithi012.stdout:8/118: sync 2024-02-14T13:10:31.986 INFO:tasks.workunit.client.0.smithi012.stdout:6/76: sync 2024-02-14T13:10:31.988 INFO:tasks.workunit.client.0.smithi012.stdout:6/77: dread d1/f3 [0,4194304] 0 2024-02-14T13:10:31.993 INFO:tasks.workunit.client.0.smithi012.stdout:4/123: dread d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:31.998 INFO:tasks.workunit.client.0.smithi012.stdout:5/155: write dc/d17/d20/f22 [1809583,33466] 0 2024-02-14T13:10:31.998 INFO:tasks.workunit.client.0.smithi012.stdout:5/156: fdatasync dc/f15 0 2024-02-14T13:10:31.999 INFO:tasks.workunit.client.0.smithi012.stdout:8/119: write f4 [1197418,14563] 0 2024-02-14T13:10:31.999 INFO:tasks.workunit.client.0.smithi012.stdout:8/120: fdatasync d9/dc/f26 0 2024-02-14T13:10:32.000 INFO:tasks.workunit.client.0.smithi012.stdout:8/121: dread - d9/dc/f26 zero size 2024-02-14T13:10:32.000 INFO:tasks.workunit.client.0.smithi012.stdout:8/122: chown c7 7814 1 2024-02-14T13:10:32.000 INFO:tasks.workunit.client.0.smithi012.stdout:8/123: write f4 [3234125,82492] 0 2024-02-14T13:10:32.001 INFO:tasks.workunit.client.0.smithi012.stdout:8/124: stat d9/c16 0 2024-02-14T13:10:32.001 INFO:tasks.workunit.client.0.smithi012.stdout:8/125: write d9/dc/d1b/f20 [563384,99430] 0 2024-02-14T13:10:32.006 INFO:tasks.workunit.client.0.smithi012.stdout:8/126: fsync d9/dc/d1b/f20 0 2024-02-14T13:10:32.006 INFO:tasks.workunit.client.0.smithi012.stdout:6/78: dwrite d1/d9/dc/fe [0,4194304] 0 2024-02-14T13:10:32.006 INFO:tasks.workunit.client.0.smithi012.stdout:6/79: stat d1/df/c12 0 2024-02-14T13:10:32.006 INFO:tasks.workunit.client.0.smithi012.stdout:6/80: rename d1/d9 to d1/d9/dc/d19 22 2024-02-14T13:10:32.011 INFO:tasks.workunit.client.0.smithi012.stdout:6/81: creat d1/df/d16/f1a x:0 0 0 2024-02-14T13:10:32.011 INFO:tasks.workunit.client.0.smithi012.stdout:6/82: dread - d1/df/d16/f1a zero size 2024-02-14T13:10:32.011 INFO:tasks.workunit.client.0.smithi012.stdout:6/83: mkdir d1/d9/d1b 0 2024-02-14T13:10:32.018 INFO:tasks.workunit.client.0.smithi012.stdout:5/157: dwrite dc/d17/f24 [0,4194304] 0 2024-02-14T13:10:32.018 INFO:tasks.workunit.client.0.smithi012.stdout:5/158: dread - dc/d17/f27 zero size 2024-02-14T13:10:32.019 INFO:tasks.workunit.client.0.smithi012.stdout:8/127: dwrite d9/dc/d1b/f1e [0,4194304] 0 2024-02-14T13:10:32.019 INFO:tasks.workunit.client.0.smithi012.stdout:8/128: read - d9/dc/f26 zero size 2024-02-14T13:10:32.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/84: rename d1/d9 to d1/df/d1c 0 2024-02-14T13:10:32.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/85: fsync d1/f6 0 2024-02-14T13:10:32.023 INFO:tasks.workunit.client.0.smithi012.stdout:5/159: rename dc/d17/d20/c2a to dc/d17/d20/c2e 0 2024-02-14T13:10:32.023 INFO:tasks.workunit.client.0.smithi012.stdout:5/160: dread - dc/d17/f2c zero size 2024-02-14T13:10:32.023 INFO:tasks.workunit.client.0.smithi012.stdout:5/161: dread - dc/d17/d20/f2b zero size 2024-02-14T13:10:32.024 INFO:tasks.workunit.client.0.smithi012.stdout:8/129: getdents d9 0 2024-02-14T13:10:32.024 INFO:tasks.workunit.client.0.smithi012.stdout:8/130: dread - d9/dc/d14/f24 zero size 2024-02-14T13:10:32.024 INFO:tasks.workunit.client.0.smithi012.stdout:8/131: truncate d9/dc/f26 755384 0 2024-02-14T13:10:32.025 INFO:tasks.workunit.client.0.smithi012.stdout:6/86: creat d1/df/d1c/dc/f1d x:0 0 0 2024-02-14T13:10:32.025 INFO:tasks.workunit.client.0.smithi012.stdout:6/87: fdatasync d1/f6 0 2024-02-14T13:10:32.025 INFO:tasks.workunit.client.0.smithi012.stdout:6/88: write d1/df/d1c/dc/f15 [23375,64648] 0 2024-02-14T13:10:32.027 INFO:tasks.workunit.client.0.smithi012.stdout:5/162: mkdir dc/d2f 0 2024-02-14T13:10:32.028 INFO:tasks.workunit.client.0.smithi012.stdout:8/132: getdents d9/dc 0 2024-02-14T13:10:32.029 INFO:tasks.workunit.client.0.smithi012.stdout:2/101: sync 2024-02-14T13:10:32.029 INFO:tasks.workunit.client.0.smithi012.stdout:7/100: sync 2024-02-14T13:10:32.029 INFO:tasks.workunit.client.0.smithi012.stdout:0/138: sync 2024-02-14T13:10:32.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/149: sync 2024-02-14T13:10:32.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/163: creat dc/d17/f30 x:0 0 0 2024-02-14T13:10:32.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/164: read - dc/f26 zero size 2024-02-14T13:10:32.032 INFO:tasks.workunit.client.0.smithi012.stdout:6/89: rename d1/df/d1c to d1/d1e 0 2024-02-14T13:10:32.033 INFO:tasks.workunit.client.0.smithi012.stdout:9/150: link da/dd/c16 da/d13/d20/c2f 0 2024-02-14T13:10:32.034 INFO:tasks.workunit.client.0.smithi012.stdout:7/101: creat df/f26 x:0 0 0 2024-02-14T13:10:32.035 INFO:tasks.workunit.client.0.smithi012.stdout:2/102: creat d0/d8/d11/f27 x:0 0 0 2024-02-14T13:10:32.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/102: mkdir df/d27 0 2024-02-14T13:10:32.038 INFO:tasks.workunit.client.0.smithi012.stdout:2/103: symlink d0/d6/de/l28 0 2024-02-14T13:10:32.039 INFO:tasks.workunit.client.0.smithi012.stdout:5/165: read dc/d17/f24 [82658,119957] 0 2024-02-14T13:10:32.039 INFO:tasks.workunit.client.0.smithi012.stdout:7/103: getdents df/d24 0 2024-02-14T13:10:32.040 INFO:tasks.workunit.client.0.smithi012.stdout:0/139: write f0 [3549515,121522] 0 2024-02-14T13:10:32.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/133: dwrite d9/dc/d14/f24 [0,4194304] 0 2024-02-14T13:10:32.042 INFO:tasks.workunit.client.0.smithi012.stdout:5/166: link dc/c14 dc/d2f/c31 0 2024-02-14T13:10:32.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/104: creat df/d27/f28 x:0 0 0 2024-02-14T13:10:32.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/105: chown df/d24 93 1 2024-02-14T13:10:32.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/106: write df/d24/f25 [38729,2865] 0 2024-02-14T13:10:32.048 INFO:tasks.workunit.client.0.smithi012.stdout:9/151: rename da/d13 to da/dd/d19/d30 0 2024-02-14T13:10:32.049 INFO:tasks.workunit.client.0.smithi012.stdout:0/140: creat d10/d14/d20/d21/f26 x:0 0 0 2024-02-14T13:10:32.053 INFO:tasks.workunit.client.0.smithi012.stdout:5/167: symlink dc/l32 0 2024-02-14T13:10:32.053 INFO:tasks.workunit.client.0.smithi012.stdout:8/134: dread f4 [0,4194304] 0 2024-02-14T13:10:32.055 INFO:tasks.workunit.client.0.smithi012.stdout:5/168: creat dc/f33 x:0 0 0 2024-02-14T13:10:32.056 INFO:tasks.workunit.client.0.smithi012.stdout:8/135: creat d9/dc/d1b/f27 x:0 0 0 2024-02-14T13:10:32.058 INFO:tasks.workunit.client.0.smithi012.stdout:8/136: mknod d9/dc/d1b/c28 0 2024-02-14T13:10:32.058 INFO:tasks.workunit.client.0.smithi012.stdout:8/137: write d9/dc/d1b/f20 [714706,17227] 0 2024-02-14T13:10:32.060 INFO:tasks.workunit.client.0.smithi012.stdout:8/138: symlink d9/l29 0 2024-02-14T13:10:32.060 INFO:tasks.workunit.client.0.smithi012.stdout:8/139: stat d9/ce 0 2024-02-14T13:10:32.060 INFO:tasks.workunit.client.0.smithi012.stdout:5/169: dread dc/f12 [0,4194304] 0 2024-02-14T13:10:32.061 INFO:tasks.workunit.client.0.smithi012.stdout:6/90: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:32.062 INFO:tasks.workunit.client.0.smithi012.stdout:8/140: symlink d9/dc/d14/d23/l2a 0 2024-02-14T13:10:32.063 INFO:tasks.workunit.client.0.smithi012.stdout:5/170: mknod dc/d17/c34 0 2024-02-14T13:10:32.067 INFO:tasks.workunit.client.0.smithi012.stdout:6/91: unlink d1/f6 0 2024-02-14T13:10:32.067 INFO:tasks.workunit.client.0.smithi012.stdout:6/92: write d1/d1e/dc/f15 [37811,83286] 0 2024-02-14T13:10:32.067 INFO:tasks.workunit.client.0.smithi012.stdout:5/171: creat dc/d17/d20/f35 x:0 0 0 2024-02-14T13:10:32.070 INFO:tasks.workunit.client.0.smithi012.stdout:5/172: rename dc/d17/f30 to dc/d17/d20/f36 0 2024-02-14T13:10:32.070 INFO:tasks.workunit.client.0.smithi012.stdout:5/173: write dc/d17/d20/f2d [127912,26281] 0 2024-02-14T13:10:32.070 INFO:tasks.workunit.client.0.smithi012.stdout:5/174: truncate dc/f29 1727 0 2024-02-14T13:10:32.071 INFO:tasks.workunit.client.0.smithi012.stdout:5/175: creat dc/d17/d20/f37 x:0 0 0 2024-02-14T13:10:32.073 INFO:tasks.workunit.client.0.smithi012.stdout:5/176: rename dc/c21 to dc/d17/c38 0 2024-02-14T13:10:32.073 INFO:tasks.workunit.client.0.smithi012.stdout:5/177: fdatasync dc/d17/f27 0 2024-02-14T13:10:32.073 INFO:tasks.workunit.client.0.smithi012.stdout:5/178: chown dc/l18 55 1 2024-02-14T13:10:32.073 INFO:tasks.workunit.client.0.smithi012.stdout:8/141: dread f4 [0,4194304] 0 2024-02-14T13:10:32.074 INFO:tasks.workunit.client.0.smithi012.stdout:5/179: creat dc/d2f/f39 x:0 0 0 2024-02-14T13:10:32.075 INFO:tasks.workunit.client.0.smithi012.stdout:8/142: write d9/dc/d1b/f20 [159550,92078] 0 2024-02-14T13:10:32.075 INFO:tasks.workunit.client.0.smithi012.stdout:5/180: creat dc/d17/d20/f3a x:0 0 0 2024-02-14T13:10:32.075 INFO:tasks.workunit.client.0.smithi012.stdout:5/181: chown dc/d17/d20/c23 6188 1 2024-02-14T13:10:32.075 INFO:tasks.workunit.client.0.smithi012.stdout:2/104: dwrite d0/d5/fd [0,4194304] 0 2024-02-14T13:10:32.076 INFO:tasks.workunit.client.0.smithi012.stdout:8/143: mknod d9/dc/d1b/c2b 0 2024-02-14T13:10:32.076 INFO:tasks.workunit.client.0.smithi012.stdout:8/144: getdents d9/dc 0 2024-02-14T13:10:32.076 INFO:tasks.workunit.client.0.smithi012.stdout:8/145: stat d9/dc 0 2024-02-14T13:10:32.076 INFO:tasks.workunit.client.0.smithi012.stdout:8/146: chown d9/dc/d14/d23/c25 5947439 1 2024-02-14T13:10:32.076 INFO:tasks.workunit.client.0.smithi012.stdout:8/147: fsync d9/dc/d14/f24 0 2024-02-14T13:10:32.077 INFO:tasks.workunit.client.0.smithi012.stdout:5/182: symlink dc/d17/l3b 0 2024-02-14T13:10:32.077 INFO:tasks.workunit.client.0.smithi012.stdout:8/148: dread d9/dc/f26 [0,4194304] 0 2024-02-14T13:10:32.077 INFO:tasks.workunit.client.0.smithi012.stdout:7/107: dwrite df/f23 [0,4194304] 0 2024-02-14T13:10:32.084 INFO:tasks.workunit.client.0.smithi012.stdout:8/149: creat d9/dc/f2c x:0 0 0 2024-02-14T13:10:32.084 INFO:tasks.workunit.client.0.smithi012.stdout:8/150: write f8 [3229229,61616] 0 2024-02-14T13:10:32.084 INFO:tasks.workunit.client.0.smithi012.stdout:8/151: write d9/dc/f26 [1455119,112977] 0 2024-02-14T13:10:32.087 INFO:tasks.workunit.client.0.smithi012.stdout:7/108: rename df/f19 to df/d24/f29 0 2024-02-14T13:10:32.088 INFO:tasks.workunit.client.0.smithi012.stdout:2/105: mknod d0/d20/c29 0 2024-02-14T13:10:32.088 INFO:tasks.workunit.client.0.smithi012.stdout:2/106: write d0/d20/f19 [1155907,53602] 0 2024-02-14T13:10:32.088 INFO:tasks.workunit.client.0.smithi012.stdout:2/107: fdatasync d0/d8/d11/f27 0 2024-02-14T13:10:32.088 INFO:tasks.workunit.client.0.smithi012.stdout:9/152: dwrite da/dd/d19/d30/d20/f2e [0,4194304] 0 2024-02-14T13:10:32.089 INFO:tasks.workunit.client.0.smithi012.stdout:0/141: dwrite d10/d14/d20/d21/f26 [0,4194304] 0 2024-02-14T13:10:32.089 INFO:tasks.workunit.client.0.smithi012.stdout:6/93: dwrite d1/f5 [0,4194304] 0 2024-02-14T13:10:32.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/94: read - d1/d1e/dc/f1d zero size 2024-02-14T13:10:32.090 INFO:tasks.workunit.client.0.smithi012.stdout:2/108: unlink d0/d6/de/l28 0 2024-02-14T13:10:32.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/153: creat da/dd/d19/d30/d20/f31 x:0 0 0 2024-02-14T13:10:32.097 INFO:tasks.workunit.client.0.smithi012.stdout:0/142: truncate d10/f17 1330270 0 2024-02-14T13:10:32.098 INFO:tasks.workunit.client.0.smithi012.stdout:7/109: dread df/f11 [4194304,4194304] 0 2024-02-14T13:10:32.098 INFO:tasks.workunit.client.0.smithi012.stdout:7/110: write df/f26 [895977,37141] 0 2024-02-14T13:10:32.099 INFO:tasks.workunit.client.0.smithi012.stdout:6/95: truncate d1/f3 707364 0 2024-02-14T13:10:32.101 INFO:tasks.workunit.client.0.smithi012.stdout:2/109: link d0/d8/d11/c14 d0/d20/c2a 0 2024-02-14T13:10:32.101 INFO:tasks.workunit.client.0.smithi012.stdout:2/110: chown d0/d8/d11/l1d 120 1 2024-02-14T13:10:32.102 INFO:tasks.workunit.client.0.smithi012.stdout:9/154: creat da/dd/d18/f32 x:0 0 0 2024-02-14T13:10:32.102 INFO:tasks.workunit.client.0.smithi012.stdout:9/155: write da/dd/d18/f22 [937233,90213] 0 2024-02-14T13:10:32.103 INFO:tasks.workunit.client.0.smithi012.stdout:0/143: truncate d10/d14/f15 73767 0 2024-02-14T13:10:32.104 INFO:tasks.workunit.client.0.smithi012.stdout:7/111: symlink df/d24/l2a 0 2024-02-14T13:10:32.106 INFO:tasks.workunit.client.0.smithi012.stdout:6/96: creat d1/d1e/d1b/f1f x:0 0 0 2024-02-14T13:10:32.108 INFO:tasks.workunit.client.0.smithi012.stdout:9/156: mkdir da/d33 0 2024-02-14T13:10:32.108 INFO:tasks.workunit.client.0.smithi012.stdout:9/157: chown da/dd/c25 33351525 1 2024-02-14T13:10:32.109 INFO:tasks.workunit.client.0.smithi012.stdout:5/183: rmdir dc 39 2024-02-14T13:10:32.109 INFO:tasks.workunit.client.0.smithi012.stdout:5/184: write f0 [3387361,126362] 0 2024-02-14T13:10:32.112 INFO:tasks.workunit.client.0.smithi012.stdout:9/158: rename da/cb to da/dd/d19/d30/d20/c34 0 2024-02-14T13:10:32.114 INFO:tasks.workunit.client.0.smithi012.stdout:3/100: sync 2024-02-14T13:10:32.114 INFO:tasks.workunit.client.0.smithi012.stdout:1/160: sync 2024-02-14T13:10:32.114 INFO:tasks.workunit.client.0.smithi012.stdout:2/111: dread d0/f2 [4194304,4194304] 0 2024-02-14T13:10:32.114 INFO:tasks.workunit.client.0.smithi012.stdout:2/112: read - d0/d8/d11/f27 zero size 2024-02-14T13:10:32.116 INFO:tasks.workunit.client.0.smithi012.stdout:3/101: mkdir d9/dd/d27 0 2024-02-14T13:10:32.117 INFO:tasks.workunit.client.0.smithi012.stdout:2/113: truncate d0/f2 6497428 0 2024-02-14T13:10:32.119 INFO:tasks.workunit.client.0.smithi012.stdout:3/102: mkdir d9/d13/d28 0 2024-02-14T13:10:32.119 INFO:tasks.workunit.client.0.smithi012.stdout:3/103: read f1 [2708,77227] 0 2024-02-14T13:10:32.119 INFO:tasks.workunit.client.0.smithi012.stdout:9/159: dread da/fc [0,4194304] 0 2024-02-14T13:10:32.120 INFO:tasks.workunit.client.0.smithi012.stdout:2/114: rmdir d0/d8 39 2024-02-14T13:10:32.120 INFO:tasks.workunit.client.0.smithi012.stdout:2/115: stat d0/d8/c16 0 2024-02-14T13:10:32.120 INFO:tasks.workunit.client.0.smithi012.stdout:2/116: fdatasync d0/d5/fd 0 2024-02-14T13:10:32.122 INFO:tasks.workunit.client.0.smithi012.stdout:3/104: creat d9/dd/d27/f29 x:0 0 0 2024-02-14T13:10:32.122 INFO:tasks.workunit.client.0.smithi012.stdout:3/105: write d9/dd/f24 [136019,2673] 0 2024-02-14T13:10:32.122 INFO:tasks.workunit.client.0.smithi012.stdout:3/106: chown d9/d18/f1c 13845091 1 2024-02-14T13:10:32.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/144: dwrite d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:32.129 INFO:tasks.workunit.client.0.smithi012.stdout:3/107: rename l6 to d9/d13/l2a 0 2024-02-14T13:10:32.129 INFO:tasks.workunit.client.0.smithi012.stdout:2/117: rename d0/d1a to d0/d1a/d2b 22 2024-02-14T13:10:32.129 INFO:tasks.workunit.client.0.smithi012.stdout:2/118: chown d0/d8/d11/l1d 47408265 1 2024-02-14T13:10:32.129 INFO:tasks.workunit.client.0.smithi012.stdout:2/119: truncate d0/d20/f23 306450 0 2024-02-14T13:10:32.131 INFO:tasks.workunit.client.0.smithi012.stdout:4/124: sync 2024-02-14T13:10:32.132 INFO:tasks.workunit.client.0.smithi012.stdout:7/112: dwrite df/f15 [0,4194304] 0 2024-02-14T13:10:32.134 INFO:tasks.workunit.client.0.smithi012.stdout:2/120: truncate d0/d20/f19 1860071 0 2024-02-14T13:10:32.136 INFO:tasks.workunit.client.0.smithi012.stdout:0/145: read fc [618301,32172] 0 2024-02-14T13:10:32.138 INFO:tasks.workunit.client.0.smithi012.stdout:7/113: unlink df/f12 0 2024-02-14T13:10:32.139 INFO:tasks.workunit.client.0.smithi012.stdout:4/125: symlink d0/l2c 0 2024-02-14T13:10:32.141 INFO:tasks.workunit.client.0.smithi012.stdout:2/121: mknod d0/d6/de/c2c 0 2024-02-14T13:10:32.143 INFO:tasks.workunit.client.0.smithi012.stdout:6/97: unlink d1/f3 0 2024-02-14T13:10:32.144 INFO:tasks.workunit.client.0.smithi012.stdout:6/98: write d1/d1e/d1b/f1f [111482,45463] 0 2024-02-14T13:10:32.145 INFO:tasks.workunit.client.0.smithi012.stdout:0/146: rename d10/d14/d1b/c19 to d10/d14/d23/c27 0 2024-02-14T13:10:32.145 INFO:tasks.workunit.client.0.smithi012.stdout:0/147: truncate d10/f17 1644119 0 2024-02-14T13:10:32.146 INFO:tasks.workunit.client.0.smithi012.stdout:7/114: creat df/d27/f2b x:0 0 0 2024-02-14T13:10:32.148 INFO:tasks.workunit.client.0.smithi012.stdout:2/122: truncate d0/d8/d11/f17 628680 0 2024-02-14T13:10:32.149 INFO:tasks.workunit.client.0.smithi012.stdout:6/99: creat d1/d1e/f20 x:0 0 0 2024-02-14T13:10:32.150 INFO:tasks.workunit.client.0.smithi012.stdout:7/115: creat df/f2c x:0 0 0 2024-02-14T13:10:32.150 INFO:tasks.workunit.client.0.smithi012.stdout:7/116: truncate f5 4780294 0 2024-02-14T13:10:32.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/117: mkdir df/d2d 0 2024-02-14T13:10:32.154 INFO:tasks.workunit.client.0.smithi012.stdout:7/118: creat df/f2e x:0 0 0 2024-02-14T13:10:32.156 INFO:tasks.workunit.client.0.smithi012.stdout:5/185: dwrite f0 [0,4194304] 0 2024-02-14T13:10:32.156 INFO:tasks.workunit.client.0.smithi012.stdout:1/161: dwrite d6/d10/f23 [0,4194304] 0 2024-02-14T13:10:32.156 INFO:tasks.workunit.client.0.smithi012.stdout:0/148: dread d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:32.156 INFO:tasks.workunit.client.0.smithi012.stdout:7/119: write df/f26 [318474,110589] 0 2024-02-14T13:10:32.157 INFO:tasks.workunit.client.0.smithi012.stdout:7/120: truncate df/f2e 28129 0 2024-02-14T13:10:32.157 INFO:tasks.workunit.client.0.smithi012.stdout:7/121: truncate df/f20 4545988 0 2024-02-14T13:10:32.157 INFO:tasks.workunit.client.0.smithi012.stdout:7/122: write df/f2e [100649,119794] 0 2024-02-14T13:10:32.157 INFO:tasks.workunit.client.0.smithi012.stdout:5/186: dread dc/d17/d20/f2d [0,4194304] 0 2024-02-14T13:10:32.159 INFO:tasks.workunit.client.0.smithi012.stdout:1/162: mkdir d6/d35 0 2024-02-14T13:10:32.161 INFO:tasks.workunit.client.0.smithi012.stdout:0/149: dread d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:32.161 INFO:tasks.workunit.client.0.smithi012.stdout:1/163: write d6/fc [610299,55614] 0 2024-02-14T13:10:32.162 INFO:tasks.workunit.client.0.smithi012.stdout:5/187: rename la to dc/d17/l3c 0 2024-02-14T13:10:32.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/188: symlink dc/d17/d20/l3d 0 2024-02-14T13:10:32.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/189: write dc/d17/f2c [415987,46718] 0 2024-02-14T13:10:32.168 INFO:tasks.workunit.client.0.smithi012.stdout:6/100: dwrite d1/d1e/dc/fe [0,4194304] 0 2024-02-14T13:10:32.168 INFO:tasks.workunit.client.0.smithi012.stdout:6/101: write d1/d1e/f20 [888989,123453] 0 2024-02-14T13:10:32.168 INFO:tasks.workunit.client.0.smithi012.stdout:7/123: write df/f20 [2290296,4498] 0 2024-02-14T13:10:32.170 INFO:tasks.workunit.client.0.smithi012.stdout:7/124: rename df/l1b to df/d24/l2f 0 2024-02-14T13:10:32.172 INFO:tasks.workunit.client.0.smithi012.stdout:1/164: dread d6/d10/f23 [0,4194304] 0 2024-02-14T13:10:32.177 INFO:tasks.workunit.client.0.smithi012.stdout:6/102: dread d1/d1e/dc/fe [0,4194304] 0 2024-02-14T13:10:32.177 INFO:tasks.workunit.client.0.smithi012.stdout:6/103: readlink d1/d1e/dc/l18 0 2024-02-14T13:10:32.180 INFO:tasks.workunit.client.0.smithi012.stdout:6/104: dread d1/d1e/dc/fe [0,4194304] 0 2024-02-14T13:10:32.180 INFO:tasks.workunit.client.0.smithi012.stdout:5/190: dwrite dc/d17/f27 [0,4194304] 0 2024-02-14T13:10:32.182 INFO:tasks.workunit.client.0.smithi012.stdout:6/105: mkdir d1/d1e/d1b/d21 0 2024-02-14T13:10:32.182 INFO:tasks.workunit.client.0.smithi012.stdout:6/106: stat d1/df/d16 0 2024-02-14T13:10:32.185 INFO:tasks.workunit.client.0.smithi012.stdout:5/191: mkdir dc/d2f/d3e 0 2024-02-14T13:10:32.186 INFO:tasks.workunit.client.0.smithi012.stdout:6/107: mknod d1/c22 0 2024-02-14T13:10:32.188 INFO:tasks.workunit.client.0.smithi012.stdout:7/125: getdents df 0 2024-02-14T13:10:32.189 INFO:tasks.workunit.client.0.smithi012.stdout:7/126: rename df/f2e to df/f30 0 2024-02-14T13:10:32.189 INFO:tasks.workunit.client.0.smithi012.stdout:7/127: read - df/f1f zero size 2024-02-14T13:10:32.192 INFO:tasks.workunit.client.0.smithi012.stdout:7/128: creat df/d24/f31 x:0 0 0 2024-02-14T13:10:32.194 INFO:tasks.workunit.client.0.smithi012.stdout:5/192: write f6 [109884,79778] 0 2024-02-14T13:10:32.194 INFO:tasks.workunit.client.0.smithi012.stdout:5/193: stat c9 0 2024-02-14T13:10:32.195 INFO:tasks.workunit.client.0.smithi012.stdout:7/129: rename df/f17 to df/d2d/f32 0 2024-02-14T13:10:32.195 INFO:tasks.workunit.client.0.smithi012.stdout:5/194: read dc/d17/d20/f2d [35331,71130] 0 2024-02-14T13:10:32.196 INFO:tasks.workunit.client.0.smithi012.stdout:7/130: creat df/f33 x:0 0 0 2024-02-14T13:10:32.197 INFO:tasks.workunit.client.0.smithi012.stdout:1/165: dwrite d6/d12/f2d [0,4194304] 0 2024-02-14T13:10:32.199 INFO:tasks.workunit.client.0.smithi012.stdout:7/131: rename df/d24/l2f to df/d27/l34 0 2024-02-14T13:10:32.200 INFO:tasks.workunit.client.0.smithi012.stdout:1/166: creat d6/d12/d15/f36 x:0 0 0 2024-02-14T13:10:32.204 INFO:tasks.workunit.client.0.smithi012.stdout:6/108: dwrite d1/f4 [0,4194304] 0 2024-02-14T13:10:32.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/109: creat d1/d1e/d1b/f23 x:0 0 0 2024-02-14T13:10:32.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/110: chown d1/df/d16/f1a 16471671 1 2024-02-14T13:10:32.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/111: dread - d1/df/d16/f1a zero size 2024-02-14T13:10:32.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/112: write d1/d1e/d1b/f23 [680608,125662] 0 2024-02-14T13:10:32.209 INFO:tasks.workunit.client.0.smithi012.stdout:7/132: read df/d2d/f32 [866540,113055] 0 2024-02-14T13:10:32.209 INFO:tasks.workunit.client.0.smithi012.stdout:7/133: chown df 203 1 2024-02-14T13:10:32.209 INFO:tasks.workunit.client.0.smithi012.stdout:5/195: dwrite dc/f29 [0,4194304] 0 2024-02-14T13:10:32.211 INFO:tasks.workunit.client.0.smithi012.stdout:7/134: dread - df/f2c zero size 2024-02-14T13:10:32.212 INFO:tasks.workunit.client.0.smithi012.stdout:5/196: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:32.213 INFO:tasks.workunit.client.0.smithi012.stdout:5/197: dread - dc/d17/d20/f3a zero size 2024-02-14T13:10:32.218 INFO:tasks.workunit.client.0.smithi012.stdout:7/135: link fe df/d24/f35 0 2024-02-14T13:10:32.220 INFO:tasks.workunit.client.0.smithi012.stdout:7/136: readlink df/l16 0 2024-02-14T13:10:32.225 INFO:tasks.workunit.client.0.smithi012.stdout:6/113: dread d1/f5 [0,4194304] 0 2024-02-14T13:10:32.225 INFO:tasks.workunit.client.0.smithi012.stdout:1/167: dwrite d6/d12/f2b [0,4194304] 0 2024-02-14T13:10:32.225 INFO:tasks.workunit.client.0.smithi012.stdout:1/168: write d6/d12/d15/f1d [615661,96579] 0 2024-02-14T13:10:32.225 INFO:tasks.workunit.client.0.smithi012.stdout:1/169: dread - d6/d12/f29 zero size 2024-02-14T13:10:32.225 INFO:tasks.workunit.client.0.smithi012.stdout:1/170: read d6/ff [2771282,28618] 0 2024-02-14T13:10:32.226 INFO:tasks.workunit.client.0.smithi012.stdout:7/137: stat df/c10 0 2024-02-14T13:10:32.230 INFO:tasks.workunit.client.0.smithi012.stdout:1/171: mknod d6/d35/c37 0 2024-02-14T13:10:32.232 INFO:tasks.workunit.client.0.smithi012.stdout:1/172: creat d6/d12/f38 x:0 0 0 2024-02-14T13:10:32.232 INFO:tasks.workunit.client.0.smithi012.stdout:1/173: truncate d6/d10/f21 213114 0 2024-02-14T13:10:32.233 INFO:tasks.workunit.client.0.smithi012.stdout:7/138: mkdir df/d36 0 2024-02-14T13:10:32.233 INFO:tasks.workunit.client.0.smithi012.stdout:5/198: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:32.234 INFO:tasks.workunit.client.0.smithi012.stdout:1/174: mknod d6/d10/d22/d31/c39 0 2024-02-14T13:10:32.235 INFO:tasks.workunit.client.0.smithi012.stdout:7/139: mknod df/d36/c37 0 2024-02-14T13:10:32.236 INFO:tasks.workunit.client.0.smithi012.stdout:5/199: creat dc/d17/f3f x:0 0 0 2024-02-14T13:10:32.238 INFO:tasks.workunit.client.0.smithi012.stdout:1/175: creat d6/d10/f3a x:0 0 0 2024-02-14T13:10:32.239 INFO:tasks.workunit.client.0.smithi012.stdout:7/140: creat df/d24/f38 x:0 0 0 2024-02-14T13:10:32.239 INFO:tasks.workunit.client.0.smithi012.stdout:7/141: write df/f1f [650684,87670] 0 2024-02-14T13:10:32.240 INFO:tasks.workunit.client.0.smithi012.stdout:1/176: mkdir d6/d10/d22/d31/d34/d3b 0 2024-02-14T13:10:32.240 INFO:tasks.workunit.client.0.smithi012.stdout:1/177: chown d6/d12/f29 230 1 2024-02-14T13:10:32.240 INFO:tasks.workunit.client.0.smithi012.stdout:6/114: dwrite d1/f4 [0,4194304] 0 2024-02-14T13:10:32.241 INFO:tasks.workunit.client.0.smithi012.stdout:1/178: unlink d6/c20 0 2024-02-14T13:10:32.242 INFO:tasks.workunit.client.0.smithi012.stdout:7/142: dread f5 [0,4194304] 0 2024-02-14T13:10:32.242 INFO:tasks.workunit.client.0.smithi012.stdout:7/143: fsync df/d24/f25 0 2024-02-14T13:10:32.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/115: mkdir d1/df/d24 0 2024-02-14T13:10:32.244 INFO:tasks.workunit.client.0.smithi012.stdout:1/179: dread d6/fc [0,4194304] 0 2024-02-14T13:10:32.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/116: write d1/d1e/dc/f15 [829339,36099] 0 2024-02-14T13:10:32.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/117: rename d1/df/d16 to d1/df/d16/d25 22 2024-02-14T13:10:32.244 INFO:tasks.workunit.client.0.smithi012.stdout:7/144: creat df/d36/f39 x:0 0 0 2024-02-14T13:10:32.247 INFO:tasks.workunit.client.0.smithi012.stdout:6/118: rename d1/df/c12 to d1/d1e/dc/c26 0 2024-02-14T13:10:32.247 INFO:tasks.workunit.client.0.smithi012.stdout:6/119: chown d1/d1e/d1b/d21 29973 1 2024-02-14T13:10:32.247 INFO:tasks.workunit.client.0.smithi012.stdout:6/120: getdents d1/d1e/d1b/d21 0 2024-02-14T13:10:32.247 INFO:tasks.workunit.client.0.smithi012.stdout:6/121: truncate d1/d1e/dc/f1d 161175 0 2024-02-14T13:10:32.248 INFO:tasks.workunit.client.0.smithi012.stdout:7/145: creat df/d36/f3a x:0 0 0 2024-02-14T13:10:32.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/122: creat d1/df/d24/f27 x:0 0 0 2024-02-14T13:10:32.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/123: chown d1/d17 4144088 1 2024-02-14T13:10:32.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/124: readlink d1/d1e/dc/l18 0 2024-02-14T13:10:32.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/125: chown d1/d1e/dc 167 1 2024-02-14T13:10:32.250 INFO:tasks.workunit.client.0.smithi012.stdout:7/146: rmdir df/d2d 39 2024-02-14T13:10:32.251 INFO:tasks.workunit.client.0.smithi012.stdout:6/126: mkdir d1/d1e/dc/d28 0 2024-02-14T13:10:32.251 INFO:tasks.workunit.client.0.smithi012.stdout:5/200: rmdir dc/d17 39 2024-02-14T13:10:32.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/147: creat df/f3b x:0 0 0 2024-02-14T13:10:32.254 INFO:tasks.workunit.client.0.smithi012.stdout:5/201: mkdir dc/d2f/d40 0 2024-02-14T13:10:32.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/127: dread d1/d1e/f20 [0,4194304] 0 2024-02-14T13:10:32.254 INFO:tasks.workunit.client.0.smithi012.stdout:6/128: getdents d1/d17 0 2024-02-14T13:10:32.254 INFO:tasks.workunit.client.0.smithi012.stdout:7/148: creat df/d36/f3c x:0 0 0 2024-02-14T13:10:32.255 INFO:tasks.workunit.client.0.smithi012.stdout:7/149: fsync df/d24/f38 0 2024-02-14T13:10:32.255 INFO:tasks.workunit.client.0.smithi012.stdout:5/202: creat dc/d17/f41 x:0 0 0 2024-02-14T13:10:32.256 INFO:tasks.workunit.client.0.smithi012.stdout:5/203: link dc/d17/f3f dc/d17/d20/f42 0 2024-02-14T13:10:32.257 INFO:tasks.workunit.client.0.smithi012.stdout:5/204: creat dc/d17/f43 x:0 0 0 2024-02-14T13:10:32.257 INFO:tasks.workunit.client.0.smithi012.stdout:5/205: truncate dc/d17/f41 333641 0 2024-02-14T13:10:32.258 INFO:tasks.workunit.client.0.smithi012.stdout:8/152: sync 2024-02-14T13:10:32.261 INFO:tasks.workunit.client.0.smithi012.stdout:8/153: mknod d9/dc/d14/d23/c2d 0 2024-02-14T13:10:32.262 INFO:tasks.workunit.client.0.smithi012.stdout:8/154: stat d9/dc/d14/c1c 0 2024-02-14T13:10:32.264 INFO:tasks.workunit.client.0.smithi012.stdout:8/155: unlink d9/dc/d14/f24 0 2024-02-14T13:10:32.264 INFO:tasks.workunit.client.0.smithi012.stdout:8/156: chown c7 27639 1 2024-02-14T13:10:32.265 INFO:tasks.workunit.client.0.smithi012.stdout:8/157: rmdir d9/dc/d14/d23 39 2024-02-14T13:10:32.269 INFO:tasks.workunit.client.0.smithi012.stdout:8/158: mkdir d9/dc/d14/d2e 0 2024-02-14T13:10:32.271 INFO:tasks.workunit.client.0.smithi012.stdout:8/159: symlink d9/dc/d1b/l2f 0 2024-02-14T13:10:32.272 INFO:tasks.workunit.client.0.smithi012.stdout:8/160: mknod d9/dc/c30 0 2024-02-14T13:10:32.273 INFO:tasks.workunit.client.0.smithi012.stdout:7/150: dwrite df/d36/f3c [0,4194304] 0 2024-02-14T13:10:32.273 INFO:tasks.workunit.client.0.smithi012.stdout:8/161: creat d9/dc/d14/f31 x:0 0 0 2024-02-14T13:10:32.274 INFO:tasks.workunit.client.0.smithi012.stdout:8/162: chown d9/c1a 1860477 1 2024-02-14T13:10:32.274 INFO:tasks.workunit.client.0.smithi012.stdout:8/163: chown d9/dc/d14/c1c 937688236 1 2024-02-14T13:10:32.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/164: symlink d9/l32 0 2024-02-14T13:10:32.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/165: write d9/dc/d1b/f1e [4858418,37249] 0 2024-02-14T13:10:32.280 INFO:tasks.workunit.client.0.smithi012.stdout:8/166: symlink d9/dc/d1b/l33 0 2024-02-14T13:10:32.282 INFO:tasks.workunit.client.0.smithi012.stdout:8/167: symlink d9/dc/d1b/l34 0 2024-02-14T13:10:32.283 INFO:tasks.workunit.client.0.smithi012.stdout:8/168: dread d9/dc/d1b/f21 [0,4194304] 0 2024-02-14T13:10:32.283 INFO:tasks.workunit.client.0.smithi012.stdout:8/169: chown d9/c1d 6 1 2024-02-14T13:10:32.283 INFO:tasks.workunit.client.0.smithi012.stdout:8/170: readlink d9/dc/d1b/l34 0 2024-02-14T13:10:32.284 INFO:tasks.workunit.client.0.smithi012.stdout:6/129: dwrite d1/f4 [0,4194304] 0 2024-02-14T13:10:32.284 INFO:tasks.workunit.client.0.smithi012.stdout:8/171: mkdir d9/dc/d1b/d35 0 2024-02-14T13:10:32.284 INFO:tasks.workunit.client.0.smithi012.stdout:5/206: dwrite dc/d17/f24 [0,4194304] 0 2024-02-14T13:10:32.286 INFO:tasks.workunit.client.0.smithi012.stdout:6/130: mknod d1/d1e/c29 0 2024-02-14T13:10:32.286 INFO:tasks.workunit.client.0.smithi012.stdout:7/151: rmdir df 39 2024-02-14T13:10:32.286 INFO:tasks.workunit.client.0.smithi012.stdout:7/152: write df/d24/f25 [417281,96253] 0 2024-02-14T13:10:32.287 INFO:tasks.workunit.client.0.smithi012.stdout:8/172: rmdir d9/dc/d14/d23 39 2024-02-14T13:10:32.289 INFO:tasks.workunit.client.0.smithi012.stdout:6/131: dread d1/d1e/d1b/f1f [0,4194304] 0 2024-02-14T13:10:32.290 INFO:tasks.workunit.client.0.smithi012.stdout:7/153: dread df/f1f [0,4194304] 0 2024-02-14T13:10:32.290 INFO:tasks.workunit.client.0.smithi012.stdout:7/154: fdatasync df/d27/f28 0 2024-02-14T13:10:32.292 INFO:tasks.workunit.client.0.smithi012.stdout:5/207: symlink dc/d17/d20/l44 0 2024-02-14T13:10:32.295 INFO:tasks.workunit.client.0.smithi012.stdout:7/155: symlink df/d27/l3d 0 2024-02-14T13:10:32.296 INFO:tasks.workunit.client.0.smithi012.stdout:7/156: getdents df 0 2024-02-14T13:10:32.296 INFO:tasks.workunit.client.0.smithi012.stdout:8/173: dread d9/dc/d14/f15 [4194304,4194304] 0 2024-02-14T13:10:32.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/174: unlink d9/ce 0 2024-02-14T13:10:32.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/175: write d9/dc/f19 [350080,76817] 0 2024-02-14T13:10:32.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/176: fdatasync d9/dc/d14/f15 0 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:2/123: sync 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:4/126: sync 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:0/150: sync 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:8/177: dread d9/dc/d1b/f20 [0,4194304] 0 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:9/160: sync 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:3/108: sync 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:8/178: stat d9/dc/d1b/d35 0 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:2/124: dread - d0/d8/d11/f27 zero size 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:0/151: truncate d10/d14/f15 728590 0 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:8/179: chown d9/dc/d1b/f1e 214565255 1 2024-02-14T13:10:32.301 INFO:tasks.workunit.client.0.smithi012.stdout:8/180: write d9/dc/d1b/f20 [72353,77059] 0 2024-02-14T13:10:32.304 INFO:tasks.workunit.client.0.smithi012.stdout:8/181: symlink d9/l36 0 2024-02-14T13:10:32.304 INFO:tasks.workunit.client.0.smithi012.stdout:8/182: stat c0 0 2024-02-14T13:10:32.304 INFO:tasks.workunit.client.0.smithi012.stdout:8/183: rename d9/dc to d9/dc/d1b/d35/d37 22 2024-02-14T13:10:32.304 INFO:tasks.workunit.client.0.smithi012.stdout:2/125: mkdir d0/d2d 0 2024-02-14T13:10:32.306 INFO:tasks.workunit.client.0.smithi012.stdout:2/126: rename d0/d20/c1c to d0/d5/c2e 0 2024-02-14T13:10:32.306 INFO:tasks.workunit.client.0.smithi012.stdout:2/127: stat d0/d6 0 2024-02-14T13:10:32.308 INFO:tasks.workunit.client.0.smithi012.stdout:2/128: rename d0/d20/f19 to d0/f2f 0 2024-02-14T13:10:32.308 INFO:tasks.workunit.client.0.smithi012.stdout:2/129: chown d0/d8/d12/d26 661 1 2024-02-14T13:10:32.308 INFO:tasks.workunit.client.0.smithi012.stdout:2/130: fdatasync d0/d20/f23 0 2024-02-14T13:10:32.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/131: creat d0/d8/f30 x:0 0 0 2024-02-14T13:10:32.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/132: chown d0/d1a 1384323 1 2024-02-14T13:10:32.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/133: write d0/d8/d11/f17 [1472263,56587] 0 2024-02-14T13:10:32.310 INFO:tasks.workunit.client.0.smithi012.stdout:9/161: dread da/dd/d19/d30/d20/f2e [0,4194304] 0 2024-02-14T13:10:32.310 INFO:tasks.workunit.client.0.smithi012.stdout:9/162: truncate da/dd/d19/d30/d20/f2e 4687513 0 2024-02-14T13:10:32.311 INFO:tasks.workunit.client.0.smithi012.stdout:2/134: creat d0/d8/f31 x:0 0 0 2024-02-14T13:10:32.311 INFO:tasks.workunit.client.0.smithi012.stdout:2/135: write d0/d8/d11/f17 [2183108,73030] 0 2024-02-14T13:10:32.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/136: write d0/d5/fd [4543034,109459] 0 2024-02-14T13:10:32.315 INFO:tasks.workunit.client.0.smithi012.stdout:2/137: creat d0/d8/d11/f32 x:0 0 0 2024-02-14T13:10:32.317 INFO:tasks.workunit.client.0.smithi012.stdout:0/152: truncate d10/d14/f15 224776 0 2024-02-14T13:10:32.322 INFO:tasks.workunit.client.0.smithi012.stdout:2/138: mkdir d0/d8/d11/d33 0 2024-02-14T13:10:32.323 INFO:tasks.workunit.client.0.smithi012.stdout:2/139: read d0/d20/f23 [231559,36491] 0 2024-02-14T13:10:32.325 INFO:tasks.workunit.client.0.smithi012.stdout:2/140: creat d0/d20/f34 x:0 0 0 2024-02-14T13:10:32.325 INFO:tasks.workunit.client.0.smithi012.stdout:2/141: write d0/d1a/f25 [707781,85449] 0 2024-02-14T13:10:32.325 INFO:tasks.workunit.client.0.smithi012.stdout:2/142: write d0/d8/d11/f32 [905402,77138] 0 2024-02-14T13:10:32.325 INFO:tasks.workunit.client.0.smithi012.stdout:2/143: write d0/d20/f34 [651895,130225] 0 2024-02-14T13:10:32.328 INFO:tasks.workunit.client.0.smithi012.stdout:9/163: dread f9 [0,4194304] 0 2024-02-14T13:10:32.328 INFO:tasks.workunit.client.0.smithi012.stdout:9/164: chown da 744 1 2024-02-14T13:10:32.328 INFO:tasks.workunit.client.0.smithi012.stdout:9/165: chown f0 13734883 1 2024-02-14T13:10:32.328 INFO:tasks.workunit.client.0.smithi012.stdout:9/166: fdatasync f4 0 2024-02-14T13:10:32.338 INFO:tasks.workunit.client.0.smithi012.stdout:2/144: read d0/d5/fd [2759054,42206] 0 2024-02-14T13:10:32.338 INFO:tasks.workunit.client.0.smithi012.stdout:2/145: chown d0/d1a/f25 16 1 2024-02-14T13:10:32.339 INFO:tasks.workunit.client.0.smithi012.stdout:2/146: mkdir d0/d8/d11/d35 0 2024-02-14T13:10:32.339 INFO:tasks.workunit.client.0.smithi012.stdout:2/147: readlink d0/l22 0 2024-02-14T13:10:32.340 INFO:tasks.workunit.client.0.smithi012.stdout:9/167: write f0 [3378068,124410] 0 2024-02-14T13:10:32.341 INFO:tasks.workunit.client.0.smithi012.stdout:2/148: write d0/d8/d11/f17 [255408,116310] 0 2024-02-14T13:10:32.341 INFO:tasks.workunit.client.0.smithi012.stdout:9/168: symlink da/dd/l35 0 2024-02-14T13:10:32.342 INFO:tasks.workunit.client.0.smithi012.stdout:2/149: symlink d0/d20/l36 0 2024-02-14T13:10:32.342 INFO:tasks.workunit.client.0.smithi012.stdout:2/150: stat d0/f2 0 2024-02-14T13:10:32.342 INFO:tasks.workunit.client.0.smithi012.stdout:2/151: write d0/d1a/f25 [711556,9845] 0 2024-02-14T13:10:32.342 INFO:tasks.workunit.client.0.smithi012.stdout:8/184: dwrite d9/dc/d1b/f27 [0,4194304] 0 2024-02-14T13:10:32.342 INFO:tasks.workunit.client.0.smithi012.stdout:8/185: chown d9/c16 13 1 2024-02-14T13:10:32.343 INFO:tasks.workunit.client.0.smithi012.stdout:3/109: dwrite d9/d13/f20 [0,4194304] 0 2024-02-14T13:10:32.343 INFO:tasks.workunit.client.0.smithi012.stdout:0/153: dwrite d10/d14/f1e [0,4194304] 0 2024-02-14T13:10:32.344 INFO:tasks.workunit.client.0.smithi012.stdout:2/152: truncate d0/f2f 842945 0 2024-02-14T13:10:32.344 INFO:tasks.workunit.client.0.smithi012.stdout:2/153: write d0/d8/d11/f17 [3150417,16156] 0 2024-02-14T13:10:32.346 INFO:tasks.workunit.client.0.smithi012.stdout:8/186: mkdir d9/dc/d38 0 2024-02-14T13:10:32.351 INFO:tasks.workunit.client.0.smithi012.stdout:2/154: mkdir d0/d6/d37 0 2024-02-14T13:10:32.352 INFO:tasks.workunit.client.0.smithi012.stdout:2/155: write d0/d8/f31 [769359,124026] 0 2024-02-14T13:10:32.354 INFO:tasks.workunit.client.0.smithi012.stdout:2/156: creat d0/d8/d11/d33/f38 x:0 0 0 2024-02-14T13:10:32.354 INFO:tasks.workunit.client.0.smithi012.stdout:4/127: dwrite d0/f1a [0,4194304] 0 2024-02-14T13:10:32.354 INFO:tasks.workunit.client.0.smithi012.stdout:8/187: dread f8 [4194304,4194304] 0 2024-02-14T13:10:32.356 INFO:tasks.workunit.client.0.smithi012.stdout:0/154: read d10/d14/f15 [12527,74189] 0 2024-02-14T13:10:32.359 INFO:tasks.workunit.client.0.smithi012.stdout:8/188: rename d9/dc/f26 to d9/dc/d14/d23/f39 0 2024-02-14T13:10:32.366 INFO:tasks.workunit.client.0.smithi012.stdout:8/189: mknod d9/dc/d14/d2e/c3a 0 2024-02-14T13:10:32.369 INFO:tasks.workunit.client.0.smithi012.stdout:2/157: write d0/f2 [3273690,33664] 0 2024-02-14T13:10:32.369 INFO:tasks.workunit.client.0.smithi012.stdout:9/169: dwrite da/dd/f1e [0,4194304] 0 2024-02-14T13:10:32.369 INFO:tasks.workunit.client.0.smithi012.stdout:9/170: chown da/dd/d19/c27 1614 1 2024-02-14T13:10:32.371 INFO:tasks.workunit.client.0.smithi012.stdout:2/158: dread d0/d20/f23 [0,4194304] 0 2024-02-14T13:10:32.371 INFO:tasks.workunit.client.0.smithi012.stdout:8/190: truncate d9/dc/d14/f1f 152888 0 2024-02-14T13:10:32.371 INFO:tasks.workunit.client.0.smithi012.stdout:8/191: fsync d9/dc/d1b/f1e 0 2024-02-14T13:10:32.374 INFO:tasks.workunit.client.0.smithi012.stdout:9/171: creat da/d33/f36 x:0 0 0 2024-02-14T13:10:32.374 INFO:tasks.workunit.client.0.smithi012.stdout:9/172: write f0 [2988824,16065] 0 2024-02-14T13:10:32.375 INFO:tasks.workunit.client.0.smithi012.stdout:2/159: mkdir d0/d5/d39 0 2024-02-14T13:10:32.377 INFO:tasks.workunit.client.0.smithi012.stdout:9/173: mknod da/d33/c37 0 2024-02-14T13:10:32.379 INFO:tasks.workunit.client.0.smithi012.stdout:2/160: readlink d0/lb 0 2024-02-14T13:10:32.379 INFO:tasks.workunit.client.0.smithi012.stdout:2/161: fdatasync d0/d8/d11/f32 0 2024-02-14T13:10:32.381 INFO:tasks.workunit.client.0.smithi012.stdout:9/174: mkdir da/dd/d38 0 2024-02-14T13:10:32.381 INFO:tasks.workunit.client.0.smithi012.stdout:8/192: write d9/dc/d1b/f27 [1339921,64146] 0 2024-02-14T13:10:32.381 INFO:tasks.workunit.client.0.smithi012.stdout:4/128: dwrite d0/d10/d13/f26 [0,4194304] 0 2024-02-14T13:10:32.384 INFO:tasks.workunit.client.0.smithi012.stdout:9/175: write da/fc [2680709,24679] 0 2024-02-14T13:10:32.385 INFO:tasks.workunit.client.0.smithi012.stdout:8/193: rmdir d9/dc/d1b 39 2024-02-14T13:10:32.386 INFO:tasks.workunit.client.0.smithi012.stdout:2/162: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:32.388 INFO:tasks.workunit.client.0.smithi012.stdout:2/163: creat d0/d8/f3a x:0 0 0 2024-02-14T13:10:32.388 INFO:tasks.workunit.client.0.smithi012.stdout:2/164: write d0/d5/fd [153323,32958] 0 2024-02-14T13:10:32.388 INFO:tasks.workunit.client.0.smithi012.stdout:2/165: fdatasync d0/d8/f31 0 2024-02-14T13:10:32.388 INFO:tasks.workunit.client.0.smithi012.stdout:3/110: dwrite d9/dd/de/f1a [0,4194304] 0 2024-02-14T13:10:32.388 INFO:tasks.workunit.client.0.smithi012.stdout:0/155: dwrite fc [0,4194304] 0 2024-02-14T13:10:32.393 INFO:tasks.workunit.client.0.smithi012.stdout:9/176: dread da/fc [0,4194304] 0 2024-02-14T13:10:32.394 INFO:tasks.workunit.client.0.smithi012.stdout:0/156: rename d10/d14/d20/d21/f26 to d10/d14/d20/d21/f28 0 2024-02-14T13:10:32.395 INFO:tasks.workunit.client.0.smithi012.stdout:3/111: creat d9/d13/f2b x:0 0 0 2024-02-14T13:10:32.396 INFO:tasks.workunit.client.0.smithi012.stdout:9/177: mkdir da/dd/d39 0 2024-02-14T13:10:32.396 INFO:tasks.workunit.client.0.smithi012.stdout:9/178: chown da/dd/d19/d30/f17 6 1 2024-02-14T13:10:32.397 INFO:tasks.workunit.client.0.smithi012.stdout:3/112: symlink d9/l2c 0 2024-02-14T13:10:32.397 INFO:tasks.workunit.client.0.smithi012.stdout:3/113: readlink d9/dd/l10 0 2024-02-14T13:10:32.399 INFO:tasks.workunit.client.0.smithi012.stdout:9/179: rename da/l12 to da/dd/d19/d30/d20/l3a 0 2024-02-14T13:10:32.399 INFO:tasks.workunit.client.0.smithi012.stdout:9/180: readlink l1 0 2024-02-14T13:10:32.399 INFO:tasks.workunit.client.0.smithi012.stdout:9/181: write f7 [261042,58421] 0 2024-02-14T13:10:32.400 INFO:tasks.workunit.client.0.smithi012.stdout:3/114: symlink d9/dd/l2d 0 2024-02-14T13:10:32.400 INFO:tasks.workunit.client.0.smithi012.stdout:3/115: chown d9/lc 23 1 2024-02-14T13:10:32.401 INFO:tasks.workunit.client.0.smithi012.stdout:9/182: mkdir da/dd/d39/d3b 0 2024-02-14T13:10:32.402 INFO:tasks.workunit.client.0.smithi012.stdout:9/183: mknod da/dd/d39/d3b/c3c 0 2024-02-14T13:10:32.402 INFO:tasks.workunit.client.0.smithi012.stdout:9/184: stat da/dd/d19 0 2024-02-14T13:10:32.403 INFO:tasks.workunit.client.0.smithi012.stdout:9/185: rename f7 to da/dd/d39/f3d 0 2024-02-14T13:10:32.404 INFO:tasks.workunit.client.0.smithi012.stdout:9/186: stat da/l11 0 2024-02-14T13:10:32.404 INFO:tasks.workunit.client.0.smithi012.stdout:9/187: stat da/dd/d38 0 2024-02-14T13:10:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:9/188: stat da/le 0 2024-02-14T13:10:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:4/129: dwrite d0/d10/d13/d17/f1c [0,4194304] 0 2024-02-14T13:10:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:1/180: sync 2024-02-14T13:10:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:1/181: stat d6/d10/d22/d31 0 2024-02-14T13:10:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:1/182: fdatasync d6/d10/d22/f2a 0 2024-02-14T13:10:32.405 INFO:tasks.workunit.client.0.smithi012.stdout:1/183: chown d6/fc 13243406 1 2024-02-14T13:10:32.406 INFO:tasks.workunit.client.0.smithi012.stdout:4/130: truncate d0/d10/f24 533484 0 2024-02-14T13:10:32.413 INFO:tasks.workunit.client.0.smithi012.stdout:8/194: dwrite d9/dc/d14/f31 [0,4194304] 0 2024-02-14T13:10:32.415 INFO:tasks.workunit.client.0.smithi012.stdout:2/166: dwrite d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:32.415 INFO:tasks.workunit.client.0.smithi012.stdout:2/167: fsync d0/d8/d11/f27 0 2024-02-14T13:10:32.415 INFO:tasks.workunit.client.0.smithi012.stdout:2/168: fdatasync d0/d20/f23 0 2024-02-14T13:10:32.437 INFO:tasks.workunit.client.0.smithi012.stdout:1/184: dwrite d6/d10/f21 [0,4194304] 0 2024-02-14T13:10:32.437 INFO:tasks.workunit.client.0.smithi012.stdout:0/157: dwrite fc [0,4194304] 0 2024-02-14T13:10:32.438 INFO:tasks.workunit.client.0.smithi012.stdout:0/158: dread d10/f11 [0,4194304] 0 2024-02-14T13:10:32.440 INFO:tasks.workunit.client.0.smithi012.stdout:1/185: symlink d6/d10/d22/d31/d34/d3b/l3c 0 2024-02-14T13:10:32.442 INFO:tasks.workunit.client.0.smithi012.stdout:0/159: mknod d10/d14/d20/c29 0 2024-02-14T13:10:32.443 INFO:tasks.workunit.client.0.smithi012.stdout:0/160: creat d10/f2a x:0 0 0 2024-02-14T13:10:32.456 INFO:tasks.workunit.client.0.smithi012.stdout:4/131: dwrite d0/d10/f2a [0,4194304] 0 2024-02-14T13:10:32.456 INFO:tasks.workunit.client.0.smithi012.stdout:2/169: dwrite d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:32.456 INFO:tasks.workunit.client.0.smithi012.stdout:9/189: dwrite da/dd/d19/d30/d20/f2e [4194304,4194304] 0 2024-02-14T13:10:32.457 INFO:tasks.workunit.client.0.smithi012.stdout:3/116: dwrite d9/dd/f24 [0,4194304] 0 2024-02-14T13:10:32.457 INFO:tasks.workunit.client.0.smithi012.stdout:4/132: creat d0/d10/d13/f2d x:0 0 0 2024-02-14T13:10:32.458 INFO:tasks.workunit.client.0.smithi012.stdout:9/190: dread da/f23 [0,4194304] 0 2024-02-14T13:10:32.461 INFO:tasks.workunit.client.0.smithi012.stdout:3/117: mknod d9/dd/de/c2e 0 2024-02-14T13:10:32.462 INFO:tasks.workunit.client.0.smithi012.stdout:9/191: creat da/dd/d38/f3e x:0 0 0 2024-02-14T13:10:32.462 INFO:tasks.workunit.client.0.smithi012.stdout:9/192: write f0 [1349089,8984] 0 2024-02-14T13:10:32.463 INFO:tasks.workunit.client.0.smithi012.stdout:9/193: unlink da/dd/f1e 0 2024-02-14T13:10:32.463 INFO:tasks.workunit.client.0.smithi012.stdout:9/194: fsync da/dd/d19/d30/d20/f31 0 2024-02-14T13:10:32.465 INFO:tasks.workunit.client.0.smithi012.stdout:4/133: dread d0/f1e [0,4194304] 0 2024-02-14T13:10:32.465 INFO:tasks.workunit.client.0.smithi012.stdout:4/134: chown d0/l2c 1078 1 2024-02-14T13:10:32.465 INFO:tasks.workunit.client.0.smithi012.stdout:4/135: chown d0/c19 3266 1 2024-02-14T13:10:32.465 INFO:tasks.workunit.client.0.smithi012.stdout:9/195: creat da/f3f x:0 0 0 2024-02-14T13:10:32.465 INFO:tasks.workunit.client.0.smithi012.stdout:9/196: chown l5 116 1 2024-02-14T13:10:32.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:32 smithi012 ceph-mon[32370]: pgmap v402: 97 pgs: 97 active+clean; 98 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 2.08k op/s 2024-02-14T13:10:32.467 INFO:tasks.workunit.client.0.smithi012.stdout:4/136: mknod d0/d10/d13/c2e 0 2024-02-14T13:10:32.467 INFO:tasks.workunit.client.0.smithi012.stdout:4/137: write d0/d10/d13/d17/f1c [4323210,22470] 0 2024-02-14T13:10:32.467 INFO:tasks.workunit.client.0.smithi012.stdout:1/186: dwrite d6/fe [0,4194304] 0 2024-02-14T13:10:32.468 INFO:tasks.workunit.client.0.smithi012.stdout:0/161: dwrite d10/d14/d1b/f22 [0,4194304] 0 2024-02-14T13:10:32.469 INFO:tasks.workunit.client.0.smithi012.stdout:4/138: creat d0/d10/d1f/f2f x:0 0 0 2024-02-14T13:10:32.473 INFO:tasks.workunit.client.0.smithi012.stdout:1/187: unlink d6/d10/d22/c32 0 2024-02-14T13:10:32.473 INFO:tasks.workunit.client.0.smithi012.stdout:1/188: fdatasync d6/d12/f17 0 2024-02-14T13:10:32.473 INFO:tasks.workunit.client.0.smithi012.stdout:9/197: dread f2 [4194304,4194304] 0 2024-02-14T13:10:32.473 INFO:tasks.workunit.client.0.smithi012.stdout:9/198: chown da/d33/f36 2365 1 2024-02-14T13:10:32.474 INFO:tasks.workunit.client.0.smithi012.stdout:2/170: dwrite d0/d8/f30 [0,4194304] 0 2024-02-14T13:10:32.478 INFO:tasks.workunit.client.0.smithi012.stdout:0/162: mkdir d10/d14/d2b 0 2024-02-14T13:10:32.478 INFO:tasks.workunit.client.0.smithi012.stdout:0/163: chown d10/d14/d23/c27 188 1 2024-02-14T13:10:32.479 INFO:tasks.workunit.client.0.smithi012.stdout:1/189: getdents d6/d10/d22/d31/d34/d3b 0 2024-02-14T13:10:32.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/199: mkdir da/dd/d39/d40 0 2024-02-14T13:10:32.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/200: stat da/d33/f36 0 2024-02-14T13:10:32.484 INFO:tasks.workunit.client.0.smithi012.stdout:0/164: truncate d10/d14/d20/d21/f28 3464979 0 2024-02-14T13:10:32.484 INFO:tasks.workunit.client.0.smithi012.stdout:0/165: stat d10/d14/d23/c24 0 2024-02-14T13:10:32.484 INFO:tasks.workunit.client.0.smithi012.stdout:1/190: truncate d6/d10/f13 3792039 0 2024-02-14T13:10:32.487 INFO:tasks.workunit.client.0.smithi012.stdout:0/166: mknod d10/d14/d1b/c2c 0 2024-02-14T13:10:32.487 INFO:tasks.workunit.client.0.smithi012.stdout:9/201: fsync da/f3f 0 2024-02-14T13:10:32.489 INFO:tasks.workunit.client.0.smithi012.stdout:9/202: truncate da/fc 1460084 0 2024-02-14T13:10:32.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:32 smithi103 ceph-mon[36921]: pgmap v402: 97 pgs: 97 active+clean; 98 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 2.08k op/s 2024-02-14T13:10:32.493 INFO:tasks.workunit.client.0.smithi012.stdout:5/208: sync 2024-02-14T13:10:32.493 INFO:tasks.workunit.client.0.smithi012.stdout:7/157: sync 2024-02-14T13:10:32.493 INFO:tasks.workunit.client.0.smithi012.stdout:6/132: sync 2024-02-14T13:10:32.493 INFO:tasks.workunit.client.0.smithi012.stdout:6/133: chown d1/d17 5599201 1 2024-02-14T13:10:32.494 INFO:tasks.workunit.client.0.smithi012.stdout:7/158: creat df/d2d/f3e x:0 0 0 2024-02-14T13:10:32.494 INFO:tasks.workunit.client.0.smithi012.stdout:5/209: dread dc/d17/f41 [0,4194304] 0 2024-02-14T13:10:32.495 INFO:tasks.workunit.client.0.smithi012.stdout:3/118: dwrite d9/dd/de/f1a [0,4194304] 0 2024-02-14T13:10:32.495 INFO:tasks.workunit.client.0.smithi012.stdout:6/134: creat d1/d1e/dc/d28/f2a x:0 0 0 2024-02-14T13:10:32.495 INFO:tasks.workunit.client.0.smithi012.stdout:5/210: dread dc/d17/d20/f2d [0,4194304] 0 2024-02-14T13:10:32.496 INFO:tasks.workunit.client.0.smithi012.stdout:7/159: stat df/d27/l34 0 2024-02-14T13:10:32.497 INFO:tasks.workunit.client.0.smithi012.stdout:6/135: mkdir d1/d1e/d1b/d21/d2b 0 2024-02-14T13:10:32.498 INFO:tasks.workunit.client.0.smithi012.stdout:5/211: creat dc/d2f/d40/f45 x:0 0 0 2024-02-14T13:10:32.498 INFO:tasks.workunit.client.0.smithi012.stdout:7/160: creat df/d2d/f3f x:0 0 0 2024-02-14T13:10:32.500 INFO:tasks.workunit.client.0.smithi012.stdout:6/136: unlink d1/f4 0 2024-02-14T13:10:32.500 INFO:tasks.workunit.client.0.smithi012.stdout:9/203: dread f9 [0,4194304] 0 2024-02-14T13:10:32.501 INFO:tasks.workunit.client.0.smithi012.stdout:5/212: mknod dc/d17/c46 0 2024-02-14T13:10:32.503 INFO:tasks.workunit.client.0.smithi012.stdout:7/161: creat df/f40 x:0 0 0 2024-02-14T13:10:32.503 INFO:tasks.workunit.client.0.smithi012.stdout:7/162: stat df/c10 0 2024-02-14T13:10:32.504 INFO:tasks.workunit.client.0.smithi012.stdout:0/167: getdents d10/d14/d1b 0 2024-02-14T13:10:32.504 INFO:tasks.workunit.client.0.smithi012.stdout:0/168: truncate f0 4660600 0 2024-02-14T13:10:32.504 INFO:tasks.workunit.client.0.smithi012.stdout:7/163: creat df/d2d/f41 x:0 0 0 2024-02-14T13:10:32.505 INFO:tasks.workunit.client.0.smithi012.stdout:0/169: rmdir d10/d14/d1b 39 2024-02-14T13:10:32.505 INFO:tasks.workunit.client.0.smithi012.stdout:3/119: dread d9/dd/f24 [0,4194304] 0 2024-02-14T13:10:32.507 INFO:tasks.workunit.client.0.smithi012.stdout:0/170: unlink d10/f17 0 2024-02-14T13:10:32.509 INFO:tasks.workunit.client.0.smithi012.stdout:3/120: mknod d9/d18/c2f 0 2024-02-14T13:10:32.516 INFO:tasks.workunit.client.0.smithi012.stdout:9/204: read f4 [996388,114180] 0 2024-02-14T13:10:32.516 INFO:tasks.workunit.client.0.smithi012.stdout:9/205: write da/f14 [1657339,3151] 0 2024-02-14T13:10:32.517 INFO:tasks.workunit.client.0.smithi012.stdout:2/171: dwrite d0/f2f [0,4194304] 0 2024-02-14T13:10:32.517 INFO:tasks.workunit.client.0.smithi012.stdout:3/121: dread d9/dd/f17 [0,4194304] 0 2024-02-14T13:10:32.518 INFO:tasks.workunit.client.0.smithi012.stdout:4/139: dwrite d0/d10/d13/f26 [0,4194304] 0 2024-02-14T13:10:32.518 INFO:tasks.workunit.client.0.smithi012.stdout:4/140: fsync d0/d10/d13/f2d 0 2024-02-14T13:10:32.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/191: read d6/d10/f13 [68257,120678] 0 2024-02-14T13:10:32.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/192: chown d6/d35 8733246 1 2024-02-14T13:10:32.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/172: getdents d0/d6/de 0 2024-02-14T13:10:32.523 INFO:tasks.workunit.client.0.smithi012.stdout:3/122: rmdir d9/d13 39 2024-02-14T13:10:32.525 INFO:tasks.workunit.client.0.smithi012.stdout:9/206: write da/dd/d19/d30/d20/f2e [2014179,70962] 0 2024-02-14T13:10:32.526 INFO:tasks.workunit.client.0.smithi012.stdout:1/193: rmdir d6/d10 39 2024-02-14T13:10:32.527 INFO:tasks.workunit.client.0.smithi012.stdout:0/171: dread d10/d14/d20/d21/f28 [0,4194304] 0 2024-02-14T13:10:32.527 INFO:tasks.workunit.client.0.smithi012.stdout:0/172: chown d10/f2a 1152 1 2024-02-14T13:10:32.527 INFO:tasks.workunit.client.0.smithi012.stdout:0/173: chown f0 0 1 2024-02-14T13:10:32.529 INFO:tasks.workunit.client.0.smithi012.stdout:2/173: creat d0/d6/d37/f3b x:0 0 0 2024-02-14T13:10:32.529 INFO:tasks.workunit.client.0.smithi012.stdout:2/174: chown d0/d8/f30 12018 1 2024-02-14T13:10:32.529 INFO:tasks.workunit.client.0.smithi012.stdout:2/175: write d0/d8/f3a [454866,12422] 0 2024-02-14T13:10:32.531 INFO:tasks.workunit.client.0.smithi012.stdout:4/141: read d0/fa [3465195,42420] 0 2024-02-14T13:10:32.531 INFO:tasks.workunit.client.0.smithi012.stdout:6/137: dwrite d1/d1e/f20 [0,4194304] 0 2024-02-14T13:10:32.531 INFO:tasks.workunit.client.0.smithi012.stdout:9/207: truncate f2 5229019 0 2024-02-14T13:10:32.531 INFO:tasks.workunit.client.0.smithi012.stdout:9/208: chown da/dd/d19/d30/d20/c2f 935366 1 2024-02-14T13:10:32.532 INFO:tasks.workunit.client.0.smithi012.stdout:1/194: mkdir d6/d12/d15/d3d 0 2024-02-14T13:10:32.534 INFO:tasks.workunit.client.0.smithi012.stdout:0/174: symlink d10/d14/d2b/l2d 0 2024-02-14T13:10:32.534 INFO:tasks.workunit.client.0.smithi012.stdout:0/175: write d10/f11 [1157745,64283] 0 2024-02-14T13:10:32.535 INFO:tasks.workunit.client.0.smithi012.stdout:2/176: link d0/d5/c2e d0/d8/d12/d26/c3c 0 2024-02-14T13:10:32.539 INFO:tasks.workunit.client.0.smithi012.stdout:5/213: dwrite f0 [0,4194304] 0 2024-02-14T13:10:32.540 INFO:tasks.workunit.client.0.smithi012.stdout:3/123: dwrite d9/d13/f2b [0,4194304] 0 2024-02-14T13:10:32.541 INFO:tasks.workunit.client.0.smithi012.stdout:3/124: write f1 [2919687,54740] 0 2024-02-14T13:10:32.541 INFO:tasks.workunit.client.0.smithi012.stdout:3/125: truncate d9/d18/f23 632656 0 2024-02-14T13:10:32.542 INFO:tasks.workunit.client.0.smithi012.stdout:6/138: dread d1/d1e/dc/f1d [0,4194304] 0 2024-02-14T13:10:32.542 INFO:tasks.workunit.client.0.smithi012.stdout:9/209: creat da/dd/d39/d3b/f41 x:0 0 0 2024-02-14T13:10:32.542 INFO:tasks.workunit.client.0.smithi012.stdout:8/195: sync 2024-02-14T13:10:32.542 INFO:tasks.workunit.client.0.smithi012.stdout:1/195: mkdir d6/d10/d22/d31/d3e 0 2024-02-14T13:10:32.543 INFO:tasks.workunit.client.0.smithi012.stdout:4/142: dread d0/d10/d13/f16 [0,4194304] 0 2024-02-14T13:10:32.544 INFO:tasks.workunit.client.0.smithi012.stdout:2/177: symlink d0/d20/l3d 0 2024-02-14T13:10:32.546 INFO:tasks.workunit.client.0.smithi012.stdout:9/210: dread da/dd/d19/d30/f1f [0,4194304] 0 2024-02-14T13:10:32.547 INFO:tasks.workunit.client.0.smithi012.stdout:5/214: mkdir dc/d47 0 2024-02-14T13:10:32.550 INFO:tasks.workunit.client.0.smithi012.stdout:3/126: truncate d9/dd/de/f1a 2397409 0 2024-02-14T13:10:32.550 INFO:tasks.workunit.client.0.smithi012.stdout:3/127: chown d9/d13/l2a 362758 1 2024-02-14T13:10:32.551 INFO:tasks.workunit.client.0.smithi012.stdout:1/196: creat d6/d12/d15/f3f x:0 0 0 2024-02-14T13:10:32.552 INFO:tasks.workunit.client.0.smithi012.stdout:2/178: mknod d0/d8/d12/c3e 0 2024-02-14T13:10:32.552 INFO:tasks.workunit.client.0.smithi012.stdout:2/179: rename d0/d8 to d0/d8/d11/d3f 22 2024-02-14T13:10:32.553 INFO:tasks.workunit.client.0.smithi012.stdout:9/211: mknod da/dd/d19/d30/c42 0 2024-02-14T13:10:32.554 INFO:tasks.workunit.client.0.smithi012.stdout:3/128: mkdir d9/dd/d30 0 2024-02-14T13:10:32.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/197: creat d6/d10/d22/d31/f40 x:0 0 0 2024-02-14T13:10:32.556 INFO:tasks.workunit.client.0.smithi012.stdout:5/215: dread dc/d17/f27 [0,4194304] 0 2024-02-14T13:10:32.556 INFO:tasks.workunit.client.0.smithi012.stdout:5/216: write dc/d17/d20/f37 [11123,126624] 0 2024-02-14T13:10:32.557 INFO:tasks.workunit.client.0.smithi012.stdout:9/212: creat da/dd/d19/d30/f43 x:0 0 0 2024-02-14T13:10:32.559 INFO:tasks.workunit.client.0.smithi012.stdout:4/143: dwrite d0/d10/d13/f16 [4194304,4194304] 0 2024-02-14T13:10:32.559 INFO:tasks.workunit.client.0.smithi012.stdout:4/144: fsync d0/fa 0 2024-02-14T13:10:32.559 INFO:tasks.workunit.client.0.smithi012.stdout:5/217: creat dc/d2f/d40/f48 x:0 0 0 2024-02-14T13:10:32.559 INFO:tasks.workunit.client.0.smithi012.stdout:5/218: write dc/f33 [324707,10909] 0 2024-02-14T13:10:32.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:32 smithi055 ceph-mon[36853]: pgmap v402: 97 pgs: 97 active+clean; 98 MiB data, 798 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 2.08k op/s 2024-02-14T13:10:32.560 INFO:tasks.workunit.client.0.smithi012.stdout:9/213: link f4 da/f44 0 2024-02-14T13:10:32.562 INFO:tasks.workunit.client.0.smithi012.stdout:4/145: creat d0/d10/f30 x:0 0 0 2024-02-14T13:10:32.562 INFO:tasks.workunit.client.0.smithi012.stdout:4/146: fsync d0/f6 0 2024-02-14T13:10:32.563 INFO:tasks.workunit.client.0.smithi012.stdout:2/180: write d0/d8/f31 [3472885,57327] 0 2024-02-14T13:10:32.563 INFO:tasks.workunit.client.0.smithi012.stdout:2/181: readlink d0/d20/l36 0 2024-02-14T13:10:32.563 INFO:tasks.workunit.client.0.smithi012.stdout:3/129: rmdir d9/dd/de 39 2024-02-14T13:10:32.564 INFO:tasks.workunit.client.0.smithi012.stdout:6/139: write d1/f5 [4097737,75008] 0 2024-02-14T13:10:32.564 INFO:tasks.workunit.client.0.smithi012.stdout:5/219: mknod dc/d17/c49 0 2024-02-14T13:10:32.566 INFO:tasks.workunit.client.0.smithi012.stdout:9/214: truncate da/dd/d19/d30/f29 918606 0 2024-02-14T13:10:32.566 INFO:tasks.workunit.client.0.smithi012.stdout:9/215: stat f9 0 2024-02-14T13:10:32.568 INFO:tasks.workunit.client.0.smithi012.stdout:4/147: truncate d0/f1e 2211328 0 2024-02-14T13:10:32.568 INFO:tasks.workunit.client.0.smithi012.stdout:2/182: rmdir d0/d8/d9 39 2024-02-14T13:10:32.569 INFO:tasks.workunit.client.0.smithi012.stdout:2/183: dread - d0/d6/d37/f3b zero size 2024-02-14T13:10:32.572 INFO:tasks.workunit.client.0.smithi012.stdout:9/216: mkdir da/dd/d19/d30/d45 0 2024-02-14T13:10:32.573 INFO:tasks.workunit.client.0.smithi012.stdout:3/130: dread d9/dd/de/f1a [0,4194304] 0 2024-02-14T13:10:32.579 INFO:tasks.workunit.client.0.smithi012.stdout:2/184: unlink d0/d8/d9/l24 0 2024-02-14T13:10:32.580 INFO:tasks.workunit.client.0.smithi012.stdout:2/185: write d0/d1a/f25 [1065957,56258] 0 2024-02-14T13:10:32.580 INFO:tasks.workunit.client.0.smithi012.stdout:9/217: truncate da/f44 3963614 0 2024-02-14T13:10:32.582 INFO:tasks.workunit.client.0.smithi012.stdout:3/131: mknod d9/dd/de/c31 0 2024-02-14T13:10:32.583 INFO:tasks.workunit.client.0.smithi012.stdout:4/148: mknod d0/c31 0 2024-02-14T13:10:32.585 INFO:tasks.workunit.client.0.smithi012.stdout:9/218: mknod da/dd/c46 0 2024-02-14T13:10:32.585 INFO:tasks.workunit.client.0.smithi012.stdout:9/219: fdatasync da/d33/f36 0 2024-02-14T13:10:32.585 INFO:tasks.workunit.client.0.smithi012.stdout:9/220: write da/f14 [4993477,33000] 0 2024-02-14T13:10:32.587 INFO:tasks.workunit.client.0.smithi012.stdout:4/149: link d0/lc d0/d10/l32 0 2024-02-14T13:10:32.587 INFO:tasks.workunit.client.0.smithi012.stdout:1/198: dwrite d6/ff [4194304,4194304] 0 2024-02-14T13:10:32.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/150: link d0/l5 d0/d10/d13/d17/l33 0 2024-02-14T13:10:32.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/151: write d0/d10/d1f/f20 [4616633,114022] 0 2024-02-14T13:10:32.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/152: write d0/f1a [8589967,48465] 0 2024-02-14T13:10:32.590 INFO:tasks.workunit.client.0.smithi012.stdout:1/199: symlink d6/d10/d22/d31/d34/d3b/l41 0 2024-02-14T13:10:32.591 INFO:tasks.workunit.client.0.smithi012.stdout:3/132: dread d9/d18/f1c [0,4194304] 0 2024-02-14T13:10:32.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/133: getdents d9/d13 0 2024-02-14T13:10:32.593 INFO:tasks.workunit.client.0.smithi012.stdout:6/140: dwrite d1/df/d24/f27 [0,4194304] 0 2024-02-14T13:10:32.596 INFO:tasks.workunit.client.0.smithi012.stdout:6/141: getdents d1/d1e/d1b 0 2024-02-14T13:10:32.603 INFO:tasks.workunit.client.0.smithi012.stdout:2/186: dwrite d0/d8/d11/f32 [0,4194304] 0 2024-02-14T13:10:32.615 INFO:tasks.workunit.client.0.smithi012.stdout:3/134: write d9/d13/f2b [1073211,40844] 0 2024-02-14T13:10:32.616 INFO:tasks.workunit.client.0.smithi012.stdout:3/135: symlink d9/dd/d30/l32 0 2024-02-14T13:10:32.617 INFO:tasks.workunit.client.0.smithi012.stdout:3/136: truncate d9/d13/f2b 5101964 0 2024-02-14T13:10:32.617 INFO:tasks.workunit.client.0.smithi012.stdout:2/187: write d0/f2f [2628010,22604] 0 2024-02-14T13:10:32.617 INFO:tasks.workunit.client.0.smithi012.stdout:3/137: mknod d9/d18/c33 0 2024-02-14T13:10:32.618 INFO:tasks.workunit.client.0.smithi012.stdout:6/142: dwrite d1/df/d16/f1a [0,4194304] 0 2024-02-14T13:10:32.619 INFO:tasks.workunit.client.0.smithi012.stdout:3/138: mkdir d9/dd/d30/d34 0 2024-02-14T13:10:32.619 INFO:tasks.workunit.client.0.smithi012.stdout:4/153: dwrite d0/d10/d13/f16 [4194304,4194304] 0 2024-02-14T13:10:32.620 INFO:tasks.workunit.client.0.smithi012.stdout:9/221: dwrite da/dd/d19/d30/d20/f2e [4194304,4194304] 0 2024-02-14T13:10:32.620 INFO:tasks.workunit.client.0.smithi012.stdout:9/222: write da/dd/d38/f3e [434140,108268] 0 2024-02-14T13:10:32.620 INFO:tasks.workunit.client.0.smithi012.stdout:9/223: chown da/dd/d19/d30/f29 7 1 2024-02-14T13:10:32.620 INFO:tasks.workunit.client.0.smithi012.stdout:9/224: stat da/dd/d19 0 2024-02-14T13:10:32.620 INFO:tasks.workunit.client.0.smithi012.stdout:1/200: dwrite d6/d12/f1a [0,4194304] 0 2024-02-14T13:10:32.622 INFO:tasks.workunit.client.0.smithi012.stdout:6/143: symlink d1/df/l2c 0 2024-02-14T13:10:32.623 INFO:tasks.workunit.client.0.smithi012.stdout:9/225: unlink da/le 0 2024-02-14T13:10:32.628 INFO:tasks.workunit.client.0.smithi012.stdout:3/139: dread d9/d13/f20 [0,4194304] 0 2024-02-14T13:10:32.629 INFO:tasks.workunit.client.0.smithi012.stdout:4/154: write d0/d10/d13/d17/f1c [2259613,97570] 0 2024-02-14T13:10:32.630 INFO:tasks.workunit.client.0.smithi012.stdout:4/155: dread - d0/d10/d1f/f2f zero size 2024-02-14T13:10:32.630 INFO:tasks.workunit.client.0.smithi012.stdout:2/188: rmdir d0/d8/d9/d13 0 2024-02-14T13:10:32.631 INFO:tasks.workunit.client.0.smithi012.stdout:2/189: chown d0/d6/de/c21 3682 1 2024-02-14T13:10:32.632 INFO:tasks.workunit.client.0.smithi012.stdout:1/201: rename d6/d12/d15/c19 to d6/c42 0 2024-02-14T13:10:32.633 INFO:tasks.workunit.client.0.smithi012.stdout:6/144: unlink f0 0 2024-02-14T13:10:32.635 INFO:tasks.workunit.client.0.smithi012.stdout:9/226: unlink da/dd/c16 0 2024-02-14T13:10:32.636 INFO:tasks.workunit.client.0.smithi012.stdout:3/140: truncate d9/d13/f20 865329 0 2024-02-14T13:10:32.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/190: dread d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:32.637 INFO:tasks.workunit.client.0.smithi012.stdout:2/191: write d0/d20/f34 [1793652,113217] 0 2024-02-14T13:10:32.637 INFO:tasks.workunit.client.0.smithi012.stdout:2/192: chown d0/d8/f31 23461165 1 2024-02-14T13:10:32.637 INFO:tasks.workunit.client.0.smithi012.stdout:4/156: mknod d0/d10/c34 0 2024-02-14T13:10:32.637 INFO:tasks.workunit.client.0.smithi012.stdout:4/157: fdatasync d0/d10/d13/f16 0 2024-02-14T13:10:32.638 INFO:tasks.workunit.client.0.smithi012.stdout:1/202: unlink d6/d10/c1f 0 2024-02-14T13:10:32.638 INFO:tasks.workunit.client.0.smithi012.stdout:1/203: write d6/d10/d22/f2a [2078967,92532] 0 2024-02-14T13:10:32.640 INFO:tasks.workunit.client.0.smithi012.stdout:6/145: rename d1/d1e/dc/fe to d1/d1e/dc/d28/f2d 0 2024-02-14T13:10:32.640 INFO:tasks.workunit.client.0.smithi012.stdout:9/227: mknod da/c47 0 2024-02-14T13:10:32.641 INFO:tasks.workunit.client.0.smithi012.stdout:3/141: link d9/dd/f17 d9/f35 0 2024-02-14T13:10:32.642 INFO:tasks.workunit.client.0.smithi012.stdout:2/193: mknod d0/d8/d11/d35/c40 0 2024-02-14T13:10:32.645 INFO:tasks.workunit.client.0.smithi012.stdout:7/164: sync 2024-02-14T13:10:32.646 INFO:tasks.workunit.client.0.smithi012.stdout:4/158: dread d0/f3 [0,4194304] 0 2024-02-14T13:10:32.649 INFO:tasks.workunit.client.0.smithi012.stdout:6/146: rename d1/df/d24/f27 to d1/d1e/dc/f2e 0 2024-02-14T13:10:32.651 INFO:tasks.workunit.client.0.smithi012.stdout:4/159: dread d0/f6 [0,4194304] 0 2024-02-14T13:10:32.651 INFO:tasks.workunit.client.0.smithi012.stdout:9/228: mkdir da/dd/d19/d30/d20/d48 0 2024-02-14T13:10:32.651 INFO:tasks.workunit.client.0.smithi012.stdout:9/229: fdatasync da/f3f 0 2024-02-14T13:10:32.651 INFO:tasks.workunit.client.0.smithi012.stdout:9/230: dread - da/dd/f1b zero size 2024-02-14T13:10:32.652 INFO:tasks.workunit.client.0.smithi012.stdout:9/231: dread - da/dd/d19/d30/d20/f31 zero size 2024-02-14T13:10:32.654 INFO:tasks.workunit.client.0.smithi012.stdout:1/204: rmdir d6/d10 39 2024-02-14T13:10:32.657 INFO:tasks.workunit.client.0.smithi012.stdout:7/165: rename df/d24/f25 to df/f42 0 2024-02-14T13:10:32.659 INFO:tasks.workunit.client.0.smithi012.stdout:6/147: rename d1/d1e/d1b/f1f to d1/d1e/d1b/f2f 0 2024-02-14T13:10:32.661 INFO:tasks.workunit.client.0.smithi012.stdout:9/232: link da/l11 da/dd/d19/d30/d45/l49 0 2024-02-14T13:10:32.662 INFO:tasks.workunit.client.0.smithi012.stdout:9/233: dread - da/dd/d39/d3b/f41 zero size 2024-02-14T13:10:32.664 INFO:tasks.workunit.client.0.smithi012.stdout:1/205: creat d6/d10/d22/d31/d34/d3b/f43 x:0 0 0 2024-02-14T13:10:32.664 INFO:tasks.workunit.client.0.smithi012.stdout:8/196: sync 2024-02-14T13:10:32.664 INFO:tasks.workunit.client.0.smithi012.stdout:0/176: sync 2024-02-14T13:10:32.664 INFO:tasks.workunit.client.0.smithi012.stdout:5/220: sync 2024-02-14T13:10:32.664 INFO:tasks.workunit.client.0.smithi012.stdout:5/221: truncate dc/d17/d20/f2d 424190 0 2024-02-14T13:10:32.664 INFO:tasks.workunit.client.0.smithi012.stdout:5/222: chown dc 730667 1 2024-02-14T13:10:32.665 INFO:tasks.workunit.client.0.smithi012.stdout:4/160: rename d0/d10/d13/f26 to d0/d10/f35 0 2024-02-14T13:10:32.667 INFO:tasks.workunit.client.0.smithi012.stdout:7/166: unlink la 0 2024-02-14T13:10:32.671 INFO:tasks.workunit.client.0.smithi012.stdout:3/142: dwrite d9/d13/f20 [0,4194304] 0 2024-02-14T13:10:32.672 INFO:tasks.workunit.client.0.smithi012.stdout:1/206: mkdir d6/d10/d22/d44 0 2024-02-14T13:10:32.674 INFO:tasks.workunit.client.0.smithi012.stdout:7/167: dread fe [0,4194304] 0 2024-02-14T13:10:32.674 INFO:tasks.workunit.client.0.smithi012.stdout:7/168: fsync df/f33 0 2024-02-14T13:10:32.675 INFO:tasks.workunit.client.0.smithi012.stdout:0/177: link fc d10/d14/f2e 0 2024-02-14T13:10:32.677 INFO:tasks.workunit.client.0.smithi012.stdout:8/197: creat d9/f3b x:0 0 0 2024-02-14T13:10:32.681 INFO:tasks.workunit.client.0.smithi012.stdout:9/234: rename da/dd/d19/l21 to da/dd/d39/l4a 0 2024-02-14T13:10:32.681 INFO:tasks.workunit.client.0.smithi012.stdout:9/235: truncate da/dd/f2a 870871 0 2024-02-14T13:10:32.681 INFO:tasks.workunit.client.0.smithi012.stdout:5/223: dwrite f7 [0,4194304] 0 2024-02-14T13:10:32.682 INFO:tasks.workunit.client.0.smithi012.stdout:4/161: mknod d0/d10/d13/d17/c36 0 2024-02-14T13:10:32.684 INFO:tasks.workunit.client.0.smithi012.stdout:6/148: rename d1/f5 to d1/f30 0 2024-02-14T13:10:32.684 INFO:tasks.workunit.client.0.smithi012.stdout:6/149: write d1/d1e/dc/d28/f2a [254417,80081] 0 2024-02-14T13:10:32.686 INFO:tasks.workunit.client.0.smithi012.stdout:3/143: truncate d9/f35 608202 0 2024-02-14T13:10:32.686 INFO:tasks.workunit.client.0.smithi012.stdout:3/144: fsync d9/d13/f26 0 2024-02-14T13:10:32.688 INFO:tasks.workunit.client.0.smithi012.stdout:1/207: creat d6/d12/d15/d3d/f45 x:0 0 0 2024-02-14T13:10:32.690 INFO:tasks.workunit.client.0.smithi012.stdout:7/169: symlink df/d36/l43 0 2024-02-14T13:10:32.692 INFO:tasks.workunit.client.0.smithi012.stdout:0/178: symlink d10/d14/d1b/l2f 0 2024-02-14T13:10:32.692 INFO:tasks.workunit.client.0.smithi012.stdout:0/179: fdatasync fd 0 2024-02-14T13:10:32.695 INFO:tasks.workunit.client.0.smithi012.stdout:4/162: rename d0/d10/f35 to d0/d10/d28/f37 0 2024-02-14T13:10:32.697 INFO:tasks.workunit.client.0.smithi012.stdout:6/150: rmdir d1/d1e 39 2024-02-14T13:10:32.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/198: dwrite d9/f3b [0,4194304] 0 2024-02-14T13:10:32.698 INFO:tasks.workunit.client.0.smithi012.stdout:3/145: creat d9/d13/d28/f36 x:0 0 0 2024-02-14T13:10:32.699 INFO:tasks.workunit.client.0.smithi012.stdout:5/224: dwrite dc/d17/f2c [0,4194304] 0 2024-02-14T13:10:32.700 INFO:tasks.workunit.client.0.smithi012.stdout:7/170: mknod df/d2d/c44 0 2024-02-14T13:10:32.700 INFO:tasks.workunit.client.0.smithi012.stdout:7/171: stat df/c14 0 2024-02-14T13:10:32.701 INFO:tasks.workunit.client.0.smithi012.stdout:0/180: truncate d10/d14/d1b/f22 3839712 0 2024-02-14T13:10:32.703 INFO:tasks.workunit.client.0.smithi012.stdout:1/208: rename d6/d10/d22/f2a to d6/d35/f46 0 2024-02-14T13:10:32.703 INFO:tasks.workunit.client.0.smithi012.stdout:3/146: dread d9/dd/f24 [0,4194304] 0 2024-02-14T13:10:32.703 INFO:tasks.workunit.client.0.smithi012.stdout:3/147: stat d9/d13 0 2024-02-14T13:10:32.705 INFO:tasks.workunit.client.0.smithi012.stdout:4/163: creat d0/d10/d13/d17/f38 x:0 0 0 2024-02-14T13:10:32.705 INFO:tasks.workunit.client.0.smithi012.stdout:6/151: getdents d1/d1e/d1b/d21/d2b 0 2024-02-14T13:10:32.707 INFO:tasks.workunit.client.0.smithi012.stdout:5/225: write dc/d17/f24 [1409337,25141] 0 2024-02-14T13:10:32.707 INFO:tasks.workunit.client.0.smithi012.stdout:5/226: chown dc/d17/d20/c23 7 1 2024-02-14T13:10:32.708 INFO:tasks.workunit.client.0.smithi012.stdout:4/164: dread d0/f1a [0,4194304] 0 2024-02-14T13:10:32.708 INFO:tasks.workunit.client.0.smithi012.stdout:5/227: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:32.708 INFO:tasks.workunit.client.0.smithi012.stdout:5/228: readlink dc/d17/d20/l3d 0 2024-02-14T13:10:32.708 INFO:tasks.workunit.client.0.smithi012.stdout:8/199: creat d9/f3c x:0 0 0 2024-02-14T13:10:32.712 INFO:tasks.workunit.client.0.smithi012.stdout:7/172: mknod df/d2d/c45 0 2024-02-14T13:10:32.712 INFO:tasks.workunit.client.0.smithi012.stdout:7/173: chown df/d36/f3a 91 1 2024-02-14T13:10:32.714 INFO:tasks.workunit.client.0.smithi012.stdout:0/181: mkdir d10/d14/d1b/d30 0 2024-02-14T13:10:32.716 INFO:tasks.workunit.client.0.smithi012.stdout:3/148: rename d9/d18/c2f to d9/d13/c37 0 2024-02-14T13:10:32.716 INFO:tasks.workunit.client.0.smithi012.stdout:3/149: write d9/dd/f24 [4729494,59152] 0 2024-02-14T13:10:32.716 INFO:tasks.workunit.client.0.smithi012.stdout:3/150: write d9/d13/d28/f36 [531603,80221] 0 2024-02-14T13:10:32.717 INFO:tasks.workunit.client.0.smithi012.stdout:6/152: mknod d1/d1e/d1b/c31 0 2024-02-14T13:10:32.717 INFO:tasks.workunit.client.0.smithi012.stdout:8/200: write d9/dc/d1b/f1e [1187805,103730] 0 2024-02-14T13:10:32.719 INFO:tasks.workunit.client.0.smithi012.stdout:0/182: symlink d10/d14/d1b/l31 0 2024-02-14T13:10:32.721 INFO:tasks.workunit.client.0.smithi012.stdout:3/151: rename d9/dd/f24 to d9/dd/de/f38 0 2024-02-14T13:10:32.722 INFO:tasks.workunit.client.0.smithi012.stdout:5/229: read f6 [2242630,54912] 0 2024-02-14T13:10:32.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/153: creat d1/d1e/d1b/d21/f32 x:0 0 0 2024-02-14T13:10:32.722 INFO:tasks.workunit.client.0.smithi012.stdout:6/154: write d1/d1e/d1b/f2f [896725,22070] 0 2024-02-14T13:10:32.723 INFO:tasks.workunit.client.0.smithi012.stdout:0/183: truncate d10/f13 147268 0 2024-02-14T13:10:32.724 INFO:tasks.workunit.client.0.smithi012.stdout:5/230: mknod dc/d47/c4a 0 2024-02-14T13:10:32.724 INFO:tasks.workunit.client.0.smithi012.stdout:5/231: truncate dc/d2f/d40/f45 735134 0 2024-02-14T13:10:32.724 INFO:tasks.workunit.client.0.smithi012.stdout:5/232: write dc/d17/d20/f2d [916023,7269] 0 2024-02-14T13:10:32.726 INFO:tasks.workunit.client.0.smithi012.stdout:0/184: dread d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:32.726 INFO:tasks.workunit.client.0.smithi012.stdout:6/155: creat d1/d1e/d1b/f33 x:0 0 0 2024-02-14T13:10:32.726 INFO:tasks.workunit.client.0.smithi012.stdout:6/156: truncate d1/d1e/d1b/f33 694865 0 2024-02-14T13:10:32.726 INFO:tasks.workunit.client.0.smithi012.stdout:1/209: dwrite d6/d10/d22/d31/d34/d3b/f43 [0,4194304] 0 2024-02-14T13:10:32.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/233: mkdir dc/d17/d4b 0 2024-02-14T13:10:32.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/234: write f5 [1763078,78125] 0 2024-02-14T13:10:32.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/235: chown dc/d2f/d3e 1180893 1 2024-02-14T13:10:32.727 INFO:tasks.workunit.client.0.smithi012.stdout:0/185: creat d10/f32 x:0 0 0 2024-02-14T13:10:32.727 INFO:tasks.workunit.client.0.smithi012.stdout:0/186: fsync d10/d14/f1e 0 2024-02-14T13:10:32.728 INFO:tasks.workunit.client.0.smithi012.stdout:3/152: dread d9/dd/f15 [0,4194304] 0 2024-02-14T13:10:32.728 INFO:tasks.workunit.client.0.smithi012.stdout:3/153: readlink d9/d18/l1d 0 2024-02-14T13:10:32.729 INFO:tasks.workunit.client.0.smithi012.stdout:6/157: dread d1/d1e/d1b/f23 [0,4194304] 0 2024-02-14T13:10:32.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/154: mkdir d9/d18/d39 0 2024-02-14T13:10:32.732 INFO:tasks.workunit.client.0.smithi012.stdout:4/165: dwrite d0/d10/d13/f16 [0,4194304] 0 2024-02-14T13:10:32.732 INFO:tasks.workunit.client.0.smithi012.stdout:6/158: dread d1/d1e/d1b/f23 [0,4194304] 0 2024-02-14T13:10:32.733 INFO:tasks.workunit.client.0.smithi012.stdout:3/155: symlink d9/dd/d30/d34/l3a 0 2024-02-14T13:10:32.733 INFO:tasks.workunit.client.0.smithi012.stdout:3/156: rename d9/dd to d9/dd/d30/d3b 22 2024-02-14T13:10:32.733 INFO:tasks.workunit.client.0.smithi012.stdout:3/157: chown d9/l1e 3792 1 2024-02-14T13:10:32.733 INFO:tasks.workunit.client.0.smithi012.stdout:4/166: mknod d0/d10/d28/c39 0 2024-02-14T13:10:32.734 INFO:tasks.workunit.client.0.smithi012.stdout:0/187: write d10/d14/d1b/f22 [2378214,70528] 0 2024-02-14T13:10:32.735 INFO:tasks.workunit.client.0.smithi012.stdout:6/159: getdents d1/d1e 0 2024-02-14T13:10:32.736 INFO:tasks.workunit.client.0.smithi012.stdout:4/167: getdents d0/d10/d1f 0 2024-02-14T13:10:32.739 INFO:tasks.workunit.client.0.smithi012.stdout:0/188: symlink d10/d14/d1b/l33 0 2024-02-14T13:10:32.739 INFO:tasks.workunit.client.0.smithi012.stdout:0/189: read fd [561085,12002] 0 2024-02-14T13:10:32.741 INFO:tasks.workunit.client.0.smithi012.stdout:6/160: mknod d1/d1e/c34 0 2024-02-14T13:10:32.742 INFO:tasks.workunit.client.0.smithi012.stdout:4/168: mkdir d0/d10/d13/d17/d3a 0 2024-02-14T13:10:32.742 INFO:tasks.workunit.client.0.smithi012.stdout:4/169: write d0/d10/f24 [5029564,52881] 0 2024-02-14T13:10:32.744 INFO:tasks.workunit.client.0.smithi012.stdout:0/190: rename d10/d14/d1b/l2f to d10/d14/d23/l34 0 2024-02-14T13:10:32.745 INFO:tasks.workunit.client.0.smithi012.stdout:6/161: getdents d1/df/d16 0 2024-02-14T13:10:32.745 INFO:tasks.workunit.client.0.smithi012.stdout:7/174: dwrite df/d2d/f32 [4194304,4194304] 0 2024-02-14T13:10:32.747 INFO:tasks.workunit.client.0.smithi012.stdout:4/170: creat d0/d10/f3b x:0 0 0 2024-02-14T13:10:32.748 INFO:tasks.workunit.client.0.smithi012.stdout:4/171: dread d0/f6 [4194304,4194304] 0 2024-02-14T13:10:32.750 INFO:tasks.workunit.client.0.smithi012.stdout:6/162: write d1/d1e/d1b/f2f [166347,59080] 0 2024-02-14T13:10:32.750 INFO:tasks.workunit.client.0.smithi012.stdout:8/201: dwrite d9/dc/d1b/f27 [4194304,4194304] 0 2024-02-14T13:10:32.751 INFO:tasks.workunit.client.0.smithi012.stdout:7/175: creat df/d36/f46 x:0 0 0 2024-02-14T13:10:32.751 INFO:tasks.workunit.client.0.smithi012.stdout:7/176: write df/d36/f3a [282429,1212] 0 2024-02-14T13:10:32.752 INFO:tasks.workunit.client.0.smithi012.stdout:4/172: creat d0/d10/d28/f3c x:0 0 0 2024-02-14T13:10:32.753 INFO:tasks.workunit.client.0.smithi012.stdout:6/163: creat d1/d1e/d1b/d21/f35 x:0 0 0 2024-02-14T13:10:32.753 INFO:tasks.workunit.client.0.smithi012.stdout:6/164: chown d1 2952048 1 2024-02-14T13:10:32.753 INFO:tasks.workunit.client.0.smithi012.stdout:0/191: write d10/f13 [197631,27738] 0 2024-02-14T13:10:32.753 INFO:tasks.workunit.client.0.smithi012.stdout:0/192: dread - d10/f2a zero size 2024-02-14T13:10:32.755 INFO:tasks.workunit.client.0.smithi012.stdout:8/202: mknod d9/dc/c3d 0 2024-02-14T13:10:32.756 INFO:tasks.workunit.client.0.smithi012.stdout:7/177: symlink df/d36/l47 0 2024-02-14T13:10:32.756 INFO:tasks.workunit.client.0.smithi012.stdout:7/178: dread - df/d2d/f3e zero size 2024-02-14T13:10:32.756 INFO:tasks.workunit.client.0.smithi012.stdout:4/173: mknod d0/d10/d28/c3d 0 2024-02-14T13:10:32.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/210: dwrite d6/d10/f3a [0,4194304] 0 2024-02-14T13:10:32.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/211: read d6/fb [865361,27329] 0 2024-02-14T13:10:32.759 INFO:tasks.workunit.client.0.smithi012.stdout:0/193: creat d10/d14/d20/d21/f35 x:0 0 0 2024-02-14T13:10:32.761 INFO:tasks.workunit.client.0.smithi012.stdout:8/203: getdents d9/dc/d14 0 2024-02-14T13:10:32.762 INFO:tasks.workunit.client.0.smithi012.stdout:7/179: symlink df/d24/l48 0 2024-02-14T13:10:32.764 INFO:tasks.workunit.client.0.smithi012.stdout:6/165: unlink d1/d1e/dc/l18 0 2024-02-14T13:10:32.767 INFO:tasks.workunit.client.0.smithi012.stdout:1/212: dread d6/fe [0,4194304] 0 2024-02-14T13:10:32.767 INFO:tasks.workunit.client.0.smithi012.stdout:1/213: write d6/d12/d15/d3d/f45 [885669,63801] 0 2024-02-14T13:10:32.768 INFO:tasks.workunit.client.0.smithi012.stdout:5/236: dwrite dc/d2f/d40/f45 [0,4194304] 0 2024-02-14T13:10:32.768 INFO:tasks.workunit.client.0.smithi012.stdout:5/237: chown dc/d17/f2c 3986502 1 2024-02-14T13:10:32.769 INFO:tasks.workunit.client.0.smithi012.stdout:5/238: write dc/d17/d20/f2b [835309,84399] 0 2024-02-14T13:10:32.769 INFO:tasks.workunit.client.0.smithi012.stdout:5/239: write dc/d17/f24 [1645450,107956] 0 2024-02-14T13:10:32.769 INFO:tasks.workunit.client.0.smithi012.stdout:5/240: dread - dc/d17/f3f zero size 2024-02-14T13:10:32.769 INFO:tasks.workunit.client.0.smithi012.stdout:3/158: dwrite d9/dd/d27/f29 [0,4194304] 0 2024-02-14T13:10:32.770 INFO:tasks.workunit.client.0.smithi012.stdout:3/159: chown d9/f35 61669237 1 2024-02-14T13:10:32.770 INFO:tasks.workunit.client.0.smithi012.stdout:3/160: chown l8 126834 1 2024-02-14T13:10:32.770 INFO:tasks.workunit.client.0.smithi012.stdout:6/166: unlink d1/f30 0 2024-02-14T13:10:32.770 INFO:tasks.workunit.client.0.smithi012.stdout:1/214: write d6/d35/f46 [583208,103137] 0 2024-02-14T13:10:32.773 INFO:tasks.workunit.client.0.smithi012.stdout:0/194: dread d10/d14/d1b/f22 [0,4194304] 0 2024-02-14T13:10:32.773 INFO:tasks.workunit.client.0.smithi012.stdout:0/195: readlink d10/d14/d1b/l33 0 2024-02-14T13:10:32.773 INFO:tasks.workunit.client.0.smithi012.stdout:0/196: chown d10/d14/d1b/f22 42518395 1 2024-02-14T13:10:32.773 INFO:tasks.workunit.client.0.smithi012.stdout:0/197: dread - d10/d14/d20/d21/f35 zero size 2024-02-14T13:10:32.773 INFO:tasks.workunit.client.0.smithi012.stdout:0/198: write d10/f2a [668985,127836] 0 2024-02-14T13:10:32.782 INFO:tasks.workunit.client.0.smithi012.stdout:5/241: mkdir dc/d17/d20/d4c 0 2024-02-14T13:10:32.782 INFO:tasks.workunit.client.0.smithi012.stdout:5/242: read f6 [3514283,16665] 0 2024-02-14T13:10:32.784 INFO:tasks.workunit.client.0.smithi012.stdout:3/161: mkdir d9/d18/d3c 0 2024-02-14T13:10:32.784 INFO:tasks.workunit.client.0.smithi012.stdout:3/162: fsync d9/f22 0 2024-02-14T13:10:32.785 INFO:tasks.workunit.client.0.smithi012.stdout:1/215: creat d6/d12/d15/f47 x:0 0 0 2024-02-14T13:10:32.786 INFO:tasks.workunit.client.0.smithi012.stdout:4/174: dwrite d0/f6 [4194304,4194304] 0 2024-02-14T13:10:32.786 INFO:tasks.workunit.client.0.smithi012.stdout:4/175: readlink d0/lf 0 2024-02-14T13:10:32.787 INFO:tasks.workunit.client.0.smithi012.stdout:4/176: read - d0/d10/f30 zero size 2024-02-14T13:10:32.787 INFO:tasks.workunit.client.0.smithi012.stdout:0/199: truncate d10/d14/f1e 1533341 0 2024-02-14T13:10:32.788 INFO:tasks.workunit.client.0.smithi012.stdout:3/163: mkdir d9/dd/d27/d3d 0 2024-02-14T13:10:32.789 INFO:tasks.workunit.client.0.smithi012.stdout:1/216: rmdir d6/d10/d22/d31/d34 39 2024-02-14T13:10:32.792 INFO:tasks.workunit.client.0.smithi012.stdout:4/177: mkdir d0/d10/d1f/d3e 0 2024-02-14T13:10:32.792 INFO:tasks.workunit.client.0.smithi012.stdout:4/178: chown d0/c19 39895 1 2024-02-14T13:10:32.794 INFO:tasks.workunit.client.0.smithi012.stdout:6/167: dwrite d1/df/d16/f1a [0,4194304] 0 2024-02-14T13:10:32.794 INFO:tasks.workunit.client.0.smithi012.stdout:7/180: dwrite df/f2c [0,4194304] 0 2024-02-14T13:10:32.796 INFO:tasks.workunit.client.0.smithi012.stdout:0/200: rmdir d10/d14/d20/d21 39 2024-02-14T13:10:32.796 INFO:tasks.workunit.client.0.smithi012.stdout:6/168: write d1/d1e/d1b/f2f [231967,37892] 0 2024-02-14T13:10:32.796 INFO:tasks.workunit.client.0.smithi012.stdout:0/201: fsync d10/d14/d20/d21/f35 0 2024-02-14T13:10:32.796 INFO:tasks.workunit.client.0.smithi012.stdout:6/169: write d1/d1e/d1b/f33 [1553470,55299] 0 2024-02-14T13:10:32.796 INFO:tasks.workunit.client.0.smithi012.stdout:6/170: write d1/d1e/dc/d28/f2a [911942,124589] 0 2024-02-14T13:10:32.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/179: dread d0/d10/d13/d17/f1c [0,4194304] 0 2024-02-14T13:10:32.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/164: creat d9/dd/de/f3e x:0 0 0 2024-02-14T13:10:32.801 INFO:tasks.workunit.client.0.smithi012.stdout:0/202: creat d10/d14/d20/d21/f36 x:0 0 0 2024-02-14T13:10:32.802 INFO:tasks.workunit.client.0.smithi012.stdout:0/203: fsync d10/f2a 0 2024-02-14T13:10:32.803 INFO:tasks.workunit.client.0.smithi012.stdout:3/165: mkdir d9/d3f 0 2024-02-14T13:10:32.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/166: creat d9/d13/d28/f40 x:0 0 0 2024-02-14T13:10:32.805 INFO:tasks.workunit.client.0.smithi012.stdout:1/217: dwrite d6/d10/f13 [4194304,4194304] 0 2024-02-14T13:10:32.805 INFO:tasks.workunit.client.0.smithi012.stdout:1/218: chown d6/d10/d22/l26 2 1 2024-02-14T13:10:32.805 INFO:tasks.workunit.client.0.smithi012.stdout:2/194: sync 2024-02-14T13:10:32.808 INFO:tasks.workunit.client.0.smithi012.stdout:1/219: creat d6/d10/d22/d44/f48 x:0 0 0 2024-02-14T13:10:32.809 INFO:tasks.workunit.client.0.smithi012.stdout:4/180: dread d0/d10/d28/f37 [0,4194304] 0 2024-02-14T13:10:32.809 INFO:tasks.workunit.client.0.smithi012.stdout:2/195: truncate d0/d20/f34 1732344 0 2024-02-14T13:10:32.809 INFO:tasks.workunit.client.0.smithi012.stdout:6/171: read d1/df/d16/f1a [426708,21499] 0 2024-02-14T13:10:32.809 INFO:tasks.workunit.client.0.smithi012.stdout:6/172: write d1/df/d16/f1a [3745301,13854] 0 2024-02-14T13:10:32.810 INFO:tasks.workunit.client.0.smithi012.stdout:7/181: write df/f15 [3576414,9195] 0 2024-02-14T13:10:32.810 INFO:tasks.workunit.client.0.smithi012.stdout:8/204: dwrite d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:32.812 INFO:tasks.workunit.client.0.smithi012.stdout:1/220: creat d6/d10/d22/d31/d34/f49 x:0 0 0 2024-02-14T13:10:32.813 INFO:tasks.workunit.client.0.smithi012.stdout:6/173: read d1/d1e/d1b/f33 [223060,103209] 0 2024-02-14T13:10:32.813 INFO:tasks.workunit.client.0.smithi012.stdout:6/174: chown d1/df/d16/f1a 343742219 1 2024-02-14T13:10:32.813 INFO:tasks.workunit.client.0.smithi012.stdout:6/175: truncate d1/d1e/d1b/f2f 1258516 0 2024-02-14T13:10:32.817 INFO:tasks.workunit.client.0.smithi012.stdout:4/181: dread d0/f3 [4194304,4194304] 0 2024-02-14T13:10:32.820 INFO:tasks.workunit.client.0.smithi012.stdout:8/205: symlink d9/dc/d14/d2e/l3e 0 2024-02-14T13:10:32.821 INFO:tasks.workunit.client.0.smithi012.stdout:6/176: creat d1/df/d24/f36 x:0 0 0 2024-02-14T13:10:32.822 INFO:tasks.workunit.client.0.smithi012.stdout:0/204: dwrite d10/d14/d1b/f22 [0,4194304] 0 2024-02-14T13:10:32.822 INFO:tasks.workunit.client.0.smithi012.stdout:0/205: chown d10/d14/f2e 101583 1 2024-02-14T13:10:32.824 INFO:tasks.workunit.client.0.smithi012.stdout:0/206: creat d10/d14/d20/f37 x:0 0 0 2024-02-14T13:10:32.824 INFO:tasks.workunit.client.0.smithi012.stdout:6/177: dread d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:32.825 INFO:tasks.workunit.client.0.smithi012.stdout:6/178: getdents d1/d1e/d1b/d21/d2b 0 2024-02-14T13:10:32.825 INFO:tasks.workunit.client.0.smithi012.stdout:0/207: link fc d10/f38 0 2024-02-14T13:10:32.826 INFO:tasks.workunit.client.0.smithi012.stdout:7/182: dwrite df/d27/f2b [0,4194304] 0 2024-02-14T13:10:32.826 INFO:tasks.workunit.client.0.smithi012.stdout:0/208: creat d10/d14/d1b/f39 x:0 0 0 2024-02-14T13:10:32.827 INFO:tasks.workunit.client.0.smithi012.stdout:6/179: mknod d1/d17/c37 0 2024-02-14T13:10:32.827 INFO:tasks.workunit.client.0.smithi012.stdout:1/221: dread d6/d10/f21 [0,4194304] 0 2024-02-14T13:10:32.830 INFO:tasks.workunit.client.0.smithi012.stdout:0/209: creat d10/d14/d1b/f3a x:0 0 0 2024-02-14T13:10:32.830 INFO:tasks.workunit.client.0.smithi012.stdout:6/180: dread d1/d1e/d1b/f33 [0,4194304] 0 2024-02-14T13:10:32.830 INFO:tasks.workunit.client.0.smithi012.stdout:8/206: read d9/dc/d14/f31 [995446,17700] 0 2024-02-14T13:10:32.831 INFO:tasks.workunit.client.0.smithi012.stdout:0/210: mkdir d10/d14/d2b/d3b 0 2024-02-14T13:10:32.832 INFO:tasks.workunit.client.0.smithi012.stdout:6/181: getdents d1/d1e/d1b/d21 0 2024-02-14T13:10:32.832 INFO:tasks.workunit.client.0.smithi012.stdout:6/182: truncate d1/d1e/d1b/f23 1071277 0 2024-02-14T13:10:32.832 INFO:tasks.workunit.client.0.smithi012.stdout:6/183: write d1/df/d16/f1a [4084622,88751] 0 2024-02-14T13:10:32.833 INFO:tasks.workunit.client.0.smithi012.stdout:1/222: rename d6/d10/d22/d31/d34/f49 to d6/d10/f4a 0 2024-02-14T13:10:32.834 INFO:tasks.workunit.client.0.smithi012.stdout:0/211: creat d10/d14/d1b/f3c x:0 0 0 2024-02-14T13:10:32.834 INFO:tasks.workunit.client.0.smithi012.stdout:0/212: readlink d10/d14/d2b/l2d 0 2024-02-14T13:10:32.834 INFO:tasks.workunit.client.0.smithi012.stdout:0/213: fdatasync d10/f2a 0 2024-02-14T13:10:32.834 INFO:tasks.workunit.client.0.smithi012.stdout:9/236: sync 2024-02-14T13:10:32.835 INFO:tasks.workunit.client.0.smithi012.stdout:9/237: dread - da/dd/d18/f32 zero size 2024-02-14T13:10:32.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/223: mknod d6/d10/c4b 0 2024-02-14T13:10:32.837 INFO:tasks.workunit.client.0.smithi012.stdout:0/214: symlink d10/d14/d1b/d30/l3d 0 2024-02-14T13:10:32.838 INFO:tasks.workunit.client.0.smithi012.stdout:1/224: creat d6/d10/d22/d31/d34/f4c x:0 0 0 2024-02-14T13:10:32.838 INFO:tasks.workunit.client.0.smithi012.stdout:1/225: chown d6/d12/f2e 813635 1 2024-02-14T13:10:32.838 INFO:tasks.workunit.client.0.smithi012.stdout:1/226: dread - d6/d10/d22/d44/f48 zero size 2024-02-14T13:10:32.838 INFO:tasks.workunit.client.0.smithi012.stdout:0/215: dread d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:32.839 INFO:tasks.workunit.client.0.smithi012.stdout:1/227: symlink d6/d12/d15/l4d 0 2024-02-14T13:10:32.841 INFO:tasks.workunit.client.0.smithi012.stdout:0/216: mknod d10/d14/d1b/c3e 0 2024-02-14T13:10:32.841 INFO:tasks.workunit.client.0.smithi012.stdout:9/238: dread f9 [0,4194304] 0 2024-02-14T13:10:32.841 INFO:tasks.workunit.client.0.smithi012.stdout:1/228: link d6/d10/d22/l28 d6/d10/l4e 0 2024-02-14T13:10:32.843 INFO:tasks.workunit.client.0.smithi012.stdout:0/217: creat d10/d14/d1b/d30/f3f x:0 0 0 2024-02-14T13:10:32.843 INFO:tasks.workunit.client.0.smithi012.stdout:0/218: write d10/d14/d1b/f39 [94119,66383] 0 2024-02-14T13:10:32.844 INFO:tasks.workunit.client.0.smithi012.stdout:9/239: creat da/dd/d19/f4b x:0 0 0 2024-02-14T13:10:32.845 INFO:tasks.workunit.client.0.smithi012.stdout:1/229: creat d6/d10/d22/d31/d3e/f4f x:0 0 0 2024-02-14T13:10:32.845 INFO:tasks.workunit.client.0.smithi012.stdout:1/230: fdatasync d6/d12/d15/f3f 0 2024-02-14T13:10:32.846 INFO:tasks.workunit.client.0.smithi012.stdout:9/240: mknod da/dd/d19/c4c 0 2024-02-14T13:10:32.847 INFO:tasks.workunit.client.0.smithi012.stdout:9/241: unlink da/dd/d19/d30/d45/l49 0 2024-02-14T13:10:32.849 INFO:tasks.workunit.client.0.smithi012.stdout:9/242: rename da/dd/d19/d30/f28 to da/dd/d19/f4d 0 2024-02-14T13:10:32.849 INFO:tasks.workunit.client.0.smithi012.stdout:9/243: dread - da/dd/d19/f4d zero size 2024-02-14T13:10:32.849 INFO:tasks.workunit.client.0.smithi012.stdout:9/244: fsync f0 0 2024-02-14T13:10:32.850 INFO:tasks.workunit.client.0.smithi012.stdout:9/245: dread da/dd/f2a [0,4194304] 0 2024-02-14T13:10:32.852 INFO:tasks.workunit.client.0.smithi012.stdout:9/246: rename da/lf to da/dd/l4e 0 2024-02-14T13:10:32.852 INFO:tasks.workunit.client.0.smithi012.stdout:0/219: dread fd [0,4194304] 0 2024-02-14T13:10:32.852 INFO:tasks.workunit.client.0.smithi012.stdout:9/247: dread - da/dd/d19/d30/d20/f31 zero size 2024-02-14T13:10:32.853 INFO:tasks.workunit.client.0.smithi012.stdout:9/248: truncate da/f23 795342 0 2024-02-14T13:10:32.853 INFO:tasks.workunit.client.0.smithi012.stdout:9/249: readlink l5 0 2024-02-14T13:10:32.854 INFO:tasks.workunit.client.0.smithi012.stdout:0/220: rename d10/d14/d1b/l33 to d10/d14/d1b/l40 0 2024-02-14T13:10:32.856 INFO:tasks.workunit.client.0.smithi012.stdout:9/250: mkdir da/d4f 0 2024-02-14T13:10:32.856 INFO:tasks.workunit.client.0.smithi012.stdout:0/221: mkdir d10/d14/d41 0 2024-02-14T13:10:32.858 INFO:tasks.workunit.client.0.smithi012.stdout:9/251: mknod da/dd/d19/d30/d20/c50 0 2024-02-14T13:10:32.858 INFO:tasks.workunit.client.0.smithi012.stdout:8/207: dwrite d9/f3b [4194304,4194304] 0 2024-02-14T13:10:32.858 INFO:tasks.workunit.client.0.smithi012.stdout:6/184: dwrite d1/d1e/d1b/d21/f32 [0,4194304] 0 2024-02-14T13:10:32.860 INFO:tasks.workunit.client.0.smithi012.stdout:8/208: creat d9/dc/d14/d2e/f3f x:0 0 0 2024-02-14T13:10:32.862 INFO:tasks.workunit.client.0.smithi012.stdout:6/185: mkdir d1/d1e/dc/d38 0 2024-02-14T13:10:32.862 INFO:tasks.workunit.client.0.smithi012.stdout:9/252: dread f8 [0,4194304] 0 2024-02-14T13:10:32.862 INFO:tasks.workunit.client.0.smithi012.stdout:0/222: dread d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:32.862 INFO:tasks.workunit.client.0.smithi012.stdout:9/253: fsync f4 0 2024-02-14T13:10:32.862 INFO:tasks.workunit.client.0.smithi012.stdout:1/231: dwrite d6/d12/d15/d3d/f45 [0,4194304] 0 2024-02-14T13:10:32.863 INFO:tasks.workunit.client.0.smithi012.stdout:8/209: creat d9/dc/d14/f40 x:0 0 0 2024-02-14T13:10:32.863 INFO:tasks.workunit.client.0.smithi012.stdout:0/223: dread d10/f13 [0,4194304] 0 2024-02-14T13:10:32.872 INFO:tasks.workunit.client.0.smithi012.stdout:1/232: rename d6/d12 to d6/d10/d22/d31/d34/d3b/d50 0 2024-02-14T13:10:32.874 INFO:tasks.workunit.client.0.smithi012.stdout:8/210: creat d9/dc/d14/d23/f41 x:0 0 0 2024-02-14T13:10:32.874 INFO:tasks.workunit.client.0.smithi012.stdout:8/211: stat f8 0 2024-02-14T13:10:32.875 INFO:tasks.workunit.client.0.smithi012.stdout:0/224: dread f0 [0,4194304] 0 2024-02-14T13:10:32.875 INFO:tasks.workunit.client.0.smithi012.stdout:6/186: symlink d1/d1e/l39 0 2024-02-14T13:10:32.876 INFO:tasks.workunit.client.0.smithi012.stdout:6/187: write d1/d1e/d1b/f33 [101392,118777] 0 2024-02-14T13:10:32.877 INFO:tasks.workunit.client.0.smithi012.stdout:1/233: creat d6/d10/d22/d31/d34/d3b/d50/d15/d3d/f51 x:0 0 0 2024-02-14T13:10:32.879 INFO:tasks.workunit.client.0.smithi012.stdout:0/225: link c9 d10/d14/d41/c42 0 2024-02-14T13:10:32.879 INFO:tasks.workunit.client.0.smithi012.stdout:0/226: readlink lb 0 2024-02-14T13:10:32.879 INFO:tasks.workunit.client.0.smithi012.stdout:0/227: chown d10/d14/d20/d21/f36 1905 1 2024-02-14T13:10:32.881 INFO:tasks.workunit.client.0.smithi012.stdout:6/188: fsync d1/d1e/f20 0 2024-02-14T13:10:32.881 INFO:tasks.workunit.client.0.smithi012.stdout:6/189: rename d1/d1e/d1b to d1/d1e/d1b/d21/d2b/d3a 22 2024-02-14T13:10:32.881 INFO:tasks.workunit.client.0.smithi012.stdout:8/212: dread d9/dc/d14/f31 [0,4194304] 0 2024-02-14T13:10:32.884 INFO:tasks.workunit.client.0.smithi012.stdout:8/213: mknod d9/dc/d1b/d35/c42 0 2024-02-14T13:10:32.886 INFO:tasks.workunit.client.0.smithi012.stdout:9/254: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:32.886 INFO:tasks.workunit.client.0.smithi012.stdout:6/190: truncate d1/d1e/d1b/d21/f32 368316 0 2024-02-14T13:10:32.886 INFO:tasks.workunit.client.0.smithi012.stdout:6/191: chown d1/d1e/dc/c26 6975 1 2024-02-14T13:10:32.886 INFO:tasks.workunit.client.0.smithi012.stdout:6/192: dread - d1/df/d24/f36 zero size 2024-02-14T13:10:32.886 INFO:tasks.workunit.client.0.smithi012.stdout:6/193: chown d1/d1e/d1b 77163 1 2024-02-14T13:10:32.886 INFO:tasks.workunit.client.0.smithi012.stdout:6/194: chown d1/d1e/l39 57538850 1 2024-02-14T13:10:32.887 INFO:tasks.workunit.client.0.smithi012.stdout:9/255: creat da/dd/d19/d30/d20/f51 x:0 0 0 2024-02-14T13:10:32.889 INFO:tasks.workunit.client.0.smithi012.stdout:6/195: symlink d1/df/d16/l3b 0 2024-02-14T13:10:32.890 INFO:tasks.workunit.client.0.smithi012.stdout:9/256: creat da/dd/d39/f52 x:0 0 0 2024-02-14T13:10:32.892 INFO:tasks.workunit.client.0.smithi012.stdout:6/196: getdents d1/d17 0 2024-02-14T13:10:32.893 INFO:tasks.workunit.client.0.smithi012.stdout:9/257: getdents da/dd/d18 0 2024-02-14T13:10:32.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/214: dread f4 [0,4194304] 0 2024-02-14T13:10:32.895 INFO:tasks.workunit.client.0.smithi012.stdout:6/197: mkdir d1/d1e/d3c 0 2024-02-14T13:10:32.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/198: unlink d1/df/l2c 0 2024-02-14T13:10:32.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/199: readlink d1/df/d16/l3b 0 2024-02-14T13:10:32.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/200: fdatasync d1/d1e/d1b/f2f 0 2024-02-14T13:10:32.898 INFO:tasks.workunit.client.0.smithi012.stdout:8/215: getdents d9/dc 0 2024-02-14T13:10:32.899 INFO:tasks.workunit.client.0.smithi012.stdout:8/216: dread - d9/dc/d14/d23/f41 zero size 2024-02-14T13:10:32.899 INFO:tasks.workunit.client.0.smithi012.stdout:6/201: creat d1/d1e/d1b/f3d x:0 0 0 2024-02-14T13:10:32.900 INFO:tasks.workunit.client.0.smithi012.stdout:6/202: stat d1/df/d16/f1a 0 2024-02-14T13:10:32.904 INFO:tasks.workunit.client.0.smithi012.stdout:6/203: fsync d1/d1e/d1b/f3d 0 2024-02-14T13:10:32.904 INFO:tasks.workunit.client.0.smithi012.stdout:8/217: dread d9/dc/d1b/f27 [0,4194304] 0 2024-02-14T13:10:32.905 INFO:tasks.workunit.client.0.smithi012.stdout:6/204: mkdir d1/d1e/d1b/d3e 0 2024-02-14T13:10:32.906 INFO:tasks.workunit.client.0.smithi012.stdout:6/205: mkdir d1/df/d24/d3f 0 2024-02-14T13:10:32.907 INFO:tasks.workunit.client.0.smithi012.stdout:6/206: creat d1/df/d24/f40 x:0 0 0 2024-02-14T13:10:32.908 INFO:tasks.workunit.client.0.smithi012.stdout:6/207: symlink d1/d1e/dc/d38/l41 0 2024-02-14T13:10:32.910 INFO:tasks.workunit.client.0.smithi012.stdout:6/208: symlink d1/d17/l42 0 2024-02-14T13:10:32.911 INFO:tasks.workunit.client.0.smithi012.stdout:6/209: mkdir d1/d1e/dc/d43 0 2024-02-14T13:10:32.911 INFO:tasks.workunit.client.0.smithi012.stdout:6/210: mknod d1/d1e/d3c/c44 0 2024-02-14T13:10:32.915 INFO:tasks.workunit.client.0.smithi012.stdout:0/228: dwrite d10/f32 [0,4194304] 0 2024-02-14T13:10:32.915 INFO:tasks.workunit.client.0.smithi012.stdout:9/258: dwrite da/dd/d19/d30/f43 [0,4194304] 0 2024-02-14T13:10:32.915 INFO:tasks.workunit.client.0.smithi012.stdout:9/259: dread - da/dd/d19/f4d zero size 2024-02-14T13:10:32.916 INFO:tasks.workunit.client.0.smithi012.stdout:6/211: dread d1/df/d16/f1a [0,4194304] 0 2024-02-14T13:10:32.919 INFO:tasks.workunit.client.0.smithi012.stdout:0/229: creat d10/d14/f43 x:0 0 0 2024-02-14T13:10:32.919 INFO:tasks.workunit.client.0.smithi012.stdout:0/230: write fd [454937,17813] 0 2024-02-14T13:10:32.921 INFO:tasks.workunit.client.0.smithi012.stdout:9/260: dread f9 [0,4194304] 0 2024-02-14T13:10:32.921 INFO:tasks.workunit.client.0.smithi012.stdout:8/218: dwrite d9/dc/d1b/f21 [0,4194304] 0 2024-02-14T13:10:32.922 INFO:tasks.workunit.client.0.smithi012.stdout:6/212: rename d1/d1e/d3c/c44 to d1/df/d16/c45 0 2024-02-14T13:10:32.922 INFO:tasks.workunit.client.0.smithi012.stdout:6/213: fsync d1/d1e/f20 0 2024-02-14T13:10:32.927 INFO:tasks.workunit.client.0.smithi012.stdout:9/261: rename da/dd/d38/f3e to da/dd/f53 0 2024-02-14T13:10:32.928 INFO:tasks.workunit.client.0.smithi012.stdout:9/262: mknod da/c54 0 2024-02-14T13:10:32.929 INFO:tasks.workunit.client.0.smithi012.stdout:9/263: mkdir da/dd/d55 0 2024-02-14T13:10:32.948 INFO:tasks.workunit.client.0.smithi012.stdout:5/243: sync 2024-02-14T13:10:32.949 INFO:tasks.workunit.client.0.smithi012.stdout:5/244: creat dc/f4d x:0 0 0 2024-02-14T13:10:32.949 INFO:tasks.workunit.client.0.smithi012.stdout:5/245: write dc/d17/f24 [1428076,63313] 0 2024-02-14T13:10:32.951 INFO:tasks.workunit.client.0.smithi012.stdout:5/246: rmdir dc/d2f/d40 39 2024-02-14T13:10:32.951 INFO:tasks.workunit.client.0.smithi012.stdout:5/247: fsync dc/d17/d20/f42 0 2024-02-14T13:10:32.952 INFO:tasks.workunit.client.0.smithi012.stdout:5/248: unlink dc/d17/f2c 0 2024-02-14T13:10:32.953 INFO:tasks.workunit.client.0.smithi012.stdout:5/249: write dc/d17/d20/f2d [172458,16619] 0 2024-02-14T13:10:32.954 INFO:tasks.workunit.client.0.smithi012.stdout:5/250: mknod dc/d17/d20/c4e 0 2024-02-14T13:10:32.955 INFO:tasks.workunit.client.0.smithi012.stdout:5/251: creat dc/d17/d20/f4f x:0 0 0 2024-02-14T13:10:32.958 INFO:tasks.workunit.client.0.smithi012.stdout:8/219: dwrite f8 [4194304,4194304] 0 2024-02-14T13:10:32.959 INFO:tasks.workunit.client.0.smithi012.stdout:8/220: symlink d9/l43 0 2024-02-14T13:10:32.960 INFO:tasks.workunit.client.0.smithi012.stdout:8/221: creat d9/dc/d14/d2e/f44 x:0 0 0 2024-02-14T13:10:32.960 INFO:tasks.workunit.client.0.smithi012.stdout:8/222: fsync d9/dc/d1b/f21 0 2024-02-14T13:10:32.961 INFO:tasks.workunit.client.0.smithi012.stdout:6/214: dwrite d1/d1e/dc/f15 [0,4194304] 0 2024-02-14T13:10:32.966 INFO:tasks.workunit.client.0.smithi012.stdout:0/231: dwrite fc [0,4194304] 0 2024-02-14T13:10:32.966 INFO:tasks.workunit.client.0.smithi012.stdout:9/264: dwrite f0 [0,4194304] 0 2024-02-14T13:10:32.967 INFO:tasks.workunit.client.0.smithi012.stdout:6/215: rmdir d1/d1e/d1b/d21/d2b 0 2024-02-14T13:10:32.972 INFO:tasks.workunit.client.0.smithi012.stdout:0/232: unlink c6 0 2024-02-14T13:10:32.973 INFO:tasks.workunit.client.0.smithi012.stdout:9/265: creat da/f56 x:0 0 0 2024-02-14T13:10:32.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/223: read d9/dc/d14/f15 [4429517,50725] 0 2024-02-14T13:10:32.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/224: write f8 [2971875,19718] 0 2024-02-14T13:10:32.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/225: write d9/dc/d14/d23/f41 [29107,20735] 0 2024-02-14T13:10:32.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/226: dread - d9/dc/d14/f40 zero size 2024-02-14T13:10:32.974 INFO:tasks.workunit.client.0.smithi012.stdout:0/233: link d10/d14/d1b/c3e d10/d14/d41/c44 0 2024-02-14T13:10:32.989 INFO:tasks.workunit.client.0.smithi012.stdout:5/252: dwrite dc/d17/d20/f36 [0,4194304] 0 2024-02-14T13:10:32.992 INFO:tasks.workunit.client.0.smithi012.stdout:0/234: write d10/f32 [1534331,103578] 0 2024-02-14T13:10:32.992 INFO:tasks.workunit.client.0.smithi012.stdout:0/235: readlink d10/d14/d1b/l40 0 2024-02-14T13:10:32.993 INFO:tasks.workunit.client.0.smithi012.stdout:3/167: sync 2024-02-14T13:10:32.994 INFO:tasks.workunit.client.0.smithi012.stdout:3/168: dread d9/dd/f17 [0,4194304] 0 2024-02-14T13:10:32.994 INFO:tasks.workunit.client.0.smithi012.stdout:3/169: fsync f1 0 2024-02-14T13:10:32.995 INFO:tasks.workunit.client.0.smithi012.stdout:6/216: dwrite d1/d1e/dc/f2e [0,4194304] 0 2024-02-14T13:10:32.997 INFO:tasks.workunit.client.0.smithi012.stdout:6/217: getdents d1/d1e/d1b 0 2024-02-14T13:10:32.998 INFO:tasks.workunit.client.0.smithi012.stdout:6/218: rmdir d1/d1e/dc/d38 39 2024-02-14T13:10:32.999 INFO:tasks.workunit.client.0.smithi012.stdout:8/227: dwrite d9/dc/d14/f40 [0,4194304] 0 2024-02-14T13:10:33.000 INFO:tasks.workunit.client.0.smithi012.stdout:8/228: read - d9/dc/f2c zero size 2024-02-14T13:10:33.001 INFO:tasks.workunit.client.0.smithi012.stdout:8/229: symlink d9/dc/d1b/l45 0 2024-02-14T13:10:33.004 INFO:tasks.workunit.client.0.smithi012.stdout:8/230: unlink d9/dc/d1b/l34 0 2024-02-14T13:10:33.004 INFO:tasks.workunit.client.0.smithi012.stdout:8/231: chown d9/dc/d14/f31 408848 1 2024-02-14T13:10:33.005 INFO:tasks.workunit.client.0.smithi012.stdout:8/232: mknod d9/dc/d14/d2e/c46 0 2024-02-14T13:10:33.005 INFO:tasks.workunit.client.0.smithi012.stdout:8/233: write d9/dc/d14/d23/f39 [2524615,83631] 0 2024-02-14T13:10:33.005 INFO:tasks.workunit.client.0.smithi012.stdout:8/234: dread - d9/dc/d14/d2e/f44 zero size 2024-02-14T13:10:33.007 INFO:tasks.workunit.client.0.smithi012.stdout:8/235: link d9/l43 d9/dc/d14/l47 0 2024-02-14T13:10:33.008 INFO:tasks.workunit.client.0.smithi012.stdout:8/236: write f8 [5155335,113074] 0 2024-02-14T13:10:33.008 INFO:tasks.workunit.client.0.smithi012.stdout:8/237: write d9/f3c [963372,37034] 0 2024-02-14T13:10:33.008 INFO:tasks.workunit.client.0.smithi012.stdout:8/238: mknod d9/dc/d38/c48 0 2024-02-14T13:10:33.020 INFO:tasks.workunit.client.0.smithi012.stdout:3/170: dwrite d9/d18/f23 [0,4194304] 0 2024-02-14T13:10:33.021 INFO:tasks.workunit.client.0.smithi012.stdout:0/236: dwrite d10/d14/d1b/f3a [0,4194304] 0 2024-02-14T13:10:33.021 INFO:tasks.workunit.client.0.smithi012.stdout:0/237: write d10/d14/d20/d21/f36 [939977,118367] 0 2024-02-14T13:10:33.021 INFO:tasks.workunit.client.0.smithi012.stdout:8/239: dread d9/dc/d14/f40 [0,4194304] 0 2024-02-14T13:10:33.022 INFO:tasks.workunit.client.0.smithi012.stdout:8/240: readlink d9/dc/d1b/l2f 0 2024-02-14T13:10:33.022 INFO:tasks.workunit.client.0.smithi012.stdout:3/171: getdents d9/dd/de 0 2024-02-14T13:10:33.025 INFO:tasks.workunit.client.0.smithi012.stdout:8/241: dread d9/dc/d1b/f1e [0,4194304] 0 2024-02-14T13:10:33.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/238: creat d10/d14/d23/f45 x:0 0 0 2024-02-14T13:10:33.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/239: chown d10/f2a 476 1 2024-02-14T13:10:33.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/240: chown lb 12 1 2024-02-14T13:10:33.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/241: fsync d10/d14/d1b/f39 0 2024-02-14T13:10:33.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/242: fdatasync d10/f11 0 2024-02-14T13:10:33.026 INFO:tasks.workunit.client.0.smithi012.stdout:0/243: write d10/f32 [3899162,116950] 0 2024-02-14T13:10:33.027 INFO:tasks.workunit.client.0.smithi012.stdout:3/172: creat d9/d3f/f41 x:0 0 0 2024-02-14T13:10:33.028 INFO:tasks.workunit.client.0.smithi012.stdout:0/244: mknod d10/d14/d41/c46 0 2024-02-14T13:10:33.029 INFO:tasks.workunit.client.0.smithi012.stdout:0/245: mknod d10/d14/d20/c47 0 2024-02-14T13:10:33.046 INFO:tasks.workunit.client.0.smithi012.stdout:3/173: dwrite d9/d3f/f41 [0,4194304] 0 2024-02-14T13:10:33.046 INFO:tasks.workunit.client.0.smithi012.stdout:8/242: dwrite d9/dc/d1b/f20 [0,4194304] 0 2024-02-14T13:10:33.048 INFO:tasks.workunit.client.0.smithi012.stdout:3/174: rename d9/dd/de/c31 to d9/d13/c42 0 2024-02-14T13:10:33.051 INFO:tasks.workunit.client.0.smithi012.stdout:8/243: mkdir d9/dc/d14/d2e/d49 0 2024-02-14T13:10:33.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/175: getdents d9 0 2024-02-14T13:10:33.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/176: truncate d9/d13/d28/f40 259425 0 2024-02-14T13:10:33.055 INFO:tasks.workunit.client.0.smithi012.stdout:3/177: unlink d9/dd/d30/l32 0 2024-02-14T13:10:33.056 INFO:tasks.workunit.client.0.smithi012.stdout:3/178: write d9/d13/d28/f36 [645209,75020] 0 2024-02-14T13:10:33.057 INFO:tasks.workunit.client.0.smithi012.stdout:3/179: rename d9/d18/l21 to d9/dd/d30/d34/l43 0 2024-02-14T13:10:33.057 INFO:tasks.workunit.client.0.smithi012.stdout:3/180: stat d9/d13/d28/f40 0 2024-02-14T13:10:33.059 INFO:tasks.workunit.client.0.smithi012.stdout:3/181: rmdir d9/dd/d30/d34 39 2024-02-14T13:10:33.060 INFO:tasks.workunit.client.0.smithi012.stdout:8/244: dread d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:33.060 INFO:tasks.workunit.client.0.smithi012.stdout:0/246: dwrite d10/d14/d20/d21/f28 [0,4194304] 0 2024-02-14T13:10:33.060 INFO:tasks.workunit.client.0.smithi012.stdout:8/245: dread - d9/dc/d14/d2e/f3f zero size 2024-02-14T13:10:33.061 INFO:tasks.workunit.client.0.smithi012.stdout:3/182: rename d9/dd/d27 to d9/dd/d30/d44 0 2024-02-14T13:10:33.066 INFO:tasks.workunit.client.0.smithi012.stdout:3/183: write d9/d18/f1c [688357,116624] 0 2024-02-14T13:10:33.068 INFO:tasks.workunit.client.0.smithi012.stdout:8/246: truncate d9/dc/d1b/f20 3826827 0 2024-02-14T13:10:33.070 INFO:tasks.workunit.client.0.smithi012.stdout:8/247: write d9/f3c [455,114418] 0 2024-02-14T13:10:33.070 INFO:tasks.workunit.client.0.smithi012.stdout:8/248: write d9/dc/d14/d2e/f3f [47215,80387] 0 2024-02-14T13:10:33.070 INFO:tasks.workunit.client.0.smithi012.stdout:8/249: chown d9/l36 51 1 2024-02-14T13:10:33.070 INFO:tasks.workunit.client.0.smithi012.stdout:3/184: symlink d9/dd/d30/d44/d3d/l45 0 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:1/234: sync 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:7/183: sync 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:2/196: sync 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:4/182: sync 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:7/184: chown df/d2d/f3e 7502970 1 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:2/197: write d0/d1a/f25 [1942428,75756] 0 2024-02-14T13:10:33.071 INFO:tasks.workunit.client.0.smithi012.stdout:8/250: creat d9/dc/d38/f4a x:0 0 0 2024-02-14T13:10:33.073 INFO:tasks.workunit.client.0.smithi012.stdout:1/235: rename d6/d35/f46 to d6/d10/d22/d44/f52 0 2024-02-14T13:10:33.074 INFO:tasks.workunit.client.0.smithi012.stdout:8/251: rmdir d9/dc/d14/d2e/d49 0 2024-02-14T13:10:33.075 INFO:tasks.workunit.client.0.smithi012.stdout:4/183: rename d0/f3 to d0/d10/d1f/d3e/f3f 0 2024-02-14T13:10:33.075 INFO:tasks.workunit.client.0.smithi012.stdout:4/184: fsync d0/fa 0 2024-02-14T13:10:33.076 INFO:tasks.workunit.client.0.smithi012.stdout:1/236: stat d6/d10/l4e 0 2024-02-14T13:10:33.076 INFO:tasks.workunit.client.0.smithi012.stdout:1/237: write d6/fb [45018,82038] 0 2024-02-14T13:10:33.078 INFO:tasks.workunit.client.0.smithi012.stdout:2/198: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:33.078 INFO:tasks.workunit.client.0.smithi012.stdout:2/199: stat d0/d6/de/c21 0 2024-02-14T13:10:33.080 INFO:tasks.workunit.client.0.smithi012.stdout:4/185: creat d0/d10/d13/d17/d3a/f40 x:0 0 0 2024-02-14T13:10:33.080 INFO:tasks.workunit.client.0.smithi012.stdout:4/186: dread - d0/d10/d13/d17/d3a/f40 zero size 2024-02-14T13:10:33.082 INFO:tasks.workunit.client.0.smithi012.stdout:1/238: unlink d6/fb 0 2024-02-14T13:10:33.084 INFO:tasks.workunit.client.0.smithi012.stdout:2/200: symlink d0/d6/de/l41 0 2024-02-14T13:10:33.084 INFO:tasks.workunit.client.0.smithi012.stdout:3/185: dread d9/dd/d30/d44/f29 [0,4194304] 0 2024-02-14T13:10:33.085 INFO:tasks.workunit.client.0.smithi012.stdout:4/187: link d0/d10/d28/c39 d0/d10/d13/d17/c41 0 2024-02-14T13:10:33.085 INFO:tasks.workunit.client.0.smithi012.stdout:4/188: fdatasync d0/d10/d13/f2d 0 2024-02-14T13:10:33.086 INFO:tasks.workunit.client.0.smithi012.stdout:1/239: unlink d6/d10/f23 0 2024-02-14T13:10:33.086 INFO:tasks.workunit.client.0.smithi012.stdout:1/240: dread - d6/d10/d22/d31/d34/d3b/d50/d15/f36 zero size 2024-02-14T13:10:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:3/186: creat d9/dd/d30/d44/f46 x:0 0 0 2024-02-14T13:10:33.087 INFO:tasks.workunit.client.0.smithi012.stdout:3/187: chown d9/d13 6 1 2024-02-14T13:10:33.088 INFO:tasks.workunit.client.0.smithi012.stdout:0/247: dwrite fc [4194304,4194304] 0 2024-02-14T13:10:33.088 INFO:tasks.workunit.client.0.smithi012.stdout:4/189: mknod d0/d10/d13/c42 0 2024-02-14T13:10:33.089 INFO:tasks.workunit.client.0.smithi012.stdout:3/188: symlink d9/d18/d39/l47 0 2024-02-14T13:10:33.090 INFO:tasks.workunit.client.0.smithi012.stdout:0/248: creat d10/d14/d41/f48 x:0 0 0 2024-02-14T13:10:33.091 INFO:tasks.workunit.client.0.smithi012.stdout:7/185: dwrite df/d24/f31 [0,4194304] 0 2024-02-14T13:10:33.093 INFO:tasks.workunit.client.0.smithi012.stdout:4/190: mknod d0/d10/d13/d17/d3a/c43 0 2024-02-14T13:10:33.094 INFO:tasks.workunit.client.0.smithi012.stdout:3/189: rename d9/dd/l10 to d9/d3f/l48 0 2024-02-14T13:10:33.096 INFO:tasks.workunit.client.0.smithi012.stdout:0/249: mkdir d10/d14/d20/d49 0 2024-02-14T13:10:33.100 INFO:tasks.workunit.client.0.smithi012.stdout:7/186: rmdir df/d2d 39 2024-02-14T13:10:33.101 INFO:tasks.workunit.client.0.smithi012.stdout:7/187: stat df/f11 0 2024-02-14T13:10:33.102 INFO:tasks.workunit.client.0.smithi012.stdout:2/201: dwrite d0/d8/d11/d33/f38 [0,4194304] 0 2024-02-14T13:10:33.102 INFO:tasks.workunit.client.0.smithi012.stdout:4/191: dread d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:33.103 INFO:tasks.workunit.client.0.smithi012.stdout:7/188: link df/d36/c37 df/d2d/c49 0 2024-02-14T13:10:33.105 INFO:tasks.workunit.client.0.smithi012.stdout:3/190: write d9/d13/f26 [1180023,106920] 0 2024-02-14T13:10:33.106 INFO:tasks.workunit.client.0.smithi012.stdout:2/202: link d0/d8/d11/f32 d0/d5/f42 0 2024-02-14T13:10:33.107 INFO:tasks.workunit.client.0.smithi012.stdout:7/189: mknod df/d2d/c4a 0 2024-02-14T13:10:33.107 INFO:tasks.workunit.client.0.smithi012.stdout:7/190: dread - df/d2d/f3f zero size 2024-02-14T13:10:33.108 INFO:tasks.workunit.client.0.smithi012.stdout:7/191: dread - df/d36/f39 zero size 2024-02-14T13:10:33.111 INFO:tasks.workunit.client.0.smithi012.stdout:3/191: truncate d9/d3f/f41 2177775 0 2024-02-14T13:10:33.112 INFO:tasks.workunit.client.0.smithi012.stdout:7/192: mkdir df/d27/d4b 0 2024-02-14T13:10:33.113 INFO:tasks.workunit.client.0.smithi012.stdout:2/203: write d0/d8/d11/f32 [3783216,80964] 0 2024-02-14T13:10:33.113 INFO:tasks.workunit.client.0.smithi012.stdout:3/192: symlink d9/dd/d30/d34/l49 0 2024-02-14T13:10:33.113 INFO:tasks.workunit.client.0.smithi012.stdout:3/193: fdatasync d9/f35 0 2024-02-14T13:10:33.114 INFO:tasks.workunit.client.0.smithi012.stdout:3/194: truncate d9/d13/d28/f36 861062 0 2024-02-14T13:10:33.120 INFO:tasks.workunit.client.0.smithi012.stdout:3/195: write d9/d3f/f41 [2637412,25555] 0 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/250: dwrite d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/251: chown d10/d14/d2b/l2d 3 1 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:4/192: dwrite d0/d10/d13/f2d [0,4194304] 0 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:7/193: dread df/f2c [0,4194304] 0 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:4/193: read d0/fa [1892564,127081] 0 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:7/194: write df/f21 [291651,70611] 0 2024-02-14T13:10:33.125 INFO:tasks.workunit.client.0.smithi012.stdout:7/195: chown df/c1e 15963400 1 2024-02-14T13:10:33.128 INFO:tasks.workunit.client.0.smithi012.stdout:4/194: rmdir d0/d10/d1f/d3e 39 2024-02-14T13:10:33.128 INFO:tasks.workunit.client.0.smithi012.stdout:4/195: truncate d0/d10/d13/d17/d3a/f40 982410 0 2024-02-14T13:10:33.129 INFO:tasks.workunit.client.0.smithi012.stdout:4/196: dread - d0/d10/f30 zero size 2024-02-14T13:10:33.129 INFO:tasks.workunit.client.0.smithi012.stdout:3/196: dread f1 [0,4194304] 0 2024-02-14T13:10:33.130 INFO:tasks.workunit.client.0.smithi012.stdout:0/252: dread d10/d14/f1e [0,4194304] 0 2024-02-14T13:10:33.130 INFO:tasks.workunit.client.0.smithi012.stdout:0/253: dread - d10/d14/d1b/f3c zero size 2024-02-14T13:10:33.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/196: rename df/d24/f35 to df/d27/f4c 0 2024-02-14T13:10:33.131 INFO:tasks.workunit.client.0.smithi012.stdout:7/197: write df/d24/f29 [3437494,50940] 0 2024-02-14T13:10:33.132 INFO:tasks.workunit.client.0.smithi012.stdout:4/197: rmdir d0/d10/d28 39 2024-02-14T13:10:33.132 INFO:tasks.workunit.client.0.smithi012.stdout:2/204: dwrite d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:33.133 INFO:tasks.workunit.client.0.smithi012.stdout:3/197: creat d9/dd/f4a x:0 0 0 2024-02-14T13:10:33.133 INFO:tasks.workunit.client.0.smithi012.stdout:3/198: chown d9/dd/f15 94 1 2024-02-14T13:10:33.134 INFO:tasks.workunit.client.0.smithi012.stdout:0/254: creat d10/d14/d20/f4a x:0 0 0 2024-02-14T13:10:33.135 INFO:tasks.workunit.client.0.smithi012.stdout:2/205: dread d0/d1a/f25 [0,4194304] 0 2024-02-14T13:10:33.135 INFO:tasks.workunit.client.0.smithi012.stdout:7/198: symlink df/d36/l4d 0 2024-02-14T13:10:33.137 INFO:tasks.workunit.client.0.smithi012.stdout:4/198: rmdir d0/d10/d13/d17 39 2024-02-14T13:10:33.137 INFO:tasks.workunit.client.0.smithi012.stdout:4/199: truncate d0/d10/f30 1039273 0 2024-02-14T13:10:33.137 INFO:tasks.workunit.client.0.smithi012.stdout:4/200: read d0/f6 [3629261,64506] 0 2024-02-14T13:10:33.138 INFO:tasks.workunit.client.0.smithi012.stdout:3/199: rmdir d9/d18 39 2024-02-14T13:10:33.140 INFO:tasks.workunit.client.0.smithi012.stdout:0/255: creat d10/d14/d2b/d3b/f4b x:0 0 0 2024-02-14T13:10:33.140 INFO:tasks.workunit.client.0.smithi012.stdout:3/200: dread d9/f35 [0,4194304] 0 2024-02-14T13:10:33.140 INFO:tasks.workunit.client.0.smithi012.stdout:7/199: rmdir df/d2d 39 2024-02-14T13:10:33.142 INFO:tasks.workunit.client.0.smithi012.stdout:0/256: mknod d10/d14/d20/d49/c4c 0 2024-02-14T13:10:33.142 INFO:tasks.workunit.client.0.smithi012.stdout:0/257: fsync d10/d14/f43 0 2024-02-14T13:10:33.144 INFO:tasks.workunit.client.0.smithi012.stdout:3/201: rename f1 to d9/dd/d30/d44/f4b 0 2024-02-14T13:10:33.145 INFO:tasks.workunit.client.0.smithi012.stdout:0/258: creat d10/d14/d2b/d3b/f4d x:0 0 0 2024-02-14T13:10:33.145 INFO:tasks.workunit.client.0.smithi012.stdout:4/201: write d0/f1a [2577711,67533] 0 2024-02-14T13:10:33.145 INFO:tasks.workunit.client.0.smithi012.stdout:3/202: creat d9/d3f/f4c x:0 0 0 2024-02-14T13:10:33.146 INFO:tasks.workunit.client.0.smithi012.stdout:2/206: dread d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:33.147 INFO:tasks.workunit.client.0.smithi012.stdout:0/259: rename d10/d14/d1b/f39 to d10/d14/d20/d21/f4e 0 2024-02-14T13:10:33.148 INFO:tasks.workunit.client.0.smithi012.stdout:4/202: truncate d0/d10/f2a 1385599 0 2024-02-14T13:10:33.148 INFO:tasks.workunit.client.0.smithi012.stdout:4/203: write d0/d10/d1f/d3e/f3f [9059736,91092] 0 2024-02-14T13:10:33.149 INFO:tasks.workunit.client.0.smithi012.stdout:3/203: creat d9/d18/f4d x:0 0 0 2024-02-14T13:10:33.150 INFO:tasks.workunit.client.0.smithi012.stdout:2/207: mkdir d0/d8/d43 0 2024-02-14T13:10:33.150 INFO:tasks.workunit.client.0.smithi012.stdout:2/208: fdatasync d0/d8/d11/f17 0 2024-02-14T13:10:33.151 INFO:tasks.workunit.client.0.smithi012.stdout:0/260: creat d10/d14/d2b/d3b/f4f x:0 0 0 2024-02-14T13:10:33.154 INFO:tasks.workunit.client.0.smithi012.stdout:4/204: symlink d0/d10/d13/d17/d3a/l44 0 2024-02-14T13:10:33.154 INFO:tasks.workunit.client.0.smithi012.stdout:0/261: dread d10/d14/f1e [0,4194304] 0 2024-02-14T13:10:33.155 INFO:tasks.workunit.client.0.smithi012.stdout:3/204: mkdir d9/d3f/d4e 0 2024-02-14T13:10:33.155 INFO:tasks.workunit.client.0.smithi012.stdout:2/209: dread d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:33.157 INFO:tasks.workunit.client.0.smithi012.stdout:7/200: dwrite df/f33 [0,4194304] 0 2024-02-14T13:10:33.160 INFO:tasks.workunit.client.0.smithi012.stdout:4/205: creat d0/d10/d28/f45 x:0 0 0 2024-02-14T13:10:33.162 INFO:tasks.workunit.client.0.smithi012.stdout:7/201: dread df/f11 [4194304,4194304] 0 2024-02-14T13:10:33.164 INFO:tasks.workunit.client.0.smithi012.stdout:0/262: rename d10/f38 to d10/d14/d2b/d3b/f50 0 2024-02-14T13:10:33.166 INFO:tasks.workunit.client.0.smithi012.stdout:3/205: mknod d9/d18/c4f 0 2024-02-14T13:10:33.167 INFO:tasks.workunit.client.0.smithi012.stdout:2/210: mknod d0/d8/d11/d35/c44 0 2024-02-14T13:10:33.167 INFO:tasks.workunit.client.0.smithi012.stdout:2/211: read d0/d5/f42 [3094686,89925] 0 2024-02-14T13:10:33.169 INFO:tasks.workunit.client.0.smithi012.stdout:7/202: mknod df/d2d/c4e 0 2024-02-14T13:10:33.171 INFO:tasks.workunit.client.0.smithi012.stdout:3/206: mkdir d9/d18/d50 0 2024-02-14T13:10:33.171 INFO:tasks.workunit.client.0.smithi012.stdout:3/207: truncate d9/dd/d30/d44/f46 1016746 0 2024-02-14T13:10:33.172 INFO:tasks.workunit.client.0.smithi012.stdout:7/203: link df/d24/l2a df/l4f 0 2024-02-14T13:10:33.174 INFO:tasks.workunit.client.0.smithi012.stdout:3/208: creat d9/dd/d30/d34/f51 x:0 0 0 2024-02-14T13:10:33.174 INFO:tasks.workunit.client.0.smithi012.stdout:3/209: truncate d9/d3f/f4c 748053 0 2024-02-14T13:10:33.175 INFO:tasks.workunit.client.0.smithi012.stdout:7/204: unlink df/d36/l43 0 2024-02-14T13:10:33.175 INFO:tasks.workunit.client.0.smithi012.stdout:3/210: mknod d9/c52 0 2024-02-14T13:10:33.180 INFO:tasks.workunit.client.0.smithi012.stdout:4/206: dwrite d0/d10/d1f/d3e/f3f [4194304,4194304] 0 2024-02-14T13:10:33.180 INFO:tasks.workunit.client.0.smithi012.stdout:4/207: fsync d0/d10/d28/f37 0 2024-02-14T13:10:33.186 INFO:tasks.workunit.client.0.smithi012.stdout:7/205: write fd [855450,51282] 0 2024-02-14T13:10:33.191 INFO:tasks.workunit.client.0.smithi012.stdout:6/219: sync 2024-02-14T13:10:33.192 INFO:tasks.workunit.client.0.smithi012.stdout:2/212: dwrite d0/d8/d11/d33/f38 [0,4194304] 0 2024-02-14T13:10:33.192 INFO:tasks.workunit.client.0.smithi012.stdout:2/213: readlink d0/lb 0 2024-02-14T13:10:33.192 INFO:tasks.workunit.client.0.smithi012.stdout:5/253: sync 2024-02-14T13:10:33.192 INFO:tasks.workunit.client.0.smithi012.stdout:8/252: sync 2024-02-14T13:10:33.192 INFO:tasks.workunit.client.0.smithi012.stdout:9/266: sync 2024-02-14T13:10:33.192 INFO:tasks.workunit.client.0.smithi012.stdout:9/267: chown da/dd/d18/c26 108314 1 2024-02-14T13:10:33.193 INFO:tasks.workunit.client.0.smithi012.stdout:0/263: dwrite d10/d14/d2b/d3b/f4d [0,4194304] 0 2024-02-14T13:10:33.193 INFO:tasks.workunit.client.0.smithi012.stdout:0/264: chown d10/d14/d20/c47 36948303 1 2024-02-14T13:10:33.193 INFO:tasks.workunit.client.0.smithi012.stdout:3/211: dwrite d9/dd/f15 [8388608,4194304] 0 2024-02-14T13:10:33.193 INFO:tasks.workunit.client.0.smithi012.stdout:3/212: truncate d9/d13/d28/f40 1094990 0 2024-02-14T13:10:33.195 INFO:tasks.workunit.client.0.smithi012.stdout:6/220: unlink d1/df/d16/f1a 0 2024-02-14T13:10:33.196 INFO:tasks.workunit.client.0.smithi012.stdout:2/214: unlink d0/d8/d11/d35/c40 0 2024-02-14T13:10:33.196 INFO:tasks.workunit.client.0.smithi012.stdout:2/215: write d0/d6/d37/f3b [509961,56417] 0 2024-02-14T13:10:33.196 INFO:tasks.workunit.client.0.smithi012.stdout:2/216: write d0/d8/d11/d33/f38 [4731736,115878] 0 2024-02-14T13:10:33.196 INFO:tasks.workunit.client.0.smithi012.stdout:2/217: readlink d0/d6/de/l41 0 2024-02-14T13:10:33.198 INFO:tasks.workunit.client.0.smithi012.stdout:9/268: rename da/dd/d39/d3b to da/dd/d57 0 2024-02-14T13:10:33.202 INFO:tasks.workunit.client.0.smithi012.stdout:0/265: mkdir d10/d14/d51 0 2024-02-14T13:10:33.202 INFO:tasks.workunit.client.0.smithi012.stdout:0/266: dread - d10/d14/d1b/d30/f3f zero size 2024-02-14T13:10:33.203 INFO:tasks.workunit.client.0.smithi012.stdout:3/213: mknod d9/c53 0 2024-02-14T13:10:33.203 INFO:tasks.workunit.client.0.smithi012.stdout:6/221: truncate d1/d1e/dc/f15 2316385 0 2024-02-14T13:10:33.203 INFO:tasks.workunit.client.0.smithi012.stdout:6/222: stat d1/d1e/dc/d28 0 2024-02-14T13:10:33.203 INFO:tasks.workunit.client.0.smithi012.stdout:6/223: dread - d1/df/d24/f40 zero size 2024-02-14T13:10:33.204 INFO:tasks.workunit.client.0.smithi012.stdout:2/218: creat d0/d20/f45 x:0 0 0 2024-02-14T13:10:33.205 INFO:tasks.workunit.client.0.smithi012.stdout:9/269: mknod da/dd/d38/c58 0 2024-02-14T13:10:33.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/267: mkdir d10/d14/d41/d52 0 2024-02-14T13:10:33.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/224: symlink d1/d1e/d1b/l46 0 2024-02-14T13:10:33.207 INFO:tasks.workunit.client.0.smithi012.stdout:7/206: dwrite df/f20 [4194304,4194304] 0 2024-02-14T13:10:33.207 INFO:tasks.workunit.client.0.smithi012.stdout:2/219: symlink d0/d8/d12/d26/l46 0 2024-02-14T13:10:33.207 INFO:tasks.workunit.client.0.smithi012.stdout:9/270: mkdir da/dd/d57/d59 0 2024-02-14T13:10:33.209 INFO:tasks.workunit.client.0.smithi012.stdout:6/225: creat d1/df/d24/d3f/f47 x:0 0 0 2024-02-14T13:10:33.209 INFO:tasks.workunit.client.0.smithi012.stdout:6/226: chown d1/d1e/dc 10106 1 2024-02-14T13:10:33.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/253: dwrite d9/dc/d14/f31 [4194304,4194304] 0 2024-02-14T13:10:33.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/254: fsync d9/dc/d14/f15 0 2024-02-14T13:10:33.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/255: write d9/dc/d14/d2e/f3f [819421,26862] 0 2024-02-14T13:10:33.210 INFO:tasks.workunit.client.0.smithi012.stdout:8/256: write d9/dc/d14/d23/f41 [650996,100308] 0 2024-02-14T13:10:33.215 INFO:tasks.workunit.client.0.smithi012.stdout:8/257: unlink d9/dc/d14/f31 0 2024-02-14T13:10:33.216 INFO:tasks.workunit.client.0.smithi012.stdout:1/241: sync 2024-02-14T13:10:33.217 INFO:tasks.workunit.client.0.smithi012.stdout:8/258: getdents d9/dc/d38 0 2024-02-14T13:10:33.217 INFO:tasks.workunit.client.0.smithi012.stdout:8/259: write f8 [8013313,107498] 0 2024-02-14T13:10:33.221 INFO:tasks.workunit.client.0.smithi012.stdout:8/260: mknod d9/dc/d14/c4b 0 2024-02-14T13:10:33.223 INFO:tasks.workunit.client.0.smithi012.stdout:6/227: dread d1/d1e/dc/f2e [0,4194304] 0 2024-02-14T13:10:33.226 INFO:tasks.workunit.client.0.smithi012.stdout:6/228: write d1/d1e/d1b/f23 [605531,16285] 0 2024-02-14T13:10:33.226 INFO:tasks.workunit.client.0.smithi012.stdout:6/229: read d1/d1e/d1b/f33 [555670,124956] 0 2024-02-14T13:10:33.226 INFO:tasks.workunit.client.0.smithi012.stdout:6/230: write d1/d1e/d1b/d21/f32 [718173,17982] 0 2024-02-14T13:10:33.229 INFO:tasks.workunit.client.0.smithi012.stdout:6/231: rename d1/d1e/d1b/f23 to d1/df/f48 0 2024-02-14T13:10:33.231 INFO:tasks.workunit.client.0.smithi012.stdout:2/220: dwrite d0/d8/d11/f27 [0,4194304] 0 2024-02-14T13:10:33.232 INFO:tasks.workunit.client.0.smithi012.stdout:2/221: readlink d0/d20/l36 0 2024-02-14T13:10:33.234 INFO:tasks.workunit.client.0.smithi012.stdout:2/222: write d0/d8/f3a [399422,21287] 0 2024-02-14T13:10:33.236 INFO:tasks.workunit.client.0.smithi012.stdout:2/223: creat d0/d1a/f47 x:0 0 0 2024-02-14T13:10:33.237 INFO:tasks.workunit.client.0.smithi012.stdout:3/214: dwrite d9/dd/de/f1a [0,4194304] 0 2024-02-14T13:10:33.237 INFO:tasks.workunit.client.0.smithi012.stdout:2/224: mknod d0/d8/d11/d35/c48 0 2024-02-14T13:10:33.238 INFO:tasks.workunit.client.0.smithi012.stdout:3/215: creat d9/dd/d30/d34/f54 x:0 0 0 2024-02-14T13:10:33.239 INFO:tasks.workunit.client.0.smithi012.stdout:3/216: creat d9/d18/f55 x:0 0 0 2024-02-14T13:10:33.239 INFO:tasks.workunit.client.0.smithi012.stdout:3/217: chown d9/dd/d30/d34/f51 114842253 1 2024-02-14T13:10:33.240 INFO:tasks.workunit.client.0.smithi012.stdout:3/218: creat d9/d18/f56 x:0 0 0 2024-02-14T13:10:33.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/219: write d9/d13/f20 [2470640,113983] 0 2024-02-14T13:10:33.258 INFO:tasks.workunit.client.0.smithi012.stdout:7/207: dwrite df/d24/f31 [0,4194304] 0 2024-02-14T13:10:33.258 INFO:tasks.workunit.client.0.smithi012.stdout:0/268: dwrite d10/f13 [0,4194304] 0 2024-02-14T13:10:33.259 INFO:tasks.workunit.client.0.smithi012.stdout:9/271: dwrite da/dd/f2a [0,4194304] 0 2024-02-14T13:10:33.259 INFO:tasks.workunit.client.0.smithi012.stdout:9/272: chown da/fc 1728879 1 2024-02-14T13:10:33.259 INFO:tasks.workunit.client.0.smithi012.stdout:3/220: symlink d9/l57 0 2024-02-14T13:10:33.260 INFO:tasks.workunit.client.0.smithi012.stdout:7/208: rmdir df/d27 39 2024-02-14T13:10:33.262 INFO:tasks.workunit.client.0.smithi012.stdout:0/269: truncate d10/d14/f18 2094835 0 2024-02-14T13:10:33.265 INFO:tasks.workunit.client.0.smithi012.stdout:9/273: rename da/dd/d39/d40 to da/dd/d18/d5a 0 2024-02-14T13:10:33.265 INFO:tasks.workunit.client.0.smithi012.stdout:9/274: dread - da/d33/f36 zero size 2024-02-14T13:10:33.265 INFO:tasks.workunit.client.0.smithi012.stdout:3/221: mkdir d9/dd/de/d58 0 2024-02-14T13:10:33.266 INFO:tasks.workunit.client.0.smithi012.stdout:0/270: getdents d10/d14/d2b/d3b 0 2024-02-14T13:10:33.268 INFO:tasks.workunit.client.0.smithi012.stdout:7/209: dread df/d36/f3c [0,4194304] 0 2024-02-14T13:10:33.268 INFO:tasks.workunit.client.0.smithi012.stdout:7/210: chown df/c1e 638 1 2024-02-14T13:10:33.268 INFO:tasks.workunit.client.0.smithi012.stdout:1/242: dwrite d6/d10/d22/d31/d34/d3b/d50/f2d [0,4194304] 0 2024-02-14T13:10:33.269 INFO:tasks.workunit.client.0.smithi012.stdout:3/222: rename d9/dd/d30/d44/f46 to d9/d18/d39/f59 0 2024-02-14T13:10:33.270 INFO:tasks.workunit.client.0.smithi012.stdout:7/211: creat df/d2d/f50 x:0 0 0 2024-02-14T13:10:33.270 INFO:tasks.workunit.client.0.smithi012.stdout:2/225: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:33.270 INFO:tasks.workunit.client.0.smithi012.stdout:8/261: dwrite d9/dc/d1b/f1e [4194304,4194304] 0 2024-02-14T13:10:33.271 INFO:tasks.workunit.client.0.smithi012.stdout:1/243: creat d6/d10/d22/d31/d34/d3b/f53 x:0 0 0 2024-02-14T13:10:33.272 INFO:tasks.workunit.client.0.smithi012.stdout:0/271: rename d10/l1f to d10/d14/d1b/d30/l53 0 2024-02-14T13:10:33.273 INFO:tasks.workunit.client.0.smithi012.stdout:0/272: chown d10/d14/d20/c47 10373 1 2024-02-14T13:10:33.273 INFO:tasks.workunit.client.0.smithi012.stdout:7/212: dread df/f26 [0,4194304] 0 2024-02-14T13:10:33.273 INFO:tasks.workunit.client.0.smithi012.stdout:7/213: write df/d27/f28 [155903,71633] 0 2024-02-14T13:10:33.273 INFO:tasks.workunit.client.0.smithi012.stdout:3/223: unlink d9/dd/f15 0 2024-02-14T13:10:33.274 INFO:tasks.workunit.client.0.smithi012.stdout:2/226: creat d0/d1a/f49 x:0 0 0 2024-02-14T13:10:33.274 INFO:tasks.workunit.client.0.smithi012.stdout:2/227: getdents d0/d5/d15 0 2024-02-14T13:10:33.278 INFO:tasks.workunit.client.0.smithi012.stdout:1/244: dread d6/d10/f3a [0,4194304] 0 2024-02-14T13:10:33.281 INFO:tasks.workunit.client.0.smithi012.stdout:0/273: mkdir d10/d14/d1b/d54 0 2024-02-14T13:10:33.281 INFO:tasks.workunit.client.0.smithi012.stdout:0/274: write d10/d14/d20/f37 [120893,45654] 0 2024-02-14T13:10:33.282 INFO:tasks.workunit.client.0.smithi012.stdout:0/275: dread - d10/d14/f43 zero size 2024-02-14T13:10:33.282 INFO:tasks.workunit.client.0.smithi012.stdout:0/276: fdatasync d10/d14/d23/f45 0 2024-02-14T13:10:33.282 INFO:tasks.workunit.client.0.smithi012.stdout:7/214: creat df/f51 x:0 0 0 2024-02-14T13:10:33.283 INFO:tasks.workunit.client.0.smithi012.stdout:3/224: creat d9/d3f/d4e/f5a x:0 0 0 2024-02-14T13:10:33.284 INFO:tasks.workunit.client.0.smithi012.stdout:2/228: creat d0/d5/d15/f4a x:0 0 0 2024-02-14T13:10:33.286 INFO:tasks.workunit.client.0.smithi012.stdout:1/245: creat d6/d10/d22/f54 x:0 0 0 2024-02-14T13:10:33.288 INFO:tasks.workunit.client.0.smithi012.stdout:3/225: mknod d9/d3f/c5b 0 2024-02-14T13:10:33.288 INFO:tasks.workunit.client.0.smithi012.stdout:2/229: stat d0/c1 0 2024-02-14T13:10:33.288 INFO:tasks.workunit.client.0.smithi012.stdout:2/230: write d0/d20/f23 [334129,106012] 0 2024-02-14T13:10:33.288 INFO:tasks.workunit.client.0.smithi012.stdout:2/231: truncate d0/d20/f34 1991283 0 2024-02-14T13:10:33.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/232: unlink d0/d5/c2e 0 2024-02-14T13:10:33.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/233: write d0/d20/f23 [1247253,81827] 0 2024-02-14T13:10:33.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/234: write d0/d20/f23 [1981305,53324] 0 2024-02-14T13:10:33.295 INFO:tasks.workunit.client.0.smithi012.stdout:7/215: dread f5 [0,4194304] 0 2024-02-14T13:10:33.299 INFO:tasks.workunit.client.0.smithi012.stdout:2/235: truncate d0/f2 4067574 0 2024-02-14T13:10:33.299 INFO:tasks.workunit.client.0.smithi012.stdout:2/236: chown d0/d8/f30 152416305 1 2024-02-14T13:10:33.300 INFO:tasks.workunit.client.0.smithi012.stdout:2/237: creat d0/d8/d12/f4b x:0 0 0 2024-02-14T13:10:33.304 INFO:tasks.workunit.client.0.smithi012.stdout:0/277: dwrite d10/d14/d1b/f3c [0,4194304] 0 2024-02-14T13:10:33.307 INFO:tasks.workunit.client.0.smithi012.stdout:0/278: rename d10/d14/d1b/l40 to d10/d14/d23/l55 0 2024-02-14T13:10:33.312 INFO:tasks.workunit.client.0.smithi012.stdout:1/246: dwrite d6/d10/d22/d31/d34/d3b/f53 [0,4194304] 0 2024-02-14T13:10:33.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/279: dread d10/f32 [0,4194304] 0 2024-02-14T13:10:33.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/280: dread - d10/d14/d2b/d3b/f4b zero size 2024-02-14T13:10:33.316 INFO:tasks.workunit.client.0.smithi012.stdout:1/247: creat d6/d10/d22/d31/d34/d3b/d50/f55 x:0 0 0 2024-02-14T13:10:33.316 INFO:tasks.workunit.client.0.smithi012.stdout:1/248: dread - d6/d10/f4a zero size 2024-02-14T13:10:33.318 INFO:tasks.workunit.client.0.smithi012.stdout:1/249: creat d6/d10/d22/d31/d34/d3b/f56 x:0 0 0 2024-02-14T13:10:33.319 INFO:tasks.workunit.client.0.smithi012.stdout:1/250: getdents d6 0 2024-02-14T13:10:33.321 INFO:tasks.workunit.client.0.smithi012.stdout:1/251: rename d6/d10/d22/d31/d34/d3b/d50/f2b to d6/d10/d22/d31/d34/f57 0 2024-02-14T13:10:33.321 INFO:tasks.workunit.client.0.smithi012.stdout:1/252: write d6/d10/d22/d31/d34/d3b/d50/f55 [815699,69819] 0 2024-02-14T13:10:33.321 INFO:tasks.workunit.client.0.smithi012.stdout:1/253: fsync d6/ff 0 2024-02-14T13:10:33.322 INFO:tasks.workunit.client.0.smithi012.stdout:0/281: write d10/d14/d2b/d3b/f4d [2053476,58268] 0 2024-02-14T13:10:33.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/254: mkdir d6/d10/d22/d31/d34/d58 0 2024-02-14T13:10:33.324 INFO:tasks.workunit.client.0.smithi012.stdout:0/282: mkdir d10/d14/d41/d52/d56 0 2024-02-14T13:10:33.324 INFO:tasks.workunit.client.0.smithi012.stdout:0/283: chown d10/f2a 32 1 2024-02-14T13:10:33.326 INFO:tasks.workunit.client.0.smithi012.stdout:4/208: sync 2024-02-14T13:10:33.326 INFO:tasks.workunit.client.0.smithi012.stdout:4/209: rename d0/d10/d13/d17 to d0/d10/d13/d17/d46 22 2024-02-14T13:10:33.327 INFO:tasks.workunit.client.0.smithi012.stdout:0/284: write d10/d14/f18 [1751976,2422] 0 2024-02-14T13:10:33.328 INFO:tasks.workunit.client.0.smithi012.stdout:0/285: creat d10/f57 x:0 0 0 2024-02-14T13:10:33.330 INFO:tasks.workunit.client.0.smithi012.stdout:1/255: write d6/d10/d22/d31/d34/d3b/d50/d15/d3d/f45 [1683173,96720] 0 2024-02-14T13:10:33.331 INFO:tasks.workunit.client.0.smithi012.stdout:2/238: dwrite d0/d20/f34 [0,4194304] 0 2024-02-14T13:10:33.334 INFO:tasks.workunit.client.0.smithi012.stdout:1/256: rename d6/d10/f13 to d6/f59 0 2024-02-14T13:10:33.334 INFO:tasks.workunit.client.0.smithi012.stdout:1/257: write d6/d10/f21 [4990462,89634] 0 2024-02-14T13:10:33.338 INFO:tasks.workunit.client.0.smithi012.stdout:0/286: rmdir d10 39 2024-02-14T13:10:33.338 INFO:tasks.workunit.client.0.smithi012.stdout:2/239: truncate d0/d8/d11/f17 2109006 0 2024-02-14T13:10:33.341 INFO:tasks.workunit.client.0.smithi012.stdout:0/287: getdents d10/d14/d1b/d30 0 2024-02-14T13:10:33.342 INFO:tasks.workunit.client.0.smithi012.stdout:1/258: getdents d6/d10 0 2024-02-14T13:10:33.343 INFO:tasks.workunit.client.0.smithi012.stdout:2/240: rmdir d0/d8/d12 39 2024-02-14T13:10:33.344 INFO:tasks.workunit.client.0.smithi012.stdout:1/259: mkdir d6/d10/d22/d31/d34/d3b/d5a 0 2024-02-14T13:10:33.344 INFO:tasks.workunit.client.0.smithi012.stdout:4/210: dwrite d0/d10/f2a [0,4194304] 0 2024-02-14T13:10:33.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/260: mkdir d6/d10/d22/d31/d5b 0 2024-02-14T13:10:33.348 INFO:tasks.workunit.client.0.smithi012.stdout:4/211: truncate d0/fa 3074467 0 2024-02-14T13:10:33.350 INFO:tasks.workunit.client.0.smithi012.stdout:4/212: creat d0/d10/d13/d17/f47 x:0 0 0 2024-02-14T13:10:33.350 INFO:tasks.workunit.client.0.smithi012.stdout:4/213: write d0/d10/d1f/f2f [32017,23179] 0 2024-02-14T13:10:33.351 INFO:tasks.workunit.client.0.smithi012.stdout:4/214: rmdir d0/d10/d13/d17/d3a 39 2024-02-14T13:10:33.353 INFO:tasks.workunit.client.0.smithi012.stdout:0/288: read d10/d14/d2b/d3b/f50 [2647060,126398] 0 2024-02-14T13:10:33.353 INFO:tasks.workunit.client.0.smithi012.stdout:0/289: fdatasync fd 0 2024-02-14T13:10:33.353 INFO:tasks.workunit.client.0.smithi012.stdout:0/290: readlink d10/d14/d2b/l2d 0 2024-02-14T13:10:33.354 INFO:tasks.workunit.client.0.smithi012.stdout:0/291: mknod d10/d14/d41/d52/c58 0 2024-02-14T13:10:33.357 INFO:tasks.workunit.client.0.smithi012.stdout:1/261: dread d6/d10/d22/d31/d34/d3b/f43 [0,4194304] 0 2024-02-14T13:10:33.358 INFO:tasks.workunit.client.0.smithi012.stdout:1/262: getdents d6/d10/d22/d31 0 2024-02-14T13:10:33.361 INFO:tasks.workunit.client.0.smithi012.stdout:2/241: dwrite d0/d20/f34 [0,4194304] 0 2024-02-14T13:10:33.364 INFO:tasks.workunit.client.0.smithi012.stdout:2/242: symlink d0/d8/d43/l4c 0 2024-02-14T13:10:33.384 INFO:tasks.workunit.client.0.smithi012.stdout:4/215: dwrite d0/d10/d13/d17/d3a/f40 [0,4194304] 0 2024-02-14T13:10:33.384 INFO:tasks.workunit.client.0.smithi012.stdout:4/216: write d0/d10/d13/d17/f47 [1003304,40895] 0 2024-02-14T13:10:33.384 INFO:tasks.workunit.client.0.smithi012.stdout:1/263: dwrite d6/fc [0,4194304] 0 2024-02-14T13:10:33.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/292: dwrite d10/f2a [0,4194304] 0 2024-02-14T13:10:33.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/293: getdents d10/d14/d51 0 2024-02-14T13:10:33.389 INFO:tasks.workunit.client.0.smithi012.stdout:1/264: rmdir d6/d10/d22/d31/d34/d3b 39 2024-02-14T13:10:33.391 INFO:tasks.workunit.client.0.smithi012.stdout:1/265: symlink d6/d10/d22/d31/d34/d3b/d50/d15/d3d/l5c 0 2024-02-14T13:10:33.391 INFO:tasks.workunit.client.0.smithi012.stdout:2/243: read d0/f2 [2790253,5914] 0 2024-02-14T13:10:33.391 INFO:tasks.workunit.client.0.smithi012.stdout:1/266: getdents d6/d10/d22/d31/d34/d3b 0 2024-02-14T13:10:33.393 INFO:tasks.workunit.client.0.smithi012.stdout:2/244: mknod d0/d6/de/c4d 0 2024-02-14T13:10:33.395 INFO:tasks.workunit.client.0.smithi012.stdout:0/294: dread d10/f13 [0,4194304] 0 2024-02-14T13:10:33.395 INFO:tasks.workunit.client.0.smithi012.stdout:2/245: creat d0/d6/de/f4e x:0 0 0 2024-02-14T13:10:33.396 INFO:tasks.workunit.client.0.smithi012.stdout:0/295: rename d10/d14/d20/c47 to d10/d14/d51/c59 0 2024-02-14T13:10:33.397 INFO:tasks.workunit.client.0.smithi012.stdout:0/296: unlink d10/d14/d41/c44 0 2024-02-14T13:10:33.397 INFO:tasks.workunit.client.0.smithi012.stdout:0/297: readlink d10/d14/d23/l34 0 2024-02-14T13:10:33.398 INFO:tasks.workunit.client.0.smithi012.stdout:0/298: creat d10/d14/d20/f5a x:0 0 0 2024-02-14T13:10:33.399 INFO:tasks.workunit.client.0.smithi012.stdout:0/299: mknod d10/d14/c5b 0 2024-02-14T13:10:33.399 INFO:tasks.workunit.client.0.smithi012.stdout:5/254: sync 2024-02-14T13:10:33.399 INFO:tasks.workunit.client.0.smithi012.stdout:5/255: write dc/d17/d20/f42 [888200,43616] 0 2024-02-14T13:10:33.402 INFO:tasks.workunit.client.0.smithi012.stdout:0/300: getdents d10/d14/d51 0 2024-02-14T13:10:33.402 INFO:tasks.workunit.client.0.smithi012.stdout:2/246: dread d0/d8/f30 [0,4194304] 0 2024-02-14T13:10:33.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/247: rename d0/c1 to d0/d6/d37/c4f 0 2024-02-14T13:10:33.407 INFO:tasks.workunit.client.0.smithi012.stdout:0/301: dread d10/d14/d2b/d3b/f50 [0,4194304] 0 2024-02-14T13:10:33.407 INFO:tasks.workunit.client.0.smithi012.stdout:0/302: truncate d10/d14/d2b/d3b/f4f 806967 0 2024-02-14T13:10:33.407 INFO:tasks.workunit.client.0.smithi012.stdout:0/303: chown d10/d14/d20/d21/f28 343043 1 2024-02-14T13:10:33.408 INFO:tasks.workunit.client.0.smithi012.stdout:0/304: mknod d10/d14/d1b/d54/c5c 0 2024-02-14T13:10:33.408 INFO:tasks.workunit.client.0.smithi012.stdout:0/305: write d10/d14/d20/d21/f36 [1523116,90057] 0 2024-02-14T13:10:33.413 INFO:tasks.workunit.client.0.smithi012.stdout:2/248: dread d0/d8/d11/f32 [0,4194304] 0 2024-02-14T13:10:33.413 INFO:tasks.workunit.client.0.smithi012.stdout:1/267: dwrite d6/d10/d22/f54 [0,4194304] 0 2024-02-14T13:10:33.413 INFO:tasks.workunit.client.0.smithi012.stdout:1/268: chown d6/d10/d22/d31/d34/d3b/d50/d15/d3d/l5c 1614 1 2024-02-14T13:10:33.414 INFO:tasks.workunit.client.0.smithi012.stdout:2/249: read d0/d6/d37/f3b [127224,90625] 0 2024-02-14T13:10:33.415 INFO:tasks.workunit.client.0.smithi012.stdout:1/269: dread d6/d10/d22/d31/d34/d3b/d50/f55 [0,4194304] 0 2024-02-14T13:10:33.425 INFO:tasks.workunit.client.0.smithi012.stdout:0/306: dwrite d10/d14/f18 [0,4194304] 0 2024-02-14T13:10:33.429 INFO:tasks.workunit.client.0.smithi012.stdout:0/307: symlink d10/d14/d1b/d30/l5d 0 2024-02-14T13:10:33.429 INFO:tasks.workunit.client.0.smithi012.stdout:0/308: read d10/f32 [187076,2726] 0 2024-02-14T13:10:33.429 INFO:tasks.workunit.client.0.smithi012.stdout:0/309: chown d10/d14/d20/l25 44 1 2024-02-14T13:10:33.429 INFO:tasks.workunit.client.0.smithi012.stdout:0/310: dread - d10/d14/d20/d21/f35 zero size 2024-02-14T13:10:33.440 INFO:tasks.workunit.client.0.smithi012.stdout:0/311: dread d10/d14/d20/d21/f36 [0,4194304] 0 2024-02-14T13:10:33.440 INFO:tasks.workunit.client.0.smithi012.stdout:0/312: chown d10/d14/d1b/d30/l5d 3494 1 2024-02-14T13:10:33.448 INFO:tasks.workunit.client.0.smithi012.stdout:1/270: dwrite d6/d10/d22/d31/d34/d3b/d50/d15/f1d [0,4194304] 0 2024-02-14T13:10:33.448 INFO:tasks.workunit.client.0.smithi012.stdout:1/271: write d6/d10/d22/d31/d34/d3b/d50/f55 [1695403,127971] 0 2024-02-14T13:10:33.451 INFO:tasks.workunit.client.0.smithi012.stdout:2/250: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:33.452 INFO:tasks.workunit.client.0.smithi012.stdout:2/251: unlink d0/d8/d11/f27 0 2024-02-14T13:10:33.453 INFO:tasks.workunit.client.0.smithi012.stdout:2/252: stat d0/d8/d11/c14 0 2024-02-14T13:10:33.454 INFO:tasks.workunit.client.0.smithi012.stdout:2/253: mkdir d0/d5/d50 0 2024-02-14T13:10:33.455 INFO:tasks.workunit.client.0.smithi012.stdout:2/254: truncate d0/d8/f31 2440385 0 2024-02-14T13:10:33.457 INFO:tasks.workunit.client.0.smithi012.stdout:1/272: dread d6/d10/d22/d31/d34/d3b/d50/f2d [0,4194304] 0 2024-02-14T13:10:33.457 INFO:tasks.workunit.client.0.smithi012.stdout:0/313: dwrite d10/d14/d20/f37 [0,4194304] 0 2024-02-14T13:10:33.457 INFO:tasks.workunit.client.0.smithi012.stdout:0/314: write d10/d14/d2b/d3b/f4b [443929,120157] 0 2024-02-14T13:10:33.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/273: unlink d6/d10/d22/d31/d34/d3b/d50/f29 0 2024-02-14T13:10:33.461 INFO:tasks.workunit.client.0.smithi012.stdout:0/315: creat d10/d14/d20/d49/f5e x:0 0 0 2024-02-14T13:10:33.461 INFO:tasks.workunit.client.0.smithi012.stdout:0/316: dread - d10/d14/f43 zero size 2024-02-14T13:10:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.460+0000 7f6501691640 1 -- 172.21.15.12:0/205734775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc0ff8d0 msgr2=0x7f64fc0ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:33.462 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.460+0000 7f6501691640 1 --2- 172.21.15.12:0/205734775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc0ff8d0 0x7f64fc0ffcf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009900 tx=0x7f64ec02bc30 comp rx=0 tx=0).stop 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 -- 172.21.15.12:0/205734775 shutdown_connections 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 --2- 172.21.15.12:0/205734775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc101480 0x7f64fc107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 --2- 172.21.15.12:0/205734775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc100ac0 0x7f64fc100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 --2- 172.21.15.12:0/205734775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc0ff8d0 0x7f64fc0ffcf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 -- 172.21.15.12:0/205734775 >> 172.21.15.12:0/205734775 conn(0x7f64fc0fae80 msgr2=0x7f64fc0fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 -- 172.21.15.12:0/205734775 shutdown_connections 2024-02-14T13:10:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 -- 172.21.15.12:0/205734775 wait complete. 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 Processor -- start 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.461+0000 7f6501691640 1 -- start start 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc0ff8d0 0x7f64fc1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc100ac0 0x7f64fc197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 0x7f64fc19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc19edd0 con 0x7f64fc101480 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc19ef40 con 0x7f64fc0ff8d0 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc19f100 con 0x7f64fc100ac0 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 0x7f64fc19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 0x7f64fc19e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34888/0 (socket says 172.21.15.12:34888) 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 -- 172.21.15.12:0/2469927829 learned_addr learned my addr 172.21.15.12:0/2469927829 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc100ac0 0x7f64fc197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64faffd640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc0ff8d0 0x7f64fc1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 -- 172.21.15.12:0/2469927829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc100ac0 msgr2=0x7f64fc197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc100ac0 0x7f64fc197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 -- 172.21.15.12:0/2469927829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc0ff8d0 msgr2=0x7f64fc1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc0ff8d0 0x7f64fc1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 -- 172.21.15.12:0/2469927829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec009560 con 0x7f64fc101480 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64fb7fe640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 0x7f64fc19e890 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f64f400b970 tx=0x7f64f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64e3fff640 1 -- 172.21.15.12:0/2469927829 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f400cb40 con 0x7f64fc101480 2024-02-14T13:10:33.466 INFO:tasks.workunit.client.0.smithi012.stdout:0/317: dread d10/d14/f1e [0,4194304] 0 2024-02-14T13:10:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64e3fff640 1 -- 172.21.15.12:0/2469927829 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f64f400cca0 con 0x7f64fc101480 2024-02-14T13:10:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc19f3e0 con 0x7f64fc101480 2024-02-14T13:10:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.462+0000 7f64e3fff640 1 -- 172.21.15.12:0/2469927829 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f40077d0 con 0x7f64fc101480 2024-02-14T13:10:33.467 INFO:tasks.workunit.client.0.smithi012.stdout:0/318: write d10/d14/f43 [251725,14568] 0 2024-02-14T13:10:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.463+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc19f920 con 0x7f64fc101480 2024-02-14T13:10:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f64e3fff640 1 -- 172.21.15.12:0/2469927829 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f64f4014440 con 0x7f64fc101480 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 Processor -- start 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 -- start start 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f64e3fff640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64e40a2160 0x7f64e40a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 0x560c7e94cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94d130 0x560c7e951c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e954730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e8bb9e0 con 0x560c7e94c740 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e8b8f10 con 0x560c7e94d130 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.465+0000 7f6504259740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e8b46f0 con 0x560c7e9522a0 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64e3fff640 1 -- 172.21.15.12:0/2469927829 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f64f40cd590 con 0x7f64fc101480 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64e40a2160 0x7f64e40a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 0x560c7e94cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 0x560c7e94cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34892/0 (socket says 172.21.15.12:34892) 2024-02-14T13:10:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 -- 172.21.15.12:0/2369846847 learned_addr learned my addr 172.21.15.12:0/2369846847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94d130 0x560c7e951c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 -- 172.21.15.12:0/2369846847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 msgr2=0x560c7e954730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e954730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 -- 172.21.15.12:0/2369846847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94d130 msgr2=0x560c7e951c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94d130 0x560c7e951c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 -- 172.21.15.12:0/2369846847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7e5c5920 con 0x560c7e94c740 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64e40a2160 0x7f64e40a4620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f64fc1987f0 tx=0x7f64f0013880 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64faffd640 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 0x560c7e94cb60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f64ec006010 tx=0x7f64ec02ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9384ec9ba9825a4f server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64e17fa640 1 -- 172.21.15.12:0/2369846847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0048c0 con 0x560c7e94c740 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64e17fa640 1 -- 172.21.15.12:0/2369846847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f64ec02cc10 con 0x560c7e94c740 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.466+0000 7f64e17fa640 1 -- 172.21.15.12:0/2369846847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec005500 con 0x560c7e94c740 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 -- 172.21.15.12:0/2369846847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 msgr2=0x560c7e94cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 0x560c7e94cb60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f64ec006010 tx=0x7f64ec02ca20 comp rx=0 tx=0).stop 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 -- 172.21.15.12:0/2369846847 shutdown_connections 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e954730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94d130 0x560c7e951c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 --2- 172.21.15.12:0/2369846847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94c740 0x560c7e94cb60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 -- 172.21.15.12:0/2369846847 >> 172.21.15.12:0/2369846847 conn(0x560c7e947cb0 msgr2=0x560c7e9480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 -- 172.21.15.12:0/2369846847 shutdown_connections 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 -- 172.21.15.12:0/2369846847 wait complete. 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 -- start start 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.467+0000 7f6504259740 1 Processor -- start 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e95aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e95af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e961f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e850fa0 con 0x560c7e94d130 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e588250 con 0x560c7e94c740 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e83a200 con 0x560c7e9522a0 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 10 client.0 _ll_register_callbacks cb 0x560c7e8a9b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e95af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e95af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34906/0 (socket says 172.21.15.12:34906) 2024-02-14T13:10:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2294930028 learned_addr learned my addr 172.21.15.12:0/2294930028 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64faffd640 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e95aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 msgr2=0x560c7e961f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e961f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2294930028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 msgr2=0x560c7e95aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e95aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2294930028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc068510 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e95af40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64f000aab0 tx=0x7f64f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432b10d0f40f1ae9 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64deff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64deff5640 1 -- 172.21.15.12:0/2294930028 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0005020 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f64deff5640 1 -- 172.21.15.12:0/2294930028 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f64f0005180 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.468+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c7e5b4600 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f64deff5640 1 -- 172.21.15.12:0/2294930028 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64f002e030 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 10 client.15324 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x560c7e8b2d70 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f64deff5640 1 -- 172.21.15.12:0/2294930028 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x560c7e5b4600 con 0x560c7e94d130 2024-02-14T13:10:33.475 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f64deff5640 1 -- 172.21.15.12:0/2294930028 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f64f00333f0 con 0x560c7e94d130 2024-02-14T13:10:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 10 client.15324 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 10 client.15324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 20 client.15324 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e966930 0x560c7e968d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 4 client.15324 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:10:33.476 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.469+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c7e6051b0 con 0x560c7e966930 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.470+0000 7f64faffd640 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e966930 0x560c7e968d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.471+0000 7f64faffd640 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e966930 0x560c7e968d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f3c5aa16a04b8 server_cookie=2bc76694b12254a1 in_seq=0 out_seq=0 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.471+0000 7f64deff5640 10 client.15324 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f64deff5640 1 -- 172.21.15.12:0/2294930028 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560c7e6051b0 con 0x560c7e966930 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f64deff5640 10 client.15324 handle_command_reply: tid=0 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 client.15324 shutdown 2024-02-14T13:10:33.477 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 msgr2=0x560c7e95af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e95af40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64f000aab0 tx=0x7f64f0019000 comp rx=0 tx=0).stop 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 shutdown_connections 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e966930 0x560c7e968d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e961f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e95af40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f64deff5640 0 client.15324 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 --2- 172.21.15.12:0/2294930028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e95aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 >> 172.21.15.12:0/2294930028 conn(0x560c7e947cb0 msgr2=0x560c7e946ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 shutdown_connections 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 1 -- 172.21.15.12:0/2294930028 wait complete. 2024-02-14T13:10:33.478 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.472+0000 7f6504259740 20 client.15324 trim_cache size 0 max 16384 2024-02-14T13:10:33.487 INFO:tasks.workunit.client.0.smithi012.stdout:0/319: dwrite d10/d14/d2b/d3b/f4f [0,4194304] 0 2024-02-14T13:10:33.487 INFO:tasks.workunit.client.0.smithi012.stdout:1/274: dwrite d6/d10/d22/d31/d34/d3b/f43 [0,4194304] 0 2024-02-14T13:10:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.486+0000 7f6504259740 1 Processor -- start 2024-02-14T13:10:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.486+0000 7f6504259740 1 -- start start 2024-02-14T13:10:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f6504259740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e948090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f6504259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f6504259740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e946630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f6504259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e6051b0 con 0x560c7e94d130 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f6504259740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e5b4600 con 0x560c7e94c740 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f6504259740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e956070 con 0x560c7e9522a0 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34916/0 (socket says 172.21.15.12:34916) 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 -- 172.21.15.12:0/4150569149 learned_addr learned my addr 172.21.15.12:0/4150569149 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64faffd640 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e948090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fb7fe640 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e946630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 -- 172.21.15.12:0/4150569149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 msgr2=0x560c7e946630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e946630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 -- 172.21.15.12:0/4150569149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 msgr2=0x560c7e948090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e948090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 -- 172.21.15.12:0/4150569149 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7e84f820 con 0x560c7e94d130 2024-02-14T13:10:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961f40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f64f0033820 tx=0x7f64f0005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9fd755fb66f98d server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.487+0000 7f64e0ff9640 1 -- 172.21.15.12:0/4150569149 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f002e040 con 0x560c7e94d130 2024-02-14T13:10:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f64e0ff9640 1 -- 172.21.15.12:0/4150569149 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f64f0019070 con 0x560c7e94d130 2024-02-14T13:10:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f64e0ff9640 1 -- 172.21.15.12:0/4150569149 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f00052a0 con 0x560c7e94d130 2024-02-14T13:10:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 -- 172.21.15.12:0/4150569149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 msgr2=0x560c7e961f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961f40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f64f0033820 tx=0x7f64f0005da0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 -- 172.21.15.12:0/4150569149 shutdown_connections 2024-02-14T13:10:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e9522a0 0x560c7e946630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961f40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 --2- 172.21.15.12:0/4150569149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e94c740 0x560c7e948090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 -- 172.21.15.12:0/4150569149 >> 172.21.15.12:0/4150569149 conn(0x560c7e947cb0 msgr2=0x560c7e951980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 -- 172.21.15.12:0/4150569149 shutdown_connections 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.488+0000 7f6504259740 1 -- 172.21.15.12:0/4150569149 wait complete. 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 -- start start 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 Processor -- start 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e94c740 0x560c7e9618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e9522a0 0x560c7e95ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e960510 con 0x560c7e94d130 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e960680 con 0x560c7e9522a0 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e960840 con 0x560c7e94c740 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f6504259740 10 client.0 _ll_register_callbacks cb 0x7f64ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34930/0 (socket says 172.21.15.12:34930) 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64faffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e94c740 0x560c7e9618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.494 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2315131899 learned_addr learned my addr 172.21.15.12:0/2315131899 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fb7fe640 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e9522a0 0x560c7e95ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e94c740 msgr2=0x560c7e9618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e94c740 0x560c7e9618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2315131899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e9522a0 msgr2=0x560c7e95ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e9522a0 0x560c7e95ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 -- 172.21.15.12:0/2315131899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c7e8b2d70 con 0x560c7e94d130 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.489+0000 7f64fa7fc640 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961e30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f64f0006010 tx=0x7f64f0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9455701899115447 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f64deff5640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f64deff5640 1 -- 172.21.15.12:0/2315131899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f002e040 con 0x560c7e94d130 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f64deff5640 1 -- 172.21.15.12:0/2315131899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f64f002f070 con 0x560c7e94d130 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64ec02cc10 con 0x560c7e94d130 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f64deff5640 1 -- 172.21.15.12:0/2315131899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64f0049020 con 0x560c7e94d130 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 10 client.15330 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x560c7e875720 con 0x560c7e94d130 2024-02-14T13:10:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:0/320: unlink d10/f11 0 2024-02-14T13:10:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:0/321: chown d10/d14/d1b/c2c 84800 1 2024-02-14T13:10:33.496 INFO:tasks.workunit.client.0.smithi012.stdout:0/322: fsync d10/f13 0 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f64deff5640 1 -- 172.21.15.12:0/2315131899 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f64ec02cc10 con 0x560c7e94d130 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f64deff5640 1 -- 172.21.15.12:0/2315131899 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f64f0004ba0 con 0x560c7e94d130 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 10 client.15330 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 10 client.15330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 20 client.15330 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e9bdef0 0x560c7e9c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 4 client.15330 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.490+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560c7e5f1550 con 0x560c7e9bdef0 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.491+0000 7f64faffd640 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e9bdef0 0x560c7e9c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.491+0000 7f64faffd640 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e9bdef0 0x560c7e9c0310 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355118aae9115c6b server_cookie=1ae545db990622d6 in_seq=0 out_seq=0 2024-02-14T13:10:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:33.491+0000 7f64deff5640 10 client.15330 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:33.498 INFO:tasks.workunit.client.0.smithi012.stdout:1/275: rename d6/d10/d22/d31/d34/d3b/d50 to d6/d10/d22/d31/d5b/d5d 0 2024-02-14T13:10:33.498 INFO:tasks.workunit.client.0.smithi012.stdout:0/323: symlink d10/d14/d1b/d54/l5f 0 2024-02-14T13:10:33.498 INFO:tasks.workunit.client.0.smithi012.stdout:9/275: sync 2024-02-14T13:10:33.498 INFO:tasks.workunit.client.0.smithi012.stdout:6/232: sync 2024-02-14T13:10:33.498 INFO:tasks.workunit.client.0.smithi012.stdout:1/276: rename d6/d10/d22/d31/d5b/d5d/d15 to d6/d10/d22/d31/d5b/d5e 0 2024-02-14T13:10:33.499 INFO:tasks.workunit.client.0.smithi012.stdout:1/277: write d6/d10/d22/d31/f40 [107769,39356] 0 2024-02-14T13:10:33.501 INFO:tasks.workunit.client.0.smithi012.stdout:0/324: rmdir d10/d14/d20/d49 39 2024-02-14T13:10:33.501 INFO:tasks.workunit.client.0.smithi012.stdout:0/325: chown d10/f57 4019935 1 2024-02-14T13:10:33.504 INFO:tasks.workunit.client.0.smithi012.stdout:9/276: mknod da/d4f/c5b 0 2024-02-14T13:10:33.507 INFO:tasks.workunit.client.0.smithi012.stdout:0/326: write d10/d14/d1b/f3a [2386107,6034] 0 2024-02-14T13:10:33.940 INFO:tasks.workunit.client.0.smithi012.stdout:1/278: mknod d6/d10/d22/d44/c5f 0 2024-02-14T13:10:33.977 INFO:tasks.workunit.client.0.smithi012.stdout:6/233: rmdir d1/d1e/d3c 0 2024-02-14T13:10:33.977 INFO:tasks.workunit.client.0.smithi012.stdout:9/277: symlink da/dd/d19/d30/d20/l5c 0 2024-02-14T13:10:33.983 INFO:tasks.workunit.client.0.smithi012.stdout:0/327: link d10/d14/d41/c46 d10/d14/d41/d52/c60 0 2024-02-14T13:10:33.989 INFO:tasks.workunit.client.0.smithi012.stdout:6/234: mknod d1/d1e/d1b/d3e/c49 0 2024-02-14T13:10:33.991 INFO:tasks.workunit.client.0.smithi012.stdout:9/278: rmdir da/d4f 39 2024-02-14T13:10:33.995 INFO:tasks.workunit.client.0.smithi012.stdout:6/235: mknod d1/df/d16/c4a 0 2024-02-14T13:10:34.291 INFO:tasks.workunit.client.0.smithi012.stdout:6/236: dwrite d1/df/d24/d3f/f47 [0,4194304] 0 2024-02-14T13:10:34.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:34 smithi012 ceph-mon[32370]: pgmap v403: 97 pgs: 97 active+clean; 130 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.67k op/s 2024-02-14T13:10:34.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:34 smithi103 ceph-mon[36921]: pgmap v403: 97 pgs: 97 active+clean; 130 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.67k op/s 2024-02-14T13:10:34.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:34 smithi055 ceph-mon[36853]: pgmap v403: 97 pgs: 97 active+clean; 130 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.67k op/s 2024-02-14T13:10:34.589 INFO:tasks.workunit.client.0.smithi012.stdout:6/237: dwrite d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:34.589 INFO:tasks.workunit.client.0.smithi012.stdout:6/238: dread - d1/df/d24/f40 zero size 2024-02-14T13:10:34.594 INFO:tasks.workunit.client.0.smithi012.stdout:6/239: mknod d1/df/d16/c4b 0 2024-02-14T13:10:34.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/240: rename d1/d1e/dc/d28/f2a to d1/d1e/d1b/d3e/f4c 0 2024-02-14T13:10:34.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/241: chown d1/df/d24/f40 0 1 2024-02-14T13:10:34.605 INFO:tasks.workunit.client.0.smithi012.stdout:6/242: link d1/d1e/dc/f1d d1/d1e/dc/d28/f4d 0 2024-02-14T13:10:34.605 INFO:tasks.workunit.client.0.smithi012.stdout:6/243: write d1/df/f48 [1238172,115881] 0 2024-02-14T13:10:34.608 INFO:tasks.workunit.client.0.smithi012.stdout:6/244: read d1/d1e/dc/d28/f2d [2269250,10778] 0 2024-02-14T13:10:34.608 INFO:tasks.workunit.client.0.smithi012.stdout:6/245: fdatasync d1/d1e/f20 0 2024-02-14T13:10:34.608 INFO:tasks.workunit.client.0.smithi012.stdout:6/246: readlink d1/d17/l42 0 2024-02-14T13:10:34.892 INFO:tasks.workunit.client.0.smithi012.stdout:3/226: sync 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:8/262: sync 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:4/217: sync 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:7/216: sync 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:2/255: sync 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:5/256: sync 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:5/257: fsync f6 0 2024-02-14T13:10:34.893 INFO:tasks.workunit.client.0.smithi012.stdout:3/227: mknod d9/d18/c5c 0 2024-02-14T13:10:34.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/263: symlink d9/dc/d14/d2e/l4c 0 2024-02-14T13:10:34.897 INFO:tasks.workunit.client.0.smithi012.stdout:5/258: mknod dc/d47/c50 0 2024-02-14T13:10:34.929 INFO:tasks.workunit.client.0.smithi012.stdout:0/328: mkdir d10/d14/d41/d61 0 2024-02-14T13:10:34.931 INFO:tasks.workunit.client.0.smithi012.stdout:2/256: dwrite d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:34.931 INFO:tasks.workunit.client.0.smithi012.stdout:2/257: write d0/d5/f42 [1011542,19481] 0 2024-02-14T13:10:34.932 INFO:tasks.workunit.client.0.smithi012.stdout:3/228: dwrite d9/dd/f17 [0,4194304] 0 2024-02-14T13:10:34.932 INFO:tasks.workunit.client.0.smithi012.stdout:3/229: chown d9/l57 74 1 2024-02-14T13:10:34.932 INFO:tasks.workunit.client.0.smithi012.stdout:0/329: creat d10/f62 x:0 0 0 2024-02-14T13:10:34.932 INFO:tasks.workunit.client.0.smithi012.stdout:1/279: symlink d6/d10/l60 0 2024-02-14T13:10:34.933 INFO:tasks.workunit.client.0.smithi012.stdout:4/218: dwrite d0/d10/d13/d17/f38 [0,4194304] 0 2024-02-14T13:10:34.937 INFO:tasks.workunit.client.0.smithi012.stdout:4/219: creat d0/d10/d1f/d3e/f48 x:0 0 0 2024-02-14T13:10:34.938 INFO:tasks.workunit.client.0.smithi012.stdout:4/220: write d0/fa [3575285,36945] 0 2024-02-14T13:10:34.938 INFO:tasks.workunit.client.0.smithi012.stdout:4/221: write d0/d10/d1f/d3e/f48 [611012,101456] 0 2024-02-14T13:10:34.940 INFO:tasks.workunit.client.0.smithi012.stdout:0/330: creat d10/d14/d2b/d3b/f63 x:0 0 0 2024-02-14T13:10:34.944 INFO:tasks.workunit.client.0.smithi012.stdout:0/331: creat d10/d14/d20/f64 x:0 0 0 2024-02-14T13:10:34.945 INFO:tasks.workunit.client.0.smithi012.stdout:4/222: dread d0/d10/d13/f16 [4194304,4194304] 0 2024-02-14T13:10:34.946 INFO:tasks.workunit.client.0.smithi012.stdout:0/332: link d10/d14/d41/c46 d10/d14/d20/d21/c65 0 2024-02-14T13:10:34.947 INFO:tasks.workunit.client.0.smithi012.stdout:9/279: creat da/dd/f5d x:0 0 0 2024-02-14T13:10:34.948 INFO:tasks.workunit.client.0.smithi012.stdout:3/230: dread d9/dd/f17 [0,4194304] 0 2024-02-14T13:10:34.949 INFO:tasks.workunit.client.0.smithi012.stdout:0/333: unlink d10/d14/d41/d52/c58 0 2024-02-14T13:10:34.949 INFO:tasks.workunit.client.0.smithi012.stdout:0/334: readlink d10/d14/d2b/l2d 0 2024-02-14T13:10:34.950 INFO:tasks.workunit.client.0.smithi012.stdout:4/223: symlink d0/l49 0 2024-02-14T13:10:34.952 INFO:tasks.workunit.client.0.smithi012.stdout:9/280: mknod da/dd/c5e 0 2024-02-14T13:10:34.952 INFO:tasks.workunit.client.0.smithi012.stdout:9/281: readlink da/dd/d39/l4a 0 2024-02-14T13:10:34.953 INFO:tasks.workunit.client.0.smithi012.stdout:7/217: rename fe to df/d2d/f52 0 2024-02-14T13:10:34.954 INFO:tasks.workunit.client.0.smithi012.stdout:3/231: mkdir d9/d18/d3c/d5d 0 2024-02-14T13:10:34.957 INFO:tasks.workunit.client.0.smithi012.stdout:9/282: link da/l11 da/dd/d57/d59/l5f 0 2024-02-14T13:10:34.957 INFO:tasks.workunit.client.0.smithi012.stdout:9/283: fdatasync da/dd/d19/f4b 0 2024-02-14T13:10:34.957 INFO:tasks.workunit.client.0.smithi012.stdout:9/284: readlink da/dd/l35 0 2024-02-14T13:10:34.958 INFO:tasks.workunit.client.0.smithi012.stdout:7/218: mkdir df/d2d/d53 0 2024-02-14T13:10:34.958 INFO:tasks.workunit.client.0.smithi012.stdout:7/219: fsync df/f33 0 2024-02-14T13:10:34.960 INFO:tasks.workunit.client.0.smithi012.stdout:8/264: rename c0 to d9/dc/d14/d2e/c4d 0 2024-02-14T13:10:34.960 INFO:tasks.workunit.client.0.smithi012.stdout:1/280: dwrite d6/d10/d22/d31/d3e/f4f [0,4194304] 0 2024-02-14T13:10:34.962 INFO:tasks.workunit.client.0.smithi012.stdout:4/224: creat d0/d10/d13/f4a x:0 0 0 2024-02-14T13:10:34.963 INFO:tasks.workunit.client.0.smithi012.stdout:9/285: creat da/d4f/f60 x:0 0 0 2024-02-14T13:10:34.963 INFO:tasks.workunit.client.0.smithi012.stdout:9/286: fsync da/dd/d18/f32 0 2024-02-14T13:10:34.963 INFO:tasks.workunit.client.0.smithi012.stdout:9/287: fsync da/dd/d57/f41 0 2024-02-14T13:10:34.963 INFO:tasks.workunit.client.0.smithi012.stdout:9/288: chown da/dd/f53 146 1 2024-02-14T13:10:34.964 INFO:tasks.workunit.client.0.smithi012.stdout:5/259: rename dc/d17/d20/f2d to dc/d17/d20/d4c/f51 0 2024-02-14T13:10:34.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/265: rmdir d9/dc/d14/d23 39 2024-02-14T13:10:34.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/266: chown d9/dc/d14/c4b 1 1 2024-02-14T13:10:34.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/267: chown d9/dc/d14/f40 10 1 2024-02-14T13:10:34.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/268: chown d9/dc/c3d 995243 1 2024-02-14T13:10:34.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/269: fdatasync d9/f3b 0 2024-02-14T13:10:34.968 INFO:tasks.workunit.client.0.smithi012.stdout:0/335: dwrite d10/d14/d20/f37 [0,4194304] 0 2024-02-14T13:10:34.975 INFO:tasks.workunit.client.0.smithi012.stdout:1/281: unlink d6/d10/d22/d31/d34/d3b/l3c 0 2024-02-14T13:10:34.977 INFO:tasks.workunit.client.0.smithi012.stdout:9/289: mknod da/d4f/c61 0 2024-02-14T13:10:34.978 INFO:tasks.workunit.client.0.smithi012.stdout:5/260: creat dc/d2f/f52 x:0 0 0 2024-02-14T13:10:34.979 INFO:tasks.workunit.client.0.smithi012.stdout:8/270: mknod d9/dc/c4e 0 2024-02-14T13:10:34.980 INFO:tasks.workunit.client.0.smithi012.stdout:0/336: symlink d10/d14/d20/d21/l66 0 2024-02-14T13:10:34.980 INFO:tasks.workunit.client.0.smithi012.stdout:0/337: stat d10/d14/d20/f4a 0 2024-02-14T13:10:34.981 INFO:tasks.workunit.client.0.smithi012.stdout:1/282: mkdir d6/d10/d22/d31/d34/d58/d61 0 2024-02-14T13:10:34.982 INFO:tasks.workunit.client.0.smithi012.stdout:4/225: symlink d0/l4b 0 2024-02-14T13:10:34.982 INFO:tasks.workunit.client.0.smithi012.stdout:4/226: fsync d0/d10/f2a 0 2024-02-14T13:10:34.984 INFO:tasks.workunit.client.0.smithi012.stdout:5/261: mkdir dc/d2f/d40/d53 0 2024-02-14T13:10:34.985 INFO:tasks.workunit.client.0.smithi012.stdout:8/271: rename d9/dc/d14/d2e/l3e to d9/dc/d14/l4f 0 2024-02-14T13:10:34.985 INFO:tasks.workunit.client.0.smithi012.stdout:8/272: chown d9/dc/d38/c48 4001 1 2024-02-14T13:10:34.986 INFO:tasks.workunit.client.0.smithi012.stdout:0/338: mkdir d10/d14/d41/d52/d67 0 2024-02-14T13:10:34.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/283: truncate d6/d10/d22/d31/d34/f57 2716609 0 2024-02-14T13:10:34.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/227: creat d0/d10/d1f/d3e/f4c x:0 0 0 2024-02-14T13:10:34.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/228: chown d0/d10/d13/d17/c41 989 1 2024-02-14T13:10:34.988 INFO:tasks.workunit.client.0.smithi012.stdout:4/229: read - d0/d10/d13/f4a zero size 2024-02-14T13:10:34.989 INFO:tasks.workunit.client.0.smithi012.stdout:9/290: symlink da/dd/d19/d30/d20/d48/l62 0 2024-02-14T13:10:34.990 INFO:tasks.workunit.client.0.smithi012.stdout:9/291: stat da/dd/d19/d30/d20/f31 0 2024-02-14T13:10:34.990 INFO:tasks.workunit.client.0.smithi012.stdout:9/292: chown da/f14 77 1 2024-02-14T13:10:34.991 INFO:tasks.workunit.client.0.smithi012.stdout:5/262: rename c1 to dc/d2f/c54 0 2024-02-14T13:10:34.991 INFO:tasks.workunit.client.0.smithi012.stdout:5/263: fdatasync dc/d17/d20/f37 0 2024-02-14T13:10:34.991 INFO:tasks.workunit.client.0.smithi012.stdout:5/264: truncate dc/d2f/f39 100325 0 2024-02-14T13:10:34.991 INFO:tasks.workunit.client.0.smithi012.stdout:5/265: write dc/d17/f43 [915850,103227] 0 2024-02-14T13:10:34.992 INFO:tasks.workunit.client.0.smithi012.stdout:8/273: mkdir d9/dc/d1b/d35/d50 0 2024-02-14T13:10:34.994 INFO:tasks.workunit.client.0.smithi012.stdout:1/284: mkdir d6/d10/d22/d31/d62 0 2024-02-14T13:10:34.995 INFO:tasks.workunit.client.0.smithi012.stdout:1/285: chown d6/d10/d22/d31/d34/d3b/f56 50 1 2024-02-14T13:10:34.995 INFO:tasks.workunit.client.0.smithi012.stdout:1/286: fdatasync d6/d10/d22/d31/d34/d3b/f56 0 2024-02-14T13:10:34.995 INFO:tasks.workunit.client.0.smithi012.stdout:9/293: mkdir da/d33/d63 0 2024-02-14T13:10:34.996 INFO:tasks.workunit.client.0.smithi012.stdout:8/274: creat d9/dc/d38/f51 x:0 0 0 2024-02-14T13:10:34.997 INFO:tasks.workunit.client.0.smithi012.stdout:1/287: creat d6/d10/d22/d31/d34/d58/f63 x:0 0 0 2024-02-14T13:10:34.997 INFO:tasks.workunit.client.0.smithi012.stdout:1/288: stat d6/d10/d22/d31/d5b 0 2024-02-14T13:10:34.998 INFO:tasks.workunit.client.0.smithi012.stdout:9/294: truncate f2 4658383 0 2024-02-14T13:10:34.999 INFO:tasks.workunit.client.0.smithi012.stdout:8/275: mknod d9/dc/d1b/d35/d50/c52 0 2024-02-14T13:10:35.000 INFO:tasks.workunit.client.0.smithi012.stdout:9/295: creat da/dd/d38/f64 x:0 0 0 2024-02-14T13:10:35.000 INFO:tasks.workunit.client.0.smithi012.stdout:9/296: chown da/dd/d39/f52 6176459 1 2024-02-14T13:10:35.001 INFO:tasks.workunit.client.0.smithi012.stdout:9/297: mkdir da/dd/d38/d65 0 2024-02-14T13:10:35.006 INFO:tasks.workunit.client.0.smithi012.stdout:5/266: dwrite dc/d2f/f52 [0,4194304] 0 2024-02-14T13:10:35.010 INFO:tasks.workunit.client.0.smithi012.stdout:9/298: write da/dd/f2a [1512420,128836] 0 2024-02-14T13:10:35.012 INFO:tasks.workunit.client.0.smithi012.stdout:5/267: symlink dc/l55 0 2024-02-14T13:10:35.012 INFO:tasks.workunit.client.0.smithi012.stdout:5/268: chown dc/d2f/d40 537922755 1 2024-02-14T13:10:35.015 INFO:tasks.workunit.client.0.smithi012.stdout:5/269: unlink dc/f26 0 2024-02-14T13:10:35.017 INFO:tasks.workunit.client.0.smithi012.stdout:5/270: rename dc/lf to dc/d47/l56 0 2024-02-14T13:10:35.018 INFO:tasks.workunit.client.0.smithi012.stdout:6/247: mknod d1/d1e/c4e 0 2024-02-14T13:10:35.019 INFO:tasks.workunit.client.0.smithi012.stdout:6/248: fsync d1/d1e/dc/f15 0 2024-02-14T13:10:35.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/249: truncate d1/d1e/dc/f15 1830564 0 2024-02-14T13:10:35.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/250: write d1/d1e/d1b/f3d [717645,105105] 0 2024-02-14T13:10:35.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/251: chown d1/df/d16/l3b 3741 1 2024-02-14T13:10:35.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/252: readlink d1/d1e/l39 0 2024-02-14T13:10:35.026 INFO:tasks.workunit.client.0.smithi012.stdout:8/276: dwrite d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:35.029 INFO:tasks.workunit.client.0.smithi012.stdout:8/277: symlink d9/dc/d38/l53 0 2024-02-14T13:10:35.031 INFO:tasks.workunit.client.0.smithi012.stdout:8/278: creat d9/dc/d14/d2e/f54 x:0 0 0 2024-02-14T13:10:35.031 INFO:tasks.workunit.client.0.smithi012.stdout:8/279: fdatasync d9/dc/d14/d2e/f44 0 2024-02-14T13:10:35.033 INFO:tasks.workunit.client.0.smithi012.stdout:8/280: rename f8 to d9/dc/d38/f55 0 2024-02-14T13:10:35.037 INFO:tasks.workunit.client.0.smithi012.stdout:9/299: dwrite da/dd/d19/f4d [0,4194304] 0 2024-02-14T13:10:35.037 INFO:tasks.workunit.client.0.smithi012.stdout:9/300: getdents da/dd/d38/d65 0 2024-02-14T13:10:35.038 INFO:tasks.workunit.client.0.smithi012.stdout:9/301: write da/dd/d38/f64 [891614,98936] 0 2024-02-14T13:10:35.038 INFO:tasks.workunit.client.0.smithi012.stdout:6/253: dwrite d1/df/d24/f36 [0,4194304] 0 2024-02-14T13:10:35.038 INFO:tasks.workunit.client.0.smithi012.stdout:6/254: chown d1/d1e/l39 9590 1 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f64deff5640 1 -- 172.21.15.12:0/2315131899 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560c7e5f1550 con 0x560c7e9bdef0 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f64deff5640 10 client.15330 handle_command_reply: tid=0 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 client.15330 shutdown 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 msgr2=0x560c7e961e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961e30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f64f0006010 tx=0x7f64f0011810 comp rx=0 tx=0).stop 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 shutdown_connections 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x560c7e9bdef0 0x560c7e9c0310 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560c7e9522a0 0x560c7e95ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f64deff5640 0 client.15330 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.036+0000 7f6504259740 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c7e94d130 0x560c7e961e30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.040 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6504259740 1 --2- 172.21.15.12:0/2315131899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560c7e94c740 0x560c7e9618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 >> 172.21.15.12:0/2315131899 conn(0x560c7e947cb0 msgr2=0x560c7e951550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 shutdown_connections 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6504259740 1 -- 172.21.15.12:0/2315131899 wait complete. 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6504259740 20 client.15330 trim_cache size 0 max 16384 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:10:35.041 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:10:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64e40a2160 msgr2=0x7f64e40a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.037+0000 7f6501691640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64e40a2160 0x7f64e40a4620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f64fc1987f0 tx=0x7f64f0013880 comp rx=0 tx=0).stop 2024-02-14T13:10:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 msgr2=0x7f64fc19e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 0x7f64fc19e890 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f64f400b970 tx=0x7f64f400be30 comp rx=0 tx=0).stop 2024-02-14T13:10:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 shutdown_connections 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f64e40a2160 0x7f64e40a4620 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64fc101480 0x7f64fc19e890 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64fc100ac0 0x7f64fc197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 --2- 172.21.15.12:0/2469927829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64fc0ff8d0 0x7f64fc1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 >> 172.21.15.12:0/2469927829 conn(0x7f64fc0fae80 msgr2=0x7f64fc103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 shutdown_connections 2024-02-14T13:10:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:35.038+0000 7f6501691640 1 -- 172.21.15.12:0/2469927829 wait complete. 2024-02-14T13:10:35.043 INFO:tasks.workunit.client.0.smithi012.stdout:6/255: link d1/c11 d1/d1e/d1b/c4f 0 2024-02-14T13:10:35.044 INFO:tasks.workunit.client.0.smithi012.stdout:6/256: stat d1/d1e/d1b/d3e/f4c 0 2024-02-14T13:10:35.045 INFO:tasks.workunit.client.0.smithi012.stdout:6/257: stat d1/df/d16/c45 0 2024-02-14T13:10:35.045 INFO:tasks.workunit.client.0.smithi012.stdout:8/281: write d9/dc/d1b/f21 [1607512,57529] 0 2024-02-14T13:10:35.046 INFO:tasks.workunit.client.0.smithi012.stdout:6/258: mkdir d1/df/d50 0 2024-02-14T13:10:35.048 INFO:tasks.workunit.client.0.smithi012.stdout:8/282: mkdir d9/dc/d1b/d35/d50/d56 0 2024-02-14T13:10:35.050 INFO:tasks.workunit.client.0.smithi012.stdout:6/259: creat d1/d1e/d1b/d21/f51 x:0 0 0 2024-02-14T13:10:35.051 INFO:tasks.workunit.client.0.smithi012.stdout:5/271: dwrite dc/d17/d20/f3a [0,4194304] 0 2024-02-14T13:10:35.051 INFO:tasks.workunit.client.0.smithi012.stdout:5/272: readlink dc/d17/l3b 0 2024-02-14T13:10:35.052 INFO:tasks.workunit.client.0.smithi012.stdout:5/273: dread dc/f33 [0,4194304] 0 2024-02-14T13:10:35.055 INFO:tasks.workunit.client.0.smithi012.stdout:5/274: link dc/c19 dc/d2f/d40/d53/c57 0 2024-02-14T13:10:35.058 INFO:tasks.workunit.client.0.smithi012.stdout:9/302: dwrite da/dd/d19/d30/d20/f51 [0,4194304] 0 2024-02-14T13:10:35.062 INFO:tasks.workunit.client.0.smithi012.stdout:9/303: dread da/f14 [0,4194304] 0 2024-02-14T13:10:35.062 INFO:tasks.workunit.client.0.smithi012.stdout:9/304: write f2 [348169,92990] 0 2024-02-14T13:10:35.063 INFO:tasks.workunit.client.0.smithi012.stdout:9/305: mknod da/dd/d39/c66 0 2024-02-14T13:10:35.064 INFO:tasks.workunit.client.0.smithi012.stdout:5/275: write f7 [3873993,96059] 0 2024-02-14T13:10:35.065 INFO:tasks.workunit.client.0.smithi012.stdout:9/306: unlink da/dd/d19/d30/d20/l2d 0 2024-02-14T13:10:35.066 INFO:tasks.workunit.client.0.smithi012.stdout:5/276: unlink dc/d17/d20/c2e 0 2024-02-14T13:10:35.067 INFO:tasks.workunit.client.0.smithi012.stdout:9/307: creat da/dd/d19/d30/d20/d48/f67 x:0 0 0 2024-02-14T13:10:35.067 INFO:tasks.workunit.client.0.smithi012.stdout:9/308: truncate da/dd/d39/f52 142963 0 2024-02-14T13:10:35.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/309: truncate da/f44 2670930 0 2024-02-14T13:10:35.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/310: write da/dd/f5d [141414,121715] 0 2024-02-14T13:10:35.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/311: readlink da/dd/l35 0 2024-02-14T13:10:35.069 INFO:tasks.workunit.client.0.smithi012.stdout:6/260: dwrite d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:35.069 INFO:tasks.workunit.client.0.smithi012.stdout:9/312: creat da/dd/f68 x:0 0 0 2024-02-14T13:10:35.071 INFO:tasks.workunit.client.0.smithi012.stdout:6/261: symlink d1/df/d24/l52 0 2024-02-14T13:10:35.071 INFO:tasks.workunit.client.0.smithi012.stdout:6/262: chown d1/df 44 1 2024-02-14T13:10:35.072 INFO:tasks.workunit.client.0.smithi012.stdout:6/263: fsync d1/d1e/d1b/f3d 0 2024-02-14T13:10:35.073 INFO:tasks.workunit.client.0.smithi012.stdout:9/313: symlink da/dd/d19/d30/d45/l69 0 2024-02-14T13:10:35.073 INFO:tasks.workunit.client.0.smithi012.stdout:9/314: stat da/dd/d19/d30/f29 0 2024-02-14T13:10:35.083 INFO:tasks.workunit.client.0.smithi012.stdout:5/277: write dc/d17/d20/f3a [3247700,38830] 0 2024-02-14T13:10:35.084 INFO:tasks.workunit.client.0.smithi012.stdout:5/278: mkdir dc/d17/d20/d4c/d58 0 2024-02-14T13:10:35.085 INFO:tasks.workunit.client.0.smithi012.stdout:5/279: mkdir dc/d47/d59 0 2024-02-14T13:10:35.086 INFO:tasks.workunit.client.0.smithi012.stdout:5/280: truncate dc/d17/d20/f4f 944054 0 2024-02-14T13:10:35.087 INFO:tasks.workunit.client.0.smithi012.stdout:5/281: creat dc/f5a x:0 0 0 2024-02-14T13:10:35.088 INFO:tasks.workunit.client.0.smithi012.stdout:5/282: mknod dc/d2f/d40/d53/c5b 0 2024-02-14T13:10:35.088 INFO:tasks.workunit.client.0.smithi012.stdout:5/283: chown dc/l55 479578 1 2024-02-14T13:10:35.088 INFO:tasks.workunit.client.0.smithi012.stdout:5/284: write dc/d17/d20/d4c/f51 [1956288,119765] 0 2024-02-14T13:10:35.090 INFO:tasks.workunit.client.0.smithi012.stdout:5/285: creat dc/d2f/d40/d53/f5c x:0 0 0 2024-02-14T13:10:35.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/264: dwrite d1/d1e/d1b/d21/f51 [0,4194304] 0 2024-02-14T13:10:35.091 INFO:tasks.workunit.client.0.smithi012.stdout:5/286: creat dc/f5d x:0 0 0 2024-02-14T13:10:35.096 INFO:tasks.workunit.client.0.smithi012.stdout:5/287: rename dc/l32 to dc/d2f/d3e/l5e 0 2024-02-14T13:10:35.096 INFO:tasks.workunit.client.0.smithi012.stdout:5/288: dread - dc/d2f/d40/f48 zero size 2024-02-14T13:10:35.101 INFO:tasks.workunit.client.0.smithi012.stdout:5/289: rmdir dc/d2f/d40 39 2024-02-14T13:10:35.101 INFO:tasks.workunit.client.0.smithi012.stdout:5/290: stat dc/d17 0 2024-02-14T13:10:35.101 INFO:tasks.workunit.client.0.smithi012.stdout:5/291: write dc/d17/d20/f22 [3980855,14202] 0 2024-02-14T13:10:35.102 INFO:tasks.workunit.client.0.smithi012.stdout:9/315: dwrite f0 [4194304,4194304] 0 2024-02-14T13:10:35.102 INFO:tasks.workunit.client.0.smithi012.stdout:5/292: symlink dc/l5f 0 2024-02-14T13:10:35.103 INFO:tasks.workunit.client.0.smithi012.stdout:9/316: symlink da/dd/d19/d30/d20/d48/l6a 0 2024-02-14T13:10:35.105 INFO:tasks.workunit.client.0.smithi012.stdout:5/293: truncate f6 2349820 0 2024-02-14T13:10:35.105 INFO:tasks.workunit.client.0.smithi012.stdout:5/294: fdatasync dc/d17/f41 0 2024-02-14T13:10:35.105 INFO:tasks.workunit.client.0.smithi012.stdout:5/295: write dc/d17/d20/f2b [746030,72328] 0 2024-02-14T13:10:35.106 INFO:tasks.workunit.client.0.smithi012.stdout:9/317: creat da/dd/d39/f6b x:0 0 0 2024-02-14T13:10:35.108 INFO:tasks.workunit.client.0.smithi012.stdout:5/296: link dc/c25 dc/d47/d59/c60 0 2024-02-14T13:10:35.110 INFO:tasks.workunit.client.0.smithi012.stdout:5/297: creat dc/d47/f61 x:0 0 0 2024-02-14T13:10:35.110 INFO:tasks.workunit.client.0.smithi012.stdout:5/298: chown dc/c19 30458099 1 2024-02-14T13:10:35.111 INFO:tasks.workunit.client.0.smithi012.stdout:5/299: mknod dc/d47/c62 0 2024-02-14T13:10:35.118 INFO:tasks.workunit.client.0.smithi012.stdout:5/300: write dc/f29 [3997193,126109] 0 2024-02-14T13:10:35.118 INFO:tasks.workunit.client.0.smithi012.stdout:5/301: readlink dc/d17/l3b 0 2024-02-14T13:10:35.118 INFO:tasks.workunit.client.0.smithi012.stdout:5/302: write dc/d2f/f39 [468402,123389] 0 2024-02-14T13:10:35.118 INFO:tasks.workunit.client.0.smithi012.stdout:5/303: stat dc/d17/c46 0 2024-02-14T13:10:35.119 INFO:tasks.workunit.client.0.smithi012.stdout:5/304: mkdir dc/d17/d20/d4c/d63 0 2024-02-14T13:10:35.125 INFO:tasks.workunit.client.0.smithi012.stdout:5/305: write dc/d2f/f52 [2433500,103237] 0 2024-02-14T13:10:35.127 INFO:tasks.workunit.client.0.smithi012.stdout:5/306: link f6 dc/d17/d20/f64 0 2024-02-14T13:10:35.128 INFO:tasks.workunit.client.0.smithi012.stdout:5/307: creat dc/d17/f65 x:0 0 0 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:7/220: sync 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:2/258: sync 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:6/265: sync 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:6/266: stat d1/d1e/dc/f15 0 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:2/259: chown d0/d8/f31 0 1 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:8/283: sync 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:1/289: sync 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:4/230: sync 2024-02-14T13:10:35.596 INFO:tasks.workunit.client.0.smithi012.stdout:3/232: sync 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:3/233: dread - d9/dd/d30/d34/f51 zero size 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:2/260: write d0/f2f [5014431,72901] 0 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:0/339: sync 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:5/308: sync 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:9/318: sync 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:5/309: dread - dc/f5d zero size 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:5/310: dread - dc/d2f/d40/d53/f5c zero size 2024-02-14T13:10:35.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/267: truncate d1/d1e/dc/f2e 3510606 0 2024-02-14T13:10:35.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/290: truncate d6/f1b 2845718 0 2024-02-14T13:10:35.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/291: readlink d6/d10/d22/d31/d5b/d5d/l2f 0 2024-02-14T13:10:35.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/268: write d1/df/f48 [818048,14866] 0 2024-02-14T13:10:35.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/269: truncate d1/df/d24/f40 56705 0 2024-02-14T13:10:35.598 INFO:tasks.workunit.client.0.smithi012.stdout:8/284: mkdir d9/dc/d1b/d35/d50/d56/d57 0 2024-02-14T13:10:35.599 INFO:tasks.workunit.client.0.smithi012.stdout:4/231: truncate d0/d10/f2a 706720 0 2024-02-14T13:10:35.602 INFO:tasks.workunit.client.0.smithi012.stdout:2/261: mkdir d0/d8/d12/d51 0 2024-02-14T13:10:35.602 INFO:tasks.workunit.client.0.smithi012.stdout:8/285: dread d9/f3c [0,4194304] 0 2024-02-14T13:10:35.602 INFO:tasks.workunit.client.0.smithi012.stdout:8/286: write d9/dc/f19 [1739,6040] 0 2024-02-14T13:10:35.606 INFO:tasks.workunit.client.0.smithi012.stdout:7/221: write df/f33 [3266983,28959] 0 2024-02-14T13:10:35.606 INFO:tasks.workunit.client.0.smithi012.stdout:5/311: mknod dc/c66 0 2024-02-14T13:10:35.607 INFO:tasks.workunit.client.0.smithi012.stdout:1/292: mkdir d6/d10/d64 0 2024-02-14T13:10:35.609 INFO:tasks.workunit.client.0.smithi012.stdout:6/270: creat d1/d17/f53 x:0 0 0 2024-02-14T13:10:35.612 INFO:tasks.workunit.client.0.smithi012.stdout:2/262: rename d0/d6/de/c4d to d0/d1a/c52 0 2024-02-14T13:10:35.615 INFO:tasks.workunit.client.0.smithi012.stdout:0/340: creat d10/d14/d1b/f68 x:0 0 0 2024-02-14T13:10:35.619 INFO:tasks.workunit.client.0.smithi012.stdout:7/222: creat df/d36/f54 x:0 0 0 2024-02-14T13:10:35.620 INFO:tasks.workunit.client.0.smithi012.stdout:4/232: dread d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:35.620 INFO:tasks.workunit.client.0.smithi012.stdout:5/312: creat dc/d17/f67 x:0 0 0 2024-02-14T13:10:35.622 INFO:tasks.workunit.client.0.smithi012.stdout:1/293: rmdir d6/d10/d22/d31/d5b 39 2024-02-14T13:10:35.622 INFO:tasks.workunit.client.0.smithi012.stdout:1/294: read - d6/d10/d22/d44/f48 zero size 2024-02-14T13:10:35.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/341: dread d10/d14/d1b/f3a [0,4194304] 0 2024-02-14T13:10:35.623 INFO:tasks.workunit.client.0.smithi012.stdout:6/271: truncate d1/df/d24/f36 4048938 0 2024-02-14T13:10:35.623 INFO:tasks.workunit.client.0.smithi012.stdout:6/272: truncate d1/df/d24/f40 1060274 0 2024-02-14T13:10:35.623 INFO:tasks.workunit.client.0.smithi012.stdout:6/273: fsync d1/d1e/d1b/d21/f32 0 2024-02-14T13:10:35.625 INFO:tasks.workunit.client.0.smithi012.stdout:4/233: dread d0/d10/d13/f16 [4194304,4194304] 0 2024-02-14T13:10:35.625 INFO:tasks.workunit.client.0.smithi012.stdout:2/263: mkdir d0/d8/d11/d33/d53 0 2024-02-14T13:10:35.626 INFO:tasks.workunit.client.0.smithi012.stdout:7/223: symlink df/d27/l55 0 2024-02-14T13:10:35.628 INFO:tasks.workunit.client.0.smithi012.stdout:5/313: rename dc/d2f/d40/d53/f5c to dc/d17/d20/d4c/d58/f68 0 2024-02-14T13:10:35.628 INFO:tasks.workunit.client.0.smithi012.stdout:5/314: chown dc/c13 271267 1 2024-02-14T13:10:35.628 INFO:tasks.workunit.client.0.smithi012.stdout:0/342: dread d10/d14/d1b/f3a [0,4194304] 0 2024-02-14T13:10:35.628 INFO:tasks.workunit.client.0.smithi012.stdout:4/234: symlink d0/d10/d13/l4d 0 2024-02-14T13:10:35.630 INFO:tasks.workunit.client.0.smithi012.stdout:7/224: rename df/d2d/d53 to df/d24/d56 0 2024-02-14T13:10:35.630 INFO:tasks.workunit.client.0.smithi012.stdout:5/315: mkdir dc/d47/d69 0 2024-02-14T13:10:35.631 INFO:tasks.workunit.client.0.smithi012.stdout:0/343: link d10/d14/d2b/d3b/f63 d10/d14/d20/f69 0 2024-02-14T13:10:35.632 INFO:tasks.workunit.client.0.smithi012.stdout:4/235: creat d0/d10/d13/d17/d3a/f4e x:0 0 0 2024-02-14T13:10:35.633 INFO:tasks.workunit.client.0.smithi012.stdout:5/316: dread dc/d17/f43 [0,4194304] 0 2024-02-14T13:10:35.633 INFO:tasks.workunit.client.0.smithi012.stdout:5/317: readlink dc/d17/l3c 0 2024-02-14T13:10:35.634 INFO:tasks.workunit.client.0.smithi012.stdout:1/295: read d6/d10/d22/d31/d34/d3b/f53 [2414449,119295] 0 2024-02-14T13:10:35.634 INFO:tasks.workunit.client.0.smithi012.stdout:1/296: chown d6/d10/f4a 128653212 1 2024-02-14T13:10:35.634 INFO:tasks.workunit.client.0.smithi012.stdout:7/225: mkdir df/d2d/d57 0 2024-02-14T13:10:35.634 INFO:tasks.workunit.client.0.smithi012.stdout:7/226: chown df/d2d/f52 34872958 1 2024-02-14T13:10:35.635 INFO:tasks.workunit.client.0.smithi012.stdout:0/344: creat d10/d14/d41/f6a x:0 0 0 2024-02-14T13:10:35.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/319: dwrite da/dd/f2a [4194304,4194304] 0 2024-02-14T13:10:35.637 INFO:tasks.workunit.client.0.smithi012.stdout:7/227: link df/d27/l3d df/d27/d4b/l58 0 2024-02-14T13:10:35.638 INFO:tasks.workunit.client.0.smithi012.stdout:3/234: dwrite d9/dd/d30/d44/f4b [0,4194304] 0 2024-02-14T13:10:35.638 INFO:tasks.workunit.client.0.smithi012.stdout:0/345: creat d10/d14/d20/f6b x:0 0 0 2024-02-14T13:10:35.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/287: dwrite d9/dc/d38/f4a [0,4194304] 0 2024-02-14T13:10:35.639 INFO:tasks.workunit.client.0.smithi012.stdout:1/297: write d6/fe [3644743,109145] 0 2024-02-14T13:10:35.639 INFO:tasks.workunit.client.0.smithi012.stdout:1/298: chown d6/d10/d22/d44 1183013 1 2024-02-14T13:10:35.640 INFO:tasks.workunit.client.0.smithi012.stdout:9/320: mknod da/dd/d57/c6c 0 2024-02-14T13:10:35.640 INFO:tasks.workunit.client.0.smithi012.stdout:9/321: readlink da/dd/d19/d30/d20/d48/l6a 0 2024-02-14T13:10:35.642 INFO:tasks.workunit.client.0.smithi012.stdout:7/228: creat df/f59 x:0 0 0 2024-02-14T13:10:35.644 INFO:tasks.workunit.client.0.smithi012.stdout:3/235: link d9/d3f/d4e/f5a d9/d18/f5e 0 2024-02-14T13:10:35.645 INFO:tasks.workunit.client.0.smithi012.stdout:0/346: symlink d10/d14/d2b/l6c 0 2024-02-14T13:10:35.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/347: dread d10/d14/d1b/f3a [0,4194304] 0 2024-02-14T13:10:35.652 INFO:tasks.workunit.client.0.smithi012.stdout:1/299: mkdir d6/d10/d22/d31/d5b/d5e/d65 0 2024-02-14T13:10:35.655 INFO:tasks.workunit.client.0.smithi012.stdout:8/288: dread d9/f3b [0,4194304] 0 2024-02-14T13:10:35.655 INFO:tasks.workunit.client.0.smithi012.stdout:8/289: write d9/dc/d14/d23/f41 [843377,126785] 0 2024-02-14T13:10:35.660 INFO:tasks.workunit.client.0.smithi012.stdout:0/348: dread d10/f32 [0,4194304] 0 2024-02-14T13:10:35.661 INFO:tasks.workunit.client.0.smithi012.stdout:4/236: rename d0/d10/d13/d17/d3a to d0/d10/d28/d4f 0 2024-02-14T13:10:35.662 INFO:tasks.workunit.client.0.smithi012.stdout:9/322: getdents da/dd/d38 0 2024-02-14T13:10:35.662 INFO:tasks.workunit.client.0.smithi012.stdout:9/323: readlink da/dd/d57/d59/l5f 0 2024-02-14T13:10:35.662 INFO:tasks.workunit.client.0.smithi012.stdout:0/349: read d10/d14/d2b/d3b/f4b [30538,30769] 0 2024-02-14T13:10:35.663 INFO:tasks.workunit.client.0.smithi012.stdout:2/264: truncate d0/f2f 1896973 0 2024-02-14T13:10:35.664 INFO:tasks.workunit.client.0.smithi012.stdout:7/229: mkdir df/d27/d4b/d5a 0 2024-02-14T13:10:35.664 INFO:tasks.workunit.client.0.smithi012.stdout:7/230: chown df/l13 42 1 2024-02-14T13:10:35.664 INFO:tasks.workunit.client.0.smithi012.stdout:7/231: truncate df/d24/f29 5076063 0 2024-02-14T13:10:35.665 INFO:tasks.workunit.client.0.smithi012.stdout:7/232: fsync df/d2d/f41 0 2024-02-14T13:10:35.666 INFO:tasks.workunit.client.0.smithi012.stdout:2/265: dread d0/d6/d37/f3b [0,4194304] 0 2024-02-14T13:10:35.666 INFO:tasks.workunit.client.0.smithi012.stdout:1/300: mknod d6/d10/d22/d31/d34/d3b/c66 0 2024-02-14T13:10:35.666 INFO:tasks.workunit.client.0.smithi012.stdout:5/318: dwrite dc/d17/d20/f22 [0,4194304] 0 2024-02-14T13:10:35.668 INFO:tasks.workunit.client.0.smithi012.stdout:3/236: dwrite d9/d13/f26 [0,4194304] 0 2024-02-14T13:10:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:9/324: creat da/dd/d38/f6d x:0 0 0 2024-02-14T13:10:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/350: readlink d10/d14/l1a 0 2024-02-14T13:10:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/351: truncate d10/d14/d20/d49/f5e 489615 0 2024-02-14T13:10:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:7/233: getdents df/d27 0 2024-02-14T13:10:35.670 INFO:tasks.workunit.client.0.smithi012.stdout:7/234: fdatasync df/f20 0 2024-02-14T13:10:35.672 INFO:tasks.workunit.client.0.smithi012.stdout:2/266: mkdir d0/d20/d54 0 2024-02-14T13:10:35.672 INFO:tasks.workunit.client.0.smithi012.stdout:2/267: fsync d0/d1a/f49 0 2024-02-14T13:10:35.672 INFO:tasks.workunit.client.0.smithi012.stdout:2/268: chown d0/d5/d15/f4a 0 1 2024-02-14T13:10:35.673 INFO:tasks.workunit.client.0.smithi012.stdout:5/319: getdents dc/d17/d20/d4c/d58 0 2024-02-14T13:10:35.673 INFO:tasks.workunit.client.0.smithi012.stdout:5/320: read f7 [3782310,61386] 0 2024-02-14T13:10:35.673 INFO:tasks.workunit.client.0.smithi012.stdout:5/321: fsync dc/f5a 0 2024-02-14T13:10:35.675 INFO:tasks.workunit.client.0.smithi012.stdout:9/325: rmdir da/dd/d55 0 2024-02-14T13:10:35.675 INFO:tasks.workunit.client.0.smithi012.stdout:5/322: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:35.675 INFO:tasks.workunit.client.0.smithi012.stdout:7/235: mknod df/c5b 0 2024-02-14T13:10:35.677 INFO:tasks.workunit.client.0.smithi012.stdout:8/290: dwrite d9/f3b [8388608,4194304] 0 2024-02-14T13:10:35.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/326: creat da/dd/d57/f6e x:0 0 0 2024-02-14T13:10:35.679 INFO:tasks.workunit.client.0.smithi012.stdout:7/236: rename df/d27/l34 to df/d27/l5c 0 2024-02-14T13:10:35.683 INFO:tasks.workunit.client.0.smithi012.stdout:8/291: symlink d9/dc/d1b/d35/l58 0 2024-02-14T13:10:35.684 INFO:tasks.workunit.client.0.smithi012.stdout:4/237: getdents d0/d10/d28 0 2024-02-14T13:10:35.685 INFO:tasks.workunit.client.0.smithi012.stdout:9/327: creat da/dd/d57/d59/f6f x:0 0 0 2024-02-14T13:10:35.687 INFO:tasks.workunit.client.0.smithi012.stdout:7/237: mkdir df/d2d/d5d 0 2024-02-14T13:10:35.687 INFO:tasks.workunit.client.0.smithi012.stdout:7/238: chown df/d24/f38 30 1 2024-02-14T13:10:35.688 INFO:tasks.workunit.client.0.smithi012.stdout:4/238: symlink d0/d10/d13/l50 0 2024-02-14T13:10:35.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/239: creat df/d36/f5e x:0 0 0 2024-02-14T13:10:35.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/240: chown df/d24/f29 352 1 2024-02-14T13:10:35.693 INFO:tasks.workunit.client.0.smithi012.stdout:9/328: creat da/dd/d38/d65/f70 x:0 0 0 2024-02-14T13:10:35.695 INFO:tasks.workunit.client.0.smithi012.stdout:9/329: mkdir da/dd/d18/d71 0 2024-02-14T13:10:35.695 INFO:tasks.workunit.client.0.smithi012.stdout:9/330: chown da/dd/f5d 506782 1 2024-02-14T13:10:35.698 INFO:tasks.workunit.client.0.smithi012.stdout:9/331: unlink da/dd/d38/f64 0 2024-02-14T13:10:35.700 INFO:tasks.workunit.client.0.smithi012.stdout:9/332: link da/dd/d19/d30/c42 da/dd/d57/c72 0 2024-02-14T13:10:35.702 INFO:tasks.workunit.client.0.smithi012.stdout:9/333: mkdir da/dd/d57/d59/d73 0 2024-02-14T13:10:35.702 INFO:tasks.workunit.client.0.smithi012.stdout:0/352: dwrite d10/f32 [4194304,4194304] 0 2024-02-14T13:10:35.705 INFO:tasks.workunit.client.0.smithi012.stdout:0/353: creat d10/d14/d1b/d30/f6d x:0 0 0 2024-02-14T13:10:35.708 INFO:tasks.workunit.client.0.smithi012.stdout:0/354: rename d10/d14/f18 to d10/d14/d2b/f6e 0 2024-02-14T13:10:35.709 INFO:tasks.workunit.client.0.smithi012.stdout:0/355: write d10/d14/f43 [1302753,62200] 0 2024-02-14T13:10:35.711 INFO:tasks.workunit.client.0.smithi012.stdout:9/334: read da/dd/d19/d30/d20/f51 [1914347,14439] 0 2024-02-14T13:10:35.713 INFO:tasks.workunit.client.0.smithi012.stdout:9/335: mknod da/d4f/c74 0 2024-02-14T13:10:35.717 INFO:tasks.workunit.client.0.smithi012.stdout:3/237: dwrite d9/d18/f1c [0,4194304] 0 2024-02-14T13:10:35.719 INFO:tasks.workunit.client.0.smithi012.stdout:9/336: dread da/f44 [0,4194304] 0 2024-02-14T13:10:35.720 INFO:tasks.workunit.client.0.smithi012.stdout:0/356: dread d10/f2a [0,4194304] 0 2024-02-14T13:10:35.720 INFO:tasks.workunit.client.0.smithi012.stdout:0/357: dread - d10/d14/d41/f48 zero size 2024-02-14T13:10:35.720 INFO:tasks.workunit.client.0.smithi012.stdout:3/238: mknod d9/dd/c5f 0 2024-02-14T13:10:35.721 INFO:tasks.workunit.client.0.smithi012.stdout:9/337: creat da/dd/d18/d71/f75 x:0 0 0 2024-02-14T13:10:35.722 INFO:tasks.workunit.client.0.smithi012.stdout:9/338: truncate da/f14 4136804 0 2024-02-14T13:10:35.723 INFO:tasks.workunit.client.0.smithi012.stdout:9/339: readlink da/dd/d19/d30/d20/l3a 0 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:5/323: dwrite dc/d2f/f52 [0,4194304] 0 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:4/239: dwrite d0/d10/d1f/d3e/f48 [0,4194304] 0 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/269: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/270: truncate d0/d5/d15/f4a 84474 0 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/271: chown d0/d8/c16 3439 1 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/272: fdatasync d0/d8/d11/f32 0 2024-02-14T13:10:35.726 INFO:tasks.workunit.client.0.smithi012.stdout:8/292: dwrite d9/dc/d38/f55 [0,4194304] 0 2024-02-14T13:10:35.730 INFO:tasks.workunit.client.0.smithi012.stdout:4/240: creat d0/d10/d28/f51 x:0 0 0 2024-02-14T13:10:35.737 INFO:tasks.workunit.client.0.smithi012.stdout:4/241: symlink d0/d10/d28/d4f/l52 0 2024-02-14T13:10:35.738 INFO:tasks.workunit.client.0.smithi012.stdout:4/242: chown d0/l27 18372 1 2024-02-14T13:10:35.740 INFO:tasks.workunit.client.0.smithi012.stdout:8/293: dread d9/dc/d14/d23/f41 [0,4194304] 0 2024-02-14T13:10:35.742 INFO:tasks.workunit.client.0.smithi012.stdout:3/239: dwrite d9/dd/f17 [0,4194304] 0 2024-02-14T13:10:35.742 INFO:tasks.workunit.client.0.smithi012.stdout:3/240: fsync d9/f35 0 2024-02-14T13:10:35.742 INFO:tasks.workunit.client.0.smithi012.stdout:3/241: dread - d9/dd/de/f3e zero size 2024-02-14T13:10:35.742 INFO:tasks.workunit.client.0.smithi012.stdout:8/294: creat d9/dc/d1b/d35/d50/f59 x:0 0 0 2024-02-14T13:10:35.743 INFO:tasks.workunit.client.0.smithi012.stdout:8/295: chown d9/dc/d14/d23/l2a 30 1 2024-02-14T13:10:35.743 INFO:tasks.workunit.client.0.smithi012.stdout:8/296: chown d9/dc/d14/d2e/c4d 2 1 2024-02-14T13:10:35.744 INFO:tasks.workunit.client.0.smithi012.stdout:8/297: chown d9/dc/f2c 855106 1 2024-02-14T13:10:35.745 INFO:tasks.workunit.client.0.smithi012.stdout:8/298: symlink d9/dc/l5a 0 2024-02-14T13:10:35.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/242: write d9/d13/f26 [1552005,121232] 0 2024-02-14T13:10:35.754 INFO:tasks.workunit.client.0.smithi012.stdout:3/243: write d9/d13/f26 [5161347,36583] 0 2024-02-14T13:10:35.755 INFO:tasks.workunit.client.0.smithi012.stdout:3/244: creat d9/f60 x:0 0 0 2024-02-14T13:10:35.755 INFO:tasks.workunit.client.0.smithi012.stdout:3/245: stat d9/d18/c4f 0 2024-02-14T13:10:35.755 INFO:tasks.workunit.client.0.smithi012.stdout:3/246: write d9/d18/f55 [980369,62854] 0 2024-02-14T13:10:35.756 INFO:tasks.workunit.client.0.smithi012.stdout:3/247: creat d9/f61 x:0 0 0 2024-02-14T13:10:35.757 INFO:tasks.workunit.client.0.smithi012.stdout:3/248: unlink d9/c53 0 2024-02-14T13:10:35.758 INFO:tasks.workunit.client.0.smithi012.stdout:3/249: mknod d9/dd/c62 0 2024-02-14T13:10:35.765 INFO:tasks.workunit.client.0.smithi012.stdout:6/274: sync 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:4/243: dwrite d0/d10/d1f/d3e/f48 [0,4194304] 0 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:2/273: dwrite d0/d5/d15/f4a [0,4194304] 0 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:2/274: chown d0/d6/de 467 1 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:2/275: chown d0/d8/d11/d35/c44 802 1 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:2/276: write d0/f2f [2047417,120355] 0 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:9/340: dwrite f0 [0,4194304] 0 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:9/341: truncate da/dd/d18/d71/f75 471961 0 2024-02-14T13:10:35.766 INFO:tasks.workunit.client.0.smithi012.stdout:8/299: dwrite d9/dc/d1b/f21 [0,4194304] 0 2024-02-14T13:10:35.767 INFO:tasks.workunit.client.0.smithi012.stdout:6/275: rename d1/d1e/d1b/c31 to d1/d1e/d1b/d3e/c54 0 2024-02-14T13:10:35.767 INFO:tasks.workunit.client.0.smithi012.stdout:3/250: dread d9/d13/f2b [0,4194304] 0 2024-02-14T13:10:35.770 INFO:tasks.workunit.client.0.smithi012.stdout:4/244: link d0/d10/d13/d17/l23 d0/d10/d13/d17/l53 0 2024-02-14T13:10:35.770 INFO:tasks.workunit.client.0.smithi012.stdout:4/245: fsync d0/d10/d13/f2d 0 2024-02-14T13:10:35.771 INFO:tasks.workunit.client.0.smithi012.stdout:9/342: creat da/d33/d63/f76 x:0 0 0 2024-02-14T13:10:35.772 INFO:tasks.workunit.client.0.smithi012.stdout:9/343: dread - da/dd/f2b zero size 2024-02-14T13:10:35.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/276: link d1/d1e/d1b/c4f d1/d1e/dc/d38/c55 0 2024-02-14T13:10:35.774 INFO:tasks.workunit.client.0.smithi012.stdout:3/251: mknod d9/d18/d3c/d5d/c63 0 2024-02-14T13:10:35.776 INFO:tasks.workunit.client.0.smithi012.stdout:4/246: symlink d0/d10/d1f/d3e/l54 0 2024-02-14T13:10:35.776 INFO:tasks.workunit.client.0.smithi012.stdout:9/344: stat da/l11 0 2024-02-14T13:10:35.778 INFO:tasks.workunit.client.0.smithi012.stdout:6/277: chown d1/d1e/c29 2044 1 2024-02-14T13:10:35.779 INFO:tasks.workunit.client.0.smithi012.stdout:3/252: link d9/dd/f4a d9/dd/de/d58/f64 0 2024-02-14T13:10:35.780 INFO:tasks.workunit.client.0.smithi012.stdout:3/253: chown d9/d13 7 1 2024-02-14T13:10:35.784 INFO:tasks.workunit.client.0.smithi012.stdout:6/278: mkdir d1/df/d24/d3f/d56 0 2024-02-14T13:10:35.784 INFO:tasks.workunit.client.0.smithi012.stdout:6/279: stat d1/df/d24/l52 0 2024-02-14T13:10:35.784 INFO:tasks.workunit.client.0.smithi012.stdout:6/280: fdatasync d1/df/f48 0 2024-02-14T13:10:35.784 INFO:tasks.workunit.client.0.smithi012.stdout:6/281: write d1/d1e/d1b/d3e/f4c [1918441,36623] 0 2024-02-14T13:10:35.785 INFO:tasks.workunit.client.0.smithi012.stdout:3/254: mkdir d9/dd/de/d58/d65 0 2024-02-14T13:10:35.786 INFO:tasks.workunit.client.0.smithi012.stdout:6/282: creat d1/d1e/d1b/f57 x:0 0 0 2024-02-14T13:10:35.787 INFO:tasks.workunit.client.0.smithi012.stdout:6/283: write d1/d1e/dc/f15 [2275817,24031] 0 2024-02-14T13:10:35.787 INFO:tasks.workunit.client.0.smithi012.stdout:3/255: mkdir d9/dd/d30/d44/d66 0 2024-02-14T13:10:35.789 INFO:tasks.workunit.client.0.smithi012.stdout:6/284: symlink d1/df/d24/d3f/l58 0 2024-02-14T13:10:35.789 INFO:tasks.workunit.client.0.smithi012.stdout:6/285: getdents d1/df/d24/d3f/d56 0 2024-02-14T13:10:35.791 INFO:tasks.workunit.client.0.smithi012.stdout:3/256: creat d9/dd/d30/d44/d3d/f67 x:0 0 0 2024-02-14T13:10:35.793 INFO:tasks.workunit.client.0.smithi012.stdout:6/286: getdents d1/d1e/d1b/d21 0 2024-02-14T13:10:35.793 INFO:tasks.workunit.client.0.smithi012.stdout:2/277: dwrite d0/d8/f30 [0,4194304] 0 2024-02-14T13:10:35.793 INFO:tasks.workunit.client.0.smithi012.stdout:6/287: chown d1/d1e/d1b/d3e/f4c 226448297 1 2024-02-14T13:10:35.795 INFO:tasks.workunit.client.0.smithi012.stdout:6/288: creat d1/df/d16/f59 x:0 0 0 2024-02-14T13:10:35.797 INFO:tasks.workunit.client.0.smithi012.stdout:6/289: truncate d1/d1e/d1b/d21/f32 122625 0 2024-02-14T13:10:35.799 INFO:tasks.workunit.client.0.smithi012.stdout:6/290: mkdir d1/d17/d5a 0 2024-02-14T13:10:35.808 INFO:tasks.workunit.client.0.smithi012.stdout:8/300: dwrite d9/f3b [8388608,4194304] 0 2024-02-14T13:10:35.812 INFO:tasks.workunit.client.0.smithi012.stdout:4/247: dwrite d0/d10/f2a [0,4194304] 0 2024-02-14T13:10:35.813 INFO:tasks.workunit.client.0.smithi012.stdout:9/345: dwrite da/dd/d39/f3d [0,4194304] 0 2024-02-14T13:10:35.813 INFO:tasks.workunit.client.0.smithi012.stdout:9/346: chown da/d4f/c61 91142 1 2024-02-14T13:10:35.813 INFO:tasks.workunit.client.0.smithi012.stdout:9/347: write da/dd/d18/f22 [2059259,121470] 0 2024-02-14T13:10:35.814 INFO:tasks.workunit.client.0.smithi012.stdout:9/348: dread da/fc [0,4194304] 0 2024-02-14T13:10:35.814 INFO:tasks.workunit.client.0.smithi012.stdout:9/349: stat l1 0 2024-02-14T13:10:35.814 INFO:tasks.workunit.client.0.smithi012.stdout:9/350: stat da/dd/d19/d30/d20/l5c 0 2024-02-14T13:10:35.814 INFO:tasks.workunit.client.0.smithi012.stdout:9/351: fsync da/dd/d19/d30/f1f 0 2024-02-14T13:10:35.814 INFO:tasks.workunit.client.0.smithi012.stdout:9/352: fdatasync da/dd/d19/d30/f43 0 2024-02-14T13:10:35.815 INFO:tasks.workunit.client.0.smithi012.stdout:2/278: dwrite d0/d5/f42 [0,4194304] 0 2024-02-14T13:10:35.815 INFO:tasks.workunit.client.0.smithi012.stdout:3/257: dwrite d9/d3f/d4e/f5a [0,4194304] 0 2024-02-14T13:10:35.815 INFO:tasks.workunit.client.0.smithi012.stdout:3/258: chown d9/dd/d30/d34/l3a 102431 1 2024-02-14T13:10:35.817 INFO:tasks.workunit.client.0.smithi012.stdout:4/248: mkdir d0/d55 0 2024-02-14T13:10:35.819 INFO:tasks.workunit.client.0.smithi012.stdout:9/353: mknod da/dd/d19/d30/d45/c77 0 2024-02-14T13:10:35.820 INFO:tasks.workunit.client.0.smithi012.stdout:2/279: mknod d0/d1a/c55 0 2024-02-14T13:10:35.820 INFO:tasks.workunit.client.0.smithi012.stdout:2/280: write d0/d5/d15/f4a [5017113,91104] 0 2024-02-14T13:10:35.824 INFO:tasks.workunit.client.0.smithi012.stdout:3/259: read d9/dd/de/f1a [197574,73388] 0 2024-02-14T13:10:35.825 INFO:tasks.workunit.client.0.smithi012.stdout:8/301: dwrite d9/dc/d1b/f20 [0,4194304] 0 2024-02-14T13:10:35.826 INFO:tasks.workunit.client.0.smithi012.stdout:4/249: mkdir d0/d10/d1f/d3e/d56 0 2024-02-14T13:10:35.826 INFO:tasks.workunit.client.0.smithi012.stdout:4/250: chown d0/d10/l22 2 1 2024-02-14T13:10:35.827 INFO:tasks.workunit.client.0.smithi012.stdout:9/354: write da/dd/d19/d30/d20/f2e [2436,124590] 0 2024-02-14T13:10:35.829 INFO:tasks.workunit.client.0.smithi012.stdout:2/281: mknod d0/d6/c56 0 2024-02-14T13:10:35.831 INFO:tasks.workunit.client.0.smithi012.stdout:3/260: rename d9/d18/d50 to d9/d68 0 2024-02-14T13:10:35.831 INFO:tasks.workunit.client.0.smithi012.stdout:3/261: truncate d9/dd/f17 4273029 0 2024-02-14T13:10:35.831 INFO:tasks.workunit.client.0.smithi012.stdout:1/301: sync 2024-02-14T13:10:35.831 INFO:tasks.workunit.client.0.smithi012.stdout:1/302: write d6/d10/d22/d31/d3e/f4f [5063012,32853] 0 2024-02-14T13:10:35.831 INFO:tasks.workunit.client.0.smithi012.stdout:8/302: mkdir d9/dc/d5b 0 2024-02-14T13:10:35.832 INFO:tasks.workunit.client.0.smithi012.stdout:4/251: mknod d0/d10/d28/d4f/c57 0 2024-02-14T13:10:35.833 INFO:tasks.workunit.client.0.smithi012.stdout:9/355: symlink da/d33/l78 0 2024-02-14T13:10:35.835 INFO:tasks.workunit.client.0.smithi012.stdout:3/262: mknod d9/dd/d30/c69 0 2024-02-14T13:10:35.838 INFO:tasks.workunit.client.0.smithi012.stdout:1/303: getdents d6/d10/d22/d31/d5b 0 2024-02-14T13:10:35.838 INFO:tasks.workunit.client.0.smithi012.stdout:1/304: chown d6/d10/d22/d31/d34/d3b/f43 112712 1 2024-02-14T13:10:35.840 INFO:tasks.workunit.client.0.smithi012.stdout:9/356: unlink f9 0 2024-02-14T13:10:35.841 INFO:tasks.workunit.client.0.smithi012.stdout:1/305: truncate d6/d10/f21 3557018 0 2024-02-14T13:10:35.841 INFO:tasks.workunit.client.0.smithi012.stdout:1/306: chown d6/d10/d22/c30 331326 1 2024-02-14T13:10:35.843 INFO:tasks.workunit.client.0.smithi012.stdout:7/241: sync 2024-02-14T13:10:35.843 INFO:tasks.workunit.client.0.smithi012.stdout:0/358: sync 2024-02-14T13:10:35.843 INFO:tasks.workunit.client.0.smithi012.stdout:4/252: link d0/d10/l32 d0/l58 0 2024-02-14T13:10:35.844 INFO:tasks.workunit.client.0.smithi012.stdout:9/357: truncate da/dd/f2a 3263984 0 2024-02-14T13:10:35.845 INFO:tasks.workunit.client.0.smithi012.stdout:1/307: truncate d6/d10/d22/d31/d34/d3b/f43 1542495 0 2024-02-14T13:10:35.847 INFO:tasks.workunit.client.0.smithi012.stdout:7/242: symlink df/d2d/d57/l5f 0 2024-02-14T13:10:35.847 INFO:tasks.workunit.client.0.smithi012.stdout:7/243: chown df/d27/f4c 0 1 2024-02-14T13:10:35.847 INFO:tasks.workunit.client.0.smithi012.stdout:7/244: write df/d2d/f3f [900234,174] 0 2024-02-14T13:10:35.848 INFO:tasks.workunit.client.0.smithi012.stdout:4/253: mkdir d0/d10/d1f/d3e/d59 0 2024-02-14T13:10:35.848 INFO:tasks.workunit.client.0.smithi012.stdout:2/282: dread d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:35.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/308: creat d6/d35/f67 x:0 0 0 2024-02-14T13:10:35.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/309: dread - d6/d10/d22/d31/d5b/d5d/f38 zero size 2024-02-14T13:10:35.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/310: read - d6/d35/f67 zero size 2024-02-14T13:10:35.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/311: fsync d6/d10/d22/d31/d5b/d5e/f3f 0 2024-02-14T13:10:35.851 INFO:tasks.workunit.client.0.smithi012.stdout:1/312: readlink d6/d10/l11 0 2024-02-14T13:10:35.852 INFO:tasks.workunit.client.0.smithi012.stdout:7/245: unlink df/d2d/c44 0 2024-02-14T13:10:35.854 INFO:tasks.workunit.client.0.smithi012.stdout:4/254: rmdir d0/d10/d1f/d3e/d59 0 2024-02-14T13:10:35.854 INFO:tasks.workunit.client.0.smithi012.stdout:4/255: chown d0/d10/d28/d4f 6777409 1 2024-02-14T13:10:35.855 INFO:tasks.workunit.client.0.smithi012.stdout:2/283: chown d0/d8/d12/d26/l46 1200703891 1 2024-02-14T13:10:35.856 INFO:tasks.workunit.client.0.smithi012.stdout:9/358: symlink da/dd/d38/l79 0 2024-02-14T13:10:35.858 INFO:tasks.workunit.client.0.smithi012.stdout:7/246: unlink df/d2d/f32 0 2024-02-14T13:10:35.858 INFO:tasks.workunit.client.0.smithi012.stdout:7/247: truncate df/f3b 354275 0 2024-02-14T13:10:35.858 INFO:tasks.workunit.client.0.smithi012.stdout:7/248: chown df/d27/d4b/l58 900715753 1 2024-02-14T13:10:35.858 INFO:tasks.workunit.client.0.smithi012.stdout:3/263: dwrite d9/d18/f4d [0,4194304] 0 2024-02-14T13:10:35.859 INFO:tasks.workunit.client.0.smithi012.stdout:9/359: symlink da/dd/d57/l7a 0 2024-02-14T13:10:35.859 INFO:tasks.workunit.client.0.smithi012.stdout:9/360: readlink da/dd/l35 0 2024-02-14T13:10:35.860 INFO:tasks.workunit.client.0.smithi012.stdout:7/249: creat df/d24/d56/f60 x:0 0 0 2024-02-14T13:10:35.866 INFO:tasks.workunit.client.0.smithi012.stdout:7/250: rename df/f33 to df/d24/d56/f61 0 2024-02-14T13:10:35.867 INFO:tasks.workunit.client.0.smithi012.stdout:4/256: read d0/d10/d1f/f20 [2394881,96736] 0 2024-02-14T13:10:35.867 INFO:tasks.workunit.client.0.smithi012.stdout:4/257: chown d0/d10/f30 3805551 1 2024-02-14T13:10:35.868 INFO:tasks.workunit.client.0.smithi012.stdout:7/251: getdents df/d36 0 2024-02-14T13:10:35.868 INFO:tasks.workunit.client.0.smithi012.stdout:7/252: read - df/f51 zero size 2024-02-14T13:10:35.868 INFO:tasks.workunit.client.0.smithi012.stdout:3/264: write d9/d18/f5e [2288142,34662] 0 2024-02-14T13:10:35.869 INFO:tasks.workunit.client.0.smithi012.stdout:8/303: dwrite d9/dc/d14/f40 [0,4194304] 0 2024-02-14T13:10:35.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/265: write d9/dd/f4a [803786,94914] 0 2024-02-14T13:10:35.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/266: dread d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:35.871 INFO:tasks.workunit.client.0.smithi012.stdout:4/258: rename d0/d10/l22 to d0/d10/d1f/l5a 0 2024-02-14T13:10:35.871 INFO:tasks.workunit.client.0.smithi012.stdout:4/259: write d0/d10/d1f/d3e/f4c [977347,122449] 0 2024-02-14T13:10:35.872 INFO:tasks.workunit.client.0.smithi012.stdout:7/253: mknod df/d27/c62 0 2024-02-14T13:10:35.874 INFO:tasks.workunit.client.0.smithi012.stdout:8/304: mkdir d9/dc/d1b/d35/d50/d56/d57/d5c 0 2024-02-14T13:10:35.874 INFO:tasks.workunit.client.0.smithi012.stdout:8/305: fsync d9/dc/d14/f15 0 2024-02-14T13:10:35.876 INFO:tasks.workunit.client.0.smithi012.stdout:3/267: rmdir d9 39 2024-02-14T13:10:35.878 INFO:tasks.workunit.client.0.smithi012.stdout:7/254: link f5 df/d36/f63 0 2024-02-14T13:10:35.878 INFO:tasks.workunit.client.0.smithi012.stdout:8/306: creat d9/dc/d14/d2e/f5d x:0 0 0 2024-02-14T13:10:35.880 INFO:tasks.workunit.client.0.smithi012.stdout:4/260: link d0/lc d0/l5b 0 2024-02-14T13:10:35.880 INFO:tasks.workunit.client.0.smithi012.stdout:9/361: dwrite da/dd/d19/d30/d20/f31 [0,4194304] 0 2024-02-14T13:10:35.880 INFO:tasks.workunit.client.0.smithi012.stdout:9/362: stat da/dd/d39/c66 0 2024-02-14T13:10:35.880 INFO:tasks.workunit.client.0.smithi012.stdout:9/363: write da/f56 [385480,107627] 0 2024-02-14T13:10:35.881 INFO:tasks.workunit.client.0.smithi012.stdout:0/359: dwrite d10/d14/d1b/f22 [4194304,4194304] 0 2024-02-14T13:10:35.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/255: creat df/d24/d56/f64 x:0 0 0 2024-02-14T13:10:35.881 INFO:tasks.workunit.client.0.smithi012.stdout:1/313: dwrite d6/d10/d22/d31/d34/d3b/f56 [0,4194304] 0 2024-02-14T13:10:35.881 INFO:tasks.workunit.client.0.smithi012.stdout:2/284: dwrite d0/d8/d11/d33/f38 [0,4194304] 0 2024-02-14T13:10:35.881 INFO:tasks.workunit.client.0.smithi012.stdout:2/285: readlink d0/d8/d43/l4c 0 2024-02-14T13:10:35.882 INFO:tasks.workunit.client.0.smithi012.stdout:2/286: write d0/d1a/f47 [979748,99792] 0 2024-02-14T13:10:35.887 INFO:tasks.workunit.client.0.smithi012.stdout:9/364: unlink da/dd/d57/f6e 0 2024-02-14T13:10:35.889 INFO:tasks.workunit.client.0.smithi012.stdout:0/360: write d10/d14/f1e [2496962,111635] 0 2024-02-14T13:10:35.889 INFO:tasks.workunit.client.0.smithi012.stdout:0/361: dread - d10/d14/d1b/f68 zero size 2024-02-14T13:10:35.890 INFO:tasks.workunit.client.0.smithi012.stdout:7/256: mknod df/d2d/d5d/c65 0 2024-02-14T13:10:35.890 INFO:tasks.workunit.client.0.smithi012.stdout:7/257: fdatasync df/d24/d56/f60 0 2024-02-14T13:10:35.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/307: dwrite d9/dc/d1b/f21 [4194304,4194304] 0 2024-02-14T13:10:35.895 INFO:tasks.workunit.client.0.smithi012.stdout:3/268: dwrite d9/f35 [0,4194304] 0 2024-02-14T13:10:35.902 INFO:tasks.workunit.client.0.smithi012.stdout:1/314: rename d6/f59 to d6/d10/d22/d31/d5b/d5e/d3d/f68 0 2024-02-14T13:10:35.905 INFO:tasks.workunit.client.0.smithi012.stdout:2/287: unlink d0/d8/d11/d35/c48 0 2024-02-14T13:10:35.907 INFO:tasks.workunit.client.0.smithi012.stdout:4/261: rename d0/f1e to d0/f5c 0 2024-02-14T13:10:35.910 INFO:tasks.workunit.client.0.smithi012.stdout:8/308: creat d9/dc/d1b/d35/f5e x:0 0 0 2024-02-14T13:10:35.910 INFO:tasks.workunit.client.0.smithi012.stdout:8/309: readlink d9/l43 0 2024-02-14T13:10:35.911 INFO:tasks.workunit.client.0.smithi012.stdout:3/269: mkdir d9/d68/d6a 0 2024-02-14T13:10:35.911 INFO:tasks.workunit.client.0.smithi012.stdout:3/270: truncate d9/dd/d30/d34/f54 1016688 0 2024-02-14T13:10:35.911 INFO:tasks.workunit.client.0.smithi012.stdout:3/271: chown d9/f60 41276689 1 2024-02-14T13:10:35.912 INFO:tasks.workunit.client.0.smithi012.stdout:7/258: rename df/f3b to df/d27/f66 0 2024-02-14T13:10:35.913 INFO:tasks.workunit.client.0.smithi012.stdout:1/315: link d6/l14 d6/d35/l69 0 2024-02-14T13:10:35.914 INFO:tasks.workunit.client.0.smithi012.stdout:2/288: getdents d0/d8 0 2024-02-14T13:10:35.915 INFO:tasks.workunit.client.0.smithi012.stdout:4/262: creat d0/d10/d1f/d3e/d56/f5d x:0 0 0 2024-02-14T13:10:35.916 INFO:tasks.workunit.client.0.smithi012.stdout:3/272: mknod d9/dd/d30/d44/c6b 0 2024-02-14T13:10:35.916 INFO:tasks.workunit.client.0.smithi012.stdout:3/273: stat d9/dd/d30/d44/c6b 0 2024-02-14T13:10:35.917 INFO:tasks.workunit.client.0.smithi012.stdout:7/259: mkdir df/d36/d67 0 2024-02-14T13:10:35.918 INFO:tasks.workunit.client.0.smithi012.stdout:0/362: dwrite d10/d14/d41/f48 [0,4194304] 0 2024-02-14T13:10:35.918 INFO:tasks.workunit.client.0.smithi012.stdout:9/365: dwrite da/dd/d19/d30/d20/f31 [4194304,4194304] 0 2024-02-14T13:10:35.918 INFO:tasks.workunit.client.0.smithi012.stdout:1/316: unlink d6/d10/l11 0 2024-02-14T13:10:35.918 INFO:tasks.workunit.client.0.smithi012.stdout:1/317: readlink d6/d10/d22/d31/d5b/d5e/l1e 0 2024-02-14T13:10:35.920 INFO:tasks.workunit.client.0.smithi012.stdout:5/324: sync 2024-02-14T13:10:35.922 INFO:tasks.workunit.client.0.smithi012.stdout:0/363: write d10/d14/d23/f45 [547379,71242] 0 2024-02-14T13:10:35.923 INFO:tasks.workunit.client.0.smithi012.stdout:9/366: getdents da/d4f 0 2024-02-14T13:10:35.925 INFO:tasks.workunit.client.0.smithi012.stdout:5/325: mkdir dc/d47/d59/d6a 0 2024-02-14T13:10:35.925 INFO:tasks.workunit.client.0.smithi012.stdout:5/326: dread - dc/d2f/d40/f48 zero size 2024-02-14T13:10:35.926 INFO:tasks.workunit.client.0.smithi012.stdout:0/364: creat d10/d14/d1b/d30/f6f x:0 0 0 2024-02-14T13:10:35.927 INFO:tasks.workunit.client.0.smithi012.stdout:9/367: symlink da/l7b 0 2024-02-14T13:10:35.928 INFO:tasks.workunit.client.0.smithi012.stdout:5/327: creat dc/d17/d20/d4c/d58/f6b x:0 0 0 2024-02-14T13:10:35.928 INFO:tasks.workunit.client.0.smithi012.stdout:0/365: symlink d10/d14/d41/d52/d67/l70 0 2024-02-14T13:10:35.928 INFO:tasks.workunit.client.0.smithi012.stdout:0/366: stat d10/d14/d1b/d30/f6f 0 2024-02-14T13:10:35.929 INFO:tasks.workunit.client.0.smithi012.stdout:9/368: rmdir da/dd/d19/d30/d20 39 2024-02-14T13:10:35.931 INFO:tasks.workunit.client.0.smithi012.stdout:5/328: mknod dc/d17/d20/d4c/d58/c6c 0 2024-02-14T13:10:35.932 INFO:tasks.workunit.client.0.smithi012.stdout:0/367: symlink d10/d14/d41/d52/d56/l71 0 2024-02-14T13:10:35.932 INFO:tasks.workunit.client.0.smithi012.stdout:0/368: write d10/d14/d20/f6b [266300,33719] 0 2024-02-14T13:10:35.933 INFO:tasks.workunit.client.0.smithi012.stdout:9/369: rename da/dd/d19/d30/c1c to da/d33/c7c 0 2024-02-14T13:10:35.935 INFO:tasks.workunit.client.0.smithi012.stdout:5/329: symlink dc/d17/d20/d4c/d63/l6d 0 2024-02-14T13:10:35.937 INFO:tasks.workunit.client.0.smithi012.stdout:0/369: mkdir d10/d14/d41/d52/d72 0 2024-02-14T13:10:35.938 INFO:tasks.workunit.client.0.smithi012.stdout:5/330: unlink dc/c14 0 2024-02-14T13:10:35.938 INFO:tasks.workunit.client.0.smithi012.stdout:5/331: fsync dc/f29 0 2024-02-14T13:10:35.940 INFO:tasks.workunit.client.0.smithi012.stdout:5/332: mkdir dc/d47/d6e 0 2024-02-14T13:10:35.941 INFO:tasks.workunit.client.0.smithi012.stdout:4/263: dwrite d0/f1a [4194304,4194304] 0 2024-02-14T13:10:35.941 INFO:tasks.workunit.client.0.smithi012.stdout:4/264: chown d0/d10/d28/d4f 7448649 1 2024-02-14T13:10:35.941 INFO:tasks.workunit.client.0.smithi012.stdout:4/265: readlink d0/l4b 0 2024-02-14T13:10:35.942 INFO:tasks.workunit.client.0.smithi012.stdout:5/333: creat dc/d2f/d40/f6f x:0 0 0 2024-02-14T13:10:35.945 INFO:tasks.workunit.client.0.smithi012.stdout:4/266: creat d0/d10/d13/d17/f5e x:0 0 0 2024-02-14T13:10:35.945 INFO:tasks.workunit.client.0.smithi012.stdout:4/267: chown d0/d10/d13/f2d 90727 1 2024-02-14T13:10:35.945 INFO:tasks.workunit.client.0.smithi012.stdout:8/310: dwrite d9/f3c [0,4194304] 0 2024-02-14T13:10:35.945 INFO:tasks.workunit.client.0.smithi012.stdout:7/260: dread df/f11 [4194304,4194304] 0 2024-02-14T13:10:35.946 INFO:tasks.workunit.client.0.smithi012.stdout:7/261: chown df/f59 32411 1 2024-02-14T13:10:35.946 INFO:tasks.workunit.client.0.smithi012.stdout:7/262: stat df/d27/l55 0 2024-02-14T13:10:35.947 INFO:tasks.workunit.client.0.smithi012.stdout:5/334: truncate f7 3111742 0 2024-02-14T13:10:35.949 INFO:tasks.workunit.client.0.smithi012.stdout:4/268: mkdir d0/d10/d13/d17/d5f 0 2024-02-14T13:10:35.951 INFO:tasks.workunit.client.0.smithi012.stdout:5/335: mkdir dc/d2f/d70 0 2024-02-14T13:10:35.951 INFO:tasks.workunit.client.0.smithi012.stdout:5/336: read dc/d17/d20/f64 [643331,44382] 0 2024-02-14T13:10:35.953 INFO:tasks.workunit.client.0.smithi012.stdout:4/269: unlink d0/d10/d1f/d3e/f4c 0 2024-02-14T13:10:35.954 INFO:tasks.workunit.client.0.smithi012.stdout:2/289: dwrite d0/d8/f31 [4194304,4194304] 0 2024-02-14T13:10:35.954 INFO:tasks.workunit.client.0.smithi012.stdout:2/290: write d0/d20/f45 [270113,59572] 0 2024-02-14T13:10:35.954 INFO:tasks.workunit.client.0.smithi012.stdout:5/337: rename dc/d17/c38 to dc/d2f/d40/d53/c71 0 2024-02-14T13:10:35.954 INFO:tasks.workunit.client.0.smithi012.stdout:5/338: readlink dc/l16 0 2024-02-14T13:10:35.955 INFO:tasks.workunit.client.0.smithi012.stdout:4/270: link d0/d10/f30 d0/d10/f60 0 2024-02-14T13:10:35.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/339: dread f6 [0,4194304] 0 2024-02-14T13:10:35.963 INFO:tasks.workunit.client.0.smithi012.stdout:9/370: dwrite da/dd/d39/f52 [0,4194304] 0 2024-02-14T13:10:35.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/340: chown dc/d47/c62 2752 1 2024-02-14T13:10:35.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/341: chown dc/d17/l1e 1471 1 2024-02-14T13:10:35.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/342: chown dc/d17/c46 0 1 2024-02-14T13:10:35.967 INFO:tasks.workunit.client.0.smithi012.stdout:4/271: dread d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:35.967 INFO:tasks.workunit.client.0.smithi012.stdout:5/343: mknod dc/d47/d69/c72 0 2024-02-14T13:10:35.967 INFO:tasks.workunit.client.0.smithi012.stdout:5/344: write dc/d17/f41 [1177231,36764] 0 2024-02-14T13:10:35.969 INFO:tasks.workunit.client.0.smithi012.stdout:5/345: mknod dc/d2f/d40/c73 0 2024-02-14T13:10:35.972 INFO:tasks.workunit.client.0.smithi012.stdout:9/371: write f0 [7723376,23844] 0 2024-02-14T13:10:35.973 INFO:tasks.workunit.client.0.smithi012.stdout:3/274: dwrite d9/d18/f56 [0,4194304] 0 2024-02-14T13:10:35.973 INFO:tasks.workunit.client.0.smithi012.stdout:1/318: dwrite d6/d10/d22/d31/d5b/d5d/f1a [0,4194304] 0 2024-02-14T13:10:35.973 INFO:tasks.workunit.client.0.smithi012.stdout:1/319: readlink l5 0 2024-02-14T13:10:35.973 INFO:tasks.workunit.client.0.smithi012.stdout:1/320: dread - d6/d10/d22/d31/d5b/d5e/f3f zero size 2024-02-14T13:10:35.973 INFO:tasks.workunit.client.0.smithi012.stdout:1/321: chown d6/d10/d22/l26 7492 1 2024-02-14T13:10:35.973 INFO:tasks.workunit.client.0.smithi012.stdout:1/322: chown d6/d10/d22/d31/d34/d3b/f53 0 1 2024-02-14T13:10:35.974 INFO:tasks.workunit.client.0.smithi012.stdout:1/323: write d6/d10/d22/d31/d5b/d5d/f38 [966319,78723] 0 2024-02-14T13:10:35.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/311: dwrite d9/dc/f19 [4194304,4194304] 0 2024-02-14T13:10:35.974 INFO:tasks.workunit.client.0.smithi012.stdout:9/372: rename da/d33/f36 to da/dd/d19/d30/d45/f7d 0 2024-02-14T13:10:35.976 INFO:tasks.workunit.client.0.smithi012.stdout:0/370: dwrite d10/d14/d20/f37 [0,4194304] 0 2024-02-14T13:10:35.976 INFO:tasks.workunit.client.0.smithi012.stdout:0/371: write d10/d14/d20/f4a [760348,42267] 0 2024-02-14T13:10:35.988 INFO:tasks.workunit.client.0.smithi012.stdout:3/275: getdents d9/d18 0 2024-02-14T13:10:35.990 INFO:tasks.workunit.client.0.smithi012.stdout:1/324: creat d6/d10/d22/d31/d34/d3b/d5a/f6a x:0 0 0 2024-02-14T13:10:35.991 INFO:tasks.workunit.client.0.smithi012.stdout:4/272: dwrite d0/d10/d28/d4f/f4e [0,4194304] 0 2024-02-14T13:10:35.991 INFO:tasks.workunit.client.0.smithi012.stdout:5/346: dwrite dc/d17/d20/f37 [0,4194304] 0 2024-02-14T13:10:35.993 INFO:tasks.workunit.client.0.smithi012.stdout:8/312: mknod d9/dc/d1b/c5f 0 2024-02-14T13:10:35.998 INFO:tasks.workunit.client.0.smithi012.stdout:1/325: creat d6/d10/d22/d31/d34/d58/d61/f6b x:0 0 0 2024-02-14T13:10:36.001 INFO:tasks.workunit.client.0.smithi012.stdout:4/273: creat d0/d10/d13/d17/d5f/f61 x:0 0 0 2024-02-14T13:10:36.003 INFO:tasks.workunit.client.0.smithi012.stdout:5/347: creat dc/d2f/f74 x:0 0 0 2024-02-14T13:10:36.003 INFO:tasks.workunit.client.0.smithi012.stdout:6/291: sync 2024-02-14T13:10:36.004 INFO:tasks.workunit.client.0.smithi012.stdout:3/276: dwrite d9/f35 [0,4194304] 0 2024-02-14T13:10:36.004 INFO:tasks.workunit.client.0.smithi012.stdout:8/313: creat d9/dc/d38/f60 x:0 0 0 2024-02-14T13:10:36.005 INFO:tasks.workunit.client.0.smithi012.stdout:9/373: mkdir da/dd/d38/d7e 0 2024-02-14T13:10:36.006 INFO:tasks.workunit.client.0.smithi012.stdout:0/372: creat d10/d14/d51/f73 x:0 0 0 2024-02-14T13:10:36.006 INFO:tasks.workunit.client.0.smithi012.stdout:0/373: chown d10/d14 123 1 2024-02-14T13:10:36.006 INFO:tasks.workunit.client.0.smithi012.stdout:0/374: stat d10/d14/d1b/f3a 0 2024-02-14T13:10:36.007 INFO:tasks.workunit.client.0.smithi012.stdout:1/326: truncate d6/d10/d22/d44/f52 182063 0 2024-02-14T13:10:36.008 INFO:tasks.workunit.client.0.smithi012.stdout:4/274: mkdir d0/d10/d28/d62 0 2024-02-14T13:10:36.009 INFO:tasks.workunit.client.0.smithi012.stdout:5/348: rmdir dc/d17/d20 39 2024-02-14T13:10:36.012 INFO:tasks.workunit.client.0.smithi012.stdout:3/277: mkdir d9/dd/de/d58/d65/d6c 0 2024-02-14T13:10:36.013 INFO:tasks.workunit.client.0.smithi012.stdout:9/374: link da/f14 da/dd/d19/f7f 0 2024-02-14T13:10:36.014 INFO:tasks.workunit.client.0.smithi012.stdout:0/375: mkdir d10/d14/d41/d61/d74 0 2024-02-14T13:10:36.014 INFO:tasks.workunit.client.0.smithi012.stdout:0/376: chown d10/d14/d2b/l2d 52 1 2024-02-14T13:10:36.016 INFO:tasks.workunit.client.0.smithi012.stdout:4/275: unlink d0/d10/d13/c2e 0 2024-02-14T13:10:36.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/292: mkdir d1/d1e/d5b 0 2024-02-14T13:10:36.021 INFO:tasks.workunit.client.0.smithi012.stdout:3/278: creat d9/d3f/d4e/f6d x:0 0 0 2024-02-14T13:10:36.022 INFO:tasks.workunit.client.0.smithi012.stdout:8/314: write d9/dc/d1b/f20 [3077534,128651] 0 2024-02-14T13:10:36.023 INFO:tasks.workunit.client.0.smithi012.stdout:4/276: mkdir d0/d10/d1f/d3e/d63 0 2024-02-14T13:10:36.023 INFO:tasks.workunit.client.0.smithi012.stdout:6/293: creat d1/d17/d5a/f5c x:0 0 0 2024-02-14T13:10:36.025 INFO:tasks.workunit.client.0.smithi012.stdout:1/327: write d6/d10/d22/f54 [3610886,35317] 0 2024-02-14T13:10:36.025 INFO:tasks.workunit.client.0.smithi012.stdout:3/279: unlink d9/lc 0 2024-02-14T13:10:36.025 INFO:tasks.workunit.client.0.smithi012.stdout:3/280: write d9/d18/f5e [5036943,3945] 0 2024-02-14T13:10:36.025 INFO:tasks.workunit.client.0.smithi012.stdout:3/281: stat d9/f22 0 2024-02-14T13:10:36.027 INFO:tasks.workunit.client.0.smithi012.stdout:4/277: creat d0/d55/f64 x:0 0 0 2024-02-14T13:10:36.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/375: dwrite da/dd/d19/f7f [0,4194304] 0 2024-02-14T13:10:36.031 INFO:tasks.workunit.client.0.smithi012.stdout:1/328: rename d6/d10/d22/d31/d5b/d5e/f1d to d6/d10/d22/d31/d3e/f6c 0 2024-02-14T13:10:36.033 INFO:tasks.workunit.client.0.smithi012.stdout:3/282: dread d9/dd/de/f38 [0,4194304] 0 2024-02-14T13:10:36.034 INFO:tasks.workunit.client.0.smithi012.stdout:5/349: dwrite dc/d17/d20/d4c/d58/f6b [0,4194304] 0 2024-02-14T13:10:36.035 INFO:tasks.workunit.client.0.smithi012.stdout:1/329: unlink d6/d10/f21 0 2024-02-14T13:10:36.037 INFO:tasks.workunit.client.0.smithi012.stdout:9/376: mknod da/dd/d38/c80 0 2024-02-14T13:10:36.042 INFO:tasks.workunit.client.0.smithi012.stdout:1/330: dread d6/d10/d22/d44/f52 [0,4194304] 0 2024-02-14T13:10:36.042 INFO:tasks.workunit.client.0.smithi012.stdout:1/331: chown d6 11024762 1 2024-02-14T13:10:36.042 INFO:tasks.workunit.client.0.smithi012.stdout:1/332: chown d6/ff 9128 1 2024-02-14T13:10:36.042 INFO:tasks.workunit.client.0.smithi012.stdout:1/333: fsync d6/f1b 0 2024-02-14T13:10:36.044 INFO:tasks.workunit.client.0.smithi012.stdout:4/278: write d0/d10/d28/f37 [1762816,19510] 0 2024-02-14T13:10:36.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/377: dread d10/d14/f2e [4194304,4194304] 0 2024-02-14T13:10:36.047 INFO:tasks.workunit.client.0.smithi012.stdout:5/350: getdents dc/d17 0 2024-02-14T13:10:36.050 INFO:tasks.workunit.client.0.smithi012.stdout:9/377: creat da/dd/d19/d30/f81 x:0 0 0 2024-02-14T13:10:36.051 INFO:tasks.workunit.client.0.smithi012.stdout:9/378: write da/dd/d18/d71/f75 [63886,120961] 0 2024-02-14T13:10:36.051 INFO:tasks.workunit.client.0.smithi012.stdout:1/334: rmdir d6/d10/d22/d31/d34 39 2024-02-14T13:10:36.051 INFO:tasks.workunit.client.0.smithi012.stdout:1/335: readlink l0 0 2024-02-14T13:10:36.053 INFO:tasks.workunit.client.0.smithi012.stdout:4/279: mknod d0/d10/d28/c65 0 2024-02-14T13:10:36.054 INFO:tasks.workunit.client.0.smithi012.stdout:8/315: dwrite d9/dc/d14/f40 [0,4194304] 0 2024-02-14T13:10:36.054 INFO:tasks.workunit.client.0.smithi012.stdout:8/316: readlink d9/l32 0 2024-02-14T13:10:36.054 INFO:tasks.workunit.client.0.smithi012.stdout:5/351: getdents dc/d17/d20/d4c/d58 0 2024-02-14T13:10:36.056 INFO:tasks.workunit.client.0.smithi012.stdout:3/283: dwrite d9/dd/de/f38 [0,4194304] 0 2024-02-14T13:10:36.056 INFO:tasks.workunit.client.0.smithi012.stdout:3/284: chown d9/d3f/d4e/f5a 6244236 1 2024-02-14T13:10:36.056 INFO:tasks.workunit.client.0.smithi012.stdout:5/352: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:36.056 INFO:tasks.workunit.client.0.smithi012.stdout:9/379: mknod da/d4f/c82 0 2024-02-14T13:10:36.058 INFO:tasks.workunit.client.0.smithi012.stdout:1/336: mkdir d6/d10/d22/d31/d5b/d5d/d6d 0 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:4/280: rename d0/l27 to d0/d10/d28/l66 0 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:4/281: getdents d0/d10/d1f/d3e/d63 0 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:4/282: chown d0/d10/d28/d4f/c43 14 1 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:3/285: dread d9/dd/f4a [0,4194304] 0 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:3/286: stat d9 0 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:0/378: dread d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:36.060 INFO:tasks.workunit.client.0.smithi012.stdout:0/379: fsync d10/d14/f43 0 2024-02-14T13:10:36.061 INFO:tasks.workunit.client.0.smithi012.stdout:8/317: rmdir d9/dc/d1b 39 2024-02-14T13:10:36.061 INFO:tasks.workunit.client.0.smithi012.stdout:8/318: write d9/dc/d1b/d35/f5e [873937,57263] 0 2024-02-14T13:10:36.062 INFO:tasks.workunit.client.0.smithi012.stdout:5/353: creat dc/d2f/f75 x:0 0 0 2024-02-14T13:10:36.062 INFO:tasks.workunit.client.0.smithi012.stdout:6/294: dwrite d1/d1e/f20 [4194304,4194304] 0 2024-02-14T13:10:36.063 INFO:tasks.workunit.client.0.smithi012.stdout:6/295: chown d1/d1e/d1b/d21/f35 10 1 2024-02-14T13:10:36.065 INFO:tasks.workunit.client.0.smithi012.stdout:1/337: creat d6/d10/d22/d31/d5b/d5d/f6e x:0 0 0 2024-02-14T13:10:36.065 INFO:tasks.workunit.client.0.smithi012.stdout:1/338: write d6/d10/d22/f54 [2356887,76493] 0 2024-02-14T13:10:36.065 INFO:tasks.workunit.client.0.smithi012.stdout:1/339: write d6/fd [598428,73147] 0 2024-02-14T13:10:36.065 INFO:tasks.workunit.client.0.smithi012.stdout:1/340: chown d6/d10/l4e 1059347 1 2024-02-14T13:10:36.066 INFO:tasks.workunit.client.0.smithi012.stdout:4/283: unlink d0/l29 0 2024-02-14T13:10:36.067 INFO:tasks.workunit.client.0.smithi012.stdout:0/380: mknod d10/d14/d1b/d54/c75 0 2024-02-14T13:10:36.068 INFO:tasks.workunit.client.0.smithi012.stdout:8/319: rmdir d9 39 2024-02-14T13:10:36.068 INFO:tasks.workunit.client.0.smithi012.stdout:8/320: chown d9/c1a 141682069 1 2024-02-14T13:10:36.069 INFO:tasks.workunit.client.0.smithi012.stdout:0/381: read d10/d14/d23/f45 [382860,108081] 0 2024-02-14T13:10:36.069 INFO:tasks.workunit.client.0.smithi012.stdout:0/382: readlink d10/d14/d1b/d54/l5f 0 2024-02-14T13:10:36.071 INFO:tasks.workunit.client.0.smithi012.stdout:0/383: write d10/d14/d20/d21/f36 [865147,36003] 0 2024-02-14T13:10:36.072 INFO:tasks.workunit.client.0.smithi012.stdout:6/296: creat d1/d1e/d1b/f5d x:0 0 0 2024-02-14T13:10:36.072 INFO:tasks.workunit.client.0.smithi012.stdout:6/297: chown d1/df/d24/d3f 12478688 1 2024-02-14T13:10:36.074 INFO:tasks.workunit.client.0.smithi012.stdout:1/341: creat d6/d10/d64/f6f x:0 0 0 2024-02-14T13:10:36.075 INFO:tasks.workunit.client.0.smithi012.stdout:4/284: symlink d0/d10/d13/d17/d5f/l67 0 2024-02-14T13:10:36.076 INFO:tasks.workunit.client.0.smithi012.stdout:7/263: sync 2024-02-14T13:10:36.076 INFO:tasks.workunit.client.0.smithi012.stdout:2/291: sync 2024-02-14T13:10:36.076 INFO:tasks.workunit.client.0.smithi012.stdout:7/264: fdatasync df/f23 0 2024-02-14T13:10:36.076 INFO:tasks.workunit.client.0.smithi012.stdout:2/292: dread - d0/d8/d12/f4b zero size 2024-02-14T13:10:36.076 INFO:tasks.workunit.client.0.smithi012.stdout:8/321: creat d9/dc/d1b/d35/d50/d56/d57/d5c/f61 x:0 0 0 2024-02-14T13:10:36.077 INFO:tasks.workunit.client.0.smithi012.stdout:8/322: write d9/dc/d14/d2e/f54 [165849,74135] 0 2024-02-14T13:10:36.077 INFO:tasks.workunit.client.0.smithi012.stdout:8/323: chown d9/l43 1 1 2024-02-14T13:10:36.077 INFO:tasks.workunit.client.0.smithi012.stdout:8/324: dread - d9/dc/d14/d2e/f44 zero size 2024-02-14T13:10:36.078 INFO:tasks.workunit.client.0.smithi012.stdout:3/287: dwrite d9/d3f/f4c [0,4194304] 0 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:6/298: creat d1/d1e/dc/d43/f5e x:0 0 0 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/380: dwrite da/dd/d19/d30/f17 [4194304,4194304] 0 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/381: dread - da/dd/d57/d59/f6f zero size 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/382: readlink da/dd/d38/l79 0 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/383: dread - da/dd/f68 zero size 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/384: dread - da/d33/d63/f76 zero size 2024-02-14T13:10:36.079 INFO:tasks.workunit.client.0.smithi012.stdout:9/385: fsync f8 0 2024-02-14T13:10:36.081 INFO:tasks.workunit.client.0.smithi012.stdout:1/342: rmdir d6/d10/d22/d31/d62 0 2024-02-14T13:10:36.082 INFO:tasks.workunit.client.0.smithi012.stdout:4/285: truncate d0/d10/d13/d17/f1c 102867 0 2024-02-14T13:10:36.085 INFO:tasks.workunit.client.0.smithi012.stdout:7/265: mknod df/c68 0 2024-02-14T13:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/293: mkdir d0/d5/d15/d57 0 2024-02-14T13:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/294: write d0/f2f [1388545,58991] 0 2024-02-14T13:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/295: read d0/d6/d37/f3b [58166,105978] 0 2024-02-14T13:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/296: chown d0/d6/d37/f3b 248226 1 2024-02-14T13:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:2/297: read d0/f2f [672051,122169] 0 2024-02-14T13:10:36.087 INFO:tasks.workunit.client.0.smithi012.stdout:6/299: dread d1/d1e/d1b/f2f [0,4194304] 0 2024-02-14T13:10:36.090 INFO:tasks.workunit.client.0.smithi012.stdout:5/354: dwrite dc/d47/f61 [0,4194304] 0 2024-02-14T13:10:36.091 INFO:tasks.workunit.client.0.smithi012.stdout:3/288: creat d9/dd/de/d58/d65/f6e x:0 0 0 2024-02-14T13:10:36.092 INFO:tasks.workunit.client.0.smithi012.stdout:6/300: write d1/d1e/d1b/d21/f32 [78392,24970] 0 2024-02-14T13:10:36.096 INFO:tasks.workunit.client.0.smithi012.stdout:1/343: rmdir d6/d35 39 2024-02-14T13:10:36.097 INFO:tasks.workunit.client.0.smithi012.stdout:7/266: dread fd [0,4194304] 0 2024-02-14T13:10:36.098 INFO:tasks.workunit.client.0.smithi012.stdout:2/298: creat d0/d8/f58 x:0 0 0 2024-02-14T13:10:36.098 INFO:tasks.workunit.client.0.smithi012.stdout:2/299: stat d0/d8/f58 0 2024-02-14T13:10:36.098 INFO:tasks.workunit.client.0.smithi012.stdout:2/300: getdents d0/d5/d50 0 2024-02-14T13:10:36.108 INFO:tasks.workunit.client.0.smithi012.stdout:3/289: symlink d9/l6f 0 2024-02-14T13:10:36.108 INFO:tasks.workunit.client.0.smithi012.stdout:0/384: dwrite d10/d14/d23/f45 [0,4194304] 0 2024-02-14T13:10:36.109 INFO:tasks.workunit.client.0.smithi012.stdout:1/344: dread d6/d10/d22/d31/d5b/d5d/f1a [0,4194304] 0 2024-02-14T13:10:36.115 INFO:tasks.workunit.client.0.smithi012.stdout:4/286: dwrite d0/d10/d13/f4a [0,4194304] 0 2024-02-14T13:10:36.118 INFO:tasks.workunit.client.0.smithi012.stdout:7/267: mknod df/d36/d67/c69 0 2024-02-14T13:10:36.120 INFO:tasks.workunit.client.0.smithi012.stdout:2/301: creat d0/d8/d43/f59 x:0 0 0 2024-02-14T13:10:36.120 INFO:tasks.workunit.client.0.smithi012.stdout:2/302: write d0/d8/f3a [530416,60773] 0 2024-02-14T13:10:36.122 INFO:tasks.workunit.client.0.smithi012.stdout:8/325: dwrite d9/dc/d1b/d35/d50/f59 [0,4194304] 0 2024-02-14T13:10:36.122 INFO:tasks.workunit.client.0.smithi012.stdout:8/326: write d9/dc/d14/d2e/f5d [10182,128625] 0 2024-02-14T13:10:36.122 INFO:tasks.workunit.client.0.smithi012.stdout:1/345: rmdir d6/d35 39 2024-02-14T13:10:36.122 INFO:tasks.workunit.client.0.smithi012.stdout:1/346: stat d6/d10/d22/d31/d34/d58/d61/f6b 0 2024-02-14T13:10:36.122 INFO:tasks.workunit.client.0.smithi012.stdout:6/301: dwrite d1/df/d24/f36 [4194304,4194304] 0 2024-02-14T13:10:36.123 INFO:tasks.workunit.client.0.smithi012.stdout:6/302: truncate d1/d17/d5a/f5c 546329 0 2024-02-14T13:10:36.123 INFO:tasks.workunit.client.0.smithi012.stdout:7/268: dread df/d36/f63 [0,4194304] 0 2024-02-14T13:10:36.123 INFO:tasks.workunit.client.0.smithi012.stdout:6/303: write d1/df/d24/f40 [70260,4068] 0 2024-02-14T13:10:36.124 INFO:tasks.workunit.client.0.smithi012.stdout:0/385: read d10/d14/d23/f45 [480884,68561] 0 2024-02-14T13:10:36.126 INFO:tasks.workunit.client.0.smithi012.stdout:6/304: write d1/d1e/d1b/d3e/f4c [903892,83591] 0 2024-02-14T13:10:36.127 INFO:tasks.workunit.client.0.smithi012.stdout:3/290: write d9/d18/f23 [3691415,103355] 0 2024-02-14T13:10:36.127 INFO:tasks.workunit.client.0.smithi012.stdout:3/291: read - d9/dd/de/d58/d65/f6e zero size 2024-02-14T13:10:36.128 INFO:tasks.workunit.client.0.smithi012.stdout:3/292: dread d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:36.129 INFO:tasks.workunit.client.0.smithi012.stdout:0/386: link d10/d14/d20/c29 d10/d14/d20/d49/c76 0 2024-02-14T13:10:36.132 INFO:tasks.workunit.client.0.smithi012.stdout:2/303: dread d0/d20/f34 [0,4194304] 0 2024-02-14T13:10:36.132 INFO:tasks.workunit.client.0.smithi012.stdout:2/304: fsync d0/d8/f31 0 2024-02-14T13:10:36.133 INFO:tasks.workunit.client.0.smithi012.stdout:8/327: mkdir d9/dc/d14/d23/d62 0 2024-02-14T13:10:36.133 INFO:tasks.workunit.client.0.smithi012.stdout:8/328: fsync d9/dc/d14/f40 0 2024-02-14T13:10:36.133 INFO:tasks.workunit.client.0.smithi012.stdout:8/329: dread - d9/dc/d38/f60 zero size 2024-02-14T13:10:36.135 INFO:tasks.workunit.client.0.smithi012.stdout:2/305: write d0/d1a/f47 [196031,20127] 0 2024-02-14T13:10:36.135 INFO:tasks.workunit.client.0.smithi012.stdout:2/306: write d0/d8/d11/f17 [2246797,61315] 0 2024-02-14T13:10:36.135 INFO:tasks.workunit.client.0.smithi012.stdout:3/293: unlink d9/f22 0 2024-02-14T13:10:36.136 INFO:tasks.workunit.client.0.smithi012.stdout:0/387: symlink d10/d14/d51/l77 0 2024-02-14T13:10:36.137 INFO:tasks.workunit.client.0.smithi012.stdout:6/305: dread d1/d1e/d1b/d21/f51 [0,4194304] 0 2024-02-14T13:10:36.138 INFO:tasks.workunit.client.0.smithi012.stdout:7/269: dwrite df/d36/f46 [0,4194304] 0 2024-02-14T13:10:36.138 INFO:tasks.workunit.client.0.smithi012.stdout:8/330: creat d9/dc/d14/d23/f63 x:0 0 0 2024-02-14T13:10:36.139 INFO:tasks.workunit.client.0.smithi012.stdout:2/307: mkdir d0/d8/d11/d35/d5a 0 2024-02-14T13:10:36.141 INFO:tasks.workunit.client.0.smithi012.stdout:3/294: mknod d9/d18/d3c/c70 0 2024-02-14T13:10:36.142 INFO:tasks.workunit.client.0.smithi012.stdout:0/388: mkdir d10/d14/d41/d52/d78 0 2024-02-14T13:10:36.146 INFO:tasks.workunit.client.0.smithi012.stdout:7/270: creat df/d2d/d57/f6a x:0 0 0 2024-02-14T13:10:36.146 INFO:tasks.workunit.client.0.smithi012.stdout:2/308: readlink d0/l4 0 2024-02-14T13:10:36.147 INFO:tasks.workunit.client.0.smithi012.stdout:7/271: mkdir df/d27/d4b/d6b 0 2024-02-14T13:10:36.147 INFO:tasks.workunit.client.0.smithi012.stdout:7/272: truncate df/f59 983072 0 2024-02-14T13:10:36.148 INFO:tasks.workunit.client.0.smithi012.stdout:7/273: rmdir df/d27 39 2024-02-14T13:10:36.149 INFO:tasks.workunit.client.0.smithi012.stdout:8/331: dread d9/dc/d38/f55 [4194304,4194304] 0 2024-02-14T13:10:36.149 INFO:tasks.workunit.client.0.smithi012.stdout:8/332: write d9/dc/d1b/d35/d50/d56/d57/d5c/f61 [915693,19902] 0 2024-02-14T13:10:36.151 INFO:tasks.workunit.client.0.smithi012.stdout:7/274: rmdir df/d24/d56 39 2024-02-14T13:10:36.153 INFO:tasks.workunit.client.0.smithi012.stdout:8/333: creat d9/dc/d1b/f64 x:0 0 0 2024-02-14T13:10:36.155 INFO:tasks.workunit.client.0.smithi012.stdout:4/287: rename d0/d10/d13/d17/f1c to d0/f68 0 2024-02-14T13:10:36.155 INFO:tasks.workunit.client.0.smithi012.stdout:4/288: write d0/f1a [899710,23550] 0 2024-02-14T13:10:36.155 INFO:tasks.workunit.client.0.smithi012.stdout:3/295: write d9/d18/f56 [1917737,57113] 0 2024-02-14T13:10:36.155 INFO:tasks.workunit.client.0.smithi012.stdout:0/389: dread d10/d14/f2e [4194304,4194304] 0 2024-02-14T13:10:36.155 INFO:tasks.workunit.client.0.smithi012.stdout:0/390: dread - d10/d14/d2b/d3b/f63 zero size 2024-02-14T13:10:36.156 INFO:tasks.workunit.client.0.smithi012.stdout:8/334: unlink d9/dc/d14/f40 0 2024-02-14T13:10:36.159 INFO:tasks.workunit.client.0.smithi012.stdout:2/309: rename d0/d8/d11/d35/c44 to d0/d6/d37/c5b 0 2024-02-14T13:10:36.159 INFO:tasks.workunit.client.0.smithi012.stdout:2/310: stat d0/d5/fd 0 2024-02-14T13:10:36.159 INFO:tasks.workunit.client.0.smithi012.stdout:2/311: readlink d0/d5/l10 0 2024-02-14T13:10:36.160 INFO:tasks.workunit.client.0.smithi012.stdout:4/289: getdents d0/d10/d13/d17/d5f 0 2024-02-14T13:10:36.160 INFO:tasks.workunit.client.0.smithi012.stdout:4/290: stat d0/d10/d13/d17/f5e 0 2024-02-14T13:10:36.160 INFO:tasks.workunit.client.0.smithi012.stdout:4/291: readlink d0/d10/d28/d4f/l44 0 2024-02-14T13:10:36.162 INFO:tasks.workunit.client.0.smithi012.stdout:3/296: link d9/d3f/c5b d9/d3f/d4e/c71 0 2024-02-14T13:10:36.162 INFO:tasks.workunit.client.0.smithi012.stdout:3/297: stat d9/dd/d30 0 2024-02-14T13:10:36.162 INFO:tasks.workunit.client.0.smithi012.stdout:6/306: dwrite d1/d17/f53 [0,4194304] 0 2024-02-14T13:10:36.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/391: chown d10/d14/c5b 563941 1 2024-02-14T13:10:36.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/392: fdatasync d10/d14/d2b/d3b/f63 0 2024-02-14T13:10:36.165 INFO:tasks.workunit.client.0.smithi012.stdout:8/335: mkdir d9/d65 0 2024-02-14T13:10:36.167 INFO:tasks.workunit.client.0.smithi012.stdout:7/275: rename df/f2c to df/d27/d4b/f6c 0 2024-02-14T13:10:36.167 INFO:tasks.workunit.client.0.smithi012.stdout:7/276: chown df/d36/c37 177102391 1 2024-02-14T13:10:36.168 INFO:tasks.workunit.client.0.smithi012.stdout:7/277: stat df/d36/f3c 0 2024-02-14T13:10:36.171 INFO:tasks.workunit.client.0.smithi012.stdout:4/292: dread d0/fa [0,4194304] 0 2024-02-14T13:10:36.183 INFO:tasks.workunit.client.0.smithi012.stdout:8/336: symlink d9/dc/d1b/d35/l66 0 2024-02-14T13:10:36.184 INFO:tasks.workunit.client.0.smithi012.stdout:7/278: dread df/d24/f31 [0,4194304] 0 2024-02-14T13:10:36.184 INFO:tasks.workunit.client.0.smithi012.stdout:7/279: fdatasync df/d24/f38 0 2024-02-14T13:10:36.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/293: creat d0/d10/d1f/d3e/d63/f69 x:0 0 0 2024-02-14T13:10:36.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/294: write d0/f68 [521603,108622] 0 2024-02-14T13:10:36.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/295: chown d0/l4b 386 1 2024-02-14T13:10:36.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/296: fsync d0/d10/d13/d17/f38 0 2024-02-14T13:10:36.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/297: stat d0/d10/d1f/d3e/d63 0 2024-02-14T13:10:36.186 INFO:tasks.workunit.client.0.smithi012.stdout:8/337: creat d9/dc/d14/d23/f67 x:0 0 0 2024-02-14T13:10:36.186 INFO:tasks.workunit.client.0.smithi012.stdout:0/393: dread d10/d14/d2b/d3b/f50 [4194304,4194304] 0 2024-02-14T13:10:36.186 INFO:tasks.workunit.client.0.smithi012.stdout:0/394: truncate d10/d14/d20/d49/f5e 871376 0 2024-02-14T13:10:36.187 INFO:tasks.workunit.client.0.smithi012.stdout:7/280: mkdir df/d27/d4b/d6b/d6d 0 2024-02-14T13:10:36.187 INFO:tasks.workunit.client.0.smithi012.stdout:7/281: chown df/d24/f29 82766456 1 2024-02-14T13:10:36.188 INFO:tasks.workunit.client.0.smithi012.stdout:8/338: mknod d9/dc/d1b/d35/d50/c68 0 2024-02-14T13:10:36.188 INFO:tasks.workunit.client.0.smithi012.stdout:7/282: dread df/f26 [0,4194304] 0 2024-02-14T13:10:36.188 INFO:tasks.workunit.client.0.smithi012.stdout:2/312: dwrite d0/d1a/f49 [0,4194304] 0 2024-02-14T13:10:36.189 INFO:tasks.workunit.client.0.smithi012.stdout:2/313: dread - d0/d6/de/f4e zero size 2024-02-14T13:10:36.189 INFO:tasks.workunit.client.0.smithi012.stdout:2/314: chown d0/d5/d15/f4a 3321 1 2024-02-14T13:10:36.189 INFO:tasks.workunit.client.0.smithi012.stdout:2/315: chown d0/d8/f31 20 1 2024-02-14T13:10:36.189 INFO:tasks.workunit.client.0.smithi012.stdout:0/395: link d10/d14/d20/l25 d10/d14/d1b/d30/l79 0 2024-02-14T13:10:36.190 INFO:tasks.workunit.client.0.smithi012.stdout:8/339: creat d9/dc/d5b/f69 x:0 0 0 2024-02-14T13:10:36.190 INFO:tasks.workunit.client.0.smithi012.stdout:3/298: dwrite d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:36.192 INFO:tasks.workunit.client.0.smithi012.stdout:4/298: write d0/d10/d13/d17/f38 [1379,113870] 0 2024-02-14T13:10:36.192 INFO:tasks.workunit.client.0.smithi012.stdout:4/299: stat d0/d10/d1f/d3e/f48 0 2024-02-14T13:10:36.192 INFO:tasks.workunit.client.0.smithi012.stdout:7/283: mknod df/d27/d4b/d6b/d6d/c6e 0 2024-02-14T13:10:36.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/284: fdatasync df/f21 0 2024-02-14T13:10:36.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/285: chown df/d36/l47 187 1 2024-02-14T13:10:36.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/286: stat df/d2d/d5d/c65 0 2024-02-14T13:10:36.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/287: chown df/d36/c37 135 1 2024-02-14T13:10:36.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/288: chown df/d2d/d57/f6a 32374672 1 2024-02-14T13:10:36.193 INFO:tasks.workunit.client.0.smithi012.stdout:7/289: fdatasync df/d36/f3c 0 2024-02-14T13:10:36.194 INFO:tasks.workunit.client.0.smithi012.stdout:2/316: mkdir d0/d8/d11/d33/d5c 0 2024-02-14T13:10:36.194 INFO:tasks.workunit.client.0.smithi012.stdout:0/396: dread d10/d14/f1e [0,4194304] 0 2024-02-14T13:10:36.197 INFO:tasks.workunit.client.0.smithi012.stdout:3/299: unlink d9/d18/f1c 0 2024-02-14T13:10:36.197 INFO:tasks.workunit.client.0.smithi012.stdout:3/300: dread - d9/dd/d30/d44/d3d/f67 zero size 2024-02-14T13:10:36.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/317: mknod d0/d8/d43/c5d 0 2024-02-14T13:10:36.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/318: write d0/d8/d43/f59 [796816,97329] 0 2024-02-14T13:10:36.203 INFO:tasks.workunit.client.0.smithi012.stdout:3/301: rename d9/f60 to d9/dd/d30/d44/d66/f72 0 2024-02-14T13:10:36.204 INFO:tasks.workunit.client.0.smithi012.stdout:4/300: symlink d0/l6a 0 2024-02-14T13:10:36.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/397: dread d10/d14/d2b/d3b/f4f [0,4194304] 0 2024-02-14T13:10:36.205 INFO:tasks.workunit.client.0.smithi012.stdout:2/319: link d0/d1a/f47 d0/d8/d11/d35/d5a/f5e 0 2024-02-14T13:10:36.207 INFO:tasks.workunit.client.0.smithi012.stdout:3/302: truncate d9/dd/d30/d34/f51 255731 0 2024-02-14T13:10:36.207 INFO:tasks.workunit.client.0.smithi012.stdout:8/340: dwrite d9/dc/f2c [0,4194304] 0 2024-02-14T13:10:36.208 INFO:tasks.workunit.client.0.smithi012.stdout:4/301: mkdir d0/d10/d28/d4f/d6b 0 2024-02-14T13:10:36.212 INFO:tasks.workunit.client.0.smithi012.stdout:3/303: rename d9/d18/d3c to d9/d3f/d73 0 2024-02-14T13:10:36.212 INFO:tasks.workunit.client.0.smithi012.stdout:3/304: write d9/d18/d39/f59 [2022874,114778] 0 2024-02-14T13:10:36.213 INFO:tasks.workunit.client.0.smithi012.stdout:8/341: mkdir d9/dc/d38/d6a 0 2024-02-14T13:10:36.213 INFO:tasks.workunit.client.0.smithi012.stdout:8/342: fdatasync d9/dc/f19 0 2024-02-14T13:10:36.214 INFO:tasks.workunit.client.0.smithi012.stdout:3/305: write d9/d13/d28/f36 [177120,11305] 0 2024-02-14T13:10:36.214 INFO:tasks.workunit.client.0.smithi012.stdout:7/290: dwrite df/d24/d56/f64 [0,4194304] 0 2024-02-14T13:10:36.214 INFO:tasks.workunit.client.0.smithi012.stdout:4/302: mknod d0/d10/d1f/d3e/d63/c6c 0 2024-02-14T13:10:36.219 INFO:tasks.workunit.client.0.smithi012.stdout:2/320: dread d0/d5/d15/f4a [0,4194304] 0 2024-02-14T13:10:36.222 INFO:tasks.workunit.client.0.smithi012.stdout:2/321: read d0/d20/f23 [416725,96687] 0 2024-02-14T13:10:36.222 INFO:tasks.workunit.client.0.smithi012.stdout:8/343: dread d9/dc/d14/d23/f41 [0,4194304] 0 2024-02-14T13:10:36.222 INFO:tasks.workunit.client.0.smithi012.stdout:7/291: rename df/d27/l5c to df/d24/d56/l6f 0 2024-02-14T13:10:36.223 INFO:tasks.workunit.client.0.smithi012.stdout:2/322: creat d0/d6/f5f x:0 0 0 2024-02-14T13:10:36.224 INFO:tasks.workunit.client.0.smithi012.stdout:8/344: truncate f4 983122 0 2024-02-14T13:10:36.225 INFO:tasks.workunit.client.0.smithi012.stdout:4/303: read d0/d10/f24 [266966,93095] 0 2024-02-14T13:10:36.225 INFO:tasks.workunit.client.0.smithi012.stdout:4/304: readlink d0/d10/d28/d4f/l52 0 2024-02-14T13:10:36.225 INFO:tasks.workunit.client.0.smithi012.stdout:3/306: dread d9/d18/f23 [0,4194304] 0 2024-02-14T13:10:36.225 INFO:tasks.workunit.client.0.smithi012.stdout:3/307: stat d9/dd/de/c2e 0 2024-02-14T13:10:36.225 INFO:tasks.workunit.client.0.smithi012.stdout:3/308: dread - d9/f61 zero size 2024-02-14T13:10:36.226 INFO:tasks.workunit.client.0.smithi012.stdout:2/323: mknod d0/d8/d11/d33/d5c/c60 0 2024-02-14T13:10:36.227 INFO:tasks.workunit.client.0.smithi012.stdout:4/305: truncate d0/d10/d28/f37 4017945 0 2024-02-14T13:10:36.230 INFO:tasks.workunit.client.0.smithi012.stdout:2/324: rename d0/d8/f3a to d0/d8/d11/d35/d5a/f61 0 2024-02-14T13:10:36.231 INFO:tasks.workunit.client.0.smithi012.stdout:4/306: creat d0/d10/f6d x:0 0 0 2024-02-14T13:10:36.232 INFO:tasks.workunit.client.0.smithi012.stdout:2/325: symlink d0/d1a/l62 0 2024-02-14T13:10:36.233 INFO:tasks.workunit.client.0.smithi012.stdout:4/307: mknod d0/d10/c6e 0 2024-02-14T13:10:36.234 INFO:tasks.workunit.client.0.smithi012.stdout:8/345: dread d9/f3c [0,4194304] 0 2024-02-14T13:10:36.234 INFO:tasks.workunit.client.0.smithi012.stdout:4/308: creat d0/d10/d1f/d3e/d63/f6f x:0 0 0 2024-02-14T13:10:36.235 INFO:tasks.workunit.client.0.smithi012.stdout:7/292: truncate df/f59 668750 0 2024-02-14T13:10:36.236 INFO:tasks.workunit.client.0.smithi012.stdout:8/346: mkdir d9/dc/d1b/d6b 0 2024-02-14T13:10:36.236 INFO:tasks.workunit.client.0.smithi012.stdout:3/309: write d9/d13/d28/f40 [3374723,120426] 0 2024-02-14T13:10:36.236 INFO:tasks.workunit.client.0.smithi012.stdout:3/310: chown d9/d13/f20 2088 1 2024-02-14T13:10:36.237 INFO:tasks.workunit.client.0.smithi012.stdout:4/309: rmdir d0/d10/d13 39 2024-02-14T13:10:36.238 INFO:tasks.workunit.client.0.smithi012.stdout:4/310: chown d0/d10/d28/d4f/c57 61875634 1 2024-02-14T13:10:36.238 INFO:tasks.workunit.client.0.smithi012.stdout:7/293: dread df/d24/d56/f61 [0,4194304] 0 2024-02-14T13:10:36.238 INFO:tasks.workunit.client.0.smithi012.stdout:7/294: write df/f15 [2417440,93153] 0 2024-02-14T13:10:36.240 INFO:tasks.workunit.client.0.smithi012.stdout:3/311: rename d9/d13/l2a to d9/dd/de/l74 0 2024-02-14T13:10:36.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/326: write d0/d1a/f49 [2316725,120898] 0 2024-02-14T13:10:36.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/327: readlink d0/d8/d43/l4c 0 2024-02-14T13:10:36.241 INFO:tasks.workunit.client.0.smithi012.stdout:4/311: rmdir d0/d10/d13 39 2024-02-14T13:10:36.244 INFO:tasks.workunit.client.0.smithi012.stdout:7/295: truncate df/f21 21815 0 2024-02-14T13:10:36.246 INFO:tasks.workunit.client.0.smithi012.stdout:3/312: read d9/dd/d30/d44/f29 [1131273,704] 0 2024-02-14T13:10:36.246 INFO:tasks.workunit.client.0.smithi012.stdout:7/296: dread df/f42 [0,4194304] 0 2024-02-14T13:10:36.246 INFO:tasks.workunit.client.0.smithi012.stdout:3/313: fdatasync d9/dd/de/f3e 0 2024-02-14T13:10:36.247 INFO:tasks.workunit.client.0.smithi012.stdout:7/297: creat df/d24/f70 x:0 0 0 2024-02-14T13:10:36.250 INFO:tasks.workunit.client.0.smithi012.stdout:2/328: dread d0/f2 [0,4194304] 0 2024-02-14T13:10:36.252 INFO:tasks.workunit.client.0.smithi012.stdout:2/329: mkdir d0/d8/d11/d33/d63 0 2024-02-14T13:10:36.257 INFO:tasks.workunit.client.0.smithi012.stdout:8/347: write f4 [25091,109728] 0 2024-02-14T13:10:36.258 INFO:tasks.workunit.client.0.smithi012.stdout:2/330: dread d0/d5/d15/f4a [0,4194304] 0 2024-02-14T13:10:36.261 INFO:tasks.workunit.client.0.smithi012.stdout:8/348: rename d9/dc/d14/f15 to d9/dc/d1b/d35/d50/d56/d57/f6c 0 2024-02-14T13:10:36.262 INFO:tasks.workunit.client.0.smithi012.stdout:8/349: read d9/dc/d1b/f20 [1752694,46517] 0 2024-02-14T13:10:36.263 INFO:tasks.workunit.client.0.smithi012.stdout:2/331: symlink d0/d20/d54/l64 0 2024-02-14T13:10:36.263 INFO:tasks.workunit.client.0.smithi012.stdout:3/314: dwrite d9/dd/d30/d44/d3d/f67 [0,4194304] 0 2024-02-14T13:10:36.264 INFO:tasks.workunit.client.0.smithi012.stdout:2/332: symlink d0/d1a/l65 0 2024-02-14T13:10:36.271 INFO:tasks.workunit.client.0.smithi012.stdout:2/333: getdents d0/d8/d12 0 2024-02-14T13:10:36.273 INFO:tasks.workunit.client.0.smithi012.stdout:3/315: rmdir d9 39 2024-02-14T13:10:36.274 INFO:tasks.workunit.client.0.smithi012.stdout:2/334: creat d0/d5/d15/d57/f66 x:0 0 0 2024-02-14T13:10:36.276 INFO:tasks.workunit.client.0.smithi012.stdout:2/335: rename d0/l22 to d0/d8/d12/d51/l67 0 2024-02-14T13:10:36.277 INFO:tasks.workunit.client.0.smithi012.stdout:2/336: chown d0/d5/d15/f4a 18476 1 2024-02-14T13:10:36.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/350: dwrite d9/dc/d1b/f20 [0,4194304] 0 2024-02-14T13:10:36.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/316: mkdir d9/dd/d30/d34/d75 0 2024-02-14T13:10:36.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/317: write d9/f61 [629724,100239] 0 2024-02-14T13:10:36.278 INFO:tasks.workunit.client.0.smithi012.stdout:3/318: fdatasync d9/d13/f26 0 2024-02-14T13:10:36.279 INFO:tasks.workunit.client.0.smithi012.stdout:3/319: stat l8 0 2024-02-14T13:10:36.280 INFO:tasks.workunit.client.0.smithi012.stdout:2/337: rmdir d0/d6 39 2024-02-14T13:10:36.281 INFO:tasks.workunit.client.0.smithi012.stdout:3/320: symlink d9/dd/d30/l76 0 2024-02-14T13:10:36.282 INFO:tasks.workunit.client.0.smithi012.stdout:3/321: fdatasync d9/dd/f17 0 2024-02-14T13:10:36.282 INFO:tasks.workunit.client.0.smithi012.stdout:2/338: mkdir d0/d5/d50/d68 0 2024-02-14T13:10:36.284 INFO:tasks.workunit.client.0.smithi012.stdout:8/351: dread d9/dc/f19 [0,4194304] 0 2024-02-14T13:10:36.284 INFO:tasks.workunit.client.0.smithi012.stdout:8/352: fdatasync d9/dc/d1b/d35/d50/d56/d57/d5c/f61 0 2024-02-14T13:10:36.284 INFO:tasks.workunit.client.0.smithi012.stdout:8/353: write d9/dc/d5b/f69 [908500,41051] 0 2024-02-14T13:10:36.287 INFO:tasks.workunit.client.0.smithi012.stdout:2/339: dread d0/d5/d15/f4a [0,4194304] 0 2024-02-14T13:10:36.287 INFO:tasks.workunit.client.0.smithi012.stdout:2/340: fsync d0/d8/f58 0 2024-02-14T13:10:36.288 INFO:tasks.workunit.client.0.smithi012.stdout:2/341: mknod d0/d8/d43/c69 0 2024-02-14T13:10:36.289 INFO:tasks.workunit.client.0.smithi012.stdout:2/342: creat d0/d20/d54/f6a x:0 0 0 2024-02-14T13:10:36.289 INFO:tasks.workunit.client.0.smithi012.stdout:2/343: write d0/d20/d54/f6a [328233,23704] 0 2024-02-14T13:10:36.290 INFO:tasks.workunit.client.0.smithi012.stdout:2/344: mkdir d0/d8/d11/d33/d53/d6b 0 2024-02-14T13:10:36.290 INFO:tasks.workunit.client.0.smithi012.stdout:2/345: fsync d0/d6/de/f4e 0 2024-02-14T13:10:36.308 INFO:tasks.workunit.client.0.smithi012.stdout:2/346: dwrite d0/d5/d15/d57/f66 [0,4194304] 0 2024-02-14T13:10:36.308 INFO:tasks.workunit.client.0.smithi012.stdout:2/347: fsync d0/d6/f5f 0 2024-02-14T13:10:36.311 INFO:tasks.workunit.client.0.smithi012.stdout:2/348: creat d0/d8/d11/d33/d53/d6b/f6c x:0 0 0 2024-02-14T13:10:36.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/349: mkdir d0/d5/d15/d57/d6d 0 2024-02-14T13:10:36.313 INFO:tasks.workunit.client.0.smithi012.stdout:2/350: creat d0/f6e x:0 0 0 2024-02-14T13:10:36.314 INFO:tasks.workunit.client.0.smithi012.stdout:2/351: creat d0/d8/f6f x:0 0 0 2024-02-14T13:10:36.315 INFO:tasks.workunit.client.0.smithi012.stdout:2/352: mkdir d0/d8/d12/d26/d70 0 2024-02-14T13:10:36.316 INFO:tasks.workunit.client.0.smithi012.stdout:2/353: write d0/d20/d54/f6a [165990,33661] 0 2024-02-14T13:10:36.317 INFO:tasks.workunit.client.0.smithi012.stdout:2/354: mknod d0/d8/d11/d33/d53/d6b/c71 0 2024-02-14T13:10:36.317 INFO:tasks.workunit.client.0.smithi012.stdout:2/355: dread - d0/d8/d12/f4b zero size 2024-02-14T13:10:36.323 INFO:tasks.workunit.client.0.smithi012.stdout:2/356: dread d0/d8/d11/d33/f38 [0,4194304] 0 2024-02-14T13:10:36.324 INFO:tasks.workunit.client.0.smithi012.stdout:2/357: getdents d0/d8/d11/d33/d5c 0 2024-02-14T13:10:36.325 INFO:tasks.workunit.client.0.smithi012.stdout:2/358: mkdir d0/d8/d72 0 2024-02-14T13:10:36.326 INFO:tasks.workunit.client.0.smithi012.stdout:2/359: creat d0/d8/d12/d51/f73 x:0 0 0 2024-02-14T13:10:36.327 INFO:tasks.workunit.client.0.smithi012.stdout:2/360: mknod d0/d8/c74 0 2024-02-14T13:10:36.328 INFO:tasks.workunit.client.0.smithi012.stdout:2/361: mkdir d0/d20/d75 0 2024-02-14T13:10:36.329 INFO:tasks.workunit.client.0.smithi012.stdout:2/362: mkdir d0/d5/d15/d76 0 2024-02-14T13:10:36.329 INFO:tasks.workunit.client.0.smithi012.stdout:2/363: dread - d0/d6/f5f zero size 2024-02-14T13:10:36.330 INFO:tasks.workunit.client.0.smithi012.stdout:2/364: creat d0/d2d/f77 x:0 0 0 2024-02-14T13:10:36.331 INFO:tasks.workunit.client.0.smithi012.stdout:2/365: unlink d0/d8/c16 0 2024-02-14T13:10:36.331 INFO:tasks.workunit.client.0.smithi012.stdout:2/366: dread - d0/d6/de/f4e zero size 2024-02-14T13:10:36.332 INFO:tasks.workunit.client.0.smithi012.stdout:2/367: creat d0/d5/d15/d57/f78 x:0 0 0 2024-02-14T13:10:36.333 INFO:tasks.workunit.client.0.smithi012.stdout:2/368: symlink d0/d5/d50/l79 0 2024-02-14T13:10:36.333 INFO:tasks.workunit.client.0.smithi012.stdout:1/347: sync 2024-02-14T13:10:36.333 INFO:tasks.workunit.client.0.smithi012.stdout:5/355: sync 2024-02-14T13:10:36.333 INFO:tasks.workunit.client.0.smithi012.stdout:9/386: sync 2024-02-14T13:10:36.334 INFO:tasks.workunit.client.0.smithi012.stdout:5/356: stat dc/l18 0 2024-02-14T13:10:36.334 INFO:tasks.workunit.client.0.smithi012.stdout:9/387: rename da to da/dd/d38/d65/d83 22 2024-02-14T13:10:36.334 INFO:tasks.workunit.client.0.smithi012.stdout:9/388: dread - da/dd/d39/f6b zero size 2024-02-14T13:10:36.334 INFO:tasks.workunit.client.0.smithi012.stdout:5/357: symlink dc/d17/d20/d4c/d63/l76 0 2024-02-14T13:10:36.334 INFO:tasks.workunit.client.0.smithi012.stdout:5/358: fsync dc/d47/f61 0 2024-02-14T13:10:36.334 INFO:tasks.workunit.client.0.smithi012.stdout:5/359: fsync dc/d17/f41 0 2024-02-14T13:10:36.335 INFO:tasks.workunit.client.0.smithi012.stdout:1/348: dread d6/d10/d22/d31/d5b/d5d/f38 [0,4194304] 0 2024-02-14T13:10:36.335 INFO:tasks.workunit.client.0.smithi012.stdout:9/389: unlink da/dd/f68 0 2024-02-14T13:10:36.337 INFO:tasks.workunit.client.0.smithi012.stdout:1/349: truncate d6/d10/d22/d31/d34/d3b/f53 3000287 0 2024-02-14T13:10:36.338 INFO:tasks.workunit.client.0.smithi012.stdout:9/390: unlink da/f56 0 2024-02-14T13:10:36.339 INFO:tasks.workunit.client.0.smithi012.stdout:1/350: getdents d6/d10/d22/d31/d34/d3b/d5a 0 2024-02-14T13:10:36.341 INFO:tasks.workunit.client.0.smithi012.stdout:9/391: symlink da/dd/d57/d59/d73/l84 0 2024-02-14T13:10:36.341 INFO:tasks.workunit.client.0.smithi012.stdout:9/392: chown da/dd/d38/c80 31 1 2024-02-14T13:10:36.341 INFO:tasks.workunit.client.0.smithi012.stdout:9/393: chown da/d33 7 1 2024-02-14T13:10:36.342 INFO:tasks.workunit.client.0.smithi012.stdout:2/369: dread d0/d5/fd [0,4194304] 0 2024-02-14T13:10:36.342 INFO:tasks.workunit.client.0.smithi012.stdout:1/351: truncate d6/d10/d22/d31/d5b/d5d/f55 1355736 0 2024-02-14T13:10:36.342 INFO:tasks.workunit.client.0.smithi012.stdout:1/352: chown d6/d10/d22/d31/d5b/d5e/l2c 151022536 1 2024-02-14T13:10:36.345 INFO:tasks.workunit.client.0.smithi012.stdout:9/394: rename da/dd/d19/d30/d20 to da/dd/d18/d71/d85 0 2024-02-14T13:10:36.347 INFO:tasks.workunit.client.0.smithi012.stdout:2/370: mkdir d0/d8/d12/d26/d7a 0 2024-02-14T13:10:36.351 INFO:tasks.workunit.client.0.smithi012.stdout:2/371: rename d0/d8/d11/d35/d5a to d0/d6/de/d7b 0 2024-02-14T13:10:36.354 INFO:tasks.workunit.client.0.smithi012.stdout:2/372: symlink d0/l7c 0 2024-02-14T13:10:36.354 INFO:tasks.workunit.client.0.smithi012.stdout:9/395: write da/dd/d39/f52 [1695461,88091] 0 2024-02-14T13:10:36.356 INFO:tasks.workunit.client.0.smithi012.stdout:2/373: rename d0/d5/d15/d76 to d0/d6/de/d7d 0 2024-02-14T13:10:36.358 INFO:tasks.workunit.client.0.smithi012.stdout:2/374: creat d0/d6/de/d7b/f7e x:0 0 0 2024-02-14T13:10:36.362 INFO:tasks.workunit.client.0.smithi012.stdout:9/396: dread da/f14 [0,4194304] 0 2024-02-14T13:10:36.362 INFO:tasks.workunit.client.0.smithi012.stdout:2/375: dread d0/d20/f23 [0,4194304] 0 2024-02-14T13:10:36.362 INFO:tasks.workunit.client.0.smithi012.stdout:9/397: creat da/d33/d63/f86 x:0 0 0 2024-02-14T13:10:36.363 INFO:tasks.workunit.client.0.smithi012.stdout:2/376: creat d0/d8/d12/d26/d70/f7f x:0 0 0 2024-02-14T13:10:36.364 INFO:tasks.workunit.client.0.smithi012.stdout:9/398: creat da/dd/d38/d7e/f87 x:0 0 0 2024-02-14T13:10:36.364 INFO:tasks.workunit.client.0.smithi012.stdout:1/353: dwrite d6/fe [0,4194304] 0 2024-02-14T13:10:36.365 INFO:tasks.workunit.client.0.smithi012.stdout:2/377: mknod d0/d6/d37/c80 0 2024-02-14T13:10:36.375 INFO:tasks.workunit.client.0.smithi012.stdout:0/398: sync 2024-02-14T13:10:36.375 INFO:tasks.workunit.client.0.smithi012.stdout:6/307: sync 2024-02-14T13:10:36.376 INFO:tasks.workunit.client.0.smithi012.stdout:6/308: write d1/d1e/dc/d43/f5e [797396,7213] 0 2024-02-14T13:10:36.376 INFO:tasks.workunit.client.0.smithi012.stdout:6/309: write d1/d1e/d1b/d21/f32 [404712,32805] 0 2024-02-14T13:10:36.384 INFO:tasks.workunit.client.0.smithi012.stdout:9/399: dwrite da/dd/d19/f7f [0,4194304] 0 2024-02-14T13:10:36.384 INFO:tasks.workunit.client.0.smithi012.stdout:9/400: chown da/dd/d18/f22 10 1 2024-02-14T13:10:36.387 INFO:tasks.workunit.client.0.smithi012.stdout:9/401: rmdir da/dd/d57 39 2024-02-14T13:10:36.387 INFO:tasks.workunit.client.0.smithi012.stdout:9/402: fsync da/dd/d19/d30/f17 0 2024-02-14T13:10:36.389 INFO:tasks.workunit.client.0.smithi012.stdout:9/403: rename da/dd/d57/c6c to da/d33/d63/c88 0 2024-02-14T13:10:36.389 INFO:tasks.workunit.client.0.smithi012.stdout:6/310: write d1/d1e/dc/f2e [2409845,89883] 0 2024-02-14T13:10:36.389 INFO:tasks.workunit.client.0.smithi012.stdout:1/354: dwrite d6/d10/d22/d31/d34/d58/f63 [0,4194304] 0 2024-02-14T13:10:36.390 INFO:tasks.workunit.client.0.smithi012.stdout:1/355: truncate d6/d10/d22/d31/d5b/d5e/f36 298207 0 2024-02-14T13:10:36.390 INFO:tasks.workunit.client.0.smithi012.stdout:1/356: stat d6/d10/c24 0 2024-02-14T13:10:36.391 INFO:tasks.workunit.client.0.smithi012.stdout:9/404: symlink da/dd/d18/d71/d85/l89 0 2024-02-14T13:10:36.393 INFO:tasks.workunit.client.0.smithi012.stdout:2/378: dwrite d0/d20/f45 [0,4194304] 0 2024-02-14T13:10:36.394 INFO:tasks.workunit.client.0.smithi012.stdout:2/379: fsync d0/d8/d11/f32 0 2024-02-14T13:10:36.394 INFO:tasks.workunit.client.0.smithi012.stdout:2/380: readlink d0/d6/de/l41 0 2024-02-14T13:10:36.394 INFO:tasks.workunit.client.0.smithi012.stdout:9/405: creat da/d33/d63/f8a x:0 0 0 2024-02-14T13:10:36.396 INFO:tasks.workunit.client.0.smithi012.stdout:2/381: creat d0/d6/f81 x:0 0 0 2024-02-14T13:10:36.397 INFO:tasks.workunit.client.0.smithi012.stdout:9/406: creat da/d33/f8b x:0 0 0 2024-02-14T13:10:36.398 INFO:tasks.workunit.client.0.smithi012.stdout:2/382: creat d0/d20/d54/f82 x:0 0 0 2024-02-14T13:10:36.399 INFO:tasks.workunit.client.0.smithi012.stdout:2/383: creat d0/d6/de/d7d/f83 x:0 0 0 2024-02-14T13:10:36.404 INFO:tasks.workunit.client.0.smithi012.stdout:1/357: dread d6/d10/d22/f54 [0,4194304] 0 2024-02-14T13:10:36.405 INFO:tasks.workunit.client.0.smithi012.stdout:1/358: fdatasync d6/d10/d22/d31/d5b/d5d/f38 0 2024-02-14T13:10:36.407 INFO:tasks.workunit.client.0.smithi012.stdout:1/359: rename d6/c1c to d6/d10/d22/d31/d5b/d5e/d65/c70 0 2024-02-14T13:10:36.413 INFO:tasks.workunit.client.0.smithi012.stdout:6/311: dwrite d1/d1e/d1b/f2f [0,4194304] 0 2024-02-14T13:10:36.413 INFO:tasks.workunit.client.0.smithi012.stdout:2/384: read d0/d20/f45 [3302750,85891] 0 2024-02-14T13:10:36.413 INFO:tasks.workunit.client.0.smithi012.stdout:2/385: fdatasync d0/d20/f23 0 2024-02-14T13:10:36.414 INFO:tasks.workunit.client.0.smithi012.stdout:6/312: read d1/d1e/dc/d28/f4d [109004,432] 0 2024-02-14T13:10:36.417 INFO:tasks.workunit.client.0.smithi012.stdout:6/313: mkdir d1/df/d24/d5f 0 2024-02-14T13:10:36.417 INFO:tasks.workunit.client.0.smithi012.stdout:9/407: dwrite da/dd/d19/f4d [4194304,4194304] 0 2024-02-14T13:10:36.417 INFO:tasks.workunit.client.0.smithi012.stdout:2/386: rmdir d0/d20 39 2024-02-14T13:10:36.422 INFO:tasks.workunit.client.0.smithi012.stdout:6/314: unlink d1/d1e/d1b/d21/f51 0 2024-02-14T13:10:36.422 INFO:tasks.workunit.client.0.smithi012.stdout:6/315: stat d1/d1e/d1b/f57 0 2024-02-14T13:10:36.424 INFO:tasks.workunit.client.0.smithi012.stdout:2/387: rmdir d0/d8/d72 0 2024-02-14T13:10:36.424 INFO:tasks.workunit.client.0.smithi012.stdout:2/388: write d0/d8/d12/d51/f73 [709143,28503] 0 2024-02-14T13:10:36.429 INFO:tasks.workunit.client.0.smithi012.stdout:2/389: rename d0/d8/d12 to d0/d6/d37/d84 0 2024-02-14T13:10:36.429 INFO:tasks.workunit.client.0.smithi012.stdout:2/390: write d0/d6/d37/d84/f4b [688934,53971] 0 2024-02-14T13:10:36.429 INFO:tasks.workunit.client.0.smithi012.stdout:1/360: dwrite d6/d10/d22/d31/d5b/d5d/f55 [0,4194304] 0 2024-02-14T13:10:36.429 INFO:tasks.workunit.client.0.smithi012.stdout:1/361: chown d6/d10/d22/d31/d5b/d5d/f6e 0 1 2024-02-14T13:10:36.429 INFO:tasks.workunit.client.0.smithi012.stdout:1/362: fsync d6/d10/d64/f6f 0 2024-02-14T13:10:36.430 INFO:tasks.workunit.client.0.smithi012.stdout:6/316: symlink d1/d1e/l60 0 2024-02-14T13:10:36.432 INFO:tasks.workunit.client.0.smithi012.stdout:2/391: rename d0/d20/l36 to d0/d6/d37/d84/d26/d7a/l85 0 2024-02-14T13:10:36.432 INFO:tasks.workunit.client.0.smithi012.stdout:2/392: stat d0/d6/d37/d84/d26/l46 0 2024-02-14T13:10:36.435 INFO:tasks.workunit.client.0.smithi012.stdout:1/363: truncate d6/d10/d22/d31/d5b/d5d/f2d 3283118 0 2024-02-14T13:10:36.435 INFO:tasks.workunit.client.0.smithi012.stdout:1/364: chown d6/fc 2 1 2024-02-14T13:10:36.436 INFO:tasks.workunit.client.0.smithi012.stdout:8/354: sync 2024-02-14T13:10:36.436 INFO:tasks.workunit.client.0.smithi012.stdout:3/322: sync 2024-02-14T13:10:36.436 INFO:tasks.workunit.client.0.smithi012.stdout:4/312: sync 2024-02-14T13:10:36.437 INFO:tasks.workunit.client.0.smithi012.stdout:7/298: sync 2024-02-14T13:10:36.437 INFO:tasks.workunit.client.0.smithi012.stdout:6/317: truncate d1/df/d24/f40 333982 0 2024-02-14T13:10:36.437 INFO:tasks.workunit.client.0.smithi012.stdout:6/318: fsync d1/d1e/d1b/f33 0 2024-02-14T13:10:36.437 INFO:tasks.workunit.client.0.smithi012.stdout:7/299: truncate df/d24/f70 375398 0 2024-02-14T13:10:36.437 INFO:tasks.workunit.client.0.smithi012.stdout:8/355: write d9/dc/d38/f60 [906583,78525] 0 2024-02-14T13:10:36.438 INFO:tasks.workunit.client.0.smithi012.stdout:2/393: rename d0/d1a/c52 to d0/d6/de/c86 0 2024-02-14T13:10:36.440 INFO:tasks.workunit.client.0.smithi012.stdout:4/313: creat d0/d10/d1f/f70 x:0 0 0 2024-02-14T13:10:36.440 INFO:tasks.workunit.client.0.smithi012.stdout:4/314: chown d0/d10/d28/d4f/f4e 237923 1 2024-02-14T13:10:36.440 INFO:tasks.workunit.client.0.smithi012.stdout:4/315: read d0/d10/d28/f37 [3524961,117285] 0 2024-02-14T13:10:36.441 INFO:tasks.workunit.client.0.smithi012.stdout:6/319: rmdir d1/d1e/dc/d38 39 2024-02-14T13:10:36.441 INFO:tasks.workunit.client.0.smithi012.stdout:6/320: chown d1/d1e/d1b/l46 121247 1 2024-02-14T13:10:36.441 INFO:tasks.workunit.client.0.smithi012.stdout:6/321: write d1/d1e/d1b/f3d [1507125,25795] 0 2024-02-14T13:10:36.443 INFO:tasks.workunit.client.0.smithi012.stdout:8/356: getdents d9/dc/d1b/d35 0 2024-02-14T13:10:36.444 INFO:tasks.workunit.client.0.smithi012.stdout:1/365: read d6/f1b [799085,30520] 0 2024-02-14T13:10:36.444 INFO:tasks.workunit.client.0.smithi012.stdout:2/394: symlink d0/d6/de/d7b/l87 0 2024-02-14T13:10:36.448 INFO:tasks.workunit.client.0.smithi012.stdout:4/316: mkdir d0/d10/d1f/d71 0 2024-02-14T13:10:36.448 INFO:tasks.workunit.client.0.smithi012.stdout:4/317: truncate d0/d10/d13/f2d 5199082 0 2024-02-14T13:10:36.448 INFO:tasks.workunit.client.0.smithi012.stdout:4/318: write d0/d10/d28/f37 [3787793,24024] 0 2024-02-14T13:10:36.448 INFO:tasks.workunit.client.0.smithi012.stdout:4/319: chown d0/d55/f64 1555924 1 2024-02-14T13:10:36.449 INFO:tasks.workunit.client.0.smithi012.stdout:6/322: mknod d1/df/d50/c61 0 2024-02-14T13:10:36.451 INFO:tasks.workunit.client.0.smithi012.stdout:7/300: dwrite df/d2d/f41 [0,4194304] 0 2024-02-14T13:10:36.452 INFO:tasks.workunit.client.0.smithi012.stdout:8/357: rename d9/dc/d38/f4a to d9/dc/f6d 0 2024-02-14T13:10:36.453 INFO:tasks.workunit.client.0.smithi012.stdout:1/366: mkdir d6/d10/d22/d31/d3e/d71 0 2024-02-14T13:10:36.454 INFO:tasks.workunit.client.0.smithi012.stdout:4/320: creat d0/d10/d13/d17/f72 x:0 0 0 2024-02-14T13:10:36.454 INFO:tasks.workunit.client.0.smithi012.stdout:2/395: dread d0/d5/f42 [0,4194304] 0 2024-02-14T13:10:36.456 INFO:tasks.workunit.client.0.smithi012.stdout:7/301: truncate df/d27/f2b 3755881 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:6/323: rename d1/df/d24/l52 to d1/d1e/dc/d28/l62 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:6/324: write d1/d1e/d1b/d21/f32 [975423,126374] 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:6/325: truncate d1/d1e/dc/f15 2584334 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:6/326: chown d1/d1e/dc/d28 62776756 1 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/358: link d9/dc/d1b/d35/d50/d56/d57/f6c d9/dc/d1b/d35/d50/d56/d57/f6e 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/359: write d9/dc/d1b/f20 [5028249,18618] 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:8/360: truncate d9/dc/d1b/d35/d50/d56/d57/f6c 8450326 0 2024-02-14T13:10:36.460 INFO:tasks.workunit.client.0.smithi012.stdout:1/367: creat d6/d10/d22/d31/d5b/d5d/d6d/f72 x:0 0 0 2024-02-14T13:10:36.461 INFO:tasks.workunit.client.0.smithi012.stdout:7/302: link df/d27/f28 df/d24/f71 0 2024-02-14T13:10:36.461 INFO:tasks.workunit.client.0.smithi012.stdout:7/303: stat df/l13 0 2024-02-14T13:10:36.463 INFO:tasks.workunit.client.0.smithi012.stdout:4/321: rename d0/f1a to d0/d55/f73 0 2024-02-14T13:10:36.464 INFO:tasks.workunit.client.0.smithi012.stdout:8/361: mknod d9/dc/d1b/d35/d50/c6f 0 2024-02-14T13:10:36.464 INFO:tasks.workunit.client.0.smithi012.stdout:8/362: fsync d9/dc/d14/d2e/f3f 0 2024-02-14T13:10:36.465 INFO:tasks.workunit.client.0.smithi012.stdout:1/368: symlink d6/d10/d22/d31/d34/d58/d61/l73 0 2024-02-14T13:10:36.466 INFO:tasks.workunit.client.0.smithi012.stdout:2/396: rename d0/d6/d37/d84/c3e to d0/d20/d54/c88 0 2024-02-14T13:10:36.466 INFO:tasks.workunit.client.0.smithi012.stdout:2/397: dread - d0/d8/d11/d33/d53/d6b/f6c zero size 2024-02-14T13:10:36.466 INFO:tasks.workunit.client.0.smithi012.stdout:6/327: dread d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:36.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:36 smithi012 ceph-mon[32370]: pgmap v404: 97 pgs: 97 active+clean; 294 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 37 MiB/s wr, 1.22k op/s 2024-02-14T13:10:36.467 INFO:tasks.workunit.client.0.smithi012.stdout:8/363: symlink d9/dc/d1b/l70 0 2024-02-14T13:10:36.470 INFO:tasks.workunit.client.0.smithi012.stdout:1/369: creat d6/d10/d22/d31/f74 x:0 0 0 2024-02-14T13:10:36.470 INFO:tasks.workunit.client.0.smithi012.stdout:1/370: write d6/d10/d22/d31/d5b/d5d/f2e [999260,110006] 0 2024-02-14T13:10:36.470 INFO:tasks.workunit.client.0.smithi012.stdout:1/371: write d6/d10/d22/d31/d5b/d5e/d3d/f51 [107706,8995] 0 2024-02-14T13:10:36.470 INFO:tasks.workunit.client.0.smithi012.stdout:7/304: write df/d24/d56/f64 [501244,1882] 0 2024-02-14T13:10:36.471 INFO:tasks.workunit.client.0.smithi012.stdout:8/364: dread d9/dc/d38/f60 [0,4194304] 0 2024-02-14T13:10:36.471 INFO:tasks.workunit.client.0.smithi012.stdout:2/398: mkdir d0/d8/d89 0 2024-02-14T13:10:36.472 INFO:tasks.workunit.client.0.smithi012.stdout:6/328: creat d1/d1e/dc/d43/f63 x:0 0 0 2024-02-14T13:10:36.473 INFO:tasks.workunit.client.0.smithi012.stdout:1/372: rmdir d6/d10/d22/d31/d5b/d5e/d3d 39 2024-02-14T13:10:36.476 INFO:tasks.workunit.client.0.smithi012.stdout:4/322: getdents d0 0 2024-02-14T13:10:36.478 INFO:tasks.workunit.client.0.smithi012.stdout:7/305: mkdir df/d2d/d5d/d72 0 2024-02-14T13:10:36.478 INFO:tasks.workunit.client.0.smithi012.stdout:7/306: chown fd 38152 1 2024-02-14T13:10:36.480 INFO:tasks.workunit.client.0.smithi012.stdout:2/399: getdents d0/d5/d15/d57 0 2024-02-14T13:10:36.482 INFO:tasks.workunit.client.0.smithi012.stdout:6/329: creat d1/d1e/dc/d28/f64 x:0 0 0 2024-02-14T13:10:36.484 INFO:tasks.workunit.client.0.smithi012.stdout:4/323: mknod d0/d10/d13/d17/c74 0 2024-02-14T13:10:36.485 INFO:tasks.workunit.client.0.smithi012.stdout:1/373: dread d6/fc [0,4194304] 0 2024-02-14T13:10:36.485 INFO:tasks.workunit.client.0.smithi012.stdout:1/374: write d6/d10/d22/d31/d34/f4c [561590,112547] 0 2024-02-14T13:10:36.485 INFO:tasks.workunit.client.0.smithi012.stdout:7/307: getdents df/d2d/d57 0 2024-02-14T13:10:36.486 INFO:tasks.workunit.client.0.smithi012.stdout:7/308: read df/f21 [16014,68386] 0 2024-02-14T13:10:36.487 INFO:tasks.workunit.client.0.smithi012.stdout:8/365: dwrite d9/dc/d14/d23/f67 [0,4194304] 0 2024-02-14T13:10:36.489 INFO:tasks.workunit.client.0.smithi012.stdout:4/324: rename d0/d10/d13/d17/c74 to d0/d10/d28/c75 0 2024-02-14T13:10:36.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:36 smithi103 ceph-mon[36921]: pgmap v404: 97 pgs: 97 active+clean; 294 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 37 MiB/s wr, 1.22k op/s 2024-02-14T13:10:36.493 INFO:tasks.workunit.client.0.smithi012.stdout:7/309: getdents df/d24/d56 0 2024-02-14T13:10:36.497 INFO:tasks.workunit.client.0.smithi012.stdout:8/366: symlink d9/dc/d1b/d35/d50/d56/l71 0 2024-02-14T13:10:36.501 INFO:tasks.workunit.client.0.smithi012.stdout:1/375: rename d6/d10/d22/d31/d34/d58/d61/f6b to d6/d10/d22/d31/d5b/d5e/d65/f75 0 2024-02-14T13:10:36.501 INFO:tasks.workunit.client.0.smithi012.stdout:1/376: stat d6/d10/d22/d31/d5b/d5d/f38 0 2024-02-14T13:10:36.506 INFO:tasks.workunit.client.0.smithi012.stdout:4/325: rename d0/d10/d28/d4f/f4e to d0/d10/d1f/d3e/f76 0 2024-02-14T13:10:36.506 INFO:tasks.workunit.client.0.smithi012.stdout:4/326: chown d0/d10/d28/d4f/c43 1 1 2024-02-14T13:10:36.508 INFO:tasks.workunit.client.0.smithi012.stdout:1/377: link d6/d10/d22/d31/d34/d3b/f53 d6/d10/d22/d31/d5b/d5d/f76 0 2024-02-14T13:10:36.508 INFO:tasks.workunit.client.0.smithi012.stdout:4/327: mknod d0/d10/d13/c77 0 2024-02-14T13:10:36.508 INFO:tasks.workunit.client.0.smithi012.stdout:4/328: chown d0/d10/d13/f2d 243 1 2024-02-14T13:10:36.509 INFO:tasks.workunit.client.0.smithi012.stdout:1/378: getdents d6/d10/d22/d31/d34/d58 0 2024-02-14T13:10:36.509 INFO:tasks.workunit.client.0.smithi012.stdout:1/379: stat d6/d10/d22/d31/d5b/d5e/d3d/f68 0 2024-02-14T13:10:36.510 INFO:tasks.workunit.client.0.smithi012.stdout:1/380: stat d6/d10/d22/d31/f40 0 2024-02-14T13:10:36.510 INFO:tasks.workunit.client.0.smithi012.stdout:4/329: mknod d0/d10/d13/c78 0 2024-02-14T13:10:36.512 INFO:tasks.workunit.client.0.smithi012.stdout:1/381: rename d6/d10/d22/d31/d5b/d5d/f38 to d6/d10/d22/d31/d3e/f77 0 2024-02-14T13:10:36.512 INFO:tasks.workunit.client.0.smithi012.stdout:1/382: dread - d6/d10/d22/d31/d5b/d5e/d65/f75 zero size 2024-02-14T13:10:36.512 INFO:tasks.workunit.client.0.smithi012.stdout:1/383: dread - d6/d10/d22/d44/f48 zero size 2024-02-14T13:10:36.513 INFO:tasks.workunit.client.0.smithi012.stdout:1/384: dread - d6/d10/f4a zero size 2024-02-14T13:10:36.513 INFO:tasks.workunit.client.0.smithi012.stdout:4/330: unlink d0/le 0 2024-02-14T13:10:36.513 INFO:tasks.workunit.client.0.smithi012.stdout:1/385: rmdir d6/d10/d22/d31/d5b 39 2024-02-14T13:10:36.514 INFO:tasks.workunit.client.0.smithi012.stdout:4/331: creat d0/d10/f79 x:0 0 0 2024-02-14T13:10:36.515 INFO:tasks.workunit.client.0.smithi012.stdout:1/386: mknod d6/d10/d22/d31/d34/d3b/c78 0 2024-02-14T13:10:36.516 INFO:tasks.workunit.client.0.smithi012.stdout:4/332: creat d0/d10/d28/d4f/f7a x:0 0 0 2024-02-14T13:10:36.517 INFO:tasks.workunit.client.0.smithi012.stdout:1/387: link d6/d10/d22/d31/c39 d6/d10/d22/d31/d5b/d5e/c79 0 2024-02-14T13:10:36.517 INFO:tasks.workunit.client.0.smithi012.stdout:4/333: creat d0/d10/f7b x:0 0 0 2024-02-14T13:10:36.518 INFO:tasks.workunit.client.0.smithi012.stdout:1/388: creat d6/d10/f7a x:0 0 0 2024-02-14T13:10:36.519 INFO:tasks.workunit.client.0.smithi012.stdout:2/400: dwrite d0/d8/d11/d33/f38 [4194304,4194304] 0 2024-02-14T13:10:36.519 INFO:tasks.workunit.client.0.smithi012.stdout:2/401: fsync d0/d8/d11/d33/d53/d6b/f6c 0 2024-02-14T13:10:36.519 INFO:tasks.workunit.client.0.smithi012.stdout:2/402: mkdir d0/d20/d75/d8a 0 2024-02-14T13:10:36.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/403: rename d0/d5/fd to d0/d5/d39/f8b 0 2024-02-14T13:10:36.521 INFO:tasks.workunit.client.0.smithi012.stdout:2/404: write d0/d5/d39/f8b [887594,15697] 0 2024-02-14T13:10:36.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/389: dread d6/d10/d22/d31/d34/d3b/f43 [0,4194304] 0 2024-02-14T13:10:36.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/390: dread - d6/d10/d64/f6f zero size 2024-02-14T13:10:36.524 INFO:tasks.workunit.client.0.smithi012.stdout:1/391: creat d6/d10/d22/d31/d5b/d5d/d6d/f7b x:0 0 0 2024-02-14T13:10:36.524 INFO:tasks.workunit.client.0.smithi012.stdout:1/392: chown d6/f1b 9744 1 2024-02-14T13:10:36.524 INFO:tasks.workunit.client.0.smithi012.stdout:1/393: creat d6/d10/d22/d44/f7c x:0 0 0 2024-02-14T13:10:36.525 INFO:tasks.workunit.client.0.smithi012.stdout:1/394: creat d6/d10/d22/d31/d5b/d5d/d6d/f7d x:0 0 0 2024-02-14T13:10:36.526 INFO:tasks.workunit.client.0.smithi012.stdout:1/395: write d6/d10/d22/d31/d5b/d5e/f36 [613103,40914] 0 2024-02-14T13:10:36.526 INFO:tasks.workunit.client.0.smithi012.stdout:1/396: fdatasync d6/d10/d22/d31/d5b/d5d/f6e 0 2024-02-14T13:10:36.527 INFO:tasks.workunit.client.0.smithi012.stdout:7/310: dwrite df/d36/f5e [0,4194304] 0 2024-02-14T13:10:36.528 INFO:tasks.workunit.client.0.smithi012.stdout:8/367: dwrite d9/dc/d1b/d35/d50/f59 [0,4194304] 0 2024-02-14T13:10:36.534 INFO:tasks.workunit.client.0.smithi012.stdout:6/330: dwrite d1/d1e/dc/f15 [0,4194304] 0 2024-02-14T13:10:36.534 INFO:tasks.workunit.client.0.smithi012.stdout:4/334: dread d0/d10/d28/d4f/f40 [0,4194304] 0 2024-02-14T13:10:36.538 INFO:tasks.workunit.client.0.smithi012.stdout:2/405: dwrite d0/d6/de/d7d/f83 [0,4194304] 0 2024-02-14T13:10:36.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/311: unlink df/d27/d4b/d6b/d6d/c6e 0 2024-02-14T13:10:36.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/312: chown df/d2d/f3e 233 1 2024-02-14T13:10:36.544 INFO:tasks.workunit.client.0.smithi012.stdout:4/335: dread d0/f6 [4194304,4194304] 0 2024-02-14T13:10:36.545 INFO:tasks.workunit.client.0.smithi012.stdout:4/336: write d0/d10/d13/f2d [5892580,81543] 0 2024-02-14T13:10:36.546 INFO:tasks.workunit.client.0.smithi012.stdout:7/313: creat df/d2d/d5d/f73 x:0 0 0 2024-02-14T13:10:36.547 INFO:tasks.workunit.client.0.smithi012.stdout:8/368: dwrite d9/dc/f2c [4194304,4194304] 0 2024-02-14T13:10:36.549 INFO:tasks.workunit.client.0.smithi012.stdout:7/314: rename df/d36/l4d to df/d24/l74 0 2024-02-14T13:10:36.549 INFO:tasks.workunit.client.0.smithi012.stdout:7/315: write df/d24/f31 [4746170,71911] 0 2024-02-14T13:10:36.549 INFO:tasks.workunit.client.0.smithi012.stdout:2/406: write d0/d8/f31 [7270205,36520] 0 2024-02-14T13:10:36.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/369: creat d9/dc/d38/d6a/f72 x:0 0 0 2024-02-14T13:10:36.555 INFO:tasks.workunit.client.0.smithi012.stdout:7/316: truncate df/d36/f63 5557880 0 2024-02-14T13:10:36.555 INFO:tasks.workunit.client.0.smithi012.stdout:7/317: read df/d24/d56/f64 [3880802,93515] 0 2024-02-14T13:10:36.555 INFO:tasks.workunit.client.0.smithi012.stdout:7/318: stat df/d2d/f3f 0 2024-02-14T13:10:36.556 INFO:tasks.workunit.client.0.smithi012.stdout:2/407: mknod d0/d8/d11/d33/d53/d6b/c8c 0 2024-02-14T13:10:36.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/408: read d0/d6/de/d7b/f61 [150311,100678] 0 2024-02-14T13:10:36.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/409: readlink d0/d20/d54/l64 0 2024-02-14T13:10:36.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/410: chown d0/d8/d89 2 1 2024-02-14T13:10:36.557 INFO:tasks.workunit.client.0.smithi012.stdout:1/397: dwrite d6/d10/d22/d31/d5b/d5d/f76 [0,4194304] 0 2024-02-14T13:10:36.557 INFO:tasks.workunit.client.0.smithi012.stdout:6/331: dwrite d1/df/d24/f36 [0,4194304] 0 2024-02-14T13:10:36.559 INFO:tasks.workunit.client.0.smithi012.stdout:2/411: dread d0/d6/d37/f3b [0,4194304] 0 2024-02-14T13:10:36.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:36 smithi055 ceph-mon[36853]: pgmap v404: 97 pgs: 97 active+clean; 294 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 37 MiB/s wr, 1.22k op/s 2024-02-14T13:10:36.561 INFO:tasks.workunit.client.0.smithi012.stdout:1/398: link d6/d10/f7a d6/d10/d22/d31/f7e 0 2024-02-14T13:10:36.562 INFO:tasks.workunit.client.0.smithi012.stdout:1/399: write d6/d10/d22/d31/d5b/d5e/f36 [1121615,53625] 0 2024-02-14T13:10:36.562 INFO:tasks.workunit.client.0.smithi012.stdout:1/400: write d6/d10/d22/d31/d3e/f77 [1749488,80376] 0 2024-02-14T13:10:36.562 INFO:tasks.workunit.client.0.smithi012.stdout:1/401: truncate d6/d10/d22/d31/d5b/d5d/d6d/f7b 133383 0 2024-02-14T13:10:36.567 INFO:tasks.workunit.client.0.smithi012.stdout:2/412: creat d0/d6/d37/d84/d26/d7a/f8d x:0 0 0 2024-02-14T13:10:36.568 INFO:tasks.workunit.client.0.smithi012.stdout:2/413: truncate d0/d8/f58 224144 0 2024-02-14T13:10:36.568 INFO:tasks.workunit.client.0.smithi012.stdout:4/337: dwrite d0/d10/d13/d17/f5e [0,4194304] 0 2024-02-14T13:10:36.568 INFO:tasks.workunit.client.0.smithi012.stdout:1/402: getdents d6/d10/d22/d31/d5b/d5e/d3d 0 2024-02-14T13:10:36.570 INFO:tasks.workunit.client.0.smithi012.stdout:2/414: unlink d0/d8/d11/f32 0 2024-02-14T13:10:36.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/403: symlink d6/d10/d22/l7f 0 2024-02-14T13:10:36.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/404: read d6/d10/d22/d31/d5b/d5e/d3d/f45 [1019486,11047] 0 2024-02-14T13:10:36.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/405: dread - d6/d10/d22/d31/d5b/d5d/d6d/f72 zero size 2024-02-14T13:10:36.574 INFO:tasks.workunit.client.0.smithi012.stdout:1/406: chown d6 138910 1 2024-02-14T13:10:36.575 INFO:tasks.workunit.client.0.smithi012.stdout:2/415: symlink d0/d8/d11/d33/l8e 0 2024-02-14T13:10:36.575 INFO:tasks.workunit.client.0.smithi012.stdout:5/360: sync 2024-02-14T13:10:36.575 INFO:tasks.workunit.client.0.smithi012.stdout:0/399: sync 2024-02-14T13:10:36.577 INFO:tasks.workunit.client.0.smithi012.stdout:4/338: rmdir d0/d10/d1f 39 2024-02-14T13:10:36.578 INFO:tasks.workunit.client.0.smithi012.stdout:8/370: dwrite d9/dc/d14/d2e/f5d [0,4194304] 0 2024-02-14T13:10:36.578 INFO:tasks.workunit.client.0.smithi012.stdout:5/361: dread dc/d17/d20/f42 [0,4194304] 0 2024-02-14T13:10:36.579 INFO:tasks.workunit.client.0.smithi012.stdout:1/407: mkdir d6/d10/d22/d31/d5b/d5d/d80 0 2024-02-14T13:10:36.580 INFO:tasks.workunit.client.0.smithi012.stdout:0/400: unlink d10/f2a 0 2024-02-14T13:10:36.581 INFO:tasks.workunit.client.0.smithi012.stdout:7/319: rmdir df/d2d 39 2024-02-14T13:10:36.581 INFO:tasks.workunit.client.0.smithi012.stdout:7/320: write df/d24/f29 [1701845,95626] 0 2024-02-14T13:10:36.581 INFO:tasks.workunit.client.0.smithi012.stdout:7/321: chown df/d27 661 1 2024-02-14T13:10:36.585 INFO:tasks.workunit.client.0.smithi012.stdout:5/362: creat dc/d47/d6e/f77 x:0 0 0 2024-02-14T13:10:36.585 INFO:tasks.workunit.client.0.smithi012.stdout:8/371: symlink d9/dc/d38/d6a/l73 0 2024-02-14T13:10:36.586 INFO:tasks.workunit.client.0.smithi012.stdout:6/332: dwrite d1/d1e/dc/d43/f5e [0,4194304] 0 2024-02-14T13:10:36.586 INFO:tasks.workunit.client.0.smithi012.stdout:0/401: getdents d10/d14/d51 0 2024-02-14T13:10:36.588 INFO:tasks.workunit.client.0.smithi012.stdout:7/322: rename df/d2d/d5d/f73 to df/d2d/d57/f75 0 2024-02-14T13:10:36.589 INFO:tasks.workunit.client.0.smithi012.stdout:7/323: write df/d2d/d57/f6a [174691,89627] 0 2024-02-14T13:10:36.589 INFO:tasks.workunit.client.0.smithi012.stdout:7/324: write f5 [1405565,12216] 0 2024-02-14T13:10:36.589 INFO:tasks.workunit.client.0.smithi012.stdout:1/408: dread d6/d10/d22/d31/d5b/d5e/d3d/f68 [4194304,4194304] 0 2024-02-14T13:10:36.589 INFO:tasks.workunit.client.0.smithi012.stdout:4/339: link d0/d10/d1f/d3e/l54 d0/d55/l7c 0 2024-02-14T13:10:36.590 INFO:tasks.workunit.client.0.smithi012.stdout:5/363: fsync dc/d2f/d40/f48 0 2024-02-14T13:10:36.590 INFO:tasks.workunit.client.0.smithi012.stdout:5/364: fdatasync dc/d17/f43 0 2024-02-14T13:10:36.592 INFO:tasks.workunit.client.0.smithi012.stdout:9/408: sync 2024-02-14T13:10:36.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/323: sync 2024-02-14T13:10:36.592 INFO:tasks.workunit.client.0.smithi012.stdout:2/416: dwrite d0/d8/f6f [0,4194304] 0 2024-02-14T13:10:36.592 INFO:tasks.workunit.client.0.smithi012.stdout:2/417: dread - d0/d5/d15/d57/f78 zero size 2024-02-14T13:10:36.593 INFO:tasks.workunit.client.0.smithi012.stdout:6/333: symlink d1/df/d24/d3f/l65 0 2024-02-14T13:10:36.595 INFO:tasks.workunit.client.0.smithi012.stdout:7/325: creat df/d2d/d5d/f76 x:0 0 0 2024-02-14T13:10:36.597 INFO:tasks.workunit.client.0.smithi012.stdout:4/340: mknod d0/d10/d1f/d3e/d56/c7d 0 2024-02-14T13:10:36.597 INFO:tasks.workunit.client.0.smithi012.stdout:4/341: write d0/d10/d1f/d3e/f48 [4613523,122747] 0 2024-02-14T13:10:36.599 INFO:tasks.workunit.client.0.smithi012.stdout:3/324: rename d9/dd/l2d to d9/dd/de/d58/l77 0 2024-02-14T13:10:36.600 INFO:tasks.workunit.client.0.smithi012.stdout:8/372: mknod d9/dc/d14/d23/c74 0 2024-02-14T13:10:36.603 INFO:tasks.workunit.client.0.smithi012.stdout:7/326: creat df/d2d/d5d/d72/f77 x:0 0 0 2024-02-14T13:10:36.603 INFO:tasks.workunit.client.0.smithi012.stdout:7/327: readlink df/d27/l55 0 2024-02-14T13:10:36.604 INFO:tasks.workunit.client.0.smithi012.stdout:4/342: symlink d0/d10/d1f/d71/l7e 0 2024-02-14T13:10:36.605 INFO:tasks.workunit.client.0.smithi012.stdout:5/365: mkdir dc/d2f/d70/d78 0 2024-02-14T13:10:36.609 INFO:tasks.workunit.client.0.smithi012.stdout:0/402: dwrite d10/d14/d20/d21/f4e [0,4194304] 0 2024-02-14T13:10:36.611 INFO:tasks.workunit.client.0.smithi012.stdout:2/418: rename d0/d6/de/c86 to d0/d6/d37/d84/c8f 0 2024-02-14T13:10:36.613 INFO:tasks.workunit.client.0.smithi012.stdout:7/328: mkdir df/d2d/d5d/d72/d78 0 2024-02-14T13:10:36.614 INFO:tasks.workunit.client.0.smithi012.stdout:2/419: dread d0/d6/de/d7b/f61 [0,4194304] 0 2024-02-14T13:10:36.614 INFO:tasks.workunit.client.0.smithi012.stdout:7/329: dread df/f59 [0,4194304] 0 2024-02-14T13:10:36.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/343: creat d0/d10/d1f/d3e/d56/f7f x:0 0 0 2024-02-14T13:10:36.615 INFO:tasks.workunit.client.0.smithi012.stdout:1/409: dwrite d6/d10/d22/d31/d5b/d5e/d65/f75 [0,4194304] 0 2024-02-14T13:10:36.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/366: unlink dc/d47/c4a 0 2024-02-14T13:10:36.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/367: chown dc/d17/d20/f42 9459 1 2024-02-14T13:10:36.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/368: readlink dc/d17/d20/d4c/d63/l6d 0 2024-02-14T13:10:36.616 INFO:tasks.workunit.client.0.smithi012.stdout:5/369: chown dc/d17/d20/d4c/d58/f6b 1199 1 2024-02-14T13:10:36.617 INFO:tasks.workunit.client.0.smithi012.stdout:5/370: truncate dc/d2f/f75 846240 0 2024-02-14T13:10:36.621 INFO:tasks.workunit.client.0.smithi012.stdout:0/403: creat d10/d14/d51/f7a x:0 0 0 2024-02-14T13:10:36.621 INFO:tasks.workunit.client.0.smithi012.stdout:0/404: fsync d10/d14/d2b/f6e 0 2024-02-14T13:10:36.622 INFO:tasks.workunit.client.0.smithi012.stdout:3/325: mkdir d9/dd/d30/d34/d78 0 2024-02-14T13:10:36.623 INFO:tasks.workunit.client.0.smithi012.stdout:2/420: truncate d0/d6/de/d7b/f5e 310988 0 2024-02-14T13:10:36.623 INFO:tasks.workunit.client.0.smithi012.stdout:2/421: readlink d0/d6/d37/d84/d26/l46 0 2024-02-14T13:10:36.624 INFO:tasks.workunit.client.0.smithi012.stdout:7/330: truncate df/d24/d56/f61 1276901 0 2024-02-14T13:10:36.624 INFO:tasks.workunit.client.0.smithi012.stdout:7/331: readlink df/l13 0 2024-02-14T13:10:36.624 INFO:tasks.workunit.client.0.smithi012.stdout:2/422: dread d0/d6/de/d7b/f61 [0,4194304] 0 2024-02-14T13:10:36.627 INFO:tasks.workunit.client.0.smithi012.stdout:1/410: rename d6/d10/d22/d31/f7e to d6/d10/d22/d31/d34/d3b/f81 0 2024-02-14T13:10:36.628 INFO:tasks.workunit.client.0.smithi012.stdout:9/409: dwrite da/dd/d19/f4d [0,4194304] 0 2024-02-14T13:10:36.628 INFO:tasks.workunit.client.0.smithi012.stdout:9/410: chown da/d4f/c5b 491978949 1 2024-02-14T13:10:36.628 INFO:tasks.workunit.client.0.smithi012.stdout:5/371: symlink dc/d17/d20/d4c/l79 0 2024-02-14T13:10:36.629 INFO:tasks.workunit.client.0.smithi012.stdout:8/373: dwrite d9/dc/d1b/d35/d50/d56/d57/d5c/f61 [0,4194304] 0 2024-02-14T13:10:36.631 INFO:tasks.workunit.client.0.smithi012.stdout:0/405: getdents d10/d14/d2b/d3b 0 2024-02-14T13:10:36.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/332: mknod df/d27/c79 0 2024-02-14T13:10:36.633 INFO:tasks.workunit.client.0.smithi012.stdout:2/423: unlink d0/d6/d37/c4f 0 2024-02-14T13:10:36.635 INFO:tasks.workunit.client.0.smithi012.stdout:1/411: creat d6/d10/d22/d44/f82 x:0 0 0 2024-02-14T13:10:36.637 INFO:tasks.workunit.client.0.smithi012.stdout:5/372: creat dc/d2f/d40/d53/f7a x:0 0 0 2024-02-14T13:10:36.637 INFO:tasks.workunit.client.0.smithi012.stdout:5/373: readlink dc/d17/d20/d4c/d63/l6d 0 2024-02-14T13:10:36.637 INFO:tasks.workunit.client.0.smithi012.stdout:5/374: fdatasync dc/f4d 0 2024-02-14T13:10:36.637 INFO:tasks.workunit.client.0.smithi012.stdout:5/375: chown dc/l5f 8744657 1 2024-02-14T13:10:36.637 INFO:tasks.workunit.client.0.smithi012.stdout:5/376: dread - dc/d17/d20/d4c/d58/f68 zero size 2024-02-14T13:10:36.637 INFO:tasks.workunit.client.0.smithi012.stdout:3/326: dwrite d9/dd/f17 [4194304,4194304] 0 2024-02-14T13:10:36.639 INFO:tasks.workunit.client.0.smithi012.stdout:0/406: dread d10/d14/d2b/d3b/f4d [0,4194304] 0 2024-02-14T13:10:36.639 INFO:tasks.workunit.client.0.smithi012.stdout:0/407: chown f0 0 1 2024-02-14T13:10:36.642 INFO:tasks.workunit.client.0.smithi012.stdout:7/333: symlink df/d2d/d5d/d72/l7a 0 2024-02-14T13:10:36.643 INFO:tasks.workunit.client.0.smithi012.stdout:2/424: mkdir d0/d8/d9/d90 0 2024-02-14T13:10:36.643 INFO:tasks.workunit.client.0.smithi012.stdout:2/425: write d0/d20/d54/f6a [1194379,51310] 0 2024-02-14T13:10:36.644 INFO:tasks.workunit.client.0.smithi012.stdout:3/327: mknod d9/d68/d6a/c79 0 2024-02-14T13:10:36.644 INFO:tasks.workunit.client.0.smithi012.stdout:3/328: readlink d9/l57 0 2024-02-14T13:10:36.645 INFO:tasks.workunit.client.0.smithi012.stdout:7/334: creat df/d2d/d5d/d72/f7b x:0 0 0 2024-02-14T13:10:36.645 INFO:tasks.workunit.client.0.smithi012.stdout:7/335: chown df/f22 29330 1 2024-02-14T13:10:36.645 INFO:tasks.workunit.client.0.smithi012.stdout:7/336: chown df/l1c 19468415 1 2024-02-14T13:10:36.645 INFO:tasks.workunit.client.0.smithi012.stdout:7/337: readlink df/l16 0 2024-02-14T13:10:36.646 INFO:tasks.workunit.client.0.smithi012.stdout:8/374: dread d9/dc/d14/d2e/f5d [0,4194304] 0 2024-02-14T13:10:36.646 INFO:tasks.workunit.client.0.smithi012.stdout:3/329: mknod d9/d18/c7a 0 2024-02-14T13:10:36.647 INFO:tasks.workunit.client.0.smithi012.stdout:7/338: link df/c5b df/d2d/d5d/c7c 0 2024-02-14T13:10:36.648 INFO:tasks.workunit.client.0.smithi012.stdout:5/377: write dc/d17/d20/f37 [1190495,79965] 0 2024-02-14T13:10:36.649 INFO:tasks.workunit.client.0.smithi012.stdout:8/375: creat d9/dc/d1b/d35/d50/d56/d57/d5c/f75 x:0 0 0 2024-02-14T13:10:36.650 INFO:tasks.workunit.client.0.smithi012.stdout:3/330: mkdir d9/d7b 0 2024-02-14T13:10:36.650 INFO:tasks.workunit.client.0.smithi012.stdout:3/331: write d9/dd/d30/d44/d66/f72 [725598,18278] 0 2024-02-14T13:10:36.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/332: write d9/dd/de/f38 [4394244,117807] 0 2024-02-14T13:10:36.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/333: truncate d9/dd/de/d58/f64 1096816 0 2024-02-14T13:10:36.652 INFO:tasks.workunit.client.0.smithi012.stdout:7/339: rename f5 to df/d36/f7d 0 2024-02-14T13:10:36.652 INFO:tasks.workunit.client.0.smithi012.stdout:2/426: dread d0/d1a/f47 [0,4194304] 0 2024-02-14T13:10:36.652 INFO:tasks.workunit.client.0.smithi012.stdout:5/378: mkdir dc/d17/d20/d4c/d7b 0 2024-02-14T13:10:36.653 INFO:tasks.workunit.client.0.smithi012.stdout:8/376: mknod d9/c76 0 2024-02-14T13:10:36.653 INFO:tasks.workunit.client.0.smithi012.stdout:8/377: dread - d9/dc/d14/d2e/f44 zero size 2024-02-14T13:10:36.654 INFO:tasks.workunit.client.0.smithi012.stdout:1/412: dwrite d6/d10/d22/d31/d5b/d5e/d3d/f45 [0,4194304] 0 2024-02-14T13:10:36.655 INFO:tasks.workunit.client.0.smithi012.stdout:3/334: truncate d9/d13/d28/f40 811173 0 2024-02-14T13:10:36.655 INFO:tasks.workunit.client.0.smithi012.stdout:9/411: dwrite da/dd/d18/d71/f75 [0,4194304] 0 2024-02-14T13:10:36.656 INFO:tasks.workunit.client.0.smithi012.stdout:9/412: fdatasync da/d33/d63/f8a 0 2024-02-14T13:10:36.657 INFO:tasks.workunit.client.0.smithi012.stdout:5/379: creat dc/d17/d4b/f7c x:0 0 0 2024-02-14T13:10:36.658 INFO:tasks.workunit.client.0.smithi012.stdout:8/378: creat d9/dc/d1b/d35/d50/d56/f77 x:0 0 0 2024-02-14T13:10:36.658 INFO:tasks.workunit.client.0.smithi012.stdout:8/379: readlink d9/dc/d14/d23/l2a 0 2024-02-14T13:10:36.658 INFO:tasks.workunit.client.0.smithi012.stdout:8/380: fsync d9/dc/d14/d23/f41 0 2024-02-14T13:10:36.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/413: link d6/d10/d22/d31/d5b/d5d/f6e d6/d10/d22/d31/d34/d3b/f83 0 2024-02-14T13:10:36.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/414: fsync d6/d10/f3a 0 2024-02-14T13:10:36.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/415: chown d6/d10/f7a 262810891 1 2024-02-14T13:10:36.660 INFO:tasks.workunit.client.0.smithi012.stdout:3/335: creat d9/dd/de/d58/d65/d6c/f7c x:0 0 0 2024-02-14T13:10:36.660 INFO:tasks.workunit.client.0.smithi012.stdout:8/381: dread d9/dc/d5b/f69 [0,4194304] 0 2024-02-14T13:10:36.660 INFO:tasks.workunit.client.0.smithi012.stdout:2/427: write d0/d5/f42 [2761413,99508] 0 2024-02-14T13:10:36.661 INFO:tasks.workunit.client.0.smithi012.stdout:9/413: mknod da/c8c 0 2024-02-14T13:10:36.662 INFO:tasks.workunit.client.0.smithi012.stdout:5/380: mknod dc/d17/d20/d4c/c7d 0 2024-02-14T13:10:36.663 INFO:tasks.workunit.client.0.smithi012.stdout:1/416: creat d6/f84 x:0 0 0 2024-02-14T13:10:36.665 INFO:tasks.workunit.client.0.smithi012.stdout:3/336: unlink d9/l6f 0 2024-02-14T13:10:36.666 INFO:tasks.workunit.client.0.smithi012.stdout:8/382: truncate d9/dc/d1b/f20 1394699 0 2024-02-14T13:10:36.667 INFO:tasks.workunit.client.0.smithi012.stdout:0/408: dwrite d10/d14/d1b/d30/f3f [0,4194304] 0 2024-02-14T13:10:36.667 INFO:tasks.workunit.client.0.smithi012.stdout:0/409: write d10/d14/d1b/f3a [1477602,101066] 0 2024-02-14T13:10:36.668 INFO:tasks.workunit.client.0.smithi012.stdout:7/340: dwrite df/f59 [0,4194304] 0 2024-02-14T13:10:36.668 INFO:tasks.workunit.client.0.smithi012.stdout:7/341: truncate df/d24/f70 1101268 0 2024-02-14T13:10:36.668 INFO:tasks.workunit.client.0.smithi012.stdout:9/414: mkdir da/dd/d39/d8d 0 2024-02-14T13:10:36.669 INFO:tasks.workunit.client.0.smithi012.stdout:7/342: read df/d24/f31 [4514574,72094] 0 2024-02-14T13:10:36.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/381: truncate dc/d17/d20/f36 2550900 0 2024-02-14T13:10:36.671 INFO:tasks.workunit.client.0.smithi012.stdout:3/337: rmdir d9/dd/d30 39 2024-02-14T13:10:36.672 INFO:tasks.workunit.client.0.smithi012.stdout:2/428: creat d0/d5/d39/f91 x:0 0 0 2024-02-14T13:10:36.675 INFO:tasks.workunit.client.0.smithi012.stdout:1/417: dread d6/d10/d22/d31/d5b/d5d/f76 [0,4194304] 0 2024-02-14T13:10:36.676 INFO:tasks.workunit.client.0.smithi012.stdout:0/410: dread d10/d14/d2b/d3b/f4f [0,4194304] 0 2024-02-14T13:10:36.677 INFO:tasks.workunit.client.0.smithi012.stdout:7/343: truncate df/d36/f3c 3612506 0 2024-02-14T13:10:36.678 INFO:tasks.workunit.client.0.smithi012.stdout:3/338: mkdir d9/dd/d30/d44/d3d/d7d 0 2024-02-14T13:10:36.680 INFO:tasks.workunit.client.0.smithi012.stdout:1/418: symlink d6/d10/d22/d31/d34/d3b/l85 0 2024-02-14T13:10:36.682 INFO:tasks.workunit.client.0.smithi012.stdout:0/411: creat d10/d14/d1b/d30/f7b x:0 0 0 2024-02-14T13:10:36.683 INFO:tasks.workunit.client.0.smithi012.stdout:7/344: rename df/d27/c62 to df/d2d/d5d/d72/d78/c7e 0 2024-02-14T13:10:36.683 INFO:tasks.workunit.client.0.smithi012.stdout:7/345: chown df/d24/d56/f61 5757 1 2024-02-14T13:10:36.686 INFO:tasks.workunit.client.0.smithi012.stdout:9/415: dwrite da/f3f [0,4194304] 0 2024-02-14T13:10:36.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/429: write d0/d5/d15/f4a [1813512,65375] 0 2024-02-14T13:10:36.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/430: fdatasync d0/f2 0 2024-02-14T13:10:36.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/431: write d0/d5/d15/d57/f78 [409446,370] 0 2024-02-14T13:10:36.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/432: rename d0/d8 to d0/d8/d11/d33/d92 22 2024-02-14T13:10:36.688 INFO:tasks.workunit.client.0.smithi012.stdout:7/346: rmdir df/d36 39 2024-02-14T13:10:36.691 INFO:tasks.workunit.client.0.smithi012.stdout:2/433: mknod d0/d8/d89/c93 0 2024-02-14T13:10:36.692 INFO:tasks.workunit.client.0.smithi012.stdout:2/434: stat d0/d1a/l65 0 2024-02-14T13:10:36.692 INFO:tasks.workunit.client.0.smithi012.stdout:2/435: chown d0/d6/de/cf 113989 1 2024-02-14T13:10:36.692 INFO:tasks.workunit.client.0.smithi012.stdout:2/436: chown d0/d8/d11/d33/d53/d6b/c8c 183092 1 2024-02-14T13:10:36.692 INFO:tasks.workunit.client.0.smithi012.stdout:7/347: rmdir df/d2d 39 2024-02-14T13:10:36.694 INFO:tasks.workunit.client.0.smithi012.stdout:2/437: mknod d0/d20/c94 0 2024-02-14T13:10:36.694 INFO:tasks.workunit.client.0.smithi012.stdout:2/438: write d0/d6/f5f [623967,129863] 0 2024-02-14T13:10:36.695 INFO:tasks.workunit.client.0.smithi012.stdout:0/412: write d10/d14/d2b/f6e [2398402,75727] 0 2024-02-14T13:10:36.696 INFO:tasks.workunit.client.0.smithi012.stdout:7/348: rename df/l4f to df/d27/l7f 0 2024-02-14T13:10:36.696 INFO:tasks.workunit.client.0.smithi012.stdout:7/349: truncate df/f21 594201 0 2024-02-14T13:10:36.696 INFO:tasks.workunit.client.0.smithi012.stdout:7/350: chown df/d36/f63 3 1 2024-02-14T13:10:36.697 INFO:tasks.workunit.client.0.smithi012.stdout:2/439: symlink d0/d20/d54/l95 0 2024-02-14T13:10:36.697 INFO:tasks.workunit.client.0.smithi012.stdout:2/440: write d0/d6/d37/d84/d26/d7a/f8d [703903,99996] 0 2024-02-14T13:10:36.698 INFO:tasks.workunit.client.0.smithi012.stdout:9/416: dread f0 [4194304,4194304] 0 2024-02-14T13:10:36.698 INFO:tasks.workunit.client.0.smithi012.stdout:0/413: mknod d10/d14/d20/d21/c7c 0 2024-02-14T13:10:36.699 INFO:tasks.workunit.client.0.smithi012.stdout:9/417: symlink da/dd/d19/d30/d45/l8e 0 2024-02-14T13:10:36.700 INFO:tasks.workunit.client.0.smithi012.stdout:0/414: symlink d10/d14/d20/l7d 0 2024-02-14T13:10:36.701 INFO:tasks.workunit.client.0.smithi012.stdout:2/441: dread d0/d8/d43/f59 [0,4194304] 0 2024-02-14T13:10:36.701 INFO:tasks.workunit.client.0.smithi012.stdout:2/442: chown d0/d8/f6f 54 1 2024-02-14T13:10:36.702 INFO:tasks.workunit.client.0.smithi012.stdout:2/443: symlink d0/d20/l96 0 2024-02-14T13:10:36.705 INFO:tasks.workunit.client.0.smithi012.stdout:2/444: mknod d0/d1a/c97 0 2024-02-14T13:10:36.706 INFO:tasks.workunit.client.0.smithi012.stdout:1/419: rmdir d6/d10 39 2024-02-14T13:10:36.708 INFO:tasks.workunit.client.0.smithi012.stdout:5/382: dwrite dc/d17/f3f [0,4194304] 0 2024-02-14T13:10:36.708 INFO:tasks.workunit.client.0.smithi012.stdout:8/383: dwrite d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:36.708 INFO:tasks.workunit.client.0.smithi012.stdout:2/445: symlink d0/d5/l98 0 2024-02-14T13:10:36.709 INFO:tasks.workunit.client.0.smithi012.stdout:1/420: rmdir d6/d10/d22/d31 39 2024-02-14T13:10:36.710 INFO:tasks.workunit.client.0.smithi012.stdout:7/351: dread df/d36/f3c [0,4194304] 0 2024-02-14T13:10:36.713 INFO:tasks.workunit.client.0.smithi012.stdout:5/383: mknod dc/d17/d20/d4c/d58/c7e 0 2024-02-14T13:10:36.713 INFO:tasks.workunit.client.0.smithi012.stdout:5/384: write dc/f29 [1709616,119408] 0 2024-02-14T13:10:36.714 INFO:tasks.workunit.client.0.smithi012.stdout:3/339: dwrite d9/d18/d39/f59 [0,4194304] 0 2024-02-14T13:10:36.714 INFO:tasks.workunit.client.0.smithi012.stdout:3/340: chown d9/d13/f26 24 1 2024-02-14T13:10:36.717 INFO:tasks.workunit.client.0.smithi012.stdout:8/384: creat d9/dc/d1b/d35/f78 x:0 0 0 2024-02-14T13:10:36.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/446: rename d0/d20/f34 to d0/d2d/f99 0 2024-02-14T13:10:36.718 INFO:tasks.workunit.client.0.smithi012.stdout:2/447: dread - d0/d6/de/d7b/f7e zero size 2024-02-14T13:10:36.720 INFO:tasks.workunit.client.0.smithi012.stdout:1/421: truncate d6/d10/d22/d31/d3e/f77 132905 0 2024-02-14T13:10:36.720 INFO:tasks.workunit.client.0.smithi012.stdout:1/422: write d6/fc [4474307,59041] 0 2024-02-14T13:10:36.721 INFO:tasks.workunit.client.0.smithi012.stdout:7/352: unlink df/d2d/d5d/d72/f7b 0 2024-02-14T13:10:36.731 INFO:tasks.workunit.client.0.smithi012.stdout:9/418: dwrite f2 [4194304,4194304] 0 2024-02-14T13:10:36.731 INFO:tasks.workunit.client.0.smithi012.stdout:9/419: write da/dd/d18/f22 [2863613,18618] 0 2024-02-14T13:10:36.732 INFO:tasks.workunit.client.0.smithi012.stdout:0/415: truncate d10/d14/d1b/f3a 17136 0 2024-02-14T13:10:36.732 INFO:tasks.workunit.client.0.smithi012.stdout:0/416: truncate d10/d14/d41/f6a 517035 0 2024-02-14T13:10:36.739 INFO:tasks.workunit.client.0.smithi012.stdout:2/448: dread d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:36.741 INFO:tasks.workunit.client.0.smithi012.stdout:8/385: creat d9/dc/d38/d6a/f79 x:0 0 0 2024-02-14T13:10:36.741 INFO:tasks.workunit.client.0.smithi012.stdout:8/386: write d9/dc/f2c [9169872,5960] 0 2024-02-14T13:10:36.741 INFO:tasks.workunit.client.0.smithi012.stdout:8/387: dread - d9/dc/d38/f51 zero size 2024-02-14T13:10:36.743 INFO:tasks.workunit.client.0.smithi012.stdout:1/423: creat d6/d10/d22/d31/d5b/d5d/f86 x:0 0 0 2024-02-14T13:10:36.744 INFO:tasks.workunit.client.0.smithi012.stdout:3/341: dwrite d9/d3f/d4e/f6d [0,4194304] 0 2024-02-14T13:10:36.745 INFO:tasks.workunit.client.0.smithi012.stdout:3/342: chown d9/f61 143111611 1 2024-02-14T13:10:36.745 INFO:tasks.workunit.client.0.smithi012.stdout:5/385: dwrite dc/f15 [0,4194304] 0 2024-02-14T13:10:36.746 INFO:tasks.workunit.client.0.smithi012.stdout:0/417: rmdir d10/d14/d20/d49 39 2024-02-14T13:10:36.746 INFO:tasks.workunit.client.0.smithi012.stdout:0/418: chown d10/d14/d23/l34 12952 1 2024-02-14T13:10:36.746 INFO:tasks.workunit.client.0.smithi012.stdout:0/419: write d10/d14/d20/f64 [60526,76910] 0 2024-02-14T13:10:36.746 INFO:tasks.workunit.client.0.smithi012.stdout:7/353: dwrite df/d27/f2b [0,4194304] 0 2024-02-14T13:10:36.746 INFO:tasks.workunit.client.0.smithi012.stdout:7/354: truncate df/d2d/f3f 1798078 0 2024-02-14T13:10:36.748 INFO:tasks.workunit.client.0.smithi012.stdout:8/388: rename d9/f3b to d9/dc/d1b/d35/d50/f7a 0 2024-02-14T13:10:36.749 INFO:tasks.workunit.client.0.smithi012.stdout:1/424: rmdir d6/d10/d22 39 2024-02-14T13:10:36.751 INFO:tasks.workunit.client.0.smithi012.stdout:9/420: link da/dd/d18/d71/d85/c34 da/d33/d63/c8f 0 2024-02-14T13:10:36.751 INFO:tasks.workunit.client.0.smithi012.stdout:9/421: write da/dd/d18/f32 [258547,43929] 0 2024-02-14T13:10:36.752 INFO:tasks.workunit.client.0.smithi012.stdout:9/422: truncate da/d33/d63/f8a 1009273 0 2024-02-14T13:10:36.752 INFO:tasks.workunit.client.0.smithi012.stdout:9/423: write da/dd/d19/d30/f43 [4914501,107517] 0 2024-02-14T13:10:36.754 INFO:tasks.workunit.client.0.smithi012.stdout:5/386: dread dc/d17/f27 [0,4194304] 0 2024-02-14T13:10:36.754 INFO:tasks.workunit.client.0.smithi012.stdout:5/387: write dc/d17/d4b/f7c [623704,45473] 0 2024-02-14T13:10:36.755 INFO:tasks.workunit.client.0.smithi012.stdout:0/420: mkdir d10/d14/d1b/d7e 0 2024-02-14T13:10:36.755 INFO:tasks.workunit.client.0.smithi012.stdout:3/343: write d9/dd/d30/d34/f54 [661869,89277] 0 2024-02-14T13:10:36.757 INFO:tasks.workunit.client.0.smithi012.stdout:8/389: rename c7 to d9/c7b 0 2024-02-14T13:10:36.758 INFO:tasks.workunit.client.0.smithi012.stdout:8/390: read d9/dc/d14/d2e/f54 [36881,118023] 0 2024-02-14T13:10:36.759 INFO:tasks.workunit.client.0.smithi012.stdout:9/424: mknod da/d4f/c90 0 2024-02-14T13:10:36.760 INFO:tasks.workunit.client.0.smithi012.stdout:0/421: mkdir d10/d14/d20/d21/d7f 0 2024-02-14T13:10:36.762 INFO:tasks.workunit.client.0.smithi012.stdout:3/344: creat d9/d3f/f7e x:0 0 0 2024-02-14T13:10:36.763 INFO:tasks.workunit.client.0.smithi012.stdout:9/425: mkdir da/dd/d38/d7e/d91 0 2024-02-14T13:10:36.763 INFO:tasks.workunit.client.0.smithi012.stdout:9/426: fdatasync da/dd/f1b 0 2024-02-14T13:10:36.764 INFO:tasks.workunit.client.0.smithi012.stdout:0/422: symlink d10/d14/d1b/l80 0 2024-02-14T13:10:36.764 INFO:tasks.workunit.client.0.smithi012.stdout:0/423: chown d10/d14/d1b/d30/l5d 0 1 2024-02-14T13:10:36.765 INFO:tasks.workunit.client.0.smithi012.stdout:3/345: mknod d9/d3f/d4e/c7f 0 2024-02-14T13:10:36.766 INFO:tasks.workunit.client.0.smithi012.stdout:9/427: creat da/dd/d39/d8d/f92 x:0 0 0 2024-02-14T13:10:36.767 INFO:tasks.workunit.client.0.smithi012.stdout:0/424: rename d10/d14/d1b/d30/l53 to d10/l81 0 2024-02-14T13:10:36.768 INFO:tasks.workunit.client.0.smithi012.stdout:9/428: mknod da/dd/d18/d71/c93 0 2024-02-14T13:10:36.769 INFO:tasks.workunit.client.0.smithi012.stdout:9/429: write da/d33/d63/f8a [840509,24877] 0 2024-02-14T13:10:36.769 INFO:tasks.workunit.client.0.smithi012.stdout:9/430: chown da/dd/d18/d71/d85/l3a 56508240 1 2024-02-14T13:10:36.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/334: sync 2024-02-14T13:10:36.769 INFO:tasks.workunit.client.0.smithi012.stdout:4/344: sync 2024-02-14T13:10:36.770 INFO:tasks.workunit.client.0.smithi012.stdout:4/345: write d0/d10/f2a [1697749,124460] 0 2024-02-14T13:10:36.770 INFO:tasks.workunit.client.0.smithi012.stdout:8/391: write d9/dc/f19 [6537182,54601] 0 2024-02-14T13:10:36.771 INFO:tasks.workunit.client.0.smithi012.stdout:1/425: dwrite d6/fe [4194304,4194304] 0 2024-02-14T13:10:36.771 INFO:tasks.workunit.client.0.smithi012.stdout:2/449: dwrite d0/d8/d43/f59 [0,4194304] 0 2024-02-14T13:10:36.771 INFO:tasks.workunit.client.0.smithi012.stdout:2/450: write d0/d8/f30 [4484730,74582] 0 2024-02-14T13:10:36.772 INFO:tasks.workunit.client.0.smithi012.stdout:9/431: mknod da/dd/d38/c94 0 2024-02-14T13:10:36.772 INFO:tasks.workunit.client.0.smithi012.stdout:9/432: write da/dd/d57/f41 [1008029,86705] 0 2024-02-14T13:10:36.773 INFO:tasks.workunit.client.0.smithi012.stdout:0/425: dread d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:36.775 INFO:tasks.workunit.client.0.smithi012.stdout:1/426: rename d6/d10/d22/d31/d34/d3b/d5a to d6/d10/d22/d31/d5b/d5e/d65/d87 0 2024-02-14T13:10:36.777 INFO:tasks.workunit.client.0.smithi012.stdout:4/346: link d0/d10/d13/c42 d0/c80 0 2024-02-14T13:10:36.779 INFO:tasks.workunit.client.0.smithi012.stdout:2/451: creat d0/d8/d9/f9a x:0 0 0 2024-02-14T13:10:36.779 INFO:tasks.workunit.client.0.smithi012.stdout:2/452: truncate d0/d6/de/d7b/f7e 285493 0 2024-02-14T13:10:36.780 INFO:tasks.workunit.client.0.smithi012.stdout:9/433: symlink da/dd/d18/d71/d85/d48/l95 0 2024-02-14T13:10:36.780 INFO:tasks.workunit.client.0.smithi012.stdout:9/434: chown da/dd/d57 2 1 2024-02-14T13:10:36.781 INFO:tasks.workunit.client.0.smithi012.stdout:3/346: dread d9/d18/d39/f59 [0,4194304] 0 2024-02-14T13:10:36.781 INFO:tasks.workunit.client.0.smithi012.stdout:7/355: dwrite df/d27/d4b/f6c [0,4194304] 0 2024-02-14T13:10:36.781 INFO:tasks.workunit.client.0.smithi012.stdout:5/388: dwrite dc/d47/d6e/f77 [0,4194304] 0 2024-02-14T13:10:36.781 INFO:tasks.workunit.client.0.smithi012.stdout:5/389: chown f5 279792 1 2024-02-14T13:10:36.781 INFO:tasks.workunit.client.0.smithi012.stdout:1/427: creat d6/d10/d22/d31/d34/f88 x:0 0 0 2024-02-14T13:10:36.782 INFO:tasks.workunit.client.0.smithi012.stdout:2/453: creat d0/d20/d54/f9b x:0 0 0 2024-02-14T13:10:36.783 INFO:tasks.workunit.client.0.smithi012.stdout:2/454: write d0/d5/f42 [3389943,59141] 0 2024-02-14T13:10:36.784 INFO:tasks.workunit.client.0.smithi012.stdout:9/435: creat da/dd/f96 x:0 0 0 2024-02-14T13:10:36.784 INFO:tasks.workunit.client.0.smithi012.stdout:9/436: write f2 [123003,47696] 0 2024-02-14T13:10:36.784 INFO:tasks.workunit.client.0.smithi012.stdout:9/437: write da/dd/d38/d65/f70 [956035,9723] 0 2024-02-14T13:10:36.785 INFO:tasks.workunit.client.0.smithi012.stdout:3/347: symlink d9/d7b/l80 0 2024-02-14T13:10:36.787 INFO:tasks.workunit.client.0.smithi012.stdout:7/356: symlink df/d2d/d5d/l80 0 2024-02-14T13:10:36.787 INFO:tasks.workunit.client.0.smithi012.stdout:7/357: write df/d2d/d57/f75 [446687,116137] 0 2024-02-14T13:10:36.788 INFO:tasks.workunit.client.0.smithi012.stdout:0/426: write d10/d14/d1b/d30/f3f [3446531,99980] 0 2024-02-14T13:10:36.790 INFO:tasks.workunit.client.0.smithi012.stdout:5/390: truncate dc/d17/d20/f37 1249387 0 2024-02-14T13:10:36.790 INFO:tasks.workunit.client.0.smithi012.stdout:5/391: dread - dc/d2f/f74 zero size 2024-02-14T13:10:36.790 INFO:tasks.workunit.client.0.smithi012.stdout:5/392: write dc/d17/f67 [471772,2692] 0 2024-02-14T13:10:36.791 INFO:tasks.workunit.client.0.smithi012.stdout:7/358: dread df/f22 [0,4194304] 0 2024-02-14T13:10:36.792 INFO:tasks.workunit.client.0.smithi012.stdout:1/428: mkdir d6/d10/d22/d31/d34/d89 0 2024-02-14T13:10:36.793 INFO:tasks.workunit.client.0.smithi012.stdout:6/335: dwrite d1/df/d24/f40 [0,4194304] 0 2024-02-14T13:10:36.793 INFO:tasks.workunit.client.0.smithi012.stdout:6/336: fdatasync d1/df/d24/f40 0 2024-02-14T13:10:36.794 INFO:tasks.workunit.client.0.smithi012.stdout:4/347: rename d0/l58 to d0/d10/d13/d17/l81 0 2024-02-14T13:10:36.795 INFO:tasks.workunit.client.0.smithi012.stdout:4/348: write d0/d10/d1f/f20 [2570287,2708] 0 2024-02-14T13:10:36.796 INFO:tasks.workunit.client.0.smithi012.stdout:2/455: rmdir d0/d6/de 39 2024-02-14T13:10:36.796 INFO:tasks.workunit.client.0.smithi012.stdout:8/392: dwrite d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:36.797 INFO:tasks.workunit.client.0.smithi012.stdout:0/427: truncate d10/f13 3652973 0 2024-02-14T13:10:36.801 INFO:tasks.workunit.client.0.smithi012.stdout:7/359: creat df/d27/d4b/d6b/d6d/f81 x:0 0 0 2024-02-14T13:10:36.805 INFO:tasks.workunit.client.0.smithi012.stdout:6/337: rmdir d1/d1e/d1b/d21 39 2024-02-14T13:10:36.808 INFO:tasks.workunit.client.0.smithi012.stdout:9/438: rename da/dd/f1b to da/dd/d57/f97 0 2024-02-14T13:10:36.808 INFO:tasks.workunit.client.0.smithi012.stdout:9/439: stat da/dd/d18/d71/d85/d48/l62 0 2024-02-14T13:10:36.808 INFO:tasks.workunit.client.0.smithi012.stdout:9/440: dread - da/dd/d39/f6b zero size 2024-02-14T13:10:36.808 INFO:tasks.workunit.client.0.smithi012.stdout:9/441: write da/dd/d57/f97 [784649,64126] 0 2024-02-14T13:10:36.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/348: dwrite d9/d13/f20 [4194304,4194304] 0 2024-02-14T13:10:36.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/349: fdatasync d9/d3f/f4c 0 2024-02-14T13:10:36.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/350: write d9/d18/d39/f59 [5024976,34257] 0 2024-02-14T13:10:36.810 INFO:tasks.workunit.client.0.smithi012.stdout:8/393: truncate d9/dc/d38/f60 707525 0 2024-02-14T13:10:36.811 INFO:tasks.workunit.client.0.smithi012.stdout:0/428: creat d10/d14/d41/f82 x:0 0 0 2024-02-14T13:10:36.812 INFO:tasks.workunit.client.0.smithi012.stdout:7/360: mkdir df/d2d/d82 0 2024-02-14T13:10:36.813 INFO:tasks.workunit.client.0.smithi012.stdout:2/456: mkdir d0/d5/d50/d68/d9c 0 2024-02-14T13:10:36.813 INFO:tasks.workunit.client.0.smithi012.stdout:2/457: write d0/d5/d15/f4a [5720874,124225] 0 2024-02-14T13:10:36.813 INFO:tasks.workunit.client.0.smithi012.stdout:1/429: dwrite d6/d10/d22/d31/d5b/d5e/f3f [0,4194304] 0 2024-02-14T13:10:36.814 INFO:tasks.workunit.client.0.smithi012.stdout:6/338: dread d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:36.814 INFO:tasks.workunit.client.0.smithi012.stdout:9/442: dread da/dd/d57/f41 [0,4194304] 0 2024-02-14T13:10:36.815 INFO:tasks.workunit.client.0.smithi012.stdout:3/351: rename d9/d13/f26 to d9/d3f/f81 0 2024-02-14T13:10:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:0/429: creat d10/d14/d1b/d30/f83 x:0 0 0 2024-02-14T13:10:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:0/430: dread - d10/d14/d1b/d30/f7b zero size 2024-02-14T13:10:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/430: dread d6/d10/d22/d31/f40 [0,4194304] 0 2024-02-14T13:10:36.817 INFO:tasks.workunit.client.0.smithi012.stdout:0/431: dread d10/d14/d41/f6a [0,4194304] 0 2024-02-14T13:10:36.818 INFO:tasks.workunit.client.0.smithi012.stdout:7/361: truncate df/d36/f3c 1805191 0 2024-02-14T13:10:36.818 INFO:tasks.workunit.client.0.smithi012.stdout:7/362: stat df/c14 0 2024-02-14T13:10:36.820 INFO:tasks.workunit.client.0.smithi012.stdout:5/393: dwrite dc/d2f/f52 [0,4194304] 0 2024-02-14T13:10:36.820 INFO:tasks.workunit.client.0.smithi012.stdout:5/394: fsync dc/d17/d20/f35 0 2024-02-14T13:10:36.820 INFO:tasks.workunit.client.0.smithi012.stdout:4/349: dwrite d0/d10/d28/f3c [0,4194304] 0 2024-02-14T13:10:36.820 INFO:tasks.workunit.client.0.smithi012.stdout:4/350: stat d0/d10/d13/d17/d5f/f61 0 2024-02-14T13:10:36.823 INFO:tasks.workunit.client.0.smithi012.stdout:3/352: mkdir d9/d3f/d73/d5d/d82 0 2024-02-14T13:10:36.823 INFO:tasks.workunit.client.0.smithi012.stdout:3/353: truncate d9/d3f/d4e/f6d 4345679 0 2024-02-14T13:10:36.826 INFO:tasks.workunit.client.0.smithi012.stdout:1/431: creat d6/d10/d64/f8a x:0 0 0 2024-02-14T13:10:36.828 INFO:tasks.workunit.client.0.smithi012.stdout:0/432: mkdir d10/d84 0 2024-02-14T13:10:36.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/363: creat df/d2d/f83 x:0 0 0 2024-02-14T13:10:36.833 INFO:tasks.workunit.client.0.smithi012.stdout:5/395: mknod dc/c7f 0 2024-02-14T13:10:36.835 INFO:tasks.workunit.client.0.smithi012.stdout:6/339: mkdir d1/d1e/d66 0 2024-02-14T13:10:36.838 INFO:tasks.workunit.client.0.smithi012.stdout:2/458: rename d0/d6/d37/d84/d26/c3c to d0/d1a/c9d 0 2024-02-14T13:10:36.838 INFO:tasks.workunit.client.0.smithi012.stdout:2/459: write d0/d5/d15/f4a [6194545,82477] 0 2024-02-14T13:10:36.838 INFO:tasks.workunit.client.0.smithi012.stdout:8/394: dwrite d9/dc/f19 [0,4194304] 0 2024-02-14T13:10:36.838 INFO:tasks.workunit.client.0.smithi012.stdout:8/395: write d9/dc/d38/d6a/f79 [465579,34259] 0 2024-02-14T13:10:36.838 INFO:tasks.workunit.client.0.smithi012.stdout:8/396: truncate d9/dc/d14/d2e/f44 534692 0 2024-02-14T13:10:36.838 INFO:tasks.workunit.client.0.smithi012.stdout:0/433: dread d10/d14/f2e [4194304,4194304] 0 2024-02-14T13:10:36.844 INFO:tasks.workunit.client.0.smithi012.stdout:1/432: unlink d6/d10/d64/f6f 0 2024-02-14T13:10:36.853 INFO:tasks.workunit.client.0.smithi012.stdout:3/354: rmdir d9/d3f 39 2024-02-14T13:10:36.853 INFO:tasks.workunit.client.0.smithi012.stdout:2/460: dwrite d0/d8/f31 [8388608,4194304] 0 2024-02-14T13:10:36.853 INFO:tasks.workunit.client.0.smithi012.stdout:2/461: truncate d0/f6e 614406 0 2024-02-14T13:10:36.860 INFO:tasks.workunit.client.0.smithi012.stdout:8/397: dwrite d9/dc/d14/f1f [0,4194304] 0 2024-02-14T13:10:36.868 INFO:tasks.workunit.client.0.smithi012.stdout:7/364: mknod df/d27/c84 0 2024-02-14T13:10:36.868 INFO:tasks.workunit.client.0.smithi012.stdout:7/365: chown df/d36/f54 89 1 2024-02-14T13:10:36.868 INFO:tasks.workunit.client.0.smithi012.stdout:7/366: write df/d2d/f50 [696586,94227] 0 2024-02-14T13:10:36.870 INFO:tasks.workunit.client.0.smithi012.stdout:5/396: link dc/d17/d20/f3a dc/f80 0 2024-02-14T13:10:36.870 INFO:tasks.workunit.client.0.smithi012.stdout:3/355: dwrite d9/dd/d30/d44/f29 [0,4194304] 0 2024-02-14T13:10:36.870 INFO:tasks.workunit.client.0.smithi012.stdout:6/340: getdents d1/d1e/d1b/d3e 0 2024-02-14T13:10:36.872 INFO:tasks.workunit.client.0.smithi012.stdout:3/356: dread d9/dd/de/d58/f64 [0,4194304] 0 2024-02-14T13:10:36.873 INFO:tasks.workunit.client.0.smithi012.stdout:9/443: rename da/dd/d19/d30/c15 to da/dd/d19/c98 0 2024-02-14T13:10:36.873 INFO:tasks.workunit.client.0.smithi012.stdout:9/444: chown da/dd/d57/d59/l5f 191 1 2024-02-14T13:10:36.873 INFO:tasks.workunit.client.0.smithi012.stdout:9/445: truncate da/dd/d18/d71/d85/d48/f67 1014798 0 2024-02-14T13:10:36.873 INFO:tasks.workunit.client.0.smithi012.stdout:9/446: readlink l5 0 2024-02-14T13:10:36.874 INFO:tasks.workunit.client.0.smithi012.stdout:0/434: getdents d10/d14/d1b 0 2024-02-14T13:10:36.875 INFO:tasks.workunit.client.0.smithi012.stdout:1/433: creat d6/d10/d22/d31/d34/f8b x:0 0 0 2024-02-14T13:10:36.875 INFO:tasks.workunit.client.0.smithi012.stdout:1/434: write d6/d10/f3a [4836133,51327] 0 2024-02-14T13:10:36.876 INFO:tasks.workunit.client.0.smithi012.stdout:2/462: symlink d0/d6/de/l9e 0 2024-02-14T13:10:36.877 INFO:tasks.workunit.client.0.smithi012.stdout:8/398: truncate d9/dc/d1b/d35/d50/d56/d57/f6c 6161702 0 2024-02-14T13:10:36.879 INFO:tasks.workunit.client.0.smithi012.stdout:5/397: mkdir dc/d17/d20/d4c/d63/d81 0 2024-02-14T13:10:36.884 INFO:tasks.workunit.client.0.smithi012.stdout:3/357: symlink d9/d68/d6a/l83 0 2024-02-14T13:10:36.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/399: write d9/dc/f19 [3261373,59021] 0 2024-02-14T13:10:36.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/400: truncate d9/dc/d38/d6a/f72 624127 0 2024-02-14T13:10:36.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/401: write d9/dc/d1b/d35/d50/d56/f77 [540420,90902] 0 2024-02-14T13:10:36.886 INFO:tasks.workunit.client.0.smithi012.stdout:8/402: write d9/dc/d1b/d35/f78 [659673,88206] 0 2024-02-14T13:10:36.886 INFO:tasks.workunit.client.0.smithi012.stdout:5/398: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:36.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/447: mkdir da/dd/d99 0 2024-02-14T13:10:36.891 INFO:tasks.workunit.client.0.smithi012.stdout:0/435: symlink d10/l85 0 2024-02-14T13:10:36.894 INFO:tasks.workunit.client.0.smithi012.stdout:1/435: unlink d6/d10/d22/d31/d34/d3b/c66 0 2024-02-14T13:10:36.894 INFO:tasks.workunit.client.0.smithi012.stdout:1/436: truncate d6/f84 360290 0 2024-02-14T13:10:36.896 INFO:tasks.workunit.client.0.smithi012.stdout:2/463: creat d0/d5/d50/d68/d9c/f9f x:0 0 0 2024-02-14T13:10:36.896 INFO:tasks.workunit.client.0.smithi012.stdout:2/464: write d0/d8/d11/f17 [2499321,56748] 0 2024-02-14T13:10:36.897 INFO:tasks.workunit.client.0.smithi012.stdout:6/341: symlink d1/l67 0 2024-02-14T13:10:36.899 INFO:tasks.workunit.client.0.smithi012.stdout:3/358: unlink d9/dd/d30/c69 0 2024-02-14T13:10:36.901 INFO:tasks.workunit.client.0.smithi012.stdout:8/403: rename d9/dc/d5b to d9/dc/d1b/d35/d50/d56/d57/d7c 0 2024-02-14T13:10:36.902 INFO:tasks.workunit.client.0.smithi012.stdout:5/399: chown dc/d2f/d3e 9531252 1 2024-02-14T13:10:36.904 INFO:tasks.workunit.client.0.smithi012.stdout:0/436: getdents d10/d14/d20 0 2024-02-14T13:10:36.906 INFO:tasks.workunit.client.0.smithi012.stdout:1/437: creat d6/d35/f8c x:0 0 0 2024-02-14T13:10:36.907 INFO:tasks.workunit.client.0.smithi012.stdout:9/448: dwrite da/dd/d38/d7e/f87 [0,4194304] 0 2024-02-14T13:10:36.908 INFO:tasks.workunit.client.0.smithi012.stdout:2/465: mknod d0/d5/d39/ca0 0 2024-02-14T13:10:36.909 INFO:tasks.workunit.client.0.smithi012.stdout:6/342: creat d1/d17/d5a/f68 x:0 0 0 2024-02-14T13:10:36.911 INFO:tasks.workunit.client.0.smithi012.stdout:3/359: mknod d9/d18/c84 0 2024-02-14T13:10:36.914 INFO:tasks.workunit.client.0.smithi012.stdout:1/438: write d6/d10/d22/d31/d34/f4c [413673,24902] 0 2024-02-14T13:10:36.914 INFO:tasks.workunit.client.0.smithi012.stdout:3/360: write d9/dd/de/d58/f64 [469712,59049] 0 2024-02-14T13:10:36.914 INFO:tasks.workunit.client.0.smithi012.stdout:1/439: read - d6/d10/d64/f8a zero size 2024-02-14T13:10:36.914 INFO:tasks.workunit.client.0.smithi012.stdout:3/361: chown d9/d13/d28/f40 1 1 2024-02-14T13:10:36.914 INFO:tasks.workunit.client.0.smithi012.stdout:3/362: write d9/d3f/f81 [5450522,129083] 0 2024-02-14T13:10:36.914 INFO:tasks.workunit.client.0.smithi012.stdout:8/404: rename d9/dc/d38/d6a/f72 to d9/dc/d1b/d35/f7d 0 2024-02-14T13:10:36.917 INFO:tasks.workunit.client.0.smithi012.stdout:2/466: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:36.921 INFO:tasks.workunit.client.0.smithi012.stdout:0/437: dwrite d10/d14/d2b/f6e [0,4194304] 0 2024-02-14T13:10:36.923 INFO:tasks.workunit.client.0.smithi012.stdout:9/449: rmdir da/dd/d38 39 2024-02-14T13:10:36.923 INFO:tasks.workunit.client.0.smithi012.stdout:9/450: stat da/dd/d57/d59/f6f 0 2024-02-14T13:10:36.925 INFO:tasks.workunit.client.0.smithi012.stdout:6/343: mkdir d1/d1e/d1b/d21/d69 0 2024-02-14T13:10:36.927 INFO:tasks.workunit.client.0.smithi012.stdout:3/363: symlink d9/d3f/d73/d5d/l85 0 2024-02-14T13:10:36.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/440: rename d6/d10/d22/d31/d34/d3b/l85 to d6/d10/d64/l8d 0 2024-02-14T13:10:36.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/441: stat d6/d10/d22/d31/d5b 0 2024-02-14T13:10:36.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/442: dread - d6/d10/d22/d44/f48 zero size 2024-02-14T13:10:36.929 INFO:tasks.workunit.client.0.smithi012.stdout:1/443: stat d6/d10/d22/d31/d5b/d5e/d65 0 2024-02-14T13:10:36.930 INFO:tasks.workunit.client.0.smithi012.stdout:8/405: truncate d9/dc/d14/d2e/f3f 99619 0 2024-02-14T13:10:36.933 INFO:tasks.workunit.client.0.smithi012.stdout:2/467: unlink d0/d20/c94 0 2024-02-14T13:10:36.934 INFO:tasks.workunit.client.0.smithi012.stdout:0/438: dwrite d10/d14/d1b/f3a [0,4194304] 0 2024-02-14T13:10:36.934 INFO:tasks.workunit.client.0.smithi012.stdout:0/439: fsync d10/d14/d2b/d3b/f4f 0 2024-02-14T13:10:36.934 INFO:tasks.workunit.client.0.smithi012.stdout:0/440: chown d10/d14/d41/d52/d67/l70 1900 1 2024-02-14T13:10:36.935 INFO:tasks.workunit.client.0.smithi012.stdout:0/441: write d10/d14/d41/f6a [85010,113929] 0 2024-02-14T13:10:36.935 INFO:tasks.workunit.client.0.smithi012.stdout:9/451: rename da/dd/d39/f3d to da/dd/d39/f9a 0 2024-02-14T13:10:36.937 INFO:tasks.workunit.client.0.smithi012.stdout:6/344: mknod d1/d1e/d1b/d21/d69/c6a 0 2024-02-14T13:10:36.939 INFO:tasks.workunit.client.0.smithi012.stdout:3/364: unlink d9/dd/de/d58/l77 0 2024-02-14T13:10:36.940 INFO:tasks.workunit.client.0.smithi012.stdout:1/444: getdents d6/d10/d22/d31/d5b/d5d/d6d 0 2024-02-14T13:10:36.941 INFO:tasks.workunit.client.0.smithi012.stdout:3/365: dread d9/d18/f55 [0,4194304] 0 2024-02-14T13:10:36.943 INFO:tasks.workunit.client.0.smithi012.stdout:2/468: link d0/d8/d11/d33/d5c/c60 d0/d6/d37/d84/d51/ca1 0 2024-02-14T13:10:36.943 INFO:tasks.workunit.client.0.smithi012.stdout:3/366: dread d9/dd/d30/d34/f54 [0,4194304] 0 2024-02-14T13:10:36.943 INFO:tasks.workunit.client.0.smithi012.stdout:3/367: write d9/d18/d39/f59 [5841307,44058] 0 2024-02-14T13:10:36.945 INFO:tasks.workunit.client.0.smithi012.stdout:0/442: creat d10/d14/d2b/d3b/f86 x:0 0 0 2024-02-14T13:10:36.946 INFO:tasks.workunit.client.0.smithi012.stdout:6/345: symlink d1/df/d24/d3f/d56/l6b 0 2024-02-14T13:10:36.947 INFO:tasks.workunit.client.0.smithi012.stdout:1/445: mknod d6/d10/d22/d31/d34/d89/c8e 0 2024-02-14T13:10:36.947 INFO:tasks.workunit.client.0.smithi012.stdout:1/446: stat d6/d10/d22/d31/d5b/d5d/d6d 0 2024-02-14T13:10:36.948 INFO:tasks.workunit.client.0.smithi012.stdout:2/469: symlink d0/d5/d15/d57/d6d/la2 0 2024-02-14T13:10:36.948 INFO:tasks.workunit.client.0.smithi012.stdout:0/443: getdents d10/d14/d51 0 2024-02-14T13:10:36.950 INFO:tasks.workunit.client.0.smithi012.stdout:0/444: mknod d10/d14/d20/d21/c87 0 2024-02-14T13:10:36.952 INFO:tasks.workunit.client.0.smithi012.stdout:6/346: rename d1/d1e/l60 to d1/l6c 0 2024-02-14T13:10:36.952 INFO:tasks.workunit.client.0.smithi012.stdout:3/368: dread d9/d13/f2b [0,4194304] 0 2024-02-14T13:10:36.953 INFO:tasks.workunit.client.0.smithi012.stdout:0/445: mknod d10/d14/d20/d21/d7f/c88 0 2024-02-14T13:10:36.954 INFO:tasks.workunit.client.0.smithi012.stdout:4/351: sync 2024-02-14T13:10:36.954 INFO:tasks.workunit.client.0.smithi012.stdout:2/470: rename d0/d5/d50/l79 to d0/d6/d37/d84/d26/d7a/la3 0 2024-02-14T13:10:36.954 INFO:tasks.workunit.client.0.smithi012.stdout:4/352: write d0/d10/d28/d4f/f7a [747223,129598] 0 2024-02-14T13:10:36.955 INFO:tasks.workunit.client.0.smithi012.stdout:8/406: dwrite d9/dc/d14/d23/f41 [0,4194304] 0 2024-02-14T13:10:36.955 INFO:tasks.workunit.client.0.smithi012.stdout:8/407: write d9/dc/d1b/d35/d50/d56/d57/d7c/f69 [1980963,84306] 0 2024-02-14T13:10:36.955 INFO:tasks.workunit.client.0.smithi012.stdout:9/452: dwrite da/dd/d57/f41 [0,4194304] 0 2024-02-14T13:10:36.955 INFO:tasks.workunit.client.0.smithi012.stdout:6/347: mkdir d1/d1e/d1b/d6d 0 2024-02-14T13:10:36.959 INFO:tasks.workunit.client.0.smithi012.stdout:2/471: getdents d0/d8 0 2024-02-14T13:10:36.962 INFO:tasks.workunit.client.0.smithi012.stdout:0/446: rename d10/d14/d2b/d3b/f50 to d10/d14/d41/f89 0 2024-02-14T13:10:36.963 INFO:tasks.workunit.client.0.smithi012.stdout:4/353: mkdir d0/d10/d13/d17/d5f/d82 0 2024-02-14T13:10:36.964 INFO:tasks.workunit.client.0.smithi012.stdout:1/447: dwrite d6/d10/d22/d31/d5b/d5d/d6d/f72 [0,4194304] 0 2024-02-14T13:10:36.967 INFO:tasks.workunit.client.0.smithi012.stdout:9/453: symlink da/dd/d18/l9b 0 2024-02-14T13:10:36.967 INFO:tasks.workunit.client.0.smithi012.stdout:9/454: dread - da/dd/d39/f6b zero size 2024-02-14T13:10:36.968 INFO:tasks.workunit.client.0.smithi012.stdout:3/369: getdents d9/dd/de/d58 0 2024-02-14T13:10:36.969 INFO:tasks.workunit.client.0.smithi012.stdout:3/370: getdents d9/dd/d30/d34/d75 0 2024-02-14T13:10:36.969 INFO:tasks.workunit.client.0.smithi012.stdout:6/348: getdents d1/d1e/dc/d28 0 2024-02-14T13:10:36.975 INFO:tasks.workunit.client.0.smithi012.stdout:2/472: symlink d0/d5/d15/la4 0 2024-02-14T13:10:36.975 INFO:tasks.workunit.client.0.smithi012.stdout:2/473: write d0/d8/d43/f59 [5109001,120368] 0 2024-02-14T13:10:36.978 INFO:tasks.workunit.client.0.smithi012.stdout:0/447: creat d10/d14/d1b/f8a x:0 0 0 2024-02-14T13:10:36.985 INFO:tasks.workunit.client.0.smithi012.stdout:4/354: rename d0/d10/d13 to d0/d10/d28/d4f/d6b/d83 0 2024-02-14T13:10:36.986 INFO:tasks.workunit.client.0.smithi012.stdout:9/455: creat da/dd/d57/f9c x:0 0 0 2024-02-14T13:10:36.988 INFO:tasks.workunit.client.0.smithi012.stdout:3/371: creat d9/d3f/d73/f86 x:0 0 0 2024-02-14T13:10:36.989 INFO:tasks.workunit.client.0.smithi012.stdout:6/349: symlink d1/df/d24/l6e 0 2024-02-14T13:10:36.989 INFO:tasks.workunit.client.0.smithi012.stdout:6/350: chown d1/df/d24 11191424 1 2024-02-14T13:10:36.990 INFO:tasks.workunit.client.0.smithi012.stdout:0/448: creat d10/d14/d41/d52/d67/f8b x:0 0 0 2024-02-14T13:10:36.992 INFO:tasks.workunit.client.0.smithi012.stdout:1/448: rename d6/d10/d22/d31/d34/f4c to d6/d10/d22/d31/f8f 0 2024-02-14T13:10:36.993 INFO:tasks.workunit.client.0.smithi012.stdout:9/456: getdents da/dd/d57/d59/d73 0 2024-02-14T13:10:36.993 INFO:tasks.workunit.client.0.smithi012.stdout:9/457: readlink da/l7b 0 2024-02-14T13:10:36.994 INFO:tasks.workunit.client.0.smithi012.stdout:6/351: rmdir d1/d1e/dc/d38 39 2024-02-14T13:10:36.998 INFO:tasks.workunit.client.0.smithi012.stdout:0/449: dread d10/d14/d20/f37 [0,4194304] 0 2024-02-14T13:10:36.998 INFO:tasks.workunit.client.0.smithi012.stdout:3/372: rename d9/dd/d30/d34/f54 to d9/d3f/f87 0 2024-02-14T13:10:36.999 INFO:tasks.workunit.client.0.smithi012.stdout:1/449: mknod d6/d10/d22/d31/d5b/d5d/d80/c90 0 2024-02-14T13:10:37.000 INFO:tasks.workunit.client.0.smithi012.stdout:3/373: dread d9/d13/d28/f36 [0,4194304] 0 2024-02-14T13:10:37.000 INFO:tasks.workunit.client.0.smithi012.stdout:6/352: mknod d1/d17/c6f 0 2024-02-14T13:10:37.001 INFO:tasks.workunit.client.0.smithi012.stdout:6/353: dread d1/d17/d5a/f5c [0,4194304] 0 2024-02-14T13:10:37.002 INFO:tasks.workunit.client.0.smithi012.stdout:1/450: symlink d6/d10/d22/d31/d5b/d5d/d6d/l91 0 2024-02-14T13:10:37.003 INFO:tasks.workunit.client.0.smithi012.stdout:3/374: mkdir d9/d3f/d88 0 2024-02-14T13:10:37.004 INFO:tasks.workunit.client.0.smithi012.stdout:6/354: rename d1/d1e/dc/d28/l62 to d1/d1e/dc/d38/l70 0 2024-02-14T13:10:37.004 INFO:tasks.workunit.client.0.smithi012.stdout:0/450: write d10/d14/d1b/f3a [1894176,22048] 0 2024-02-14T13:10:37.005 INFO:tasks.workunit.client.0.smithi012.stdout:6/355: dread d1/d1e/dc/f1d [0,4194304] 0 2024-02-14T13:10:37.006 INFO:tasks.workunit.client.0.smithi012.stdout:1/451: link d6/d10/d22/d31/d5b/d5d/f55 d6/d10/d22/d31/d34/d58/f92 0 2024-02-14T13:10:37.007 INFO:tasks.workunit.client.0.smithi012.stdout:3/375: mknod d9/dd/c89 0 2024-02-14T13:10:37.007 INFO:tasks.workunit.client.0.smithi012.stdout:3/376: dread - d9/dd/de/d58/d65/d6c/f7c zero size 2024-02-14T13:10:37.008 INFO:tasks.workunit.client.0.smithi012.stdout:0/451: rename d10/d14/d20/d21 to d10/d14/d41/d52/d78/d8c 0 2024-02-14T13:10:37.008 INFO:tasks.workunit.client.0.smithi012.stdout:0/452: chown d10/d14/d1b/d30/l5d 68 1 2024-02-14T13:10:37.010 INFO:tasks.workunit.client.0.smithi012.stdout:1/452: creat d6/d10/d22/d31/d34/d58/d61/f93 x:0 0 0 2024-02-14T13:10:37.011 INFO:tasks.workunit.client.0.smithi012.stdout:3/377: symlink d9/d18/d39/l8a 0 2024-02-14T13:10:37.012 INFO:tasks.workunit.client.0.smithi012.stdout:0/453: symlink d10/d14/d20/d49/l8d 0 2024-02-14T13:10:37.012 INFO:tasks.workunit.client.0.smithi012.stdout:7/367: sync 2024-02-14T13:10:37.013 INFO:tasks.workunit.client.0.smithi012.stdout:9/458: dwrite da/f44 [0,4194304] 0 2024-02-14T13:10:37.013 INFO:tasks.workunit.client.0.smithi012.stdout:6/356: symlink d1/l71 0 2024-02-14T13:10:37.013 INFO:tasks.workunit.client.0.smithi012.stdout:6/357: write d1/d1e/dc/d28/f2d [1527785,103110] 0 2024-02-14T13:10:37.013 INFO:tasks.workunit.client.0.smithi012.stdout:6/358: chown d1/df/d24/f40 216268218 1 2024-02-14T13:10:37.014 INFO:tasks.workunit.client.0.smithi012.stdout:1/453: rmdir d6/d10/d22/d31/d34/d58 39 2024-02-14T13:10:37.014 INFO:tasks.workunit.client.0.smithi012.stdout:6/359: read d1/d17/d5a/f5c [296094,35480] 0 2024-02-14T13:10:37.014 INFO:tasks.workunit.client.0.smithi012.stdout:3/378: readlink d9/dd/d30/d34/l43 0 2024-02-14T13:10:37.014 INFO:tasks.workunit.client.0.smithi012.stdout:3/379: write d9/d13/d28/f36 [609025,34412] 0 2024-02-14T13:10:37.014 INFO:tasks.workunit.client.0.smithi012.stdout:3/380: readlink d9/dd/d30/d44/d3d/l45 0 2024-02-14T13:10:37.015 INFO:tasks.workunit.client.0.smithi012.stdout:7/368: mkdir df/d27/d4b/d6b/d6d/d85 0 2024-02-14T13:10:37.016 INFO:tasks.workunit.client.0.smithi012.stdout:9/459: mkdir da/dd/d19/d30/d9d 0 2024-02-14T13:10:37.016 INFO:tasks.workunit.client.0.smithi012.stdout:1/454: mkdir d6/d10/d22/d31/d5b/d94 0 2024-02-14T13:10:37.017 INFO:tasks.workunit.client.0.smithi012.stdout:6/360: mknod d1/d1e/dc/c72 0 2024-02-14T13:10:37.017 INFO:tasks.workunit.client.0.smithi012.stdout:6/361: truncate d1/d1e/dc/f1d 662353 0 2024-02-14T13:10:37.017 INFO:tasks.workunit.client.0.smithi012.stdout:6/362: fsync d1/d17/d5a/f5c 0 2024-02-14T13:10:37.017 INFO:tasks.workunit.client.0.smithi012.stdout:6/363: rename d1/d1e/d1b/d21/d69 to d1/d1e/d1b/d21/d69/d73 22 2024-02-14T13:10:37.017 INFO:tasks.workunit.client.0.smithi012.stdout:3/381: stat d9/dd/d30/d34/l3a 0 2024-02-14T13:10:37.018 INFO:tasks.workunit.client.0.smithi012.stdout:9/460: unlink da/dd/c46 0 2024-02-14T13:10:37.019 INFO:tasks.workunit.client.0.smithi012.stdout:1/455: unlink d6/f84 0 2024-02-14T13:10:37.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/364: mkdir d1/d1e/dc/d38/d74 0 2024-02-14T13:10:37.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/365: stat d1/d1e/dc/d28/f64 0 2024-02-14T13:10:37.021 INFO:tasks.workunit.client.0.smithi012.stdout:3/382: creat d9/d3f/d73/d5d/f8b x:0 0 0 2024-02-14T13:10:37.021 INFO:tasks.workunit.client.0.smithi012.stdout:9/461: creat da/dd/d39/f9e x:0 0 0 2024-02-14T13:10:37.022 INFO:tasks.workunit.client.0.smithi012.stdout:6/366: mkdir d1/d1e/dc/d43/d75 0 2024-02-14T13:10:37.022 INFO:tasks.workunit.client.0.smithi012.stdout:6/367: write d1/d1e/dc/f2e [1697696,125672] 0 2024-02-14T13:10:37.023 INFO:tasks.workunit.client.0.smithi012.stdout:9/462: creat da/dd/d19/d30/d9d/f9f x:0 0 0 2024-02-14T13:10:37.024 INFO:tasks.workunit.client.0.smithi012.stdout:6/368: creat d1/df/d24/d3f/d56/f76 x:0 0 0 2024-02-14T13:10:37.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/463: rmdir da/dd/d18/d5a 0 2024-02-14T13:10:37.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/464: dread - da/dd/f2b zero size 2024-02-14T13:10:37.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/465: chown da/dd/d38/l79 20501735 1 2024-02-14T13:10:37.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/466: stat da/dd/d39 0 2024-02-14T13:10:37.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/467: stat da/dd/d19/d30/f81 0 2024-02-14T13:10:37.026 INFO:tasks.workunit.client.0.smithi012.stdout:3/383: write d9/d3f/f41 [1723965,63825] 0 2024-02-14T13:10:37.027 INFO:tasks.workunit.client.0.smithi012.stdout:9/468: mknod da/dd/d38/d7e/ca0 0 2024-02-14T13:10:37.028 INFO:tasks.workunit.client.0.smithi012.stdout:9/469: mknod da/dd/d18/d71/ca1 0 2024-02-14T13:10:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/470: creat da/dd/d19/d30/d9d/fa2 x:0 0 0 2024-02-14T13:10:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/471: truncate da/dd/d19/d30/d9d/f9f 361643 0 2024-02-14T13:10:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/472: fsync f8 0 2024-02-14T13:10:37.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/473: fsync da/dd/f96 0 2024-02-14T13:10:37.031 INFO:tasks.workunit.client.0.smithi012.stdout:9/474: read da/dd/f5d [29016,50662] 0 2024-02-14T13:10:37.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/369: dwrite df/d24/d56/f64 [0,4194304] 0 2024-02-14T13:10:37.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/370: truncate df/d2d/d57/f75 1275293 0 2024-02-14T13:10:37.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/371: dread - df/d24/f38 zero size 2024-02-14T13:10:37.038 INFO:tasks.workunit.client.0.smithi012.stdout:7/372: readlink df/d27/l7f 0 2024-02-14T13:10:37.038 INFO:tasks.workunit.client.0.smithi012.stdout:0/454: dwrite d10/d14/d20/f37 [4194304,4194304] 0 2024-02-14T13:10:37.040 INFO:tasks.workunit.client.0.smithi012.stdout:7/373: creat df/d2d/d5d/d72/d78/f86 x:0 0 0 2024-02-14T13:10:37.043 INFO:tasks.workunit.client.0.smithi012.stdout:7/374: creat df/d24/f87 x:0 0 0 2024-02-14T13:10:37.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/375: mkdir df/d2d/d82/d88 0 2024-02-14T13:10:37.044 INFO:tasks.workunit.client.0.smithi012.stdout:7/376: truncate df/d36/f39 785048 0 2024-02-14T13:10:37.045 INFO:tasks.workunit.client.0.smithi012.stdout:7/377: truncate df/d24/f29 3464823 0 2024-02-14T13:10:37.046 INFO:tasks.workunit.client.0.smithi012.stdout:7/378: symlink df/d36/d67/l89 0 2024-02-14T13:10:37.047 INFO:tasks.workunit.client.0.smithi012.stdout:7/379: mkdir df/d2d/d5d/d72/d8a 0 2024-02-14T13:10:37.047 INFO:tasks.workunit.client.0.smithi012.stdout:7/380: chown df/d27/d4b/d6b/d6d/f81 11 1 2024-02-14T13:10:37.047 INFO:tasks.workunit.client.0.smithi012.stdout:7/381: readlink df/d27/l7f 0 2024-02-14T13:10:37.053 INFO:tasks.workunit.client.0.smithi012.stdout:1/456: dwrite d6/d10/d22/d44/f48 [0,4194304] 0 2024-02-14T13:10:37.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/384: dwrite d9/f35 [4194304,4194304] 0 2024-02-14T13:10:37.055 INFO:tasks.workunit.client.0.smithi012.stdout:9/475: dwrite da/dd/f2a [0,4194304] 0 2024-02-14T13:10:37.055 INFO:tasks.workunit.client.0.smithi012.stdout:9/476: write da/dd/d39/d8d/f92 [433218,94001] 0 2024-02-14T13:10:37.056 INFO:tasks.workunit.client.0.smithi012.stdout:1/457: creat d6/d10/d22/d31/d3e/d71/f95 x:0 0 0 2024-02-14T13:10:37.056 INFO:tasks.workunit.client.0.smithi012.stdout:6/369: dwrite d1/d1e/dc/f2e [0,4194304] 0 2024-02-14T13:10:37.056 INFO:tasks.workunit.client.0.smithi012.stdout:1/458: chown d6/d10/d22/l28 0 1 2024-02-14T13:10:37.056 INFO:tasks.workunit.client.0.smithi012.stdout:6/370: write d1/d1e/d1b/d21/f32 [1531715,42119] 0 2024-02-14T13:10:37.058 INFO:tasks.workunit.client.0.smithi012.stdout:3/385: dread d9/d3f/f41 [0,4194304] 0 2024-02-14T13:10:37.058 INFO:tasks.workunit.client.0.smithi012.stdout:3/386: chown d9/dd/d30/d34 0 1 2024-02-14T13:10:37.060 INFO:tasks.workunit.client.0.smithi012.stdout:1/459: rename d6/d10/d22/d31/d34/d3b/c78 to d6/d10/d22/d31/d34/d3b/c96 0 2024-02-14T13:10:37.060 INFO:tasks.workunit.client.0.smithi012.stdout:1/460: chown d6/d35 314641538 1 2024-02-14T13:10:37.064 INFO:tasks.workunit.client.0.smithi012.stdout:1/461: creat d6/d10/d22/d31/d5b/d5e/d65/d87/f97 x:0 0 0 2024-02-14T13:10:37.064 INFO:tasks.workunit.client.0.smithi012.stdout:1/462: write d6/d10/d22/d44/f52 [315104,22736] 0 2024-02-14T13:10:37.066 INFO:tasks.workunit.client.0.smithi012.stdout:7/382: dwrite df/d36/f3a [0,4194304] 0 2024-02-14T13:10:37.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/463: unlink d6/d10/d22/d31/d5b/d5d/f2d 0 2024-02-14T13:10:37.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/464: chown d6/d10/f4a 1308 1 2024-02-14T13:10:37.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/465: write d6/d10/d22/d31/d5b/d5d/f6e [713525,29859] 0 2024-02-14T13:10:37.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/466: chown d6/f1b 12 1 2024-02-14T13:10:37.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/467: write d6/d35/f67 [589203,16807] 0 2024-02-14T13:10:37.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/468: dread - d6/d10/d22/d31/f74 zero size 2024-02-14T13:10:37.069 INFO:tasks.workunit.client.0.smithi012.stdout:7/383: dread df/f11 [0,4194304] 0 2024-02-14T13:10:37.080 INFO:tasks.workunit.client.0.smithi012.stdout:6/371: dwrite d1/d1e/dc/d43/f63 [0,4194304] 0 2024-02-14T13:10:37.081 INFO:tasks.workunit.client.0.smithi012.stdout:9/477: dwrite da/dd/d39/f9a [0,4194304] 0 2024-02-14T13:10:37.081 INFO:tasks.workunit.client.0.smithi012.stdout:9/478: dread - da/dd/d57/d59/f6f zero size 2024-02-14T13:10:37.087 INFO:tasks.workunit.client.0.smithi012.stdout:3/387: truncate d9/d13/d28/f36 80289 0 2024-02-14T13:10:37.089 INFO:tasks.workunit.client.0.smithi012.stdout:3/388: symlink d9/dd/d30/d34/l8c 0 2024-02-14T13:10:37.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/372: write d1/d17/f53 [1132348,99224] 0 2024-02-14T13:10:37.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/373: chown d1/df/d24/d3f/d56 482 1 2024-02-14T13:10:37.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/374: chown d1/df/d16/l3b 9 1 2024-02-14T13:10:37.096 INFO:tasks.workunit.client.0.smithi012.stdout:1/469: dwrite d6/d10/d22/d31/f8f [0,4194304] 0 2024-02-14T13:10:37.101 INFO:tasks.workunit.client.0.smithi012.stdout:7/384: dwrite df/f15 [0,4194304] 0 2024-02-14T13:10:37.101 INFO:tasks.workunit.client.0.smithi012.stdout:7/385: stat df/d36/f46 0 2024-02-14T13:10:37.102 INFO:tasks.workunit.client.0.smithi012.stdout:1/470: rename d6/d10/d22/d44/c5f to d6/d10/d22/d31/c98 0 2024-02-14T13:10:37.102 INFO:tasks.workunit.client.0.smithi012.stdout:1/471: dread - d6/d10/d22/d31/d3e/d71/f95 zero size 2024-02-14T13:10:37.102 INFO:tasks.workunit.client.0.smithi012.stdout:1/472: readlink d6/d10/d22/d31/d5b/d5d/l2f 0 2024-02-14T13:10:37.104 INFO:tasks.workunit.client.0.smithi012.stdout:3/389: write d9/d18/f4d [3974922,85116] 0 2024-02-14T13:10:37.107 INFO:tasks.workunit.client.0.smithi012.stdout:7/386: rename df/d36/d67/c69 to df/d36/c8b 0 2024-02-14T13:10:37.108 INFO:tasks.workunit.client.0.smithi012.stdout:7/387: fsync df/d24/f31 0 2024-02-14T13:10:37.109 INFO:tasks.workunit.client.0.smithi012.stdout:7/388: write df/d2d/d57/f75 [149159,61696] 0 2024-02-14T13:10:37.109 INFO:tasks.workunit.client.0.smithi012.stdout:7/389: dread - df/d24/d56/f60 zero size 2024-02-14T13:10:37.109 INFO:tasks.workunit.client.0.smithi012.stdout:5/400: sync 2024-02-14T13:10:37.109 INFO:tasks.workunit.client.0.smithi012.stdout:5/401: write dc/d17/f24 [2187199,22882] 0 2024-02-14T13:10:37.110 INFO:tasks.workunit.client.0.smithi012.stdout:1/473: link d6/d10/d22/d31/d34/f8b d6/d10/f99 0 2024-02-14T13:10:37.110 INFO:tasks.workunit.client.0.smithi012.stdout:1/474: fdatasync d6/d10/d22/d44/f7c 0 2024-02-14T13:10:37.112 INFO:tasks.workunit.client.0.smithi012.stdout:7/390: symlink df/l8c 0 2024-02-14T13:10:37.113 INFO:tasks.workunit.client.0.smithi012.stdout:5/402: truncate dc/f80 2474563 0 2024-02-14T13:10:37.113 INFO:tasks.workunit.client.0.smithi012.stdout:5/403: readlink dc/d47/l56 0 2024-02-14T13:10:37.114 INFO:tasks.workunit.client.0.smithi012.stdout:1/475: creat d6/d10/d22/d31/d34/d58/f9a x:0 0 0 2024-02-14T13:10:37.115 INFO:tasks.workunit.client.0.smithi012.stdout:6/375: dwrite d1/df/f48 [0,4194304] 0 2024-02-14T13:10:37.115 INFO:tasks.workunit.client.0.smithi012.stdout:6/376: read - d1/d1e/d1b/f5d zero size 2024-02-14T13:10:37.115 INFO:tasks.workunit.client.0.smithi012.stdout:7/391: mkdir df/d27/d4b/d8d 0 2024-02-14T13:10:37.117 INFO:tasks.workunit.client.0.smithi012.stdout:5/404: link dc/d17/d20/l44 dc/d47/d59/d6a/l82 0 2024-02-14T13:10:37.117 INFO:tasks.workunit.client.0.smithi012.stdout:9/479: dwrite da/dd/d19/d30/f1f [0,4194304] 0 2024-02-14T13:10:37.119 INFO:tasks.workunit.client.0.smithi012.stdout:7/392: truncate df/f59 2046812 0 2024-02-14T13:10:37.120 INFO:tasks.workunit.client.0.smithi012.stdout:1/476: write d6/d10/d22/d31/d5b/d5d/f76 [508279,98791] 0 2024-02-14T13:10:37.120 INFO:tasks.workunit.client.0.smithi012.stdout:1/477: fsync d6/fe 0 2024-02-14T13:10:37.120 INFO:tasks.workunit.client.0.smithi012.stdout:5/405: creat dc/d17/d20/d4c/d58/f83 x:0 0 0 2024-02-14T13:10:37.121 INFO:tasks.workunit.client.0.smithi012.stdout:1/478: dread d6/d10/d22/d31/d5b/d5e/d3d/f51 [0,4194304] 0 2024-02-14T13:10:37.122 INFO:tasks.workunit.client.0.smithi012.stdout:4/355: sync 2024-02-14T13:10:37.122 INFO:tasks.workunit.client.0.smithi012.stdout:2/474: sync 2024-02-14T13:10:37.123 INFO:tasks.workunit.client.0.smithi012.stdout:2/475: chown d0/d8/f31 17 1 2024-02-14T13:10:37.123 INFO:tasks.workunit.client.0.smithi012.stdout:8/408: sync 2024-02-14T13:10:37.123 INFO:tasks.workunit.client.0.smithi012.stdout:8/409: chown d9/dc/d1b/d35/d50/d56/d57/f6c 3567 1 2024-02-14T13:10:37.123 INFO:tasks.workunit.client.0.smithi012.stdout:3/390: dwrite d9/dd/d30/d34/f51 [0,4194304] 0 2024-02-14T13:10:37.123 INFO:tasks.workunit.client.0.smithi012.stdout:3/391: readlink d9/l57 0 2024-02-14T13:10:37.125 INFO:tasks.workunit.client.0.smithi012.stdout:9/480: rename da/dd/d19/f7f to da/dd/d39/fa3 0 2024-02-14T13:10:37.126 INFO:tasks.workunit.client.0.smithi012.stdout:4/356: link d0/d10/c6e d0/d10/d28/d4f/d6b/d83/c84 0 2024-02-14T13:10:37.126 INFO:tasks.workunit.client.0.smithi012.stdout:6/377: write d1/df/d24/f40 [491830,14474] 0 2024-02-14T13:10:37.128 INFO:tasks.workunit.client.0.smithi012.stdout:2/476: mkdir d0/d6/d37/da5 0 2024-02-14T13:10:37.129 INFO:tasks.workunit.client.0.smithi012.stdout:8/410: truncate d9/dc/d14/d23/f41 4102713 0 2024-02-14T13:10:37.129 INFO:tasks.workunit.client.0.smithi012.stdout:8/411: write d9/dc/d14/f1f [4293698,116799] 0 2024-02-14T13:10:37.132 INFO:tasks.workunit.client.0.smithi012.stdout:7/393: rename df/d36/f54 to df/d27/d4b/f8e 0 2024-02-14T13:10:37.135 INFO:tasks.workunit.client.0.smithi012.stdout:2/477: symlink d0/d5/d15/la6 0 2024-02-14T13:10:37.135 INFO:tasks.workunit.client.0.smithi012.stdout:2/478: fsync d0/d6/d37/d84/d26/d7a/f8d 0 2024-02-14T13:10:37.136 INFO:tasks.workunit.client.0.smithi012.stdout:8/412: creat d9/dc/d38/d6a/f7e x:0 0 0 2024-02-14T13:10:37.137 INFO:tasks.workunit.client.0.smithi012.stdout:6/378: write d1/d1e/dc/d43/f63 [3575663,83030] 0 2024-02-14T13:10:37.139 INFO:tasks.workunit.client.0.smithi012.stdout:9/481: rename da/dd/d57/d59/l5f to da/dd/la4 0 2024-02-14T13:10:37.139 INFO:tasks.workunit.client.0.smithi012.stdout:9/482: dread - da/dd/d57/f9c zero size 2024-02-14T13:10:37.140 INFO:tasks.workunit.client.0.smithi012.stdout:8/413: truncate d9/dc/d1b/d35/d50/d56/f77 227488 0 2024-02-14T13:10:37.144 INFO:tasks.workunit.client.0.smithi012.stdout:4/357: rename d0/d10/d28/d4f/c57 to d0/d10/d28/d62/c85 0 2024-02-14T13:10:37.147 INFO:tasks.workunit.client.0.smithi012.stdout:7/394: rename df/d2d/d5d/f76 to df/d27/d4b/f8f 0 2024-02-14T13:10:37.149 INFO:tasks.workunit.client.0.smithi012.stdout:4/358: mkdir d0/d10/d1f/d3e/d63/d86 0 2024-02-14T13:10:37.151 INFO:tasks.workunit.client.0.smithi012.stdout:5/406: dwrite dc/f15 [0,4194304] 0 2024-02-14T13:10:37.151 INFO:tasks.workunit.client.0.smithi012.stdout:3/392: dwrite d9/dd/d30/d44/f4b [8388608,4194304] 0 2024-02-14T13:10:37.152 INFO:tasks.workunit.client.0.smithi012.stdout:9/483: write da/dd/d39/f9a [3965614,57110] 0 2024-02-14T13:10:37.152 INFO:tasks.workunit.client.0.smithi012.stdout:1/479: dwrite d6/d10/d22/d31/d5b/d5d/d6d/f7d [0,4194304] 0 2024-02-14T13:10:37.153 INFO:tasks.workunit.client.0.smithi012.stdout:0/455: sync 2024-02-14T13:10:37.153 INFO:tasks.workunit.client.0.smithi012.stdout:0/456: chown d10/d14/d41/d52/d67 2288 1 2024-02-14T13:10:37.153 INFO:tasks.workunit.client.0.smithi012.stdout:0/457: dread - d10/d14/d41/d52/d78/d8c/f35 zero size 2024-02-14T13:10:37.153 INFO:tasks.workunit.client.0.smithi012.stdout:5/407: rename dc/d17/d20/l3d to dc/d17/d20/d4c/d7b/l84 0 2024-02-14T13:10:37.156 INFO:tasks.workunit.client.0.smithi012.stdout:3/393: truncate d9/dd/f4a 224414 0 2024-02-14T13:10:37.156 INFO:tasks.workunit.client.0.smithi012.stdout:3/394: getdents d9/dd/d30/d34/d78 0 2024-02-14T13:10:37.156 INFO:tasks.workunit.client.0.smithi012.stdout:3/395: dread - d9/d3f/f7e zero size 2024-02-14T13:10:37.157 INFO:tasks.workunit.client.0.smithi012.stdout:6/379: dwrite d1/df/d16/f59 [0,4194304] 0 2024-02-14T13:10:37.160 INFO:tasks.workunit.client.0.smithi012.stdout:1/480: mkdir d6/d10/d22/d31/d5b/d5e/d65/d87/d9b 0 2024-02-14T13:10:37.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/458: truncate d10/d14/d2b/d3b/f4d 2728510 0 2024-02-14T13:10:37.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/459: read d10/d14/d41/f89 [2755885,70809] 0 2024-02-14T13:10:37.163 INFO:tasks.workunit.client.0.smithi012.stdout:0/460: chown d10/d14/c5b 8286 1 2024-02-14T13:10:37.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/408: symlink dc/d17/d20/d4c/d7b/l85 0 2024-02-14T13:10:37.165 INFO:tasks.workunit.client.0.smithi012.stdout:5/409: chown dc/d47/d6e 1 1 2024-02-14T13:10:37.165 INFO:tasks.workunit.client.0.smithi012.stdout:5/410: write dc/d2f/f75 [888038,79925] 0 2024-02-14T13:10:37.165 INFO:tasks.workunit.client.0.smithi012.stdout:5/411: truncate dc/d17/d20/d4c/d58/f68 56283 0 2024-02-14T13:10:37.165 INFO:tasks.workunit.client.0.smithi012.stdout:5/412: chown dc/l1c 508490 1 2024-02-14T13:10:37.167 INFO:tasks.workunit.client.0.smithi012.stdout:8/414: dwrite d9/dc/f2c [4194304,4194304] 0 2024-02-14T13:10:37.169 INFO:tasks.workunit.client.0.smithi012.stdout:9/484: dwrite da/dd/d38/d65/f70 [0,4194304] 0 2024-02-14T13:10:37.169 INFO:tasks.workunit.client.0.smithi012.stdout:9/485: fsync da/dd/f2a 0 2024-02-14T13:10:37.174 INFO:tasks.workunit.client.0.smithi012.stdout:6/380: write d1/d1e/dc/f2e [3871040,30537] 0 2024-02-14T13:10:37.174 INFO:tasks.workunit.client.0.smithi012.stdout:6/381: chown d1/df/d24/f36 7752833 1 2024-02-14T13:10:37.176 INFO:tasks.workunit.client.0.smithi012.stdout:1/481: link d6/d10/l4e d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/l9c 0 2024-02-14T13:10:37.178 INFO:tasks.workunit.client.0.smithi012.stdout:0/461: mkdir d10/d14/d1b/d8e 0 2024-02-14T13:10:37.178 INFO:tasks.workunit.client.0.smithi012.stdout:0/462: fdatasync d10/d14/d2b/d3b/f86 0 2024-02-14T13:10:37.178 INFO:tasks.workunit.client.0.smithi012.stdout:0/463: readlink d10/d14/d1b/d30/l3d 0 2024-02-14T13:10:37.178 INFO:tasks.workunit.client.0.smithi012.stdout:0/464: fdatasync d10/d14/d1b/f3a 0 2024-02-14T13:10:37.178 INFO:tasks.workunit.client.0.smithi012.stdout:0/465: fsync d10/d14/d2b/f6e 0 2024-02-14T13:10:37.179 INFO:tasks.workunit.client.0.smithi012.stdout:8/415: mknod d9/dc/d38/d6a/c7f 0 2024-02-14T13:10:37.181 INFO:tasks.workunit.client.0.smithi012.stdout:9/486: rename da/dd/d19/c98 to da/dd/d57/d59/d73/ca5 0 2024-02-14T13:10:37.181 INFO:tasks.workunit.client.0.smithi012.stdout:9/487: readlink da/dd/d19/d30/d45/l8e 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/413: dwrite dc/f15 [4194304,4194304] 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/414: chown dc/d2f/d40/d53/c57 1 1 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/415: readlink dc/d47/l56 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:7/395: dwrite df/d36/f5e [0,4194304] 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/416: write dc/d17/d20/d4c/d58/f6b [4474527,93048] 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/417: chown dc/f5d 4459486 1 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/418: fsync dc/d2f/d40/f6f 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:3/396: link d9/d13/c37 d9/dd/d30/d34/c8d 0 2024-02-14T13:10:37.183 INFO:tasks.workunit.client.0.smithi012.stdout:6/382: stat d1/c11 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:3/397: dread d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:1/482: creat d6/d10/d22/d31/d34/d58/d61/f9d x:0 0 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:3/398: readlink d9/d3f/l48 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:3/399: truncate d9/d3f/f87 1531237 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/359: dwrite d0/d10/d28/d4f/d6b/d83/d17/f72 [0,4194304] 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/360: write d0/d10/d1f/f20 [5565853,58949] 0 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/361: read - d0/d10/d28/f45 zero size 2024-02-14T13:10:37.185 INFO:tasks.workunit.client.0.smithi012.stdout:4/362: fsync d0/d10/d28/d4f/d6b/d83/f4a 0 2024-02-14T13:10:37.186 INFO:tasks.workunit.client.0.smithi012.stdout:0/466: symlink d10/d14/d41/d52/d56/l8f 0 2024-02-14T13:10:37.187 INFO:tasks.workunit.client.0.smithi012.stdout:8/416: unlink d9/dc/f19 0 2024-02-14T13:10:37.189 INFO:tasks.workunit.client.0.smithi012.stdout:6/383: dread d1/d17/f53 [0,4194304] 0 2024-02-14T13:10:37.189 INFO:tasks.workunit.client.0.smithi012.stdout:7/396: mkdir df/d2d/d82/d88/d90 0 2024-02-14T13:10:37.189 INFO:tasks.workunit.client.0.smithi012.stdout:7/397: chown df/f40 117 1 2024-02-14T13:10:37.191 INFO:tasks.workunit.client.0.smithi012.stdout:9/488: dread da/dd/d39/f9a [0,4194304] 0 2024-02-14T13:10:37.191 INFO:tasks.workunit.client.0.smithi012.stdout:9/489: chown da/dd/d57/d59/d73/ca5 5179449 1 2024-02-14T13:10:37.194 INFO:tasks.workunit.client.0.smithi012.stdout:8/417: creat d9/dc/d1b/f80 x:0 0 0 2024-02-14T13:10:37.194 INFO:tasks.workunit.client.0.smithi012.stdout:4/363: dread d0/d10/d1f/f20 [4194304,4194304] 0 2024-02-14T13:10:37.200 INFO:tasks.workunit.client.0.smithi012.stdout:6/384: truncate d1/df/f48 3851462 0 2024-02-14T13:10:37.200 INFO:tasks.workunit.client.0.smithi012.stdout:1/483: dwrite d6/d10/d22/d31/d5b/d5d/f1a [0,4194304] 0 2024-02-14T13:10:37.201 INFO:tasks.workunit.client.0.smithi012.stdout:7/398: symlink df/d2d/d5d/d72/d8a/l91 0 2024-02-14T13:10:37.202 INFO:tasks.workunit.client.0.smithi012.stdout:9/490: mkdir da/dd/d38/d7e/d91/da6 0 2024-02-14T13:10:37.204 INFO:tasks.workunit.client.0.smithi012.stdout:6/385: getdents d1/d1e 0 2024-02-14T13:10:37.207 INFO:tasks.workunit.client.0.smithi012.stdout:8/418: rename d9/dc/c4e to d9/dc/d14/d23/c81 0 2024-02-14T13:10:37.209 INFO:tasks.workunit.client.0.smithi012.stdout:4/364: symlink d0/l87 0 2024-02-14T13:10:37.210 INFO:tasks.workunit.client.0.smithi012.stdout:9/491: write da/dd/d18/d71/d85/f2e [7485100,60191] 0 2024-02-14T13:10:37.211 INFO:tasks.workunit.client.0.smithi012.stdout:7/399: rename df/d2d/d5d/c7c to df/d36/c92 0 2024-02-14T13:10:37.212 INFO:tasks.workunit.client.0.smithi012.stdout:7/400: write df/f30 [573230,6282] 0 2024-02-14T13:10:37.212 INFO:tasks.workunit.client.0.smithi012.stdout:7/401: dread - df/d27/d4b/f8f zero size 2024-02-14T13:10:37.212 INFO:tasks.workunit.client.0.smithi012.stdout:7/402: fsync df/f22 0 2024-02-14T13:10:37.213 INFO:tasks.workunit.client.0.smithi012.stdout:8/419: creat d9/dc/d1b/d35/d50/d56/d57/f82 x:0 0 0 2024-02-14T13:10:37.214 INFO:tasks.workunit.client.0.smithi012.stdout:8/420: fsync d9/dc/d14/d2e/f44 0 2024-02-14T13:10:37.214 INFO:tasks.workunit.client.0.smithi012.stdout:8/421: chown d9/dc/d14/d23/f67 774 1 2024-02-14T13:10:37.215 INFO:tasks.workunit.client.0.smithi012.stdout:9/492: creat da/dd/d38/d7e/fa7 x:0 0 0 2024-02-14T13:10:37.216 INFO:tasks.workunit.client.0.smithi012.stdout:7/403: truncate df/f21 219938 0 2024-02-14T13:10:37.217 INFO:tasks.workunit.client.0.smithi012.stdout:4/365: read d0/d10/d28/f3c [1909497,45252] 0 2024-02-14T13:10:37.221 INFO:tasks.workunit.client.0.smithi012.stdout:8/422: write d9/dc/d14/f1f [103289,41577] 0 2024-02-14T13:10:37.222 INFO:tasks.workunit.client.0.smithi012.stdout:9/493: mkdir da/dd/d57/d59/da8 0 2024-02-14T13:10:37.225 INFO:tasks.workunit.client.0.smithi012.stdout:7/404: dread df/d2d/f41 [0,4194304] 0 2024-02-14T13:10:37.226 INFO:tasks.workunit.client.0.smithi012.stdout:9/494: creat da/dd/d39/d8d/fa9 x:0 0 0 2024-02-14T13:10:37.227 INFO:tasks.workunit.client.0.smithi012.stdout:4/366: truncate d0/fa 2426639 0 2024-02-14T13:10:37.229 INFO:tasks.workunit.client.0.smithi012.stdout:4/367: rmdir d0/d10/d1f/d3e 39 2024-02-14T13:10:37.229 INFO:tasks.workunit.client.0.smithi012.stdout:4/368: chown d0/d10/f60 22 1 2024-02-14T13:10:37.230 INFO:tasks.workunit.client.0.smithi012.stdout:8/423: link d9/dc/d1b/l2f d9/dc/d1b/d35/d50/d56/d57/d5c/l83 0 2024-02-14T13:10:37.230 INFO:tasks.workunit.client.0.smithi012.stdout:8/424: stat d9/dc/d38/d6a/c7f 0 2024-02-14T13:10:37.232 INFO:tasks.workunit.client.0.smithi012.stdout:8/425: creat d9/f84 x:0 0 0 2024-02-14T13:10:37.238 INFO:tasks.workunit.client.0.smithi012.stdout:2/479: sync 2024-02-14T13:10:37.238 INFO:tasks.workunit.client.0.smithi012.stdout:2/480: fdatasync d0/d8/d9/f9a 0 2024-02-14T13:10:37.240 INFO:tasks.workunit.client.0.smithi012.stdout:2/481: creat d0/d6/de/fa7 x:0 0 0 2024-02-14T13:10:37.240 INFO:tasks.workunit.client.0.smithi012.stdout:2/482: write d0/d8/d9/f9a [659012,9701] 0 2024-02-14T13:10:37.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/483: truncate d0/d6/de/d7b/f7e 1267635 0 2024-02-14T13:10:37.241 INFO:tasks.workunit.client.0.smithi012.stdout:2/484: write d0/d6/de/fa7 [126907,103546] 0 2024-02-14T13:10:37.246 INFO:tasks.workunit.client.0.smithi012.stdout:7/405: dwrite df/f51 [0,4194304] 0 2024-02-14T13:10:37.246 INFO:tasks.workunit.client.0.smithi012.stdout:9/495: dwrite da/dd/d18/d71/d85/d48/f67 [0,4194304] 0 2024-02-14T13:10:37.246 INFO:tasks.workunit.client.0.smithi012.stdout:9/496: chown da/dd/d39 365771965 1 2024-02-14T13:10:37.248 INFO:tasks.workunit.client.0.smithi012.stdout:6/386: read d1/df/f48 [3679279,1981] 0 2024-02-14T13:10:37.249 INFO:tasks.workunit.client.0.smithi012.stdout:9/497: creat da/faa x:0 0 0 2024-02-14T13:10:37.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/387: mknod d1/d1e/d5b/c77 0 2024-02-14T13:10:37.250 INFO:tasks.workunit.client.0.smithi012.stdout:6/388: chown d1/df/d16 39 1 2024-02-14T13:10:37.251 INFO:tasks.workunit.client.0.smithi012.stdout:9/498: creat da/dd/d38/fab x:0 0 0 2024-02-14T13:10:37.252 INFO:tasks.workunit.client.0.smithi012.stdout:6/389: mkdir d1/d1e/d1b/d21/d78 0 2024-02-14T13:10:37.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/406: write df/f59 [103364,107147] 0 2024-02-14T13:10:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/499: unlink da/dd/d18/d71/d85/c2f 0 2024-02-14T13:10:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/500: fsync da/dd/f2b 0 2024-02-14T13:10:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/501: chown da 61903699 1 2024-02-14T13:10:37.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/502: fdatasync da/f14 0 2024-02-14T13:10:37.260 INFO:tasks.workunit.client.0.smithi012.stdout:8/426: dwrite d9/dc/d14/d2e/f54 [0,4194304] 0 2024-02-14T13:10:37.260 INFO:tasks.workunit.client.0.smithi012.stdout:8/427: read - d9/dc/d14/d23/f63 zero size 2024-02-14T13:10:37.263 INFO:tasks.workunit.client.0.smithi012.stdout:8/428: creat d9/dc/d14/d23/f85 x:0 0 0 2024-02-14T13:10:37.265 INFO:tasks.workunit.client.0.smithi012.stdout:4/369: dwrite d0/d10/f60 [0,4194304] 0 2024-02-14T13:10:37.265 INFO:tasks.workunit.client.0.smithi012.stdout:7/407: dread df/d24/d56/f64 [0,4194304] 0 2024-02-14T13:10:37.265 INFO:tasks.workunit.client.0.smithi012.stdout:7/408: readlink df/d27/l3d 0 2024-02-14T13:10:37.265 INFO:tasks.workunit.client.0.smithi012.stdout:7/409: fsync df/d2d/f3f 0 2024-02-14T13:10:37.268 INFO:tasks.workunit.client.0.smithi012.stdout:4/370: creat d0/d10/d1f/d3e/f88 x:0 0 0 2024-02-14T13:10:37.268 INFO:tasks.workunit.client.0.smithi012.stdout:4/371: readlink d0/d10/d28/l2b 0 2024-02-14T13:10:37.269 INFO:tasks.workunit.client.0.smithi012.stdout:4/372: mkdir d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89 0 2024-02-14T13:10:37.269 INFO:tasks.workunit.client.0.smithi012.stdout:4/373: dread - d0/d10/d1f/f70 zero size 2024-02-14T13:10:37.271 INFO:tasks.workunit.client.0.smithi012.stdout:2/485: dwrite d0/d20/d54/f6a [0,4194304] 0 2024-02-14T13:10:37.271 INFO:tasks.workunit.client.0.smithi012.stdout:4/374: mknod d0/d10/d1f/d3e/d56/c8a 0 2024-02-14T13:10:37.273 INFO:tasks.workunit.client.0.smithi012.stdout:2/486: mkdir d0/d6/de/d7b/da8 0 2024-02-14T13:10:37.276 INFO:tasks.workunit.client.0.smithi012.stdout:2/487: symlink d0/d5/d15/d57/la9 0 2024-02-14T13:10:37.277 INFO:tasks.workunit.client.0.smithi012.stdout:9/503: dwrite da/dd/d18/d71/f75 [4194304,4194304] 0 2024-02-14T13:10:37.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/429: dwrite d9/dc/d1b/d35/f5e [0,4194304] 0 2024-02-14T13:10:37.278 INFO:tasks.workunit.client.0.smithi012.stdout:8/430: fdatasync d9/dc/d14/d23/f63 0 2024-02-14T13:10:37.278 INFO:tasks.workunit.client.0.smithi012.stdout:4/375: rename d0/l6a to d0/d10/d28/d62/l8b 0 2024-02-14T13:10:37.280 INFO:tasks.workunit.client.0.smithi012.stdout:9/504: symlink da/dd/d18/d71/lac 0 2024-02-14T13:10:37.282 INFO:tasks.workunit.client.0.smithi012.stdout:4/376: dread d0/d10/d28/d4f/d6b/d83/d17/f38 [0,4194304] 0 2024-02-14T13:10:37.282 INFO:tasks.workunit.client.0.smithi012.stdout:4/377: chown d0/d10/d1f/f70 321 1 2024-02-14T13:10:37.288 INFO:tasks.workunit.client.0.smithi012.stdout:7/410: dwrite df/d36/f3a [4194304,4194304] 0 2024-02-14T13:10:37.288 INFO:tasks.workunit.client.0.smithi012.stdout:7/411: truncate df/d2d/d5d/d72/f77 695252 0 2024-02-14T13:10:37.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/378: write d0/d55/f73 [6295895,112268] 0 2024-02-14T13:10:37.293 INFO:tasks.workunit.client.0.smithi012.stdout:8/431: read d9/dc/d1b/f1e [7124984,104462] 0 2024-02-14T13:10:37.294 INFO:tasks.workunit.client.0.smithi012.stdout:8/432: symlink d9/dc/d1b/l86 0 2024-02-14T13:10:37.295 INFO:tasks.workunit.client.0.smithi012.stdout:2/488: dwrite d0/f2 [0,4194304] 0 2024-02-14T13:10:37.296 INFO:tasks.workunit.client.0.smithi012.stdout:2/489: creat d0/d5/d15/faa x:0 0 0 2024-02-14T13:10:37.297 INFO:tasks.workunit.client.0.smithi012.stdout:5/419: sync 2024-02-14T13:10:37.297 INFO:tasks.workunit.client.0.smithi012.stdout:8/433: dread d9/dc/d1b/d35/f78 [0,4194304] 0 2024-02-14T13:10:37.299 INFO:tasks.workunit.client.0.smithi012.stdout:2/490: rename d0/d8/d43 to d0/d8/d9/d90/dab 0 2024-02-14T13:10:37.299 INFO:tasks.workunit.client.0.smithi012.stdout:2/491: write d0/d6/de/d7d/f83 [4715963,42389] 0 2024-02-14T13:10:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:5/420: truncate dc/d2f/f52 2654669 0 2024-02-14T13:10:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:5/421: readlink dc/d47/l56 0 2024-02-14T13:10:37.300 INFO:tasks.workunit.client.0.smithi012.stdout:8/434: chown d9/dc/d14/d23/c25 46117 1 2024-02-14T13:10:37.302 INFO:tasks.workunit.client.0.smithi012.stdout:2/492: rename d0/f6e to d0/d5/d50/fac 0 2024-02-14T13:10:37.302 INFO:tasks.workunit.client.0.smithi012.stdout:2/493: chown d0/d20/d54/c88 513397572 1 2024-02-14T13:10:37.303 INFO:tasks.workunit.client.0.smithi012.stdout:5/422: getdents dc/d17/d20/d4c/d63 0 2024-02-14T13:10:37.303 INFO:tasks.workunit.client.0.smithi012.stdout:5/423: truncate f5 2418724 0 2024-02-14T13:10:37.303 INFO:tasks.workunit.client.0.smithi012.stdout:5/424: fsync dc/d2f/f74 0 2024-02-14T13:10:37.304 INFO:tasks.workunit.client.0.smithi012.stdout:2/494: dread d0/d6/de/d7b/f7e [0,4194304] 0 2024-02-14T13:10:37.304 INFO:tasks.workunit.client.0.smithi012.stdout:2/495: fdatasync d0/d5/d15/d57/f66 0 2024-02-14T13:10:37.305 INFO:tasks.workunit.client.0.smithi012.stdout:5/425: unlink dc/d17/d20/d4c/l79 0 2024-02-14T13:10:37.305 INFO:tasks.workunit.client.0.smithi012.stdout:5/426: chown dc/d17/f3f 8 1 2024-02-14T13:10:37.313 INFO:tasks.workunit.client.0.smithi012.stdout:4/379: dwrite d0/d10/d28/d4f/d6b/d83/f4a [0,4194304] 0 2024-02-14T13:10:37.321 INFO:tasks.workunit.client.0.smithi012.stdout:4/380: dread d0/d10/d28/f37 [0,4194304] 0 2024-02-14T13:10:37.322 INFO:tasks.workunit.client.0.smithi012.stdout:4/381: mkdir d0/d10/d1f/d3e/d56/d8c 0 2024-02-14T13:10:37.323 INFO:tasks.workunit.client.0.smithi012.stdout:4/382: rename d0/d10/d1f/d3e/d63/f6f to d0/d10/d1f/d3e/f8d 0 2024-02-14T13:10:37.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/427: dwrite dc/d17/d20/d4c/d58/f6b [4194304,4194304] 0 2024-02-14T13:10:37.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/428: readlink dc/d17/d20/d4c/d7b/l85 0 2024-02-14T13:10:37.333 INFO:tasks.workunit.client.0.smithi012.stdout:8/435: dwrite d9/dc/d1b/d35/d50/d56/d57/f6c [4194304,4194304] 0 2024-02-14T13:10:37.333 INFO:tasks.workunit.client.0.smithi012.stdout:2/496: dwrite d0/d6/d37/d84/d26/d70/f7f [0,4194304] 0 2024-02-14T13:10:37.333 INFO:tasks.workunit.client.0.smithi012.stdout:2/497: write d0/d5/d15/d57/f78 [407785,38519] 0 2024-02-14T13:10:37.333 INFO:tasks.workunit.client.0.smithi012.stdout:2/498: write d0/d5/f42 [920566,71427] 0 2024-02-14T13:10:37.334 INFO:tasks.workunit.client.0.smithi012.stdout:4/383: dread d0/d10/d28/d4f/d6b/d83/f16 [0,4194304] 0 2024-02-14T13:10:37.337 INFO:tasks.workunit.client.0.smithi012.stdout:8/436: rmdir d9/d65 0 2024-02-14T13:10:37.338 INFO:tasks.workunit.client.0.smithi012.stdout:4/384: symlink d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/l8e 0 2024-02-14T13:10:37.338 INFO:tasks.workunit.client.0.smithi012.stdout:4/385: fdatasync d0/d10/d1f/d3e/f48 0 2024-02-14T13:10:37.338 INFO:tasks.workunit.client.0.smithi012.stdout:8/437: creat d9/dc/d1b/d35/f87 x:0 0 0 2024-02-14T13:10:37.341 INFO:tasks.workunit.client.0.smithi012.stdout:4/386: rename d0/d10/d1f/d3e to d0/d10/d28/d4f/d6b/d8f 0 2024-02-14T13:10:37.341 INFO:tasks.workunit.client.0.smithi012.stdout:4/387: truncate d0/d10/d28/d4f/d6b/d8f/d56/f5d 826823 0 2024-02-14T13:10:37.341 INFO:tasks.workunit.client.0.smithi012.stdout:4/388: write d0/d10/f79 [1029219,12187] 0 2024-02-14T13:10:37.341 INFO:tasks.workunit.client.0.smithi012.stdout:4/389: write d0/d55/f73 [9036487,112039] 0 2024-02-14T13:10:37.341 INFO:tasks.workunit.client.0.smithi012.stdout:2/499: dread d0/f2 [0,4194304] 0 2024-02-14T13:10:37.342 INFO:tasks.workunit.client.0.smithi012.stdout:2/500: readlink d0/d6/de/d7b/l87 0 2024-02-14T13:10:37.342 INFO:tasks.workunit.client.0.smithi012.stdout:8/438: rename d9/dc/d1b/f64 to d9/dc/d1b/d35/d50/f88 0 2024-02-14T13:10:37.342 INFO:tasks.workunit.client.0.smithi012.stdout:4/390: rename d0/d10/d28/d4f/d6b/d8f/d63/d86 to d0/d10/d28/d4f/d6b/d8f/d63/d86/d90 22 2024-02-14T13:10:37.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/439: symlink d9/dc/d1b/d35/d50/d56/d57/d5c/l89 0 2024-02-14T13:10:37.345 INFO:tasks.workunit.client.0.smithi012.stdout:5/429: dwrite dc/d17/d20/d4c/d58/f68 [0,4194304] 0 2024-02-14T13:10:37.345 INFO:tasks.workunit.client.0.smithi012.stdout:5/430: truncate dc/d17/f43 1147232 0 2024-02-14T13:10:37.345 INFO:tasks.workunit.client.0.smithi012.stdout:5/431: truncate dc/f4d 127387 0 2024-02-14T13:10:37.365 INFO:tasks.workunit.client.0.smithi012.stdout:2/501: dwrite d0/d5/d50/d68/d9c/f9f [0,4194304] 0 2024-02-14T13:10:37.366 INFO:tasks.workunit.client.0.smithi012.stdout:0/467: sync 2024-02-14T13:10:37.366 INFO:tasks.workunit.client.0.smithi012.stdout:3/400: sync 2024-02-14T13:10:37.367 INFO:tasks.workunit.client.0.smithi012.stdout:1/484: sync 2024-02-14T13:10:37.368 INFO:tasks.workunit.client.0.smithi012.stdout:3/401: mkdir d9/d8e 0 2024-02-14T13:10:37.369 INFO:tasks.workunit.client.0.smithi012.stdout:0/468: creat d10/d14/d41/d61/d74/f90 x:0 0 0 2024-02-14T13:10:37.369 INFO:tasks.workunit.client.0.smithi012.stdout:8/440: dwrite d9/dc/d38/f51 [0,4194304] 0 2024-02-14T13:10:37.370 INFO:tasks.workunit.client.0.smithi012.stdout:3/402: mkdir d9/d7b/d8f 0 2024-02-14T13:10:37.370 INFO:tasks.workunit.client.0.smithi012.stdout:8/441: dread d9/dc/d1b/d35/f7d [0,4194304] 0 2024-02-14T13:10:37.371 INFO:tasks.workunit.client.0.smithi012.stdout:4/391: dwrite d0/d10/f60 [4194304,4194304] 0 2024-02-14T13:10:37.371 INFO:tasks.workunit.client.0.smithi012.stdout:1/485: dread d6/fd [0,4194304] 0 2024-02-14T13:10:37.371 INFO:tasks.workunit.client.0.smithi012.stdout:1/486: readlink d6/d10/l60 0 2024-02-14T13:10:37.371 INFO:tasks.workunit.client.0.smithi012.stdout:1/487: write d6/d10/d22/d44/f82 [309801,59827] 0 2024-02-14T13:10:37.371 INFO:tasks.workunit.client.0.smithi012.stdout:0/469: creat d10/d14/d41/d61/d74/f91 x:0 0 0 2024-02-14T13:10:37.372 INFO:tasks.workunit.client.0.smithi012.stdout:5/432: dwrite dc/d2f/d40/f6f [0,4194304] 0 2024-02-14T13:10:37.374 INFO:tasks.workunit.client.0.smithi012.stdout:3/403: creat d9/d68/f90 x:0 0 0 2024-02-14T13:10:37.375 INFO:tasks.workunit.client.0.smithi012.stdout:8/442: unlink d9/dc/d14/c18 0 2024-02-14T13:10:37.378 INFO:tasks.workunit.client.0.smithi012.stdout:4/392: dread d0/d10/d28/d4f/d6b/d83/f16 [4194304,4194304] 0 2024-02-14T13:10:37.378 INFO:tasks.workunit.client.0.smithi012.stdout:1/488: link d6/d10/d22/d31/c98 d6/d10/d22/d31/d34/d89/c9e 0 2024-02-14T13:10:37.380 INFO:tasks.workunit.client.0.smithi012.stdout:0/470: creat d10/d14/d41/d52/f92 x:0 0 0 2024-02-14T13:10:37.387 INFO:tasks.workunit.client.0.smithi012.stdout:2/502: dwrite d0/d2d/f77 [0,4194304] 0 2024-02-14T13:10:37.387 INFO:tasks.workunit.client.0.smithi012.stdout:2/503: chown d0/d5/d50/d68/d9c 48 1 2024-02-14T13:10:37.387 INFO:tasks.workunit.client.0.smithi012.stdout:5/433: rmdir dc/d2f/d40/d53 39 2024-02-14T13:10:37.388 INFO:tasks.workunit.client.0.smithi012.stdout:3/404: getdents d9/d7b 0 2024-02-14T13:10:37.388 INFO:tasks.workunit.client.0.smithi012.stdout:3/405: truncate d9/d3f/f7e 452264 0 2024-02-14T13:10:37.389 INFO:tasks.workunit.client.0.smithi012.stdout:0/471: mkdir d10/d84/d93 0 2024-02-14T13:10:37.389 INFO:tasks.workunit.client.0.smithi012.stdout:0/472: fsync d10/d14/d23/f45 0 2024-02-14T13:10:37.390 INFO:tasks.workunit.client.0.smithi012.stdout:5/434: dread dc/d17/d20/f2b [0,4194304] 0 2024-02-14T13:10:37.390 INFO:tasks.workunit.client.0.smithi012.stdout:5/435: write f7 [1686090,100734] 0 2024-02-14T13:10:37.391 INFO:tasks.workunit.client.0.smithi012.stdout:5/436: read dc/d2f/f75 [125951,66123] 0 2024-02-14T13:10:37.391 INFO:tasks.workunit.client.0.smithi012.stdout:5/437: readlink dc/d17/l3b 0 2024-02-14T13:10:37.391 INFO:tasks.workunit.client.0.smithi012.stdout:2/504: creat d0/d6/d37/fad x:0 0 0 2024-02-14T13:10:37.392 INFO:tasks.workunit.client.0.smithi012.stdout:3/406: mkdir d9/d3f/d73/d5d/d91 0 2024-02-14T13:10:37.393 INFO:tasks.workunit.client.0.smithi012.stdout:0/473: creat d10/d14/d1b/f94 x:0 0 0 2024-02-14T13:10:37.393 INFO:tasks.workunit.client.0.smithi012.stdout:0/474: truncate d10/d14/d51/f7a 884784 0 2024-02-14T13:10:37.393 INFO:tasks.workunit.client.0.smithi012.stdout:0/475: readlink d10/d14/l1a 0 2024-02-14T13:10:37.394 INFO:tasks.workunit.client.0.smithi012.stdout:5/438: symlink dc/d2f/d40/d53/l86 0 2024-02-14T13:10:37.394 INFO:tasks.workunit.client.0.smithi012.stdout:5/439: rename dc to dc/d47/d59/d87 22 2024-02-14T13:10:37.394 INFO:tasks.workunit.client.0.smithi012.stdout:5/440: chown dc/f5d 93 1 2024-02-14T13:10:37.395 INFO:tasks.workunit.client.0.smithi012.stdout:2/505: truncate d0/d8/d11/d33/f38 6349060 0 2024-02-14T13:10:37.395 INFO:tasks.workunit.client.0.smithi012.stdout:2/506: dread - d0/d20/d54/f82 zero size 2024-02-14T13:10:37.395 INFO:tasks.workunit.client.0.smithi012.stdout:2/507: fsync d0/d6/f5f 0 2024-02-14T13:10:37.395 INFO:tasks.workunit.client.0.smithi012.stdout:2/508: stat d0/d1a/f49 0 2024-02-14T13:10:37.396 INFO:tasks.workunit.client.0.smithi012.stdout:6/390: sync 2024-02-14T13:10:37.396 INFO:tasks.workunit.client.0.smithi012.stdout:9/505: sync 2024-02-14T13:10:37.396 INFO:tasks.workunit.client.0.smithi012.stdout:7/412: sync 2024-02-14T13:10:37.398 INFO:tasks.workunit.client.0.smithi012.stdout:5/441: rename dc/l5f to dc/d47/d6e/l88 0 2024-02-14T13:10:37.399 INFO:tasks.workunit.client.0.smithi012.stdout:2/509: creat d0/d8/d11/d33/fae x:0 0 0 2024-02-14T13:10:37.400 INFO:tasks.workunit.client.0.smithi012.stdout:6/391: truncate d1/d1e/dc/f1d 325015 0 2024-02-14T13:10:37.400 INFO:tasks.workunit.client.0.smithi012.stdout:0/476: read d10/d14/d1b/f22 [354691,52446] 0 2024-02-14T13:10:37.400 INFO:tasks.workunit.client.0.smithi012.stdout:0/477: write d10/d14/d23/f45 [4588653,22574] 0 2024-02-14T13:10:37.402 INFO:tasks.workunit.client.0.smithi012.stdout:7/413: truncate df/f51 1455830 0 2024-02-14T13:10:37.402 INFO:tasks.workunit.client.0.smithi012.stdout:7/414: dread - df/d27/d4b/f8f zero size 2024-02-14T13:10:37.403 INFO:tasks.workunit.client.0.smithi012.stdout:2/510: unlink d0/l7c 0 2024-02-14T13:10:37.403 INFO:tasks.workunit.client.0.smithi012.stdout:3/407: write d9/dd/d30/d44/f29 [2586998,44416] 0 2024-02-14T13:10:37.403 INFO:tasks.workunit.client.0.smithi012.stdout:3/408: chown d9/dd 369125856 1 2024-02-14T13:10:37.404 INFO:tasks.workunit.client.0.smithi012.stdout:6/392: dread d1/d1e/d1b/f3d [0,4194304] 0 2024-02-14T13:10:37.405 INFO:tasks.workunit.client.0.smithi012.stdout:6/393: stat d1/d1e/c29 0 2024-02-14T13:10:37.405 INFO:tasks.workunit.client.0.smithi012.stdout:6/394: stat d1/df/d24/d3f/d56/f76 0 2024-02-14T13:10:37.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/511: creat d0/d8/d11/faf x:0 0 0 2024-02-14T13:10:37.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/512: fsync d0/d5/f42 0 2024-02-14T13:10:37.406 INFO:tasks.workunit.client.0.smithi012.stdout:1/489: dwrite d6/d10/d64/f8a [0,4194304] 0 2024-02-14T13:10:37.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/513: mkdir d0/d6/d37/d84/d26/d70/db0 0 2024-02-14T13:10:37.414 INFO:tasks.workunit.client.0.smithi012.stdout:2/514: dread d0/d6/de/d7b/f61 [0,4194304] 0 2024-02-14T13:10:37.414 INFO:tasks.workunit.client.0.smithi012.stdout:1/490: creat d6/d10/d22/d31/d5b/d5e/f9f x:0 0 0 2024-02-14T13:10:37.415 INFO:tasks.workunit.client.0.smithi012.stdout:3/409: mknod d9/dd/d30/d34/c92 0 2024-02-14T13:10:37.417 INFO:tasks.workunit.client.0.smithi012.stdout:2/515: mkdir d0/d5/d50/db1 0 2024-02-14T13:10:37.417 INFO:tasks.workunit.client.0.smithi012.stdout:1/491: mkdir d6/d10/d22/d31/d34/da0 0 2024-02-14T13:10:37.417 INFO:tasks.workunit.client.0.smithi012.stdout:1/492: truncate d6/d10/d22/d31/d34/d3b/f83 931713 0 2024-02-14T13:10:37.419 INFO:tasks.workunit.client.0.smithi012.stdout:2/516: mknod d0/d8/d11/d33/d63/cb2 0 2024-02-14T13:10:37.419 INFO:tasks.workunit.client.0.smithi012.stdout:2/517: readlink d0/d20/d54/l95 0 2024-02-14T13:10:37.420 INFO:tasks.workunit.client.0.smithi012.stdout:2/518: stat d0/d8/d11/d33/d5c/c60 0 2024-02-14T13:10:37.424 INFO:tasks.workunit.client.0.smithi012.stdout:4/393: dwrite d0/d10/d28/d4f/d6b/d83/d17/f72 [0,4194304] 0 2024-02-14T13:10:37.424 INFO:tasks.workunit.client.0.smithi012.stdout:1/493: dread d6/d10/d22/d31/d5b/d5d/f17 [0,4194304] 0 2024-02-14T13:10:37.424 INFO:tasks.workunit.client.0.smithi012.stdout:4/394: write d0/d10/d28/d4f/d6b/d83/d17/d5f/f61 [593161,14303] 0 2024-02-14T13:10:37.428 INFO:tasks.workunit.client.0.smithi012.stdout:9/506: dwrite da/dd/d57/f97 [0,4194304] 0 2024-02-14T13:10:37.428 INFO:tasks.workunit.client.0.smithi012.stdout:9/507: chown da/dd/d18/d71/d85/d48/l62 213147 1 2024-02-14T13:10:37.428 INFO:tasks.workunit.client.0.smithi012.stdout:6/395: write d1/df/d16/f59 [2606745,80098] 0 2024-02-14T13:10:37.428 INFO:tasks.workunit.client.0.smithi012.stdout:1/494: link d6/d10/d22/d31/f74 d6/d10/d22/d31/d5b/d5d/fa1 0 2024-02-14T13:10:37.428 INFO:tasks.workunit.client.0.smithi012.stdout:4/395: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 x:0 0 0 2024-02-14T13:10:37.433 INFO:tasks.workunit.client.0.smithi012.stdout:1/495: truncate d6/d10/d22/d31/d5b/d5e/d65/f75 42497 0 2024-02-14T13:10:37.433 INFO:tasks.workunit.client.0.smithi012.stdout:1/496: chown d6/d10/d22/d44 102323 1 2024-02-14T13:10:37.434 INFO:tasks.workunit.client.0.smithi012.stdout:6/396: mknod d1/c79 0 2024-02-14T13:10:37.435 INFO:tasks.workunit.client.0.smithi012.stdout:1/497: mkdir d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2 0 2024-02-14T13:10:37.436 INFO:tasks.workunit.client.0.smithi012.stdout:4/396: unlink d0/l49 0 2024-02-14T13:10:37.437 INFO:tasks.workunit.client.0.smithi012.stdout:4/397: write d0/d10/d28/d4f/d6b/d83/f16 [5936057,1764] 0 2024-02-14T13:10:37.445 INFO:tasks.workunit.client.0.smithi012.stdout:4/398: dread d0/d10/f2a [0,4194304] 0 2024-02-14T13:10:37.445 INFO:tasks.workunit.client.0.smithi012.stdout:4/399: write d0/d10/d1f/f70 [825500,63929] 0 2024-02-14T13:10:37.446 INFO:tasks.workunit.client.0.smithi012.stdout:4/400: mknod d0/d10/d28/d62/c92 0 2024-02-14T13:10:37.447 INFO:tasks.workunit.client.0.smithi012.stdout:4/401: mknod d0/d10/d1f/c93 0 2024-02-14T13:10:37.450 INFO:tasks.workunit.client.0.smithi012.stdout:4/402: dread d0/f6 [4194304,4194304] 0 2024-02-14T13:10:37.455 INFO:tasks.workunit.client.0.smithi012.stdout:3/410: dwrite d9/dd/de/d58/d65/d6c/f7c [0,4194304] 0 2024-02-14T13:10:37.456 INFO:tasks.workunit.client.0.smithi012.stdout:6/397: dwrite d1/df/d24/f40 [0,4194304] 0 2024-02-14T13:10:37.457 INFO:tasks.workunit.client.0.smithi012.stdout:3/411: rename d9/d18/c7a to d9/d7b/c93 0 2024-02-14T13:10:37.460 INFO:tasks.workunit.client.0.smithi012.stdout:3/412: unlink d9/d13/d28/f36 0 2024-02-14T13:10:37.463 INFO:tasks.workunit.client.0.smithi012.stdout:5/442: dwrite dc/d17/d20/d4c/d58/f68 [4194304,4194304] 0 2024-02-14T13:10:37.463 INFO:tasks.workunit.client.0.smithi012.stdout:5/443: readlink dc/d17/d20/d4c/d7b/l85 0 2024-02-14T13:10:37.463 INFO:tasks.workunit.client.0.smithi012.stdout:2/519: dwrite d0/d5/d50/d68/d9c/f9f [0,4194304] 0 2024-02-14T13:10:37.463 INFO:tasks.workunit.client.0.smithi012.stdout:2/520: write d0/d5/d15/d57/f78 [1301354,28391] 0 2024-02-14T13:10:37.464 INFO:tasks.workunit.client.0.smithi012.stdout:0/478: dwrite d10/f62 [0,4194304] 0 2024-02-14T13:10:37.464 INFO:tasks.workunit.client.0.smithi012.stdout:1/498: dwrite d6/d10/d22/d31/d5b/d5d/d6d/f7d [0,4194304] 0 2024-02-14T13:10:37.465 INFO:tasks.workunit.client.0.smithi012.stdout:9/508: dwrite da/d33/d63/f8a [0,4194304] 0 2024-02-14T13:10:37.470 INFO:tasks.workunit.client.0.smithi012.stdout:0/479: link d10/d14/d23/c24 d10/d14/d23/c95 0 2024-02-14T13:10:37.473 INFO:tasks.workunit.client.0.smithi012.stdout:1/499: rename d6/d10/c4b to d6/d10/d22/d31/d34/d58/d61/ca3 0 2024-02-14T13:10:37.473 INFO:tasks.workunit.client.0.smithi012.stdout:6/398: dwrite d1/d1e/f20 [4194304,4194304] 0 2024-02-14T13:10:37.474 INFO:tasks.workunit.client.0.smithi012.stdout:5/444: mkdir dc/d2f/d89 0 2024-02-14T13:10:37.477 INFO:tasks.workunit.client.0.smithi012.stdout:9/509: truncate da/dd/f2a 3307212 0 2024-02-14T13:10:37.485 INFO:tasks.workunit.client.0.smithi012.stdout:1/500: mkdir d6/d10/d22/d31/d5b/d5d/d80/da4 0 2024-02-14T13:10:37.485 INFO:tasks.workunit.client.0.smithi012.stdout:0/480: dread d10/d14/d41/d52/d78/d8c/f28 [0,4194304] 0 2024-02-14T13:10:37.487 INFO:tasks.workunit.client.0.smithi012.stdout:6/399: symlink d1/df/d24/l7a 0 2024-02-14T13:10:37.487 INFO:tasks.workunit.client.0.smithi012.stdout:5/445: mkdir dc/d2f/d40/d53/d8a 0 2024-02-14T13:10:37.488 INFO:tasks.workunit.client.0.smithi012.stdout:0/481: mkdir d10/d14/d1b/d54/d96 0 2024-02-14T13:10:37.489 INFO:tasks.workunit.client.0.smithi012.stdout:0/482: chown d10/d14/d1b/d54/c5c 5372 1 2024-02-14T13:10:37.489 INFO:tasks.workunit.client.0.smithi012.stdout:0/483: readlink d10/d14/d1b/d30/l5d 0 2024-02-14T13:10:37.490 INFO:tasks.workunit.client.0.smithi012.stdout:5/446: unlink dc/d17/d20/f4f 0 2024-02-14T13:10:37.491 INFO:tasks.workunit.client.0.smithi012.stdout:0/484: creat d10/d14/d1b/d7e/f97 x:0 0 0 2024-02-14T13:10:37.492 INFO:tasks.workunit.client.0.smithi012.stdout:9/510: write da/dd/d39/fa3 [822872,64237] 0 2024-02-14T13:10:37.492 INFO:tasks.workunit.client.0.smithi012.stdout:5/447: unlink dc/f80 0 2024-02-14T13:10:37.492 INFO:tasks.workunit.client.0.smithi012.stdout:2/521: dwrite d0/d8/f6f [0,4194304] 0 2024-02-14T13:10:37.493 INFO:tasks.workunit.client.0.smithi012.stdout:4/403: dwrite d0/d10/d1f/f70 [0,4194304] 0 2024-02-14T13:10:37.495 INFO:tasks.workunit.client.0.smithi012.stdout:3/413: dwrite d9/d18/f56 [0,4194304] 0 2024-02-14T13:10:37.495 INFO:tasks.workunit.client.0.smithi012.stdout:3/414: fsync d9/d13/f20 0 2024-02-14T13:10:37.495 INFO:tasks.workunit.client.0.smithi012.stdout:2/522: rename d0/d1a/c97 to d0/d6/d37/cb3 0 2024-02-14T13:10:37.495 INFO:tasks.workunit.client.0.smithi012.stdout:2/523: write d0/d5/d50/fac [1575615,11611] 0 2024-02-14T13:10:37.496 INFO:tasks.workunit.client.0.smithi012.stdout:2/524: fdatasync d0/d20/d54/f82 0 2024-02-14T13:10:37.496 INFO:tasks.workunit.client.0.smithi012.stdout:2/525: truncate d0/d6/f5f 776450 0 2024-02-14T13:10:37.498 INFO:tasks.workunit.client.0.smithi012.stdout:4/404: creat d0/d10/d28/d4f/d6b/d8f/f94 x:0 0 0 2024-02-14T13:10:37.498 INFO:tasks.workunit.client.0.smithi012.stdout:4/405: read d0/d10/d28/d4f/d6b/d8f/f3f [784998,120767] 0 2024-02-14T13:10:37.500 INFO:tasks.workunit.client.0.smithi012.stdout:3/415: truncate d9/dd/de/f38 416910 0 2024-02-14T13:10:37.501 INFO:tasks.workunit.client.0.smithi012.stdout:2/526: symlink d0/d5/d50/d68/d9c/lb4 0 2024-02-14T13:10:37.501 INFO:tasks.workunit.client.0.smithi012.stdout:2/527: chown d0/d8/d89/c93 404828672 1 2024-02-14T13:10:37.501 INFO:tasks.workunit.client.0.smithi012.stdout:6/400: dread d1/df/d24/f36 [4194304,4194304] 0 2024-02-14T13:10:37.501 INFO:tasks.workunit.client.0.smithi012.stdout:6/401: stat d1/d1e/c4e 0 2024-02-14T13:10:37.501 INFO:tasks.workunit.client.0.smithi012.stdout:5/448: write dc/d17/f27 [3047244,47898] 0 2024-02-14T13:10:37.502 INFO:tasks.workunit.client.0.smithi012.stdout:2/528: mknod d0/d6/de/cb5 0 2024-02-14T13:10:37.503 INFO:tasks.workunit.client.0.smithi012.stdout:6/402: mkdir d1/d1e/dc/d28/d7b 0 2024-02-14T13:10:37.504 INFO:tasks.workunit.client.0.smithi012.stdout:1/501: dwrite d6/d10/d22/d31/d5b/d5e/f3f [0,4194304] 0 2024-02-14T13:10:37.505 INFO:tasks.workunit.client.0.smithi012.stdout:4/406: rename d0/d10/f30 to d0/f95 0 2024-02-14T13:10:37.505 INFO:tasks.workunit.client.0.smithi012.stdout:4/407: chown d0/d55/f73 836 1 2024-02-14T13:10:37.507 INFO:tasks.workunit.client.0.smithi012.stdout:5/449: creat dc/d2f/d89/f8b x:0 0 0 2024-02-14T13:10:37.508 INFO:tasks.workunit.client.0.smithi012.stdout:2/529: creat d0/d6/fb6 x:0 0 0 2024-02-14T13:10:37.510 INFO:tasks.workunit.client.0.smithi012.stdout:1/502: write d6/fc [3883883,59946] 0 2024-02-14T13:10:37.510 INFO:tasks.workunit.client.0.smithi012.stdout:1/503: write d6/d10/d22/d31/d34/d3b/f43 [2392121,38530] 0 2024-02-14T13:10:37.511 INFO:tasks.workunit.client.0.smithi012.stdout:4/408: mknod d0/d10/c96 0 2024-02-14T13:10:37.511 INFO:tasks.workunit.client.0.smithi012.stdout:4/409: truncate d0/d10/d28/d4f/d6b/d8f/d56/f7f 94307 0 2024-02-14T13:10:37.511 INFO:tasks.workunit.client.0.smithi012.stdout:4/410: write d0/d10/d28/d4f/d6b/d8f/f76 [5150888,22808] 0 2024-02-14T13:10:37.512 INFO:tasks.workunit.client.0.smithi012.stdout:5/450: dread f7 [0,4194304] 0 2024-02-14T13:10:37.513 INFO:tasks.workunit.client.0.smithi012.stdout:2/530: mkdir d0/d6/de/d7d/db7 0 2024-02-14T13:10:37.513 INFO:tasks.workunit.client.0.smithi012.stdout:6/403: dread d1/df/d24/d3f/f47 [0,4194304] 0 2024-02-14T13:10:37.515 INFO:tasks.workunit.client.0.smithi012.stdout:1/504: rmdir d6/d10/d22/d31/d5b/d94 0 2024-02-14T13:10:37.515 INFO:tasks.workunit.client.0.smithi012.stdout:1/505: chown d6/d10/c24 0 1 2024-02-14T13:10:37.516 INFO:tasks.workunit.client.0.smithi012.stdout:4/411: link d0/d10/d28/c3d d0/d10/d28/d4f/d6b/d8f/c97 0 2024-02-14T13:10:37.516 INFO:tasks.workunit.client.0.smithi012.stdout:4/412: fdatasync d0/d10/d28/d4f/d6b/d83/d17/f72 0 2024-02-14T13:10:37.517 INFO:tasks.workunit.client.0.smithi012.stdout:4/413: read d0/d10/d28/d4f/d6b/d83/d17/d5f/f61 [345316,36818] 0 2024-02-14T13:10:37.518 INFO:tasks.workunit.client.0.smithi012.stdout:5/451: symlink dc/d2f/d89/l8c 0 2024-02-14T13:10:37.518 INFO:tasks.workunit.client.0.smithi012.stdout:1/506: dread d6/d10/d22/d31/d5b/d5e/d3d/f68 [4194304,4194304] 0 2024-02-14T13:10:37.520 INFO:tasks.workunit.client.0.smithi012.stdout:3/416: dwrite d9/dd/d30/d44/f29 [4194304,4194304] 0 2024-02-14T13:10:37.524 INFO:tasks.workunit.client.0.smithi012.stdout:2/531: mkdir d0/d5/d39/db8 0 2024-02-14T13:10:37.525 INFO:tasks.workunit.client.0.smithi012.stdout:4/414: rmdir d0/d10/d28/d4f/d6b 39 2024-02-14T13:10:37.527 INFO:tasks.workunit.client.0.smithi012.stdout:5/452: symlink dc/d17/d20/d4c/d63/l8d 0 2024-02-14T13:10:37.530 INFO:tasks.workunit.client.0.smithi012.stdout:3/417: creat d9/dd/de/d58/d65/d6c/f94 x:0 0 0 2024-02-14T13:10:37.531 INFO:tasks.workunit.client.0.smithi012.stdout:2/532: symlink d0/d6/d37/d84/lb9 0 2024-02-14T13:10:37.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/404: dwrite d1/d1e/dc/d28/f4d [0,4194304] 0 2024-02-14T13:10:37.533 INFO:tasks.workunit.client.0.smithi012.stdout:4/415: dread d0/d10/d28/d4f/d6b/d8f/f3f [4194304,4194304] 0 2024-02-14T13:10:37.533 INFO:tasks.workunit.client.0.smithi012.stdout:5/453: mkdir dc/d17/d20/d8e 0 2024-02-14T13:10:37.533 INFO:tasks.workunit.client.0.smithi012.stdout:5/454: truncate dc/d47/d6e/f77 4213380 0 2024-02-14T13:10:37.533 INFO:tasks.workunit.client.0.smithi012.stdout:5/455: fsync f5 0 2024-02-14T13:10:37.534 INFO:tasks.workunit.client.0.smithi012.stdout:3/418: mkdir d9/d7b/d95 0 2024-02-14T13:10:37.535 INFO:tasks.workunit.client.0.smithi012.stdout:2/533: mkdir d0/d5/d15/d57/d6d/dba 0 2024-02-14T13:10:37.537 INFO:tasks.workunit.client.0.smithi012.stdout:9/511: truncate da/f14 3226669 0 2024-02-14T13:10:37.539 INFO:tasks.workunit.client.0.smithi012.stdout:6/405: mkdir d1/df/d16/d7c 0 2024-02-14T13:10:37.541 INFO:tasks.workunit.client.0.smithi012.stdout:4/416: mkdir d0/d10/d28/d4f/d6b/d8f/d56/d98 0 2024-02-14T13:10:37.542 INFO:tasks.workunit.client.0.smithi012.stdout:5/456: write dc/d17/d20/f3a [2705744,79959] 0 2024-02-14T13:10:37.544 INFO:tasks.workunit.client.0.smithi012.stdout:1/507: dwrite d6/d10/d22/d31/d34/f57 [0,4194304] 0 2024-02-14T13:10:37.544 INFO:tasks.workunit.client.0.smithi012.stdout:3/419: creat d9/dd/d30/d34/d78/f96 x:0 0 0 2024-02-14T13:10:37.545 INFO:tasks.workunit.client.0.smithi012.stdout:6/406: dread d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:37.545 INFO:tasks.workunit.client.0.smithi012.stdout:2/534: mkdir d0/d5/d50/d68/dbb 0 2024-02-14T13:10:37.546 INFO:tasks.workunit.client.0.smithi012.stdout:2/535: fdatasync d0/d8/d9/f9a 0 2024-02-14T13:10:37.547 INFO:tasks.workunit.client.0.smithi012.stdout:9/512: creat da/dd/d19/fad x:0 0 0 2024-02-14T13:10:37.547 INFO:tasks.workunit.client.0.smithi012.stdout:9/513: truncate da/dd/f2b 827411 0 2024-02-14T13:10:37.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/417: getdents d0/d10/d28/d62 0 2024-02-14T13:10:37.549 INFO:tasks.workunit.client.0.smithi012.stdout:5/457: unlink dc/f5d 0 2024-02-14T13:10:37.551 INFO:tasks.workunit.client.0.smithi012.stdout:1/508: rename d6/d10/d22/d31/d34/d3b/f83 to d6/d10/d22/d31/d34/fa5 0 2024-02-14T13:10:37.551 INFO:tasks.workunit.client.0.smithi012.stdout:6/407: rename d1/df/d16 to d1/df/d16/d7d 22 2024-02-14T13:10:37.551 INFO:tasks.workunit.client.0.smithi012.stdout:6/408: stat d1/d1e/dc/d38/d74 0 2024-02-14T13:10:37.552 INFO:tasks.workunit.client.0.smithi012.stdout:3/420: rmdir d9/d7b/d8f 0 2024-02-14T13:10:37.553 INFO:tasks.workunit.client.0.smithi012.stdout:2/536: creat d0/d8/d9/d90/fbc x:0 0 0 2024-02-14T13:10:37.555 INFO:tasks.workunit.client.0.smithi012.stdout:9/514: mknod da/dd/d19/cae 0 2024-02-14T13:10:37.557 INFO:tasks.workunit.client.0.smithi012.stdout:4/418: mkdir d0/d10/d28/d4f/d6b/d83/d99 0 2024-02-14T13:10:37.557 INFO:tasks.workunit.client.0.smithi012.stdout:4/419: read - d0/d10/d28/f45 zero size 2024-02-14T13:10:37.563 INFO:tasks.workunit.client.0.smithi012.stdout:5/458: symlink dc/d17/d20/d4c/d63/d81/l8f 0 2024-02-14T13:10:37.563 INFO:tasks.workunit.client.0.smithi012.stdout:5/459: read - dc/d2f/d89/f8b zero size 2024-02-14T13:10:37.564 INFO:tasks.workunit.client.0.smithi012.stdout:1/509: rename d6/d10/d22/d31/f8f to d6/d10/d22/d31/d5b/d5e/d65/fa6 0 2024-02-14T13:10:37.564 INFO:tasks.workunit.client.0.smithi012.stdout:1/510: truncate d6/d10/d22/d31/d5b/d5d/fa1 511929 0 2024-02-14T13:10:37.564 INFO:tasks.workunit.client.0.smithi012.stdout:1/511: fdatasync d6/d10/d22/d31/d5b/d5e/d65/d87/f6a 0 2024-02-14T13:10:37.565 INFO:tasks.workunit.client.0.smithi012.stdout:6/409: mknod d1/df/d24/d3f/c7e 0 2024-02-14T13:10:37.565 INFO:tasks.workunit.client.0.smithi012.stdout:6/410: read d1/df/d16/f59 [993253,60406] 0 2024-02-14T13:10:37.566 INFO:tasks.workunit.client.0.smithi012.stdout:3/421: truncate d9/d3f/f81 1230392 0 2024-02-14T13:10:37.566 INFO:tasks.workunit.client.0.smithi012.stdout:3/422: fsync d9/dd/f17 0 2024-02-14T13:10:37.567 INFO:tasks.workunit.client.0.smithi012.stdout:2/537: unlink d0/d20/d54/f6a 0 2024-02-14T13:10:37.569 INFO:tasks.workunit.client.0.smithi012.stdout:9/515: creat da/dd/faf x:0 0 0 2024-02-14T13:10:37.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/460: rmdir dc/d2f 39 2024-02-14T13:10:37.570 INFO:tasks.workunit.client.0.smithi012.stdout:5/461: chown dc/d47/d69 4978412 1 2024-02-14T13:10:37.572 INFO:tasks.workunit.client.0.smithi012.stdout:1/512: mkdir d6/d35/da7 0 2024-02-14T13:10:37.573 INFO:tasks.workunit.client.0.smithi012.stdout:5/462: dread dc/d17/d20/f37 [0,4194304] 0 2024-02-14T13:10:37.575 INFO:tasks.workunit.client.0.smithi012.stdout:3/423: link d9/dd/d30/d34/c92 d9/dd/d30/d44/c97 0 2024-02-14T13:10:37.577 INFO:tasks.workunit.client.0.smithi012.stdout:2/538: mkdir d0/d5/d15/dbd 0 2024-02-14T13:10:37.578 INFO:tasks.workunit.client.0.smithi012.stdout:9/516: rename l5 to da/dd/d57/lb0 0 2024-02-14T13:10:37.579 INFO:tasks.workunit.client.0.smithi012.stdout:1/513: symlink d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/la8 0 2024-02-14T13:10:37.581 INFO:tasks.workunit.client.0.smithi012.stdout:5/463: symlink dc/d17/d4b/l90 0 2024-02-14T13:10:37.581 INFO:tasks.workunit.client.0.smithi012.stdout:5/464: readlink dc/d17/d4b/l90 0 2024-02-14T13:10:37.581 INFO:tasks.workunit.client.0.smithi012.stdout:5/465: chown dc/d2f/d3e/l5e 2 1 2024-02-14T13:10:37.582 INFO:tasks.workunit.client.0.smithi012.stdout:3/424: truncate d9/dd/f17 7067847 0 2024-02-14T13:10:37.584 INFO:tasks.workunit.client.0.smithi012.stdout:9/517: rename da/dd/d18/d71/d85/l89 to da/dd/d19/lb1 0 2024-02-14T13:10:37.585 INFO:tasks.workunit.client.0.smithi012.stdout:1/514: symlink d6/d10/d22/d31/d34/d3b/la9 0 2024-02-14T13:10:37.585 INFO:tasks.workunit.client.0.smithi012.stdout:6/411: dwrite d1/d1e/dc/d43/f5e [0,4194304] 0 2024-02-14T13:10:37.585 INFO:tasks.workunit.client.0.smithi012.stdout:2/539: write d0/d8/f31 [1876985,92919] 0 2024-02-14T13:10:37.586 INFO:tasks.workunit.client.0.smithi012.stdout:5/466: symlink dc/d17/d20/d4c/l91 0 2024-02-14T13:10:37.588 INFO:tasks.workunit.client.0.smithi012.stdout:3/425: symlink d9/d8e/l98 0 2024-02-14T13:10:37.589 INFO:tasks.workunit.client.0.smithi012.stdout:9/518: mkdir da/dd/d57/db2 0 2024-02-14T13:10:37.593 INFO:tasks.workunit.client.0.smithi012.stdout:1/515: unlink d6/d10/d22/d31/d34/d58/d61/l73 0 2024-02-14T13:10:37.593 INFO:tasks.workunit.client.0.smithi012.stdout:1/516: stat d6/d10/d22/d31/d34/f8b 0 2024-02-14T13:10:37.594 INFO:tasks.workunit.client.0.smithi012.stdout:5/467: symlink dc/d47/d6e/l92 0 2024-02-14T13:10:37.597 INFO:tasks.workunit.client.0.smithi012.stdout:3/426: creat d9/dd/de/d58/f99 x:0 0 0 2024-02-14T13:10:37.597 INFO:tasks.workunit.client.0.smithi012.stdout:3/427: fdatasync d9/d3f/d73/f86 0 2024-02-14T13:10:37.597 INFO:tasks.workunit.client.0.smithi012.stdout:3/428: readlink d9/d18/d39/l8a 0 2024-02-14T13:10:37.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/468: mkdir dc/d2f/d40/d93 0 2024-02-14T13:10:37.600 INFO:tasks.workunit.client.0.smithi012.stdout:5/469: write f6 [2949872,126308] 0 2024-02-14T13:10:37.600 INFO:tasks.workunit.client.0.smithi012.stdout:5/470: write dc/d2f/f74 [808756,112509] 0 2024-02-14T13:10:37.601 INFO:tasks.workunit.client.0.smithi012.stdout:3/429: creat d9/d13/d28/f9a x:0 0 0 2024-02-14T13:10:37.603 INFO:tasks.workunit.client.0.smithi012.stdout:5/471: mkdir dc/d2f/d94 0 2024-02-14T13:10:37.605 INFO:tasks.workunit.client.0.smithi012.stdout:2/540: dwrite d0/d20/f45 [0,4194304] 0 2024-02-14T13:10:37.608 INFO:tasks.workunit.client.0.smithi012.stdout:2/541: mkdir d0/d8/d9/dbe 0 2024-02-14T13:10:37.608 INFO:tasks.workunit.client.0.smithi012.stdout:2/542: write d0/d6/d37/d84/d51/f73 [1499040,123314] 0 2024-02-14T13:10:37.611 INFO:tasks.workunit.client.0.smithi012.stdout:1/517: dwrite d6/d10/d22/d31/d5b/d5d/f2e [0,4194304] 0 2024-02-14T13:10:37.615 INFO:tasks.workunit.client.0.smithi012.stdout:1/518: creat d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/faa x:0 0 0 2024-02-14T13:10:37.615 INFO:tasks.workunit.client.0.smithi012.stdout:1/519: stat d6/c42 0 2024-02-14T13:10:37.618 INFO:tasks.workunit.client.0.smithi012.stdout:2/543: dread d0/d5/f42 [0,4194304] 0 2024-02-14T13:10:37.618 INFO:tasks.workunit.client.0.smithi012.stdout:3/430: dwrite d9/dd/de/f1a [4194304,4194304] 0 2024-02-14T13:10:37.620 INFO:tasks.workunit.client.0.smithi012.stdout:5/472: dwrite dc/d17/f43 [0,4194304] 0 2024-02-14T13:10:37.620 INFO:tasks.workunit.client.0.smithi012.stdout:2/544: link d0/d8/d11/faf d0/d5/d50/d68/dbb/fbf 0 2024-02-14T13:10:37.621 INFO:tasks.workunit.client.0.smithi012.stdout:1/520: dread d6/fc [0,4194304] 0 2024-02-14T13:10:37.624 INFO:tasks.workunit.client.0.smithi012.stdout:8/443: sync 2024-02-14T13:10:37.624 INFO:tasks.workunit.client.0.smithi012.stdout:7/415: sync 2024-02-14T13:10:37.624 INFO:tasks.workunit.client.0.smithi012.stdout:0/485: sync 2024-02-14T13:10:37.624 INFO:tasks.workunit.client.0.smithi012.stdout:3/431: rename d9/dd/d30/d44/d66/f72 to d9/d8e/f9b 0 2024-02-14T13:10:37.627 INFO:tasks.workunit.client.0.smithi012.stdout:1/521: creat d6/fab x:0 0 0 2024-02-14T13:10:37.631 INFO:tasks.workunit.client.0.smithi012.stdout:7/416: mknod df/d24/d56/c93 0 2024-02-14T13:10:37.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/417: fsync df/f21 0 2024-02-14T13:10:37.633 INFO:tasks.workunit.client.0.smithi012.stdout:8/444: creat d9/dc/d1b/d35/f8a x:0 0 0 2024-02-14T13:10:37.633 INFO:tasks.workunit.client.0.smithi012.stdout:8/445: readlink d9/dc/d1b/d35/d50/d56/l71 0 2024-02-14T13:10:37.634 INFO:tasks.workunit.client.0.smithi012.stdout:3/432: truncate d9/d3f/f81 1091666 0 2024-02-14T13:10:37.636 INFO:tasks.workunit.client.0.smithi012.stdout:9/519: truncate da/dd/d39/fa3 517195 0 2024-02-14T13:10:37.636 INFO:tasks.workunit.client.0.smithi012.stdout:9/520: chown da/d33/d63/c8f 388978162 1 2024-02-14T13:10:37.636 INFO:tasks.workunit.client.0.smithi012.stdout:9/521: chown da/dd/d19/d30/d45/l69 1011863 1 2024-02-14T13:10:37.636 INFO:tasks.workunit.client.0.smithi012.stdout:1/522: symlink d6/d10/d22/d31/d3e/lac 0 2024-02-14T13:10:37.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/522: write da/dd/d19/d30/f29 [85525,86697] 0 2024-02-14T13:10:37.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/523: read f8 [35018,97599] 0 2024-02-14T13:10:37.637 INFO:tasks.workunit.client.0.smithi012.stdout:7/418: mknod df/d27/d4b/d8d/c94 0 2024-02-14T13:10:37.640 INFO:tasks.workunit.client.0.smithi012.stdout:7/419: link df/d2d/d5d/c65 df/d2d/d82/d88/c95 0 2024-02-14T13:10:37.641 INFO:tasks.workunit.client.0.smithi012.stdout:3/433: mknod d9/dd/d30/d34/c9c 0 2024-02-14T13:10:37.642 INFO:tasks.workunit.client.0.smithi012.stdout:9/524: rename da/dd/d18/d71/d85/f2e to da/dd/d18/d71/d85/fb3 0 2024-02-14T13:10:37.643 INFO:tasks.workunit.client.0.smithi012.stdout:7/420: creat df/d2d/f96 x:0 0 0 2024-02-14T13:10:37.644 INFO:tasks.workunit.client.0.smithi012.stdout:3/434: symlink d9/d3f/l9d 0 2024-02-14T13:10:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:2/545: dwrite d0/d1a/f49 [0,4194304] 0 2024-02-14T13:10:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:2/546: getdents d0/d20/d75/d8a 0 2024-02-14T13:10:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:2/547: write d0/d20/d54/f9b [940169,17528] 0 2024-02-14T13:10:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:2/548: write d0/d6/fb6 [867247,62653] 0 2024-02-14T13:10:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:2/549: readlink d0/d6/de/l9e 0 2024-02-14T13:10:37.645 INFO:tasks.workunit.client.0.smithi012.stdout:9/525: rmdir da/dd/d57/d59/d73 39 2024-02-14T13:10:37.648 INFO:tasks.workunit.client.0.smithi012.stdout:2/550: rmdir d0/d2d 39 2024-02-14T13:10:37.649 INFO:tasks.workunit.client.0.smithi012.stdout:9/526: creat da/dd/fb4 x:0 0 0 2024-02-14T13:10:37.649 INFO:tasks.workunit.client.0.smithi012.stdout:2/551: mknod d0/d6/d37/d84/d26/d70/db0/cc0 0 2024-02-14T13:10:37.650 INFO:tasks.workunit.client.0.smithi012.stdout:3/435: dread d9/d18/f4d [0,4194304] 0 2024-02-14T13:10:37.650 INFO:tasks.workunit.client.0.smithi012.stdout:9/527: rename da/dd/d19/f4b to da/dd/d57/d59/fb5 0 2024-02-14T13:10:37.651 INFO:tasks.workunit.client.0.smithi012.stdout:9/528: chown da/l7b 803546 1 2024-02-14T13:10:37.651 INFO:tasks.workunit.client.0.smithi012.stdout:2/552: rmdir d0/d5/d15/d57/d6d 39 2024-02-14T13:10:37.651 INFO:tasks.workunit.client.0.smithi012.stdout:3/436: getdents d9/dd/d30/d44/d66 0 2024-02-14T13:10:37.651 INFO:tasks.workunit.client.0.smithi012.stdout:3/437: chown d9/d3f/d73/c70 120 1 2024-02-14T13:10:37.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/438: write d9/d3f/f87 [1316928,33015] 0 2024-02-14T13:10:37.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/439: fdatasync d9/dd/de/f38 0 2024-02-14T13:10:37.652 INFO:tasks.workunit.client.0.smithi012.stdout:9/529: mkdir da/dd/d57/d59/d73/db6 0 2024-02-14T13:10:37.653 INFO:tasks.workunit.client.0.smithi012.stdout:2/553: mknod d0/d6/de/d7d/db7/cc1 0 2024-02-14T13:10:37.654 INFO:tasks.workunit.client.0.smithi012.stdout:3/440: rename d9/d3f/f7e to d9/dd/d30/d44/f9e 0 2024-02-14T13:10:37.654 INFO:tasks.workunit.client.0.smithi012.stdout:3/441: stat d9/dd/f4a 0 2024-02-14T13:10:37.654 INFO:tasks.workunit.client.0.smithi012.stdout:3/442: write d9/dd/de/f1a [1532966,11371] 0 2024-02-14T13:10:37.655 INFO:tasks.workunit.client.0.smithi012.stdout:9/530: symlink da/dd/d38/d7e/lb7 0 2024-02-14T13:10:37.655 INFO:tasks.workunit.client.0.smithi012.stdout:9/531: dread - da/dd/d57/d59/f6f zero size 2024-02-14T13:10:37.655 INFO:tasks.workunit.client.0.smithi012.stdout:9/532: chown da/d33/l78 573729160 1 2024-02-14T13:10:37.655 INFO:tasks.workunit.client.0.smithi012.stdout:2/554: mkdir d0/d8/d11/d33/d5c/dc2 0 2024-02-14T13:10:37.656 INFO:tasks.workunit.client.0.smithi012.stdout:3/443: creat d9/d8e/f9f x:0 0 0 2024-02-14T13:10:37.657 INFO:tasks.workunit.client.0.smithi012.stdout:9/533: creat da/dd/d18/d71/d85/d48/fb8 x:0 0 0 2024-02-14T13:10:37.659 INFO:tasks.workunit.client.0.smithi012.stdout:8/446: dwrite d9/dc/d14/d2e/f54 [4194304,4194304] 0 2024-02-14T13:10:37.659 INFO:tasks.workunit.client.0.smithi012.stdout:3/444: rmdir d9/dd 39 2024-02-14T13:10:37.659 INFO:tasks.workunit.client.0.smithi012.stdout:1/523: dwrite d6/d10/d22/d31/d5b/d5e/d65/d87/f97 [0,4194304] 0 2024-02-14T13:10:37.660 INFO:tasks.workunit.client.0.smithi012.stdout:1/524: write d6/d10/d22/d31/d5b/d5e/f36 [1718836,38138] 0 2024-02-14T13:10:37.660 INFO:tasks.workunit.client.0.smithi012.stdout:1/525: chown d6/d10/d22/d31/d34/d3b/l41 57656 1 2024-02-14T13:10:37.660 INFO:tasks.workunit.client.0.smithi012.stdout:1/526: write d6/d10/d22/d31/d5b/d5e/d65/f75 [194781,104475] 0 2024-02-14T13:10:37.660 INFO:tasks.workunit.client.0.smithi012.stdout:7/421: dwrite df/d2d/f96 [0,4194304] 0 2024-02-14T13:10:37.661 INFO:tasks.workunit.client.0.smithi012.stdout:8/447: mknod d9/dc/c8b 0 2024-02-14T13:10:37.662 INFO:tasks.workunit.client.0.smithi012.stdout:8/448: dread - d9/dc/d1b/d35/d50/d56/d57/f82 zero size 2024-02-14T13:10:37.663 INFO:tasks.workunit.client.0.smithi012.stdout:3/445: rmdir d9/dd/d30/d34/d78 39 2024-02-14T13:10:37.669 INFO:tasks.workunit.client.0.smithi012.stdout:1/527: symlink d6/d10/d22/d31/lad 0 2024-02-14T13:10:37.674 INFO:tasks.workunit.client.0.smithi012.stdout:2/555: dwrite d0/d5/d50/d68/dbb/fbf [0,4194304] 0 2024-02-14T13:10:37.674 INFO:tasks.workunit.client.0.smithi012.stdout:2/556: fsync d0/d8/d9/d90/dab/f59 0 2024-02-14T13:10:37.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/534: dwrite da/faa [0,4194304] 0 2024-02-14T13:10:37.677 INFO:tasks.workunit.client.0.smithi012.stdout:1/528: creat d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/fae x:0 0 0 2024-02-14T13:10:37.677 INFO:tasks.workunit.client.0.smithi012.stdout:1/529: write d6/d10/f4a [699458,2578] 0 2024-02-14T13:10:37.677 INFO:tasks.workunit.client.0.smithi012.stdout:1/530: chown d6/d10/d22/d31/d5b/d5e/d65/f75 323784 1 2024-02-14T13:10:37.678 INFO:tasks.workunit.client.0.smithi012.stdout:8/449: mknod d9/dc/d14/d23/c8c 0 2024-02-14T13:10:37.682 INFO:tasks.workunit.client.0.smithi012.stdout:8/450: symlink d9/dc/d14/d2e/l8d 0 2024-02-14T13:10:37.683 INFO:tasks.workunit.client.0.smithi012.stdout:3/446: dwrite d9/d18/d39/f59 [0,4194304] 0 2024-02-14T13:10:37.684 INFO:tasks.workunit.client.0.smithi012.stdout:8/451: dread d9/dc/d14/d2e/f44 [0,4194304] 0 2024-02-14T13:10:37.684 INFO:tasks.workunit.client.0.smithi012.stdout:8/452: fsync d9/dc/d38/d6a/f79 0 2024-02-14T13:10:37.684 INFO:tasks.workunit.client.0.smithi012.stdout:8/453: fsync d9/dc/d14/d23/f39 0 2024-02-14T13:10:37.684 INFO:tasks.workunit.client.0.smithi012.stdout:8/454: chown d9/dc/c3d 15 1 2024-02-14T13:10:37.684 INFO:tasks.workunit.client.0.smithi012.stdout:3/447: symlink d9/d13/d28/la0 0 2024-02-14T13:10:37.684 INFO:tasks.workunit.client.0.smithi012.stdout:3/448: getdents d9/d3f/d73/d5d/d91 0 2024-02-14T13:10:37.685 INFO:tasks.workunit.client.0.smithi012.stdout:8/455: unlink d9/dc/l5a 0 2024-02-14T13:10:37.686 INFO:tasks.workunit.client.0.smithi012.stdout:8/456: rename d9/dc/d1b/l2f to d9/dc/d14/d2e/l8e 0 2024-02-14T13:10:37.687 INFO:tasks.workunit.client.0.smithi012.stdout:8/457: write f4 [113466,74702] 0 2024-02-14T13:10:37.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/557: dwrite d0/d6/f5f [0,4194304] 0 2024-02-14T13:10:37.687 INFO:tasks.workunit.client.0.smithi012.stdout:2/558: readlink d0/l4 0 2024-02-14T13:10:37.689 INFO:tasks.workunit.client.0.smithi012.stdout:8/458: dread d9/dc/d38/f60 [0,4194304] 0 2024-02-14T13:10:37.690 INFO:tasks.workunit.client.0.smithi012.stdout:9/535: write da/dd/d19/d30/f1f [1220041,46234] 0 2024-02-14T13:10:37.691 INFO:tasks.workunit.client.0.smithi012.stdout:9/536: chown da/dd/d19/c4c 18470026 1 2024-02-14T13:10:37.691 INFO:tasks.workunit.client.0.smithi012.stdout:9/537: dread - da/d4f/f60 zero size 2024-02-14T13:10:37.693 INFO:tasks.workunit.client.0.smithi012.stdout:2/559: mkdir d0/d8/d11/d33/dc3 0 2024-02-14T13:10:37.693 INFO:tasks.workunit.client.0.smithi012.stdout:2/560: stat d0/d5/d39 0 2024-02-14T13:10:37.693 INFO:tasks.workunit.client.0.smithi012.stdout:2/561: chown d0/d6/de/d7b/l87 14 1 2024-02-14T13:10:37.694 INFO:tasks.workunit.client.0.smithi012.stdout:1/531: dread d6/d10/d22/d31/d5b/d5d/d6d/f72 [0,4194304] 0 2024-02-14T13:10:37.694 INFO:tasks.workunit.client.0.smithi012.stdout:1/532: truncate d6/d10/d22/d31/d34/d58/d61/f93 1024846 0 2024-02-14T13:10:37.694 INFO:tasks.workunit.client.0.smithi012.stdout:8/459: mknod d9/dc/c8f 0 2024-02-14T13:10:37.696 INFO:tasks.workunit.client.0.smithi012.stdout:2/562: mkdir d0/d5/d15/d57/dc4 0 2024-02-14T13:10:37.697 INFO:tasks.workunit.client.0.smithi012.stdout:1/533: symlink d6/d10/d22/d31/d5b/d5e/laf 0 2024-02-14T13:10:37.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/460: truncate d9/dc/d1b/f20 2278436 0 2024-02-14T13:10:37.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/461: write d9/dc/d14/d23/f63 [836192,103284] 0 2024-02-14T13:10:37.698 INFO:tasks.workunit.client.0.smithi012.stdout:8/462: fdatasync d9/dc/d1b/d35/d50/d56/d57/f6c 0 2024-02-14T13:10:37.699 INFO:tasks.workunit.client.0.smithi012.stdout:1/534: link d6/d10/d22/d31/d34/f8b d6/d10/d22/d31/d34/fb0 0 2024-02-14T13:10:37.700 INFO:tasks.workunit.client.0.smithi012.stdout:1/535: write d6/d10/d22/d31/f40 [193384,29642] 0 2024-02-14T13:10:37.700 INFO:tasks.workunit.client.0.smithi012.stdout:8/463: creat d9/dc/d14/f90 x:0 0 0 2024-02-14T13:10:37.703 INFO:tasks.workunit.client.0.smithi012.stdout:4/420: sync 2024-02-14T13:10:37.703 INFO:tasks.workunit.client.0.smithi012.stdout:4/421: truncate d0/d10/d28/d4f/d6b/d83/d17/f5e 4922085 0 2024-02-14T13:10:37.704 INFO:tasks.workunit.client.0.smithi012.stdout:4/422: mknod d0/d10/d28/d62/c9a 0 2024-02-14T13:10:37.708 INFO:tasks.workunit.client.0.smithi012.stdout:4/423: dread d0/f6 [4194304,4194304] 0 2024-02-14T13:10:37.708 INFO:tasks.workunit.client.0.smithi012.stdout:4/424: dread - d0/d10/d28/d4f/d6b/d8f/f8d zero size 2024-02-14T13:10:37.708 INFO:tasks.workunit.client.0.smithi012.stdout:3/449: dwrite d9/f61 [0,4194304] 0 2024-02-14T13:10:37.709 INFO:tasks.workunit.client.0.smithi012.stdout:4/425: creat d0/d10/d1f/f9b x:0 0 0 2024-02-14T13:10:37.712 INFO:tasks.workunit.client.0.smithi012.stdout:3/450: creat d9/d13/fa1 x:0 0 0 2024-02-14T13:10:37.712 INFO:tasks.workunit.client.0.smithi012.stdout:3/451: chown d9/dd/d30/d44/d66 353 1 2024-02-14T13:10:37.712 INFO:tasks.workunit.client.0.smithi012.stdout:3/452: fdatasync d9/dd/d30/d44/f4b 0 2024-02-14T13:10:37.712 INFO:tasks.workunit.client.0.smithi012.stdout:8/464: dread d9/dc/d14/d23/f67 [0,4194304] 0 2024-02-14T13:10:37.713 INFO:tasks.workunit.client.0.smithi012.stdout:2/563: dwrite d0/d8/d9/f9a [0,4194304] 0 2024-02-14T13:10:37.713 INFO:tasks.workunit.client.0.smithi012.stdout:3/453: creat d9/d3f/fa2 x:0 0 0 2024-02-14T13:10:37.713 INFO:tasks.workunit.client.0.smithi012.stdout:3/454: write d9/dd/de/f3e [284846,60953] 0 2024-02-14T13:10:37.714 INFO:tasks.workunit.client.0.smithi012.stdout:3/455: dread - d9/d13/fa1 zero size 2024-02-14T13:10:37.716 INFO:tasks.workunit.client.0.smithi012.stdout:1/536: dread d6/d10/f3a [0,4194304] 0 2024-02-14T13:10:37.716 INFO:tasks.workunit.client.0.smithi012.stdout:1/537: dread - d6/d10/d22/d31/d5b/d5e/f9f zero size 2024-02-14T13:10:37.720 INFO:tasks.workunit.client.0.smithi012.stdout:2/564: mknod d0/d5/d50/d68/cc5 0 2024-02-14T13:10:37.721 INFO:tasks.workunit.client.0.smithi012.stdout:3/456: mkdir d9/d68/da3 0 2024-02-14T13:10:37.721 INFO:tasks.workunit.client.0.smithi012.stdout:3/457: getdents d9/d7b/d95 0 2024-02-14T13:10:37.721 INFO:tasks.workunit.client.0.smithi012.stdout:3/458: write d9/d68/f90 [1038189,108099] 0 2024-02-14T13:10:37.724 INFO:tasks.workunit.client.0.smithi012.stdout:3/459: link d9/d3f/d73/d5d/c63 d9/dd/de/d58/ca4 0 2024-02-14T13:10:37.724 INFO:tasks.workunit.client.0.smithi012.stdout:3/460: truncate d9/dd/de/d58/d65/f6e 890642 0 2024-02-14T13:10:37.725 INFO:tasks.workunit.client.0.smithi012.stdout:1/538: dread d6/fc [0,4194304] 0 2024-02-14T13:10:37.725 INFO:tasks.workunit.client.0.smithi012.stdout:1/539: chown d6/f1b 1637 1 2024-02-14T13:10:37.726 INFO:tasks.workunit.client.0.smithi012.stdout:3/461: rename d9/c52 to d9/d18/d39/ca5 0 2024-02-14T13:10:37.726 INFO:tasks.workunit.client.0.smithi012.stdout:3/462: dread - d9/d13/d28/f9a zero size 2024-02-14T13:10:37.726 INFO:tasks.workunit.client.0.smithi012.stdout:2/565: dread d0/d6/de/d7b/f61 [0,4194304] 0 2024-02-14T13:10:37.727 INFO:tasks.workunit.client.0.smithi012.stdout:3/463: symlink d9/d3f/d4e/la6 0 2024-02-14T13:10:37.727 INFO:tasks.workunit.client.0.smithi012.stdout:3/464: fdatasync d9/dd/de/f38 0 2024-02-14T13:10:37.727 INFO:tasks.workunit.client.0.smithi012.stdout:3/465: readlink d9/d18/d39/l8a 0 2024-02-14T13:10:37.728 INFO:tasks.workunit.client.0.smithi012.stdout:3/466: mknod d9/dd/d30/d34/d78/ca7 0 2024-02-14T13:10:37.728 INFO:tasks.workunit.client.0.smithi012.stdout:3/467: readlink d9/l2c 0 2024-02-14T13:10:37.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/468: rmdir d9/d68/da3 0 2024-02-14T13:10:37.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/469: chown l8 360746 1 2024-02-14T13:10:37.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/470: getdents d9/dd/d30/d44/d3d/d7d 0 2024-02-14T13:10:37.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/471: fdatasync d9/d13/fa1 0 2024-02-14T13:10:37.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/472: mkdir d9/d3f/da8 0 2024-02-14T13:10:37.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/473: write d9/dd/de/f3e [1157553,4105] 0 2024-02-14T13:10:37.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/474: fdatasync d9/d3f/d4e/f5a 0 2024-02-14T13:10:37.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/475: readlink d9/d3f/l48 0 2024-02-14T13:10:37.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/476: truncate d9/d3f/d73/f86 860100 0 2024-02-14T13:10:37.731 INFO:tasks.workunit.client.0.smithi012.stdout:3/477: creat d9/d3f/da8/fa9 x:0 0 0 2024-02-14T13:10:37.732 INFO:tasks.workunit.client.0.smithi012.stdout:3/478: mkdir d9/d13/daa 0 2024-02-14T13:10:37.735 INFO:tasks.workunit.client.0.smithi012.stdout:2/566: dread d0/d5/d50/d68/d9c/f9f [0,4194304] 0 2024-02-14T13:10:37.735 INFO:tasks.workunit.client.0.smithi012.stdout:1/540: read d6/d10/d22/d31/d5b/d5d/f1a [805803,76695] 0 2024-02-14T13:10:37.735 INFO:tasks.workunit.client.0.smithi012.stdout:1/541: write d6/d10/d22/d31/d34/d3b/f81 [753407,31705] 0 2024-02-14T13:10:37.736 INFO:tasks.workunit.client.0.smithi012.stdout:2/567: rmdir d0/d8/d11/d33 39 2024-02-14T13:10:37.736 INFO:tasks.workunit.client.0.smithi012.stdout:2/568: fdatasync d0/d6/d37/d84/d26/d70/f7f 0 2024-02-14T13:10:37.737 INFO:tasks.workunit.client.0.smithi012.stdout:1/542: rmdir d6/d10/d22/d44 39 2024-02-14T13:10:37.737 INFO:tasks.workunit.client.0.smithi012.stdout:2/569: rmdir d0/d8/d9/d90/dab 39 2024-02-14T13:10:37.738 INFO:tasks.workunit.client.0.smithi012.stdout:2/570: truncate d0/d8/f6f 4840661 0 2024-02-14T13:10:37.739 INFO:tasks.workunit.client.0.smithi012.stdout:8/465: dwrite d9/dc/d14/d2e/f3f [0,4194304] 0 2024-02-14T13:10:37.739 INFO:tasks.workunit.client.0.smithi012.stdout:2/571: symlink d0/d5/d39/lc6 0 2024-02-14T13:10:37.739 INFO:tasks.workunit.client.0.smithi012.stdout:4/426: dwrite d0/d10/d28/d4f/d6b/d8f/f48 [4194304,4194304] 0 2024-02-14T13:10:37.741 INFO:tasks.workunit.client.0.smithi012.stdout:8/466: link d9/dc/d1b/d35/c42 d9/dc/d1b/d35/d50/d56/d57/c91 0 2024-02-14T13:10:37.745 INFO:tasks.workunit.client.0.smithi012.stdout:3/479: dread d9/f61 [0,4194304] 0 2024-02-14T13:10:37.745 INFO:tasks.workunit.client.0.smithi012.stdout:3/480: chown d9/d18/d39/ca5 836 1 2024-02-14T13:10:37.749 INFO:tasks.workunit.client.0.smithi012.stdout:4/427: symlink d0/d10/d28/d4f/l9c 0 2024-02-14T13:10:37.750 INFO:tasks.workunit.client.0.smithi012.stdout:8/467: mkdir d9/dc/d1b/d35/d50/d56/d57/d92 0 2024-02-14T13:10:37.752 INFO:tasks.workunit.client.0.smithi012.stdout:8/468: unlink d9/l32 0 2024-02-14T13:10:37.754 INFO:tasks.workunit.client.0.smithi012.stdout:8/469: getdents d9/dc/d38 0 2024-02-14T13:10:37.755 INFO:tasks.workunit.client.0.smithi012.stdout:3/481: rmdir d9/dd/d30/d44/d3d/d7d 0 2024-02-14T13:10:37.756 INFO:tasks.workunit.client.0.smithi012.stdout:3/482: getdents d9/d7b 0 2024-02-14T13:10:37.757 INFO:tasks.workunit.client.0.smithi012.stdout:5/473: sync 2024-02-14T13:10:37.757 INFO:tasks.workunit.client.0.smithi012.stdout:6/412: sync 2024-02-14T13:10:37.757 INFO:tasks.workunit.client.0.smithi012.stdout:7/422: sync 2024-02-14T13:10:37.757 INFO:tasks.workunit.client.0.smithi012.stdout:0/486: sync 2024-02-14T13:10:37.757 INFO:tasks.workunit.client.0.smithi012.stdout:4/428: write d0/d10/d28/d4f/d6b/d83/d17/f72 [1159550,127794] 0 2024-02-14T13:10:37.758 INFO:tasks.workunit.client.0.smithi012.stdout:5/474: truncate dc/d17/d20/d4c/d58/f68 4164795 0 2024-02-14T13:10:37.759 INFO:tasks.workunit.client.0.smithi012.stdout:6/413: symlink d1/d1e/d1b/d21/d78/l7f 0 2024-02-14T13:10:37.760 INFO:tasks.workunit.client.0.smithi012.stdout:7/423: creat df/d2d/d82/f97 x:0 0 0 2024-02-14T13:10:37.764 INFO:tasks.workunit.client.0.smithi012.stdout:4/429: creat d0/d10/d28/d4f/d6b/d8f/d56/d8c/f9d x:0 0 0 2024-02-14T13:10:37.764 INFO:tasks.workunit.client.0.smithi012.stdout:4/430: write d0/d10/f24 [3919125,40377] 0 2024-02-14T13:10:37.766 INFO:tasks.workunit.client.0.smithi012.stdout:6/414: rename d1/df/d24/d3f/c7e to d1/d1e/c80 0 2024-02-14T13:10:37.766 INFO:tasks.workunit.client.0.smithi012.stdout:6/415: fsync d1/df/d16/f59 0 2024-02-14T13:10:37.767 INFO:tasks.workunit.client.0.smithi012.stdout:7/424: truncate df/f23 1437499 0 2024-02-14T13:10:37.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/416: getdents d1/d17/d5a 0 2024-02-14T13:10:37.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/417: mknod d1/d1e/c81 0 2024-02-14T13:10:37.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/418: write d1/d1e/d1b/d3e/f4c [2232569,9026] 0 2024-02-14T13:10:37.769 INFO:tasks.workunit.client.0.smithi012.stdout:6/419: read d1/df/f48 [2220599,7214] 0 2024-02-14T13:10:37.771 INFO:tasks.workunit.client.0.smithi012.stdout:4/431: fdatasync d0/d10/f2a 0 2024-02-14T13:10:37.771 INFO:tasks.workunit.client.0.smithi012.stdout:4/432: write d0/d10/d28/d4f/d6b/d8f/d63/f69 [666164,106780] 0 2024-02-14T13:10:37.785 INFO:tasks.workunit.client.0.smithi012.stdout:6/420: dread d1/d1e/f20 [0,4194304] 0 2024-02-14T13:10:37.785 INFO:tasks.workunit.client.0.smithi012.stdout:8/470: dwrite d9/dc/d14/d2e/f44 [0,4194304] 0 2024-02-14T13:10:37.785 INFO:tasks.workunit.client.0.smithi012.stdout:0/487: dwrite d10/d14/d41/f89 [8388608,4194304] 0 2024-02-14T13:10:37.786 INFO:tasks.workunit.client.0.smithi012.stdout:6/421: unlink d1/d1e/dc/d43/f5e 0 2024-02-14T13:10:37.787 INFO:tasks.workunit.client.0.smithi012.stdout:6/422: chown d1/d17/c6f 797972 1 2024-02-14T13:10:37.789 INFO:tasks.workunit.client.0.smithi012.stdout:6/423: mkdir d1/d1e/d5b/d82 0 2024-02-14T13:10:37.790 INFO:tasks.workunit.client.0.smithi012.stdout:3/483: dwrite d9/d3f/da8/fa9 [0,4194304] 0 2024-02-14T13:10:37.790 INFO:tasks.workunit.client.0.smithi012.stdout:3/484: chown d9/dd/d30/d44/f4b 20663586 1 2024-02-14T13:10:37.790 INFO:tasks.workunit.client.0.smithi012.stdout:3/485: chown d9/d3f/l9d 80153 1 2024-02-14T13:10:37.793 INFO:tasks.workunit.client.0.smithi012.stdout:3/486: creat d9/d7b/d95/fab x:0 0 0 2024-02-14T13:10:37.794 INFO:tasks.workunit.client.0.smithi012.stdout:3/487: write d9/d3f/f87 [471037,48273] 0 2024-02-14T13:10:37.794 INFO:tasks.workunit.client.0.smithi012.stdout:0/488: dread d10/d14/d41/d52/d78/d8c/f4e [0,4194304] 0 2024-02-14T13:10:37.794 INFO:tasks.workunit.client.0.smithi012.stdout:3/488: mkdir d9/d3f/dac 0 2024-02-14T13:10:37.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/489: dread d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:37.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/490: stat d9/d8e 0 2024-02-14T13:10:37.805 INFO:tasks.workunit.client.0.smithi012.stdout:4/433: dwrite d0/d10/f3b [0,4194304] 0 2024-02-14T13:10:37.805 INFO:tasks.workunit.client.0.smithi012.stdout:4/434: chown d0/d10/d28/f37 51065 1 2024-02-14T13:10:37.808 INFO:tasks.workunit.client.0.smithi012.stdout:4/435: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f9e x:0 0 0 2024-02-14T13:10:37.810 INFO:tasks.workunit.client.0.smithi012.stdout:4/436: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/c9f 0 2024-02-14T13:10:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:3/491: write d9/d18/f56 [371521,77028] 0 2024-02-14T13:10:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:5/475: dwrite dc/d17/d20/f37 [0,4194304] 0 2024-02-14T13:10:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:5/476: fdatasync dc/d2f/f74 0 2024-02-14T13:10:37.811 INFO:tasks.workunit.client.0.smithi012.stdout:3/492: write d9/dd/de/f3e [1568916,127401] 0 2024-02-14T13:10:37.812 INFO:tasks.workunit.client.0.smithi012.stdout:3/493: symlink d9/dd/lad 0 2024-02-14T13:10:37.813 INFO:tasks.workunit.client.0.smithi012.stdout:3/494: symlink d9/d3f/d73/d5d/d82/lae 0 2024-02-14T13:10:37.814 INFO:tasks.workunit.client.0.smithi012.stdout:5/477: dread dc/d17/f41 [0,4194304] 0 2024-02-14T13:10:37.815 INFO:tasks.workunit.client.0.smithi012.stdout:5/478: dread dc/f33 [0,4194304] 0 2024-02-14T13:10:37.815 INFO:tasks.workunit.client.0.smithi012.stdout:5/479: truncate f6 4107401 0 2024-02-14T13:10:37.815 INFO:tasks.workunit.client.0.smithi012.stdout:8/471: dwrite d9/dc/d14/f90 [0,4194304] 0 2024-02-14T13:10:37.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/424: dwrite d1/df/d24/f40 [0,4194304] 0 2024-02-14T13:10:37.816 INFO:tasks.workunit.client.0.smithi012.stdout:6/425: read - d1/d1e/dc/d28/f64 zero size 2024-02-14T13:10:37.821 INFO:tasks.workunit.client.0.smithi012.stdout:5/480: dread dc/d2f/f39 [0,4194304] 0 2024-02-14T13:10:37.821 INFO:tasks.workunit.client.0.smithi012.stdout:5/481: write dc/d47/d6e/f77 [4602940,83980] 0 2024-02-14T13:10:37.821 INFO:tasks.workunit.client.0.smithi012.stdout:6/426: mknod d1/d1e/dc/d38/c83 0 2024-02-14T13:10:37.822 INFO:tasks.workunit.client.0.smithi012.stdout:8/472: symlink d9/dc/d1b/d6b/l93 0 2024-02-14T13:10:37.822 INFO:tasks.workunit.client.0.smithi012.stdout:3/495: read d9/d18/d39/f59 [1230672,40212] 0 2024-02-14T13:10:37.823 INFO:tasks.workunit.client.0.smithi012.stdout:3/496: chown d9/dd/d30/d44/d3d/f67 1971097648 1 2024-02-14T13:10:37.823 INFO:tasks.workunit.client.0.smithi012.stdout:3/497: write d9/d3f/f41 [318821,11843] 0 2024-02-14T13:10:37.823 INFO:tasks.workunit.client.0.smithi012.stdout:3/498: chown d9/d3f/d73/d5d/d91 2 1 2024-02-14T13:10:37.823 INFO:tasks.workunit.client.0.smithi012.stdout:0/489: dwrite d10/d14/d41/d52/d67/f8b [0,4194304] 0 2024-02-14T13:10:37.823 INFO:tasks.workunit.client.0.smithi012.stdout:0/490: stat d10/d14/d1b/d30/f6d 0 2024-02-14T13:10:37.825 INFO:tasks.workunit.client.0.smithi012.stdout:5/482: creat dc/d47/d59/d6a/f95 x:0 0 0 2024-02-14T13:10:37.826 INFO:tasks.workunit.client.0.smithi012.stdout:6/427: symlink d1/d17/l84 0 2024-02-14T13:10:37.828 INFO:tasks.workunit.client.0.smithi012.stdout:3/499: rename d9/dd/d30/d34/d75 to d9/d18/daf 0 2024-02-14T13:10:37.829 INFO:tasks.workunit.client.0.smithi012.stdout:4/437: dwrite d0/d55/f64 [0,4194304] 0 2024-02-14T13:10:37.835 INFO:tasks.workunit.client.0.smithi012.stdout:8/473: dread d9/dc/d38/f55 [4194304,4194304] 0 2024-02-14T13:10:37.836 INFO:tasks.workunit.client.0.smithi012.stdout:0/491: creat d10/d14/d41/f98 x:0 0 0 2024-02-14T13:10:37.836 INFO:tasks.workunit.client.0.smithi012.stdout:0/492: chown d10/d14/d1b/d30/f6f 1264256365 1 2024-02-14T13:10:37.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/483: symlink dc/d47/d6e/l96 0 2024-02-14T13:10:37.838 INFO:tasks.workunit.client.0.smithi012.stdout:6/428: creat d1/d1e/d1b/f85 x:0 0 0 2024-02-14T13:10:37.839 INFO:tasks.workunit.client.0.smithi012.stdout:3/500: rename d9/dd/d30/d44/c6b to d9/dd/d30/d34/d78/cb0 0 2024-02-14T13:10:37.839 INFO:tasks.workunit.client.0.smithi012.stdout:3/501: write d9/dd/de/d58/d65/d6c/f94 [820354,94781] 0 2024-02-14T13:10:37.842 INFO:tasks.workunit.client.0.smithi012.stdout:4/438: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/fa0 x:0 0 0 2024-02-14T13:10:37.845 INFO:tasks.workunit.client.0.smithi012.stdout:0/493: mkdir d10/d14/d41/d52/d99 0 2024-02-14T13:10:37.845 INFO:tasks.workunit.client.0.smithi012.stdout:0/494: fsync d10/f57 0 2024-02-14T13:10:37.845 INFO:tasks.workunit.client.0.smithi012.stdout:0/495: getdents d10/d14/d1b/d54/d96 0 2024-02-14T13:10:37.845 INFO:tasks.workunit.client.0.smithi012.stdout:0/496: truncate d10/d14/f1e 3524368 0 2024-02-14T13:10:37.846 INFO:tasks.workunit.client.0.smithi012.stdout:0/497: dread d10/d14/d20/d49/f5e [0,4194304] 0 2024-02-14T13:10:37.847 INFO:tasks.workunit.client.0.smithi012.stdout:5/484: unlink dc/d17/c49 0 2024-02-14T13:10:37.848 INFO:tasks.workunit.client.0.smithi012.stdout:4/439: dread d0/d10/d28/f37 [0,4194304] 0 2024-02-14T13:10:37.849 INFO:tasks.workunit.client.0.smithi012.stdout:8/474: rename d9/dc/d14/d23/c8c to d9/dc/d14/d23/c94 0 2024-02-14T13:10:37.852 INFO:tasks.workunit.client.0.smithi012.stdout:5/485: unlink dc/d17/f27 0 2024-02-14T13:10:37.853 INFO:tasks.workunit.client.0.smithi012.stdout:5/486: mkdir dc/d2f/d40/d53/d97 0 2024-02-14T13:10:37.858 INFO:tasks.workunit.client.0.smithi012.stdout:0/498: dread d10/d14/d1b/f3c [0,4194304] 0 2024-02-14T13:10:37.858 INFO:tasks.workunit.client.0.smithi012.stdout:0/499: fsync fd 0 2024-02-14T13:10:37.858 INFO:tasks.workunit.client.0.smithi012.stdout:0/500: dread - d10/d14/d1b/f8a zero size 2024-02-14T13:10:37.859 INFO:tasks.workunit.client.0.smithi012.stdout:0/501: creat d10/d14/d41/f9a x:0 0 0 2024-02-14T13:10:37.860 INFO:tasks.workunit.client.0.smithi012.stdout:9/538: sync 2024-02-14T13:10:37.861 INFO:tasks.workunit.client.0.smithi012.stdout:9/539: creat da/dd/d38/d7e/fb9 x:0 0 0 2024-02-14T13:10:37.863 INFO:tasks.workunit.client.0.smithi012.stdout:9/540: symlink da/dd/d19/d30/lba 0 2024-02-14T13:10:37.863 INFO:tasks.workunit.client.0.smithi012.stdout:9/541: stat da/dd/d57/d59/d73 0 2024-02-14T13:10:37.863 INFO:tasks.workunit.client.0.smithi012.stdout:9/542: chown da/dd/d39/f6b 16353302 1 2024-02-14T13:10:37.864 INFO:tasks.workunit.client.0.smithi012.stdout:6/429: dwrite d1/d1e/dc/d28/f64 [0,4194304] 0 2024-02-14T13:10:37.865 INFO:tasks.workunit.client.0.smithi012.stdout:9/543: creat da/dd/d39/fbb x:0 0 0 2024-02-14T13:10:37.868 INFO:tasks.workunit.client.0.smithi012.stdout:3/502: dwrite d9/dd/de/f1a [8388608,4194304] 0 2024-02-14T13:10:37.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/544: mknod da/dd/d99/cbc 0 2024-02-14T13:10:37.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/545: dread - da/dd/d38/d7e/fb9 zero size 2024-02-14T13:10:37.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/546: chown da 623336 1 2024-02-14T13:10:37.869 INFO:tasks.workunit.client.0.smithi012.stdout:9/547: write da/dd/d18/d71/d85/f51 [3149297,3084] 0 2024-02-14T13:10:37.870 INFO:tasks.workunit.client.0.smithi012.stdout:3/503: truncate d9/d3f/d4e/f6d 3289932 0 2024-02-14T13:10:37.871 INFO:tasks.workunit.client.0.smithi012.stdout:9/548: creat da/dd/d57/d59/da8/fbd x:0 0 0 2024-02-14T13:10:37.872 INFO:tasks.workunit.client.0.smithi012.stdout:3/504: truncate d9/f61 3841879 0 2024-02-14T13:10:37.872 INFO:tasks.workunit.client.0.smithi012.stdout:9/549: creat da/dd/d57/d59/fbe x:0 0 0 2024-02-14T13:10:37.873 INFO:tasks.workunit.client.0.smithi012.stdout:9/550: mknod da/dd/d19/d30/d45/cbf 0 2024-02-14T13:10:37.874 INFO:tasks.workunit.client.0.smithi012.stdout:4/440: dwrite d0/fa [0,4194304] 0 2024-02-14T13:10:37.875 INFO:tasks.workunit.client.0.smithi012.stdout:9/551: dread da/dd/d19/d30/d9d/f9f [0,4194304] 0 2024-02-14T13:10:37.877 INFO:tasks.workunit.client.0.smithi012.stdout:4/441: symlink d0/d10/d28/d4f/d6b/d83/d99/la1 0 2024-02-14T13:10:37.880 INFO:tasks.workunit.client.0.smithi012.stdout:9/552: link da/dd/c5e da/dd/cc0 0 2024-02-14T13:10:37.880 INFO:tasks.workunit.client.0.smithi012.stdout:9/553: truncate da/dd/d18/d71/d85/d48/fb8 249417 0 2024-02-14T13:10:37.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/442: mkdir d0/d10/d28/d4f/d6b/d83/d17/d5f/da2 0 2024-02-14T13:10:37.890 INFO:tasks.workunit.client.0.smithi012.stdout:4/443: dread d0/d10/d28/f3c [0,4194304] 0 2024-02-14T13:10:37.892 INFO:tasks.workunit.client.0.smithi012.stdout:4/444: creat d0/d10/d28/d4f/d6b/d83/d99/fa3 x:0 0 0 2024-02-14T13:10:37.893 INFO:tasks.workunit.client.0.smithi012.stdout:4/445: symlink d0/d10/d28/d4f/d6b/d8f/la4 0 2024-02-14T13:10:37.893 INFO:tasks.workunit.client.0.smithi012.stdout:4/446: dread - d0/d10/f7b zero size 2024-02-14T13:10:37.893 INFO:tasks.workunit.client.0.smithi012.stdout:4/447: chown d0/d10/d28/l2b 5207316 1 2024-02-14T13:10:37.896 INFO:tasks.workunit.client.0.smithi012.stdout:4/448: rename d0/d10/c96 to d0/ca5 0 2024-02-14T13:10:37.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/449: mknod d0/d10/d28/d4f/d6b/d8f/ca6 0 2024-02-14T13:10:37.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/450: fdatasync d0/d10/d28/d4f/d6b/d83/d17/f5e 0 2024-02-14T13:10:37.898 INFO:tasks.workunit.client.0.smithi012.stdout:1/543: sync 2024-02-14T13:10:37.898 INFO:tasks.workunit.client.0.smithi012.stdout:1/544: chown d6/d10 14 1 2024-02-14T13:10:37.898 INFO:tasks.workunit.client.0.smithi012.stdout:4/451: rename d0/d10/f6d to d0/d10/d1f/fa7 0 2024-02-14T13:10:37.899 INFO:tasks.workunit.client.0.smithi012.stdout:0/502: dwrite d10/d14/d41/f9a [0,4194304] 0 2024-02-14T13:10:37.899 INFO:tasks.workunit.client.0.smithi012.stdout:5/487: dwrite dc/d17/f43 [0,4194304] 0 2024-02-14T13:10:37.899 INFO:tasks.workunit.client.0.smithi012.stdout:6/430: dwrite d1/d1e/d1b/d21/f32 [0,4194304] 0 2024-02-14T13:10:37.899 INFO:tasks.workunit.client.0.smithi012.stdout:1/545: creat d6/d10/d22/d31/d3e/fb1 x:0 0 0 2024-02-14T13:10:37.900 INFO:tasks.workunit.client.0.smithi012.stdout:5/488: write dc/d47/d6e/f77 [4231614,7566] 0 2024-02-14T13:10:37.900 INFO:tasks.workunit.client.0.smithi012.stdout:5/489: chown dc/l16 0 1 2024-02-14T13:10:37.900 INFO:tasks.workunit.client.0.smithi012.stdout:4/452: creat d0/d10/d28/d4f/d6b/d83/d99/fa8 x:0 0 0 2024-02-14T13:10:37.900 INFO:tasks.workunit.client.0.smithi012.stdout:4/453: truncate d0/d10/f7b 875774 0 2024-02-14T13:10:37.901 INFO:tasks.workunit.client.0.smithi012.stdout:0/503: mkdir d10/d14/d41/d52/d99/d9b 0 2024-02-14T13:10:37.903 INFO:tasks.workunit.client.0.smithi012.stdout:8/475: dwrite d9/dc/d1b/d35/d50/d56/f77 [0,4194304] 0 2024-02-14T13:10:37.903 INFO:tasks.workunit.client.0.smithi012.stdout:6/431: rename d1/df/d24/l7a to d1/d1e/dc/d28/d7b/l86 0 2024-02-14T13:10:37.905 INFO:tasks.workunit.client.0.smithi012.stdout:1/546: mknod d6/d10/d22/d31/d3e/cb2 0 2024-02-14T13:10:37.905 INFO:tasks.workunit.client.0.smithi012.stdout:1/547: stat d6/d10/d22/d31/d5b/d5e/d65/d87/f6a 0 2024-02-14T13:10:37.905 INFO:tasks.workunit.client.0.smithi012.stdout:1/548: readlink l5 0 2024-02-14T13:10:37.906 INFO:tasks.workunit.client.0.smithi012.stdout:9/554: dwrite da/dd/fb4 [0,4194304] 0 2024-02-14T13:10:37.906 INFO:tasks.workunit.client.0.smithi012.stdout:9/555: fdatasync da/dd/d19/d30/f17 0 2024-02-14T13:10:37.906 INFO:tasks.workunit.client.0.smithi012.stdout:5/490: rmdir dc/d47/d69 39 2024-02-14T13:10:37.907 INFO:tasks.workunit.client.0.smithi012.stdout:3/505: dread d9/d3f/d4e/f6d [0,4194304] 0 2024-02-14T13:10:37.908 INFO:tasks.workunit.client.0.smithi012.stdout:4/454: unlink d0/d10/d28/d4f/d6b/d83/c84 0 2024-02-14T13:10:37.908 INFO:tasks.workunit.client.0.smithi012.stdout:6/432: dread d1/d1e/d1b/d3e/f4c [0,4194304] 0 2024-02-14T13:10:37.908 INFO:tasks.workunit.client.0.smithi012.stdout:6/433: write d1/d17/f53 [2734296,45594] 0 2024-02-14T13:10:37.909 INFO:tasks.workunit.client.0.smithi012.stdout:0/504: mknod d10/d14/d41/d52/d72/c9c 0 2024-02-14T13:10:37.909 INFO:tasks.workunit.client.0.smithi012.stdout:0/505: chown d10/d14/d41/d52/d78 0 1 2024-02-14T13:10:37.913 INFO:tasks.workunit.client.0.smithi012.stdout:9/556: write da/f3f [1587823,45920] 0 2024-02-14T13:10:37.914 INFO:tasks.workunit.client.0.smithi012.stdout:3/506: read d9/f61 [320968,64768] 0 2024-02-14T13:10:37.915 INFO:tasks.workunit.client.0.smithi012.stdout:8/476: unlink d9/dc/d14/d23/c81 0 2024-02-14T13:10:37.917 INFO:tasks.workunit.client.0.smithi012.stdout:1/549: getdents d6/d10/d22/d31/d5b/d5d/d6d 0 2024-02-14T13:10:37.926 INFO:tasks.workunit.client.0.smithi012.stdout:6/434: rename d1/d1e/d1b/f5d to d1/d1e/d1b/f87 0 2024-02-14T13:10:37.927 INFO:tasks.workunit.client.0.smithi012.stdout:0/506: creat d10/d84/f9d x:0 0 0 2024-02-14T13:10:37.930 INFO:tasks.workunit.client.0.smithi012.stdout:3/507: link d9/d18/f4d d9/dd/d30/d34/d78/fb1 0 2024-02-14T13:10:37.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/477: rename d9/dc/d14/d2e/f44 to d9/dc/d14/f95 0 2024-02-14T13:10:37.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/478: write d9/dc/d1b/d35/f8a [240319,66728] 0 2024-02-14T13:10:37.932 INFO:tasks.workunit.client.0.smithi012.stdout:5/491: truncate dc/d47/d6e/f77 4354603 0 2024-02-14T13:10:37.933 INFO:tasks.workunit.client.0.smithi012.stdout:6/435: creat d1/d1e/d66/f88 x:0 0 0 2024-02-14T13:10:37.934 INFO:tasks.workunit.client.0.smithi012.stdout:0/507: unlink d10/d14/d41/d52/d78/d8c/l66 0 2024-02-14T13:10:37.934 INFO:tasks.workunit.client.0.smithi012.stdout:0/508: fdatasync d10/f57 0 2024-02-14T13:10:37.934 INFO:tasks.workunit.client.0.smithi012.stdout:0/509: write d10/d14/d23/f45 [3430814,30586] 0 2024-02-14T13:10:37.935 INFO:tasks.workunit.client.0.smithi012.stdout:3/508: creat d9/d18/daf/fb2 x:0 0 0 2024-02-14T13:10:37.935 INFO:tasks.workunit.client.0.smithi012.stdout:8/479: creat d9/dc/d1b/d35/d50/d56/d57/f96 x:0 0 0 2024-02-14T13:10:37.936 INFO:tasks.workunit.client.0.smithi012.stdout:6/436: creat d1/d1e/dc/d43/f89 x:0 0 0 2024-02-14T13:10:37.936 INFO:tasks.workunit.client.0.smithi012.stdout:6/437: readlink d1/d1e/dc/d28/d7b/l86 0 2024-02-14T13:10:37.936 INFO:tasks.workunit.client.0.smithi012.stdout:9/557: dwrite da/fc [0,4194304] 0 2024-02-14T13:10:37.937 INFO:tasks.workunit.client.0.smithi012.stdout:4/455: dwrite d0/d10/d28/f37 [0,4194304] 0 2024-02-14T13:10:37.937 INFO:tasks.workunit.client.0.smithi012.stdout:1/550: dwrite d6/d35/f8c [0,4194304] 0 2024-02-14T13:10:37.937 INFO:tasks.workunit.client.0.smithi012.stdout:0/510: getdents d10/d14/d41/d52/d67 0 2024-02-14T13:10:37.938 INFO:tasks.workunit.client.0.smithi012.stdout:1/551: read d6/d10/d22/d31/d34/fa5 [357197,14919] 0 2024-02-14T13:10:37.939 INFO:tasks.workunit.client.0.smithi012.stdout:3/509: truncate d9/d18/f23 670527 0 2024-02-14T13:10:37.940 INFO:tasks.workunit.client.0.smithi012.stdout:9/558: dread da/dd/d18/f32 [0,4194304] 0 2024-02-14T13:10:37.942 INFO:tasks.workunit.client.0.smithi012.stdout:2/572: sync 2024-02-14T13:10:37.942 INFO:tasks.workunit.client.0.smithi012.stdout:7/425: sync 2024-02-14T13:10:37.942 INFO:tasks.workunit.client.0.smithi012.stdout:2/573: fdatasync d0/d1a/f49 0 2024-02-14T13:10:37.942 INFO:tasks.workunit.client.0.smithi012.stdout:2/574: truncate d0/d5/d15/d57/f78 1553776 0 2024-02-14T13:10:37.943 INFO:tasks.workunit.client.0.smithi012.stdout:0/511: symlink d10/d14/d41/d61/d74/l9e 0 2024-02-14T13:10:37.943 INFO:tasks.workunit.client.0.smithi012.stdout:1/552: creat d6/d10/d22/d31/d5b/d5e/fb3 x:0 0 0 2024-02-14T13:10:37.943 INFO:tasks.workunit.client.0.smithi012.stdout:1/553: stat d6/d10/d22/d31/d3e/lac 0 2024-02-14T13:10:37.944 INFO:tasks.workunit.client.0.smithi012.stdout:3/510: mkdir d9/dd/d30/d44/d66/db3 0 2024-02-14T13:10:37.946 INFO:tasks.workunit.client.0.smithi012.stdout:6/438: dread d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:37.947 INFO:tasks.workunit.client.0.smithi012.stdout:0/512: mknod d10/d14/d41/d52/c9f 0 2024-02-14T13:10:37.947 INFO:tasks.workunit.client.0.smithi012.stdout:0/513: chown d10/d14/d41/d52/d78/d8c/f36 67871364 1 2024-02-14T13:10:37.949 INFO:tasks.workunit.client.0.smithi012.stdout:1/554: mkdir d6/d10/d22/d31/d5b/d5e/d65/db4 0 2024-02-14T13:10:37.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/511: symlink d9/dd/d30/lb4 0 2024-02-14T13:10:37.951 INFO:tasks.workunit.client.0.smithi012.stdout:0/514: mkdir d10/d14/d41/d61/d74/da0 0 2024-02-14T13:10:37.953 INFO:tasks.workunit.client.0.smithi012.stdout:1/555: creat d6/d10/d22/fb5 x:0 0 0 2024-02-14T13:10:37.953 INFO:tasks.workunit.client.0.smithi012.stdout:1/556: chown d6/d10/d22/d31/d34/d58/f9a 3004 1 2024-02-14T13:10:37.954 INFO:tasks.workunit.client.0.smithi012.stdout:5/492: dwrite dc/f12 [0,4194304] 0 2024-02-14T13:10:37.954 INFO:tasks.workunit.client.0.smithi012.stdout:5/493: chown dc/d2f/d70/d78 45705119 1 2024-02-14T13:10:37.955 INFO:tasks.workunit.client.0.smithi012.stdout:9/559: dread da/dd/d57/f97 [0,4194304] 0 2024-02-14T13:10:37.955 INFO:tasks.workunit.client.0.smithi012.stdout:5/494: write dc/d17/f67 [1309837,127061] 0 2024-02-14T13:10:37.955 INFO:tasks.workunit.client.0.smithi012.stdout:9/560: write da/dd/d19/d30/f1f [3543260,68692] 0 2024-02-14T13:10:37.955 INFO:tasks.workunit.client.0.smithi012.stdout:5/495: write dc/d2f/d89/f8b [204545,52139] 0 2024-02-14T13:10:37.955 INFO:tasks.workunit.client.0.smithi012.stdout:8/480: rename d9/dc/d1b/d35/d50 to d9/dc/d14/d23/d97 0 2024-02-14T13:10:37.955 INFO:tasks.workunit.client.0.smithi012.stdout:8/481: fsync d9/dc/d38/f60 0 2024-02-14T13:10:37.956 INFO:tasks.workunit.client.0.smithi012.stdout:1/557: symlink d6/d10/d22/d31/d5b/d5e/d65/lb6 0 2024-02-14T13:10:37.957 INFO:tasks.workunit.client.0.smithi012.stdout:3/512: dread d9/d3f/d4e/f6d [0,4194304] 0 2024-02-14T13:10:37.960 INFO:tasks.workunit.client.0.smithi012.stdout:1/558: dread d6/d10/d22/d31/d34/d3b/f81 [0,4194304] 0 2024-02-14T13:10:37.960 INFO:tasks.workunit.client.0.smithi012.stdout:1/559: dread - d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/faa zero size 2024-02-14T13:10:37.961 INFO:tasks.workunit.client.0.smithi012.stdout:1/560: chown d6/d10/d22/c30 847 1 2024-02-14T13:10:37.961 INFO:tasks.workunit.client.0.smithi012.stdout:5/496: getdents dc/d17/d20/d4c/d63/d81 0 2024-02-14T13:10:37.961 INFO:tasks.workunit.client.0.smithi012.stdout:5/497: fsync dc/d17/f43 0 2024-02-14T13:10:37.963 INFO:tasks.workunit.client.0.smithi012.stdout:4/456: rename d0/d10/d28/d4f/d6b/d8f/d63 to d0/d10/d28/da9 0 2024-02-14T13:10:37.964 INFO:tasks.workunit.client.0.smithi012.stdout:3/513: mknod d9/d3f/da8/cb5 0 2024-02-14T13:10:37.964 INFO:tasks.workunit.client.0.smithi012.stdout:3/514: write d9/d3f/f41 [1278498,22358] 0 2024-02-14T13:10:37.964 INFO:tasks.workunit.client.0.smithi012.stdout:3/515: fsync d9/d3f/f87 0 2024-02-14T13:10:37.964 INFO:tasks.workunit.client.0.smithi012.stdout:3/516: chown d9/d3f/d4e/la6 113763737 1 2024-02-14T13:10:37.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/482: dread d9/dc/d14/d23/d97/f59 [0,4194304] 0 2024-02-14T13:10:37.970 INFO:tasks.workunit.client.0.smithi012.stdout:5/498: write dc/f12 [2874448,59879] 0 2024-02-14T13:10:37.970 INFO:tasks.workunit.client.0.smithi012.stdout:7/426: dwrite df/d24/d56/f64 [0,4194304] 0 2024-02-14T13:10:37.970 INFO:tasks.workunit.client.0.smithi012.stdout:5/499: write dc/d2f/d40/f48 [277816,28248] 0 2024-02-14T13:10:37.973 INFO:tasks.workunit.client.0.smithi012.stdout:3/517: write d9/dd/d30/d44/f29 [4382925,91646] 0 2024-02-14T13:10:37.973 INFO:tasks.workunit.client.0.smithi012.stdout:7/427: read df/d36/f3c [269098,82515] 0 2024-02-14T13:10:37.974 INFO:tasks.workunit.client.0.smithi012.stdout:1/561: creat d6/d10/d22/d31/d5b/d5d/d6d/fb7 x:0 0 0 2024-02-14T13:10:37.974 INFO:tasks.workunit.client.0.smithi012.stdout:0/515: dwrite d10/d14/d20/f6b [0,4194304] 0 2024-02-14T13:10:37.974 INFO:tasks.workunit.client.0.smithi012.stdout:0/516: chown c8 30 1 2024-02-14T13:10:37.976 INFO:tasks.workunit.client.0.smithi012.stdout:2/575: rename d0/d8/d89/c93 to d0/d8/d9/d90/dab/cc7 0 2024-02-14T13:10:37.978 INFO:tasks.workunit.client.0.smithi012.stdout:4/457: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa x:0 0 0 2024-02-14T13:10:37.980 INFO:tasks.workunit.client.0.smithi012.stdout:8/483: link d9/dc/d14/l47 d9/dc/d14/d23/d97/d56/d57/d5c/l98 0 2024-02-14T13:10:37.984 INFO:tasks.workunit.client.0.smithi012.stdout:3/518: symlink d9/d13/lb6 0 2024-02-14T13:10:37.984 INFO:tasks.workunit.client.0.smithi012.stdout:3/519: chown d9/d3f/f81 68983581 1 2024-02-14T13:10:37.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/562: creat d6/d10/d22/d31/d5b/d5e/d65/db4/fb8 x:0 0 0 2024-02-14T13:10:37.990 INFO:tasks.workunit.client.0.smithi012.stdout:6/439: rename d1/d1e/dc/d28/d7b/l86 to d1/df/d24/d3f/d56/l8a 0 2024-02-14T13:10:37.990 INFO:tasks.workunit.client.0.smithi012.stdout:6/440: truncate d1/d17/d5a/f68 380890 0 2024-02-14T13:10:37.991 INFO:tasks.workunit.client.0.smithi012.stdout:4/458: getdents d0/d10 0 2024-02-14T13:10:37.992 INFO:tasks.workunit.client.0.smithi012.stdout:8/484: creat d9/dc/d14/d23/d97/d56/d57/d7c/f99 x:0 0 0 2024-02-14T13:10:37.993 INFO:tasks.workunit.client.0.smithi012.stdout:5/500: dwrite f0 [0,4194304] 0 2024-02-14T13:10:37.993 INFO:tasks.workunit.client.0.smithi012.stdout:3/520: mknod d9/d13/cb7 0 2024-02-14T13:10:37.994 INFO:tasks.workunit.client.0.smithi012.stdout:5/501: dread dc/d2f/f39 [0,4194304] 0 2024-02-14T13:10:37.994 INFO:tasks.workunit.client.0.smithi012.stdout:5/502: fdatasync dc/d17/d20/f3a 0 2024-02-14T13:10:37.994 INFO:tasks.workunit.client.0.smithi012.stdout:3/521: dread d9/dd/d30/d44/f9e [0,4194304] 0 2024-02-14T13:10:37.994 INFO:tasks.workunit.client.0.smithi012.stdout:3/522: write d9/d18/f23 [621536,110023] 0 2024-02-14T13:10:37.994 INFO:tasks.workunit.client.0.smithi012.stdout:1/563: mknod d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/cb9 0 2024-02-14T13:10:37.997 INFO:tasks.workunit.client.0.smithi012.stdout:0/517: rename d10/d14/d20/f6b to d10/d14/d51/fa1 0 2024-02-14T13:10:37.997 INFO:tasks.workunit.client.0.smithi012.stdout:0/518: stat d10/d14/d51 0 2024-02-14T13:10:37.998 INFO:tasks.workunit.client.0.smithi012.stdout:4/459: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/fab x:0 0 0 2024-02-14T13:10:37.998 INFO:tasks.workunit.client.0.smithi012.stdout:4/460: read - d0/d10/d28/f51 zero size 2024-02-14T13:10:38.002 INFO:tasks.workunit.client.0.smithi012.stdout:2/576: dwrite d0/d5/d39/f91 [0,4194304] 0 2024-02-14T13:10:38.002 INFO:tasks.workunit.client.0.smithi012.stdout:2/577: readlink d0/d6/de/d7b/l87 0 2024-02-14T13:10:38.002 INFO:tasks.workunit.client.0.smithi012.stdout:5/503: mkdir dc/d2f/d40/d53/d97/d98 0 2024-02-14T13:10:38.004 INFO:tasks.workunit.client.0.smithi012.stdout:5/504: dread dc/d17/d4b/f7c [0,4194304] 0 2024-02-14T13:10:38.005 INFO:tasks.workunit.client.0.smithi012.stdout:1/564: link d6/fe d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/fba 0 2024-02-14T13:10:38.005 INFO:tasks.workunit.client.0.smithi012.stdout:1/565: chown d6/d10/d22/d31/d5b/d5d/d6d/l91 264076649 1 2024-02-14T13:10:38.006 INFO:tasks.workunit.client.0.smithi012.stdout:0/519: mknod d10/d14/d41/ca2 0 2024-02-14T13:10:38.008 INFO:tasks.workunit.client.0.smithi012.stdout:1/566: dread d6/d10/d22/d31/d34/fa5 [0,4194304] 0 2024-02-14T13:10:38.008 INFO:tasks.workunit.client.0.smithi012.stdout:1/567: chown l0 416173915 1 2024-02-14T13:10:38.008 INFO:tasks.workunit.client.0.smithi012.stdout:1/568: chown d6/d10/d22/d31/d5b/d5e/f36 6090103 1 2024-02-14T13:10:38.009 INFO:tasks.workunit.client.0.smithi012.stdout:3/523: dread d9/dd/d30/d34/f51 [0,4194304] 0 2024-02-14T13:10:38.009 INFO:tasks.workunit.client.0.smithi012.stdout:8/485: link d9/f3c d9/dc/d1b/f9a 0 2024-02-14T13:10:38.012 INFO:tasks.workunit.client.0.smithi012.stdout:6/441: dwrite d1/d1e/dc/d28/f4d [0,4194304] 0 2024-02-14T13:10:38.013 INFO:tasks.workunit.client.0.smithi012.stdout:0/520: rename d10/d14/d51/l77 to d10/d14/d41/d61/la3 0 2024-02-14T13:10:38.015 INFO:tasks.workunit.client.0.smithi012.stdout:1/569: mkdir d6/d10/d22/d44/dbb 0 2024-02-14T13:10:38.016 INFO:tasks.workunit.client.0.smithi012.stdout:1/570: fsync d6/d10/d22/d31/d5b/d5d/f86 0 2024-02-14T13:10:38.019 INFO:tasks.workunit.client.0.smithi012.stdout:0/521: mkdir d10/d14/d2b/da4 0 2024-02-14T13:10:38.023 INFO:tasks.workunit.client.0.smithi012.stdout:1/571: truncate d6/d10/d22/d31/d5b/d5d/f17 543924 0 2024-02-14T13:10:38.023 INFO:tasks.workunit.client.0.smithi012.stdout:1/572: truncate d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/faa 45491 0 2024-02-14T13:10:38.023 INFO:tasks.workunit.client.0.smithi012.stdout:1/573: truncate d6/d10/d22/d31/d5b/d5e/d65/f75 567432 0 2024-02-14T13:10:38.025 INFO:tasks.workunit.client.0.smithi012.stdout:0/522: creat d10/d14/d41/d52/d78/d8c/d7f/fa5 x:0 0 0 2024-02-14T13:10:38.025 INFO:tasks.workunit.client.0.smithi012.stdout:0/523: write d10/d14/d41/d52/d78/d8c/f36 [866310,106858] 0 2024-02-14T13:10:38.025 INFO:tasks.workunit.client.0.smithi012.stdout:0/524: dread - d10/d14/d1b/f68 zero size 2024-02-14T13:10:38.030 INFO:tasks.workunit.client.0.smithi012.stdout:1/574: unlink d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/fba 0 2024-02-14T13:10:38.030 INFO:tasks.workunit.client.0.smithi012.stdout:1/575: chown d6/d35/c37 0 1 2024-02-14T13:10:38.030 INFO:tasks.workunit.client.0.smithi012.stdout:1/576: fsync d6/d10/d22/d31/d5b/d5d/f55 0 2024-02-14T13:10:38.031 INFO:tasks.workunit.client.0.smithi012.stdout:0/525: truncate d10/d14/d2b/d3b/f4f 393479 0 2024-02-14T13:10:38.031 INFO:tasks.workunit.client.0.smithi012.stdout:2/578: dwrite d0/d5/d15/d57/f66 [4194304,4194304] 0 2024-02-14T13:10:38.032 INFO:tasks.workunit.client.0.smithi012.stdout:0/526: getdents d10/d14/d41/d52/d99 0 2024-02-14T13:10:38.034 INFO:tasks.workunit.client.0.smithi012.stdout:0/527: symlink d10/d14/d41/d52/la6 0 2024-02-14T13:10:38.036 INFO:tasks.workunit.client.0.smithi012.stdout:1/577: dread d6/d10/f3a [0,4194304] 0 2024-02-14T13:10:38.039 INFO:tasks.workunit.client.0.smithi012.stdout:1/578: link d6/d10/d22/d31/d34/f8b d6/d10/d22/d31/d5b/d5d/d80/da4/fbc 0 2024-02-14T13:10:38.050 INFO:tasks.workunit.client.0.smithi012.stdout:2/579: dwrite d0/d6/f81 [0,4194304] 0 2024-02-14T13:10:38.053 INFO:tasks.workunit.client.0.smithi012.stdout:2/580: link d0/d6/d37/d84/d26/l46 d0/d8/d9/d90/dab/lc8 0 2024-02-14T13:10:38.053 INFO:tasks.workunit.client.0.smithi012.stdout:2/581: write d0/d6/d37/f3b [1603558,84939] 0 2024-02-14T13:10:38.054 INFO:tasks.workunit.client.0.smithi012.stdout:2/582: getdents d0/d8/d11/d35 0 2024-02-14T13:10:38.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/524: dwrite d9/dd/d30/d34/d78/fb1 [0,4194304] 0 2024-02-14T13:10:38.055 INFO:tasks.workunit.client.0.smithi012.stdout:2/583: creat d0/d5/d39/db8/fc9 x:0 0 0 2024-02-14T13:10:38.056 INFO:tasks.workunit.client.0.smithi012.stdout:3/525: creat d9/dd/fb8 x:0 0 0 2024-02-14T13:10:38.056 INFO:tasks.workunit.client.0.smithi012.stdout:4/461: dwrite d0/f68 [0,4194304] 0 2024-02-14T13:10:38.056 INFO:tasks.workunit.client.0.smithi012.stdout:3/526: mkdir d9/dd/d30/d44/d66/db3/db9 0 2024-02-14T13:10:38.057 INFO:tasks.workunit.client.0.smithi012.stdout:4/462: truncate d0/d10/f2a 453021 0 2024-02-14T13:10:38.058 INFO:tasks.workunit.client.0.smithi012.stdout:3/527: symlink d9/dd/d30/d44/d66/db3/db9/lba 0 2024-02-14T13:10:38.058 INFO:tasks.workunit.client.0.smithi012.stdout:4/463: getdents d0/d10/d28/d4f/d6b/d8f/d56/d8c 0 2024-02-14T13:10:38.060 INFO:tasks.workunit.client.0.smithi012.stdout:0/528: dwrite d10/d14/f2e [4194304,4194304] 0 2024-02-14T13:10:38.060 INFO:tasks.workunit.client.0.smithi012.stdout:8/486: dwrite d9/dc/d1b/d35/f8a [0,4194304] 0 2024-02-14T13:10:38.060 INFO:tasks.workunit.client.0.smithi012.stdout:4/464: mknod d0/d10/d28/d4f/d6b/d8f/d56/d8c/cac 0 2024-02-14T13:10:38.062 INFO:tasks.workunit.client.0.smithi012.stdout:0/529: truncate d10/d14/f43 420757 0 2024-02-14T13:10:38.063 INFO:tasks.workunit.client.0.smithi012.stdout:0/530: stat d10/d14/d2b/d3b 0 2024-02-14T13:10:38.063 INFO:tasks.workunit.client.0.smithi012.stdout:0/531: fsync d10/d14/f1e 0 2024-02-14T13:10:38.067 INFO:tasks.workunit.client.0.smithi012.stdout:8/487: unlink d9/dc/d14/d23/d97/d56/d57/d5c/f75 0 2024-02-14T13:10:38.068 INFO:tasks.workunit.client.0.smithi012.stdout:1/579: dwrite d6/d10/d22/d31/d3e/f4f [0,4194304] 0 2024-02-14T13:10:38.068 INFO:tasks.workunit.client.0.smithi012.stdout:4/465: creat d0/d10/d28/d4f/d6b/d8f/d56/fad x:0 0 0 2024-02-14T13:10:38.070 INFO:tasks.workunit.client.0.smithi012.stdout:3/528: read d9/d18/f4d [1679219,5587] 0 2024-02-14T13:10:38.070 INFO:tasks.workunit.client.0.smithi012.stdout:3/529: fsync d9/d3f/f81 0 2024-02-14T13:10:38.076 INFO:tasks.workunit.client.0.smithi012.stdout:2/584: dwrite d0/d2d/f99 [0,4194304] 0 2024-02-14T13:10:38.078 INFO:tasks.workunit.client.0.smithi012.stdout:4/466: dread d0/d55/f64 [0,4194304] 0 2024-02-14T13:10:38.082 INFO:tasks.workunit.client.0.smithi012.stdout:1/580: mkdir d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/dbd 0 2024-02-14T13:10:38.082 INFO:tasks.workunit.client.0.smithi012.stdout:1/581: getdents d6/d10/d22/d31/d34/da0 0 2024-02-14T13:10:38.083 INFO:tasks.workunit.client.0.smithi012.stdout:3/530: link d9/d13/c42 d9/dd/d30/d44/d66/cbb 0 2024-02-14T13:10:38.085 INFO:tasks.workunit.client.0.smithi012.stdout:0/532: dwrite fc [8388608,4194304] 0 2024-02-14T13:10:38.085 INFO:tasks.workunit.client.0.smithi012.stdout:2/585: rename d0/d8/d11/d33/fae to d0/d8/d9/dbe/fca 0 2024-02-14T13:10:38.086 INFO:tasks.workunit.client.0.smithi012.stdout:3/531: creat d9/dd/fbc x:0 0 0 2024-02-14T13:10:38.091 INFO:tasks.workunit.client.0.smithi012.stdout:0/533: creat d10/d14/d41/d52/d72/fa7 x:0 0 0 2024-02-14T13:10:38.091 INFO:tasks.workunit.client.0.smithi012.stdout:1/582: rename d6/d10/d22/d31/d5b/d5d/f76 to d6/d10/d22/d31/d34/fbe 0 2024-02-14T13:10:38.091 INFO:tasks.workunit.client.0.smithi012.stdout:4/467: dread d0/fa [0,4194304] 0 2024-02-14T13:10:38.092 INFO:tasks.workunit.client.0.smithi012.stdout:8/488: dwrite d9/dc/d1b/d35/f78 [0,4194304] 0 2024-02-14T13:10:38.092 INFO:tasks.workunit.client.0.smithi012.stdout:2/586: mkdir d0/d5/d15/d57/d6d/dcb 0 2024-02-14T13:10:38.093 INFO:tasks.workunit.client.0.smithi012.stdout:3/532: symlink d9/dd/de/d58/lbd 0 2024-02-14T13:10:38.093 INFO:tasks.workunit.client.0.smithi012.stdout:3/533: fsync d9/d13/d28/f9a 0 2024-02-14T13:10:38.093 INFO:tasks.workunit.client.0.smithi012.stdout:3/534: chown d9/d13/d28/f40 0 1 2024-02-14T13:10:38.094 INFO:tasks.workunit.client.0.smithi012.stdout:0/534: creat d10/d14/fa8 x:0 0 0 2024-02-14T13:10:38.094 INFO:tasks.workunit.client.0.smithi012.stdout:0/535: dread - d10/d14/d41/f82 zero size 2024-02-14T13:10:38.096 INFO:tasks.workunit.client.0.smithi012.stdout:1/583: creat d6/d10/d22/d31/d3e/fbf x:0 0 0 2024-02-14T13:10:38.096 INFO:tasks.workunit.client.0.smithi012.stdout:1/584: readlink d6/d10/d22/d31/d5b/d5d/l2f 0 2024-02-14T13:10:38.096 INFO:tasks.workunit.client.0.smithi012.stdout:4/468: mknod d0/d10/cae 0 2024-02-14T13:10:38.100 INFO:tasks.workunit.client.0.smithi012.stdout:2/587: symlink d0/d5/d15/dbd/lcc 0 2024-02-14T13:10:38.101 INFO:tasks.workunit.client.0.smithi012.stdout:3/535: symlink d9/d3f/d73/lbe 0 2024-02-14T13:10:38.102 INFO:tasks.workunit.client.0.smithi012.stdout:0/536: creat d10/fa9 x:0 0 0 2024-02-14T13:10:38.102 INFO:tasks.workunit.client.0.smithi012.stdout:0/537: read - d10/d14/d41/d52/f92 zero size 2024-02-14T13:10:38.102 INFO:tasks.workunit.client.0.smithi012.stdout:0/538: fdatasync d10/d14/d1b/f94 0 2024-02-14T13:10:38.104 INFO:tasks.workunit.client.0.smithi012.stdout:1/585: mkdir d6/d10/d22/dc0 0 2024-02-14T13:10:38.105 INFO:tasks.workunit.client.0.smithi012.stdout:4/469: creat d0/d10/d28/d4f/d6b/d83/d17/faf x:0 0 0 2024-02-14T13:10:38.106 INFO:tasks.workunit.client.0.smithi012.stdout:2/588: symlink d0/d20/d54/lcd 0 2024-02-14T13:10:38.107 INFO:tasks.workunit.client.0.smithi012.stdout:3/536: mknod d9/d18/d39/cbf 0 2024-02-14T13:10:38.108 INFO:tasks.workunit.client.0.smithi012.stdout:1/586: mkdir d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/dc1 0 2024-02-14T13:10:38.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/489: dwrite d9/dc/d38/f55 [0,4194304] 0 2024-02-14T13:10:38.110 INFO:tasks.workunit.client.0.smithi012.stdout:4/470: mknod d0/d10/d28/cb0 0 2024-02-14T13:10:38.110 INFO:tasks.workunit.client.0.smithi012.stdout:4/471: stat d0/d10/d28/d4f/d6b/d83/d17/d5f 0 2024-02-14T13:10:38.110 INFO:tasks.workunit.client.0.smithi012.stdout:4/472: write d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 [559665,107637] 0 2024-02-14T13:10:38.110 INFO:tasks.workunit.client.0.smithi012.stdout:2/589: creat d0/d5/fce x:0 0 0 2024-02-14T13:10:38.110 INFO:tasks.workunit.client.0.smithi012.stdout:2/590: fsync d0/d8/d9/f9a 0 2024-02-14T13:10:38.111 INFO:tasks.workunit.client.0.smithi012.stdout:3/537: mkdir d9/d3f/d88/dc0 0 2024-02-14T13:10:38.111 INFO:tasks.workunit.client.0.smithi012.stdout:0/539: write fc [12141587,79719] 0 2024-02-14T13:10:38.112 INFO:tasks.workunit.client.0.smithi012.stdout:9/561: sync 2024-02-14T13:10:38.113 INFO:tasks.workunit.client.0.smithi012.stdout:3/538: dread d9/d3f/d73/f86 [0,4194304] 0 2024-02-14T13:10:38.119 INFO:tasks.workunit.client.0.smithi012.stdout:4/473: write d0/f95 [2589690,119403] 0 2024-02-14T13:10:38.120 INFO:tasks.workunit.client.0.smithi012.stdout:8/490: creat d9/dc/d14/d23/d97/f9b x:0 0 0 2024-02-14T13:10:38.121 INFO:tasks.workunit.client.0.smithi012.stdout:2/591: truncate d0/f2f 757982 0 2024-02-14T13:10:38.123 INFO:tasks.workunit.client.0.smithi012.stdout:9/562: mknod da/dd/d57/d59/d73/db6/cc1 0 2024-02-14T13:10:38.123 INFO:tasks.workunit.client.0.smithi012.stdout:9/563: readlink da/dd/d38/d7e/lb7 0 2024-02-14T13:10:38.123 INFO:tasks.workunit.client.0.smithi012.stdout:9/564: chown da/dd/d39/fbb 0 1 2024-02-14T13:10:38.123 INFO:tasks.workunit.client.0.smithi012.stdout:9/565: chown l1 502195199 1 2024-02-14T13:10:38.126 INFO:tasks.workunit.client.0.smithi012.stdout:4/474: mknod d0/d10/d28/da9/cb1 0 2024-02-14T13:10:38.126 INFO:tasks.workunit.client.0.smithi012.stdout:2/592: dread d0/f2 [0,4194304] 0 2024-02-14T13:10:38.127 INFO:tasks.workunit.client.0.smithi012.stdout:8/491: mknod d9/dc/c9c 0 2024-02-14T13:10:38.128 INFO:tasks.workunit.client.0.smithi012.stdout:9/566: rmdir da/dd/d18 39 2024-02-14T13:10:38.129 INFO:tasks.workunit.client.0.smithi012.stdout:1/587: dwrite d6/f1b [0,4194304] 0 2024-02-14T13:10:38.130 INFO:tasks.workunit.client.0.smithi012.stdout:4/475: read d0/d55/f64 [599328,79619] 0 2024-02-14T13:10:38.130 INFO:tasks.workunit.client.0.smithi012.stdout:3/539: mkdir d9/dd/d30/d34/dc1 0 2024-02-14T13:10:38.130 INFO:tasks.workunit.client.0.smithi012.stdout:3/540: chown d9/dd/c1f 166334 1 2024-02-14T13:10:38.130 INFO:tasks.workunit.client.0.smithi012.stdout:9/567: write da/dd/d18/f22 [1523668,105945] 0 2024-02-14T13:10:38.130 INFO:tasks.workunit.client.0.smithi012.stdout:2/593: creat d0/d1a/fcf x:0 0 0 2024-02-14T13:10:38.130 INFO:tasks.workunit.client.0.smithi012.stdout:2/594: fsync d0/d6/f5f 0 2024-02-14T13:10:38.131 INFO:tasks.workunit.client.0.smithi012.stdout:2/595: truncate d0/d6/de/d7b/f61 1406271 0 2024-02-14T13:10:38.131 INFO:tasks.workunit.client.0.smithi012.stdout:2/596: chown d0/d5/f42 1642182788 1 2024-02-14T13:10:38.131 INFO:tasks.workunit.client.0.smithi012.stdout:8/492: creat d9/dc/f9d x:0 0 0 2024-02-14T13:10:38.133 INFO:tasks.workunit.client.0.smithi012.stdout:1/588: creat d6/d10/d22/d44/dbb/fc2 x:0 0 0 2024-02-14T13:10:38.134 INFO:tasks.workunit.client.0.smithi012.stdout:4/476: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fb2 x:0 0 0 2024-02-14T13:10:38.134 INFO:tasks.workunit.client.0.smithi012.stdout:4/477: write d0/d10/d28/d4f/d6b/d8f/d56/f7f [983608,68732] 0 2024-02-14T13:10:38.134 INFO:tasks.workunit.client.0.smithi012.stdout:1/589: write d6/d10/d22/d31/d34/d3b/f81 [715186,23043] 0 2024-02-14T13:10:38.135 INFO:tasks.workunit.client.0.smithi012.stdout:3/541: rename d9/dd/d30/d44/d66/cbb to d9/d3f/d73/d5d/d91/cc2 0 2024-02-14T13:10:38.137 INFO:tasks.workunit.client.0.smithi012.stdout:9/568: rmdir da/dd/d18/d71/d85/d48 39 2024-02-14T13:10:38.137 INFO:tasks.workunit.client.0.smithi012.stdout:9/569: write da/dd/d19/d30/f29 [882794,31731] 0 2024-02-14T13:10:38.140 INFO:tasks.workunit.client.0.smithi012.stdout:4/478: creat d0/d10/d1f/d71/fb3 x:0 0 0 2024-02-14T13:10:38.140 INFO:tasks.workunit.client.0.smithi012.stdout:4/479: write d0/d10/d28/d4f/d6b/d8f/d56/f5d [1846097,109620] 0 2024-02-14T13:10:38.141 INFO:tasks.workunit.client.0.smithi012.stdout:1/590: symlink d6/d10/d22/d44/dbb/lc3 0 2024-02-14T13:10:38.144 INFO:tasks.workunit.client.0.smithi012.stdout:2/597: rename d0/d6/d37/d84/d26 to d0/d8/d11/d35/dd0 0 2024-02-14T13:10:38.145 INFO:tasks.workunit.client.0.smithi012.stdout:3/542: getdents d9/d7b/d95 0 2024-02-14T13:10:38.146 INFO:tasks.workunit.client.0.smithi012.stdout:9/570: symlink da/dd/d19/d30/lc2 0 2024-02-14T13:10:38.146 INFO:tasks.workunit.client.0.smithi012.stdout:5/505: sync 2024-02-14T13:10:38.147 INFO:tasks.workunit.client.0.smithi012.stdout:6/442: sync 2024-02-14T13:10:38.147 INFO:tasks.workunit.client.0.smithi012.stdout:5/506: stat dc/d17/d20/d4c/l91 0 2024-02-14T13:10:38.147 INFO:tasks.workunit.client.0.smithi012.stdout:7/428: sync 2024-02-14T13:10:38.148 INFO:tasks.workunit.client.0.smithi012.stdout:2/598: creat d0/d8/d11/d35/fd1 x:0 0 0 2024-02-14T13:10:38.149 INFO:tasks.workunit.client.0.smithi012.stdout:3/543: symlink d9/d18/lc3 0 2024-02-14T13:10:38.151 INFO:tasks.workunit.client.0.smithi012.stdout:9/571: mknod da/dd/d18/d71/cc3 0 2024-02-14T13:10:38.152 INFO:tasks.workunit.client.0.smithi012.stdout:6/443: symlink d1/d1e/dc/d38/l8b 0 2024-02-14T13:10:38.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/429: mknod df/d36/c98 0 2024-02-14T13:10:38.154 INFO:tasks.workunit.client.0.smithi012.stdout:9/572: mkdir da/dd/d57/d59/dc4 0 2024-02-14T13:10:38.155 INFO:tasks.workunit.client.0.smithi012.stdout:3/544: dread d9/dd/d30/d34/d78/fb1 [0,4194304] 0 2024-02-14T13:10:38.156 INFO:tasks.workunit.client.0.smithi012.stdout:6/444: creat d1/d1e/d1b/d3e/f8c x:0 0 0 2024-02-14T13:10:38.156 INFO:tasks.workunit.client.0.smithi012.stdout:6/445: read - d1/d1e/d66/f88 zero size 2024-02-14T13:10:38.156 INFO:tasks.workunit.client.0.smithi012.stdout:6/446: dread - d1/df/d24/d3f/d56/f76 zero size 2024-02-14T13:10:38.156 INFO:tasks.workunit.client.0.smithi012.stdout:6/447: fsync d1/d1e/d1b/f2f 0 2024-02-14T13:10:38.156 INFO:tasks.workunit.client.0.smithi012.stdout:7/430: rmdir df/d27 39 2024-02-14T13:10:38.157 INFO:tasks.workunit.client.0.smithi012.stdout:9/573: creat da/dd/d57/db2/fc5 x:0 0 0 2024-02-14T13:10:38.157 INFO:tasks.workunit.client.0.smithi012.stdout:3/545: dread d9/d18/f5e [4194304,4194304] 0 2024-02-14T13:10:38.159 INFO:tasks.workunit.client.0.smithi012.stdout:6/448: rename d1/d1e/dc/d28/f64 to d1/d1e/dc/f8d 0 2024-02-14T13:10:38.159 INFO:tasks.workunit.client.0.smithi012.stdout:1/591: dwrite d6/d10/d22/d31/d3e/d71/f95 [0,4194304] 0 2024-02-14T13:10:38.159 INFO:tasks.workunit.client.0.smithi012.stdout:1/592: write d6/d10/d22/d31/d5b/d5e/f3f [5079429,107447] 0 2024-02-14T13:10:38.160 INFO:tasks.workunit.client.0.smithi012.stdout:7/431: unlink df/c10 0 2024-02-14T13:10:38.161 INFO:tasks.workunit.client.0.smithi012.stdout:8/493: dwrite d9/dc/d14/d23/d97/d56/d57/f82 [0,4194304] 0 2024-02-14T13:10:38.161 INFO:tasks.workunit.client.0.smithi012.stdout:5/507: dread dc/d17/d20/d4c/d58/f68 [0,4194304] 0 2024-02-14T13:10:38.161 INFO:tasks.workunit.client.0.smithi012.stdout:5/508: chown dc/d17/l1f 806 1 2024-02-14T13:10:38.161 INFO:tasks.workunit.client.0.smithi012.stdout:2/599: write d0/d5/d15/d57/f66 [3753800,82949] 0 2024-02-14T13:10:38.161 INFO:tasks.workunit.client.0.smithi012.stdout:2/600: chown d0/d5/fce 180537 1 2024-02-14T13:10:38.162 INFO:tasks.workunit.client.0.smithi012.stdout:7/432: write df/d2d/d5d/d72/f77 [189140,28955] 0 2024-02-14T13:10:38.162 INFO:tasks.workunit.client.0.smithi012.stdout:3/546: mkdir d9/dc4 0 2024-02-14T13:10:38.163 INFO:tasks.workunit.client.0.smithi012.stdout:9/574: rename da/d33/f8b to da/dd/d57/d59/fc6 0 2024-02-14T13:10:38.163 INFO:tasks.workunit.client.0.smithi012.stdout:9/575: dread - da/dd/d39/f9e zero size 2024-02-14T13:10:38.163 INFO:tasks.workunit.client.0.smithi012.stdout:6/449: rmdir d1/d1e/dc/d28 39 2024-02-14T13:10:38.164 INFO:tasks.workunit.client.0.smithi012.stdout:4/480: getdents d0/d10/d28/d4f/d6b/d83/d17/d5f/da2 0 2024-02-14T13:10:38.164 INFO:tasks.workunit.client.0.smithi012.stdout:4/481: fsync d0/d10/d28/d4f/d6b/d83/d17/faf 0 2024-02-14T13:10:38.164 INFO:tasks.workunit.client.0.smithi012.stdout:4/482: readlink d0/d10/d28/d4f/d6b/d83/d17/l81 0 2024-02-14T13:10:38.165 INFO:tasks.workunit.client.0.smithi012.stdout:9/576: dread da/dd/f53 [0,4194304] 0 2024-02-14T13:10:38.166 INFO:tasks.workunit.client.0.smithi012.stdout:4/483: write d0/d10/f79 [630031,67052] 0 2024-02-14T13:10:38.168 INFO:tasks.workunit.client.0.smithi012.stdout:1/593: creat d6/d10/d22/d31/d3e/fc4 x:0 0 0 2024-02-14T13:10:38.168 INFO:tasks.workunit.client.0.smithi012.stdout:1/594: stat d6/d10/d22/d31/d34/d3b/f53 0 2024-02-14T13:10:38.172 INFO:tasks.workunit.client.0.smithi012.stdout:3/547: read d9/dd/de/d58/d65/d6c/f94 [129618,27172] 0 2024-02-14T13:10:38.172 INFO:tasks.workunit.client.0.smithi012.stdout:2/601: mknod d0/d5/d39/db8/cd2 0 2024-02-14T13:10:38.176 INFO:tasks.workunit.client.0.smithi012.stdout:7/433: truncate df/f15 18917 0 2024-02-14T13:10:38.177 INFO:tasks.workunit.client.0.smithi012.stdout:6/450: creat d1/d1e/d1b/d21/d69/f8e x:0 0 0 2024-02-14T13:10:38.178 INFO:tasks.workunit.client.0.smithi012.stdout:3/548: dread d9/d18/f4d [0,4194304] 0 2024-02-14T13:10:38.179 INFO:tasks.workunit.client.0.smithi012.stdout:9/577: creat da/dd/d57/fc7 x:0 0 0 2024-02-14T13:10:38.180 INFO:tasks.workunit.client.0.smithi012.stdout:9/578: dread da/f14 [0,4194304] 0 2024-02-14T13:10:38.180 INFO:tasks.workunit.client.0.smithi012.stdout:9/579: dread - da/dd/d57/d59/fbe zero size 2024-02-14T13:10:38.181 INFO:tasks.workunit.client.0.smithi012.stdout:1/595: rmdir d6/d35/da7 0 2024-02-14T13:10:38.181 INFO:tasks.workunit.client.0.smithi012.stdout:1/596: truncate d6/d10/d22/fb5 1033285 0 2024-02-14T13:10:38.181 INFO:tasks.workunit.client.0.smithi012.stdout:9/580: dread da/dd/f53 [0,4194304] 0 2024-02-14T13:10:38.182 INFO:tasks.workunit.client.0.smithi012.stdout:9/581: chown da/dd/d57/fc7 94746974 1 2024-02-14T13:10:38.182 INFO:tasks.workunit.client.0.smithi012.stdout:9/582: write da/dd/d38/d7e/fa7 [489693,22578] 0 2024-02-14T13:10:38.182 INFO:tasks.workunit.client.0.smithi012.stdout:1/597: dread d6/d10/d22/d31/d5b/d5d/f17 [0,4194304] 0 2024-02-14T13:10:38.185 INFO:tasks.workunit.client.0.smithi012.stdout:2/602: rename d0/d6/de/cb5 to d0/d5/d15/d57/d6d/cd3 0 2024-02-14T13:10:38.186 INFO:tasks.workunit.client.0.smithi012.stdout:7/434: creat df/d2d/d5d/d72/f99 x:0 0 0 2024-02-14T13:10:38.187 INFO:tasks.workunit.client.0.smithi012.stdout:8/494: dwrite d9/dc/d14/d23/d97/d56/d57/f96 [0,4194304] 0 2024-02-14T13:10:38.187 INFO:tasks.workunit.client.0.smithi012.stdout:5/509: dwrite dc/d47/d59/d6a/f95 [0,4194304] 0 2024-02-14T13:10:38.188 INFO:tasks.workunit.client.0.smithi012.stdout:6/451: creat d1/df/d24/f8f x:0 0 0 2024-02-14T13:10:38.189 INFO:tasks.workunit.client.0.smithi012.stdout:6/452: readlink d1/df/d16/l3b 0 2024-02-14T13:10:38.189 INFO:tasks.workunit.client.0.smithi012.stdout:5/510: dread dc/d17/f41 [0,4194304] 0 2024-02-14T13:10:38.191 INFO:tasks.workunit.client.0.smithi012.stdout:7/435: write df/d27/f4c [887311,130829] 0 2024-02-14T13:10:38.191 INFO:tasks.workunit.client.0.smithi012.stdout:7/436: dread - df/d2d/f83 zero size 2024-02-14T13:10:38.193 INFO:tasks.workunit.client.0.smithi012.stdout:3/549: symlink d9/dc4/lc5 0 2024-02-14T13:10:38.195 INFO:tasks.workunit.client.0.smithi012.stdout:2/603: symlink d0/d20/d54/ld4 0 2024-02-14T13:10:38.196 INFO:tasks.workunit.client.0.smithi012.stdout:8/495: read d9/dc/f6d [988790,88460] 0 2024-02-14T13:10:38.199 INFO:tasks.workunit.client.0.smithi012.stdout:1/598: dwrite d6/d10/d22/d31/d5b/d5e/d65/f75 [0,4194304] 0 2024-02-14T13:10:38.202 INFO:tasks.workunit.client.0.smithi012.stdout:5/511: mkdir dc/d2f/d70/d78/d99 0 2024-02-14T13:10:38.203 INFO:tasks.workunit.client.0.smithi012.stdout:7/437: creat df/d2d/d5d/d72/d8a/f9a x:0 0 0 2024-02-14T13:10:38.205 INFO:tasks.workunit.client.0.smithi012.stdout:9/583: symlink da/dd/d38/lc8 0 2024-02-14T13:10:38.205 INFO:tasks.workunit.client.0.smithi012.stdout:9/584: write da/dd/d18/d71/d85/d48/fb8 [1171284,41670] 0 2024-02-14T13:10:38.206 INFO:tasks.workunit.client.0.smithi012.stdout:2/604: mkdir d0/d8/d11/d33/dc3/dd5 0 2024-02-14T13:10:38.209 INFO:tasks.workunit.client.0.smithi012.stdout:1/599: unlink d6/d10/d22/d31/d34/fa5 0 2024-02-14T13:10:38.211 INFO:tasks.workunit.client.0.smithi012.stdout:5/512: truncate dc/d17/f3f 1456242 0 2024-02-14T13:10:38.211 INFO:tasks.workunit.client.0.smithi012.stdout:5/513: write dc/d17/d20/d4c/d58/f83 [660529,127133] 0 2024-02-14T13:10:38.211 INFO:tasks.workunit.client.0.smithi012.stdout:5/514: write dc/d2f/d89/f8b [336916,33248] 0 2024-02-14T13:10:38.211 INFO:tasks.workunit.client.0.smithi012.stdout:5/515: fdatasync dc/d17/d20/f36 0 2024-02-14T13:10:38.212 INFO:tasks.workunit.client.0.smithi012.stdout:7/438: link df/d27/l55 df/d36/d67/l9b 0 2024-02-14T13:10:38.212 INFO:tasks.workunit.client.0.smithi012.stdout:7/439: chown df/f42 67489096 1 2024-02-14T13:10:38.213 INFO:tasks.workunit.client.0.smithi012.stdout:7/440: write df/d24/f29 [3970578,107058] 0 2024-02-14T13:10:38.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/585: creat da/dd/d19/d30/d9d/fc9 x:0 0 0 2024-02-14T13:10:38.215 INFO:tasks.workunit.client.0.smithi012.stdout:2/605: symlink d0/d20/d75/ld6 0 2024-02-14T13:10:38.215 INFO:tasks.workunit.client.0.smithi012.stdout:2/606: truncate d0/f2 4226313 0 2024-02-14T13:10:38.216 INFO:tasks.workunit.client.0.smithi012.stdout:5/516: rename dc/ce to dc/d47/d6e/c9a 0 2024-02-14T13:10:38.217 INFO:tasks.workunit.client.0.smithi012.stdout:7/441: rename df/d24/l48 to df/l9c 0 2024-02-14T13:10:38.219 INFO:tasks.workunit.client.0.smithi012.stdout:6/453: dwrite d1/d1e/dc/f2e [0,4194304] 0 2024-02-14T13:10:38.219 INFO:tasks.workunit.client.0.smithi012.stdout:6/454: write d1/d1e/dc/d28/f2d [3686363,5729] 0 2024-02-14T13:10:38.219 INFO:tasks.workunit.client.0.smithi012.stdout:5/517: rmdir dc/d2f/d40/d53 39 2024-02-14T13:10:38.219 INFO:tasks.workunit.client.0.smithi012.stdout:8/496: dwrite d9/dc/d14/d23/d97/f7a [4194304,4194304] 0 2024-02-14T13:10:38.220 INFO:tasks.workunit.client.0.smithi012.stdout:9/586: rename da/dd/d99/cbc to da/d4f/cca 0 2024-02-14T13:10:38.220 INFO:tasks.workunit.client.0.smithi012.stdout:9/587: chown f8 56065628 1 2024-02-14T13:10:38.221 INFO:tasks.workunit.client.0.smithi012.stdout:9/588: chown da/dd/d19/fad 12972 1 2024-02-14T13:10:38.221 INFO:tasks.workunit.client.0.smithi012.stdout:7/442: creat df/d27/d4b/d5a/f9d x:0 0 0 2024-02-14T13:10:38.222 INFO:tasks.workunit.client.0.smithi012.stdout:8/497: dread - d9/dc/d1b/f80 zero size 2024-02-14T13:10:38.222 INFO:tasks.workunit.client.0.smithi012.stdout:8/498: chown d9/dc/d38/d6a/c7f 16116 1 2024-02-14T13:10:38.223 INFO:tasks.workunit.client.0.smithi012.stdout:5/518: dread dc/d17/d20/d4c/d58/f83 [0,4194304] 0 2024-02-14T13:10:38.223 INFO:tasks.workunit.client.0.smithi012.stdout:5/519: chown dc/d17/f24 1335973 1 2024-02-14T13:10:38.224 INFO:tasks.workunit.client.0.smithi012.stdout:6/455: rename d1/d17/c6f to d1/d1e/d1b/d21/d78/c90 0 2024-02-14T13:10:38.224 INFO:tasks.workunit.client.0.smithi012.stdout:7/443: mkdir df/d24/d9e 0 2024-02-14T13:10:38.225 INFO:tasks.workunit.client.0.smithi012.stdout:5/520: creat dc/d47/d69/f9b x:0 0 0 2024-02-14T13:10:38.227 INFO:tasks.workunit.client.0.smithi012.stdout:7/444: dread df/d24/f71 [0,4194304] 0 2024-02-14T13:10:38.227 INFO:tasks.workunit.client.0.smithi012.stdout:9/589: rename da/dd/d57/c3c to da/dd/d57/d59/ccb 0 2024-02-14T13:10:38.228 INFO:tasks.workunit.client.0.smithi012.stdout:2/607: dwrite d0/d6/f5f [0,4194304] 0 2024-02-14T13:10:38.228 INFO:tasks.workunit.client.0.smithi012.stdout:2/608: chown d0/d20/d54/lcd 386923396 1 2024-02-14T13:10:38.228 INFO:tasks.workunit.client.0.smithi012.stdout:6/456: link d1/d1e/c4e d1/df/d24/d5f/c91 0 2024-02-14T13:10:38.228 INFO:tasks.workunit.client.0.smithi012.stdout:6/457: stat d1/d1e/dc/d38/d74 0 2024-02-14T13:10:38.229 INFO:tasks.workunit.client.0.smithi012.stdout:5/521: symlink dc/d17/d20/d4c/d7b/l9c 0 2024-02-14T13:10:38.229 INFO:tasks.workunit.client.0.smithi012.stdout:5/522: fdatasync dc/d17/f3f 0 2024-02-14T13:10:38.230 INFO:tasks.workunit.client.0.smithi012.stdout:7/445: rename df/d2d/d5d/c65 to df/d27/c9f 0 2024-02-14T13:10:38.230 INFO:tasks.workunit.client.0.smithi012.stdout:7/446: readlink df/d36/d67/l9b 0 2024-02-14T13:10:38.231 INFO:tasks.workunit.client.0.smithi012.stdout:9/590: creat da/d4f/fcc x:0 0 0 2024-02-14T13:10:38.233 INFO:tasks.workunit.client.0.smithi012.stdout:2/609: creat d0/d1a/fd7 x:0 0 0 2024-02-14T13:10:38.234 INFO:tasks.workunit.client.0.smithi012.stdout:5/523: mknod dc/d17/d20/d4c/d63/d81/c9d 0 2024-02-14T13:10:38.236 INFO:tasks.workunit.client.0.smithi012.stdout:6/458: rename d1/d17/d5a/f5c to d1/d1e/dc/d43/d75/f92 0 2024-02-14T13:10:38.237 INFO:tasks.workunit.client.0.smithi012.stdout:8/499: dwrite d9/f84 [0,4194304] 0 2024-02-14T13:10:38.237 INFO:tasks.workunit.client.0.smithi012.stdout:7/447: unlink df/d27/l55 0 2024-02-14T13:10:38.238 INFO:tasks.workunit.client.0.smithi012.stdout:2/610: symlink d0/d5/d15/dbd/ld8 0 2024-02-14T13:10:38.242 INFO:tasks.workunit.client.0.smithi012.stdout:9/591: rename f8 to da/d33/d63/fcd 0 2024-02-14T13:10:38.242 INFO:tasks.workunit.client.0.smithi012.stdout:9/592: write da/dd/f5d [493321,79772] 0 2024-02-14T13:10:38.243 INFO:tasks.workunit.client.0.smithi012.stdout:5/524: dread f6 [0,4194304] 0 2024-02-14T13:10:38.247 INFO:tasks.workunit.client.0.smithi012.stdout:5/525: dread dc/d17/d20/d4c/d58/f83 [0,4194304] 0 2024-02-14T13:10:38.247 INFO:tasks.workunit.client.0.smithi012.stdout:5/526: readlink dc/d2f/d3e/l5e 0 2024-02-14T13:10:38.248 INFO:tasks.workunit.client.0.smithi012.stdout:6/459: rename d1/d1e/dc/d38/d74 to d1/df/d24/d3f/d56/d93 0 2024-02-14T13:10:38.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/500: write d9/dc/d14/d23/f67 [812812,35448] 0 2024-02-14T13:10:38.249 INFO:tasks.workunit.client.0.smithi012.stdout:9/593: mkdir da/dd/d19/d30/d9d/dce 0 2024-02-14T13:10:38.249 INFO:tasks.workunit.client.0.smithi012.stdout:9/594: rename da to da/dd/d57/d59/d73/db6/dcf 22 2024-02-14T13:10:38.251 INFO:tasks.workunit.client.0.smithi012.stdout:5/527: creat dc/d17/d20/d8e/f9e x:0 0 0 2024-02-14T13:10:38.253 INFO:tasks.workunit.client.0.smithi012.stdout:6/460: creat d1/d1e/f94 x:0 0 0 2024-02-14T13:10:38.254 INFO:tasks.workunit.client.0.smithi012.stdout:8/501: write d9/dc/d14/d23/d97/f59 [4070532,117212] 0 2024-02-14T13:10:38.255 INFO:tasks.workunit.client.0.smithi012.stdout:9/595: link da/dd/d18/d71/f75 da/dd/d57/db2/fd0 0 2024-02-14T13:10:38.255 INFO:tasks.workunit.client.0.smithi012.stdout:9/596: chown da/dd/d18/d71/d85/c50 218117 1 2024-02-14T13:10:38.256 INFO:tasks.workunit.client.0.smithi012.stdout:5/528: getdents dc/d47 0 2024-02-14T13:10:38.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/461: mkdir d1/df/d24/d3f/d56/d93/d95 0 2024-02-14T13:10:38.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/462: write d1/d1e/d1b/f33 [2031508,91691] 0 2024-02-14T13:10:38.258 INFO:tasks.workunit.client.0.smithi012.stdout:6/463: chown d1/df/d50/c61 14 1 2024-02-14T13:10:38.258 INFO:tasks.workunit.client.0.smithi012.stdout:5/529: write dc/d17/f41 [326686,128371] 0 2024-02-14T13:10:38.260 INFO:tasks.workunit.client.0.smithi012.stdout:2/611: dwrite d0/d8/d9/f9a [0,4194304] 0 2024-02-14T13:10:38.260 INFO:tasks.workunit.client.0.smithi012.stdout:2/612: chown d0/d5/d39/lc6 989 1 2024-02-14T13:10:38.260 INFO:tasks.workunit.client.0.smithi012.stdout:2/613: truncate d0/d6/d37/fad 28063 0 2024-02-14T13:10:38.260 INFO:tasks.workunit.client.0.smithi012.stdout:6/464: dread d1/d1e/d1b/f3d [0,4194304] 0 2024-02-14T13:10:38.264 INFO:tasks.workunit.client.0.smithi012.stdout:9/597: write da/dd/d57/f41 [2407031,116972] 0 2024-02-14T13:10:38.266 INFO:tasks.workunit.client.0.smithi012.stdout:8/502: creat d9/dc/f9e x:0 0 0 2024-02-14T13:10:38.269 INFO:tasks.workunit.client.0.smithi012.stdout:5/530: mknod dc/d2f/d40/d53/c9f 0 2024-02-14T13:10:38.269 INFO:tasks.workunit.client.0.smithi012.stdout:5/531: fsync dc/d2f/d40/f6f 0 2024-02-14T13:10:38.272 INFO:tasks.workunit.client.0.smithi012.stdout:2/614: creat d0/d8/d11/d35/dd0/d70/fd9 x:0 0 0 2024-02-14T13:10:38.272 INFO:tasks.workunit.client.0.smithi012.stdout:2/615: readlink d0/d20/d54/lcd 0 2024-02-14T13:10:38.273 INFO:tasks.workunit.client.0.smithi012.stdout:6/465: creat d1/df/d50/f96 x:0 0 0 2024-02-14T13:10:38.273 INFO:tasks.workunit.client.0.smithi012.stdout:6/466: read - d1/df/d24/f8f zero size 2024-02-14T13:10:38.276 INFO:tasks.workunit.client.0.smithi012.stdout:9/598: getdents da/dd/d38/d7e/d91 0 2024-02-14T13:10:38.277 INFO:tasks.workunit.client.0.smithi012.stdout:8/503: creat d9/dc/d1b/f9f x:0 0 0 2024-02-14T13:10:38.278 INFO:tasks.workunit.client.0.smithi012.stdout:9/599: dread da/dd/d38/d7e/fa7 [0,4194304] 0 2024-02-14T13:10:38.278 INFO:tasks.workunit.client.0.smithi012.stdout:5/532: mknod dc/d47/d59/ca0 0 2024-02-14T13:10:38.278 INFO:tasks.workunit.client.0.smithi012.stdout:5/533: fsync dc/d17/d4b/f7c 0 2024-02-14T13:10:38.279 INFO:tasks.workunit.client.0.smithi012.stdout:5/534: chown dc/l1c 12 1 2024-02-14T13:10:38.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/467: dread d1/df/d24/f36 [4194304,4194304] 0 2024-02-14T13:10:38.280 INFO:tasks.workunit.client.0.smithi012.stdout:2/616: link d0/d6/de/d7b/f61 d0/d5/d39/fda 0 2024-02-14T13:10:38.280 INFO:tasks.workunit.client.0.smithi012.stdout:2/617: write d0/d8/d11/d35/dd0/d70/fd9 [62443,59364] 0 2024-02-14T13:10:38.281 INFO:tasks.workunit.client.0.smithi012.stdout:9/600: unlink da/dd/d38/f6d 0 2024-02-14T13:10:38.281 INFO:tasks.workunit.client.0.smithi012.stdout:8/504: dread d9/dc/d14/d23/d97/d56/d57/d7c/f69 [0,4194304] 0 2024-02-14T13:10:38.282 INFO:tasks.workunit.client.0.smithi012.stdout:5/535: truncate dc/d47/f61 591353 0 2024-02-14T13:10:38.283 INFO:tasks.workunit.client.0.smithi012.stdout:6/468: rename d1/d1e/d5b to d1/df/d16/d7c/d97 0 2024-02-14T13:10:38.283 INFO:tasks.workunit.client.0.smithi012.stdout:6/469: fdatasync d1/d1e/dc/d43/d75/f92 0 2024-02-14T13:10:38.284 INFO:tasks.workunit.client.0.smithi012.stdout:2/618: symlink d0/d20/ldb 0 2024-02-14T13:10:38.285 INFO:tasks.workunit.client.0.smithi012.stdout:2/619: dread d0/d6/de/d7b/f7e [0,4194304] 0 2024-02-14T13:10:38.285 INFO:tasks.workunit.client.0.smithi012.stdout:9/601: link da/dd/f2b da/dd/d18/d71/fd1 0 2024-02-14T13:10:38.286 INFO:tasks.workunit.client.0.smithi012.stdout:8/505: creat d9/dc/d14/d23/d97/d56/d57/d7c/fa0 x:0 0 0 2024-02-14T13:10:38.287 INFO:tasks.workunit.client.0.smithi012.stdout:5/536: creat dc/d2f/fa1 x:0 0 0 2024-02-14T13:10:38.287 INFO:tasks.workunit.client.0.smithi012.stdout:5/537: fdatasync dc/d2f/d40/d53/f7a 0 2024-02-14T13:10:38.287 INFO:tasks.workunit.client.0.smithi012.stdout:0/540: sync 2024-02-14T13:10:38.287 INFO:tasks.workunit.client.0.smithi012.stdout:0/541: fsync d10/d14/d2b/d3b/f86 0 2024-02-14T13:10:38.288 INFO:tasks.workunit.client.0.smithi012.stdout:6/470: symlink d1/d1e/l98 0 2024-02-14T13:10:38.288 INFO:tasks.workunit.client.0.smithi012.stdout:6/471: fsync d1/d1e/d1b/f3d 0 2024-02-14T13:10:38.288 INFO:tasks.workunit.client.0.smithi012.stdout:6/472: readlink d1/d1e/l39 0 2024-02-14T13:10:38.289 INFO:tasks.workunit.client.0.smithi012.stdout:2/620: mkdir d0/d5/d50/d68/d9c/ddc 0 2024-02-14T13:10:38.289 INFO:tasks.workunit.client.0.smithi012.stdout:2/621: write d0/d1a/f47 [255528,112122] 0 2024-02-14T13:10:38.290 INFO:tasks.workunit.client.0.smithi012.stdout:9/602: mknod da/dd/d57/d59/cd2 0 2024-02-14T13:10:38.291 INFO:tasks.workunit.client.0.smithi012.stdout:9/603: chown da/dd/d39 0 1 2024-02-14T13:10:38.293 INFO:tasks.workunit.client.0.smithi012.stdout:8/506: mkdir d9/dc/d14/d23/d97/da1 0 2024-02-14T13:10:38.293 INFO:tasks.workunit.client.0.smithi012.stdout:5/538: creat dc/d47/d59/d6a/fa2 x:0 0 0 2024-02-14T13:10:38.293 INFO:tasks.workunit.client.0.smithi012.stdout:5/539: fdatasync dc/d17/d20/f3a 0 2024-02-14T13:10:38.294 INFO:tasks.workunit.client.0.smithi012.stdout:8/507: readlink d9/dc/d1b/l33 0 2024-02-14T13:10:38.294 INFO:tasks.workunit.client.0.smithi012.stdout:8/508: chown d9/dc/d14/d23/d97/d56/d57/d7c/f99 4049570 1 2024-02-14T13:10:38.295 INFO:tasks.workunit.client.0.smithi012.stdout:8/509: fdatasync d9/dc/d14/d23/d97/d56/d57/f82 0 2024-02-14T13:10:38.297 INFO:tasks.workunit.client.0.smithi012.stdout:5/540: creat dc/d2f/fa3 x:0 0 0 2024-02-14T13:10:38.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/510: mknod d9/ca2 0 2024-02-14T13:10:38.299 INFO:tasks.workunit.client.0.smithi012.stdout:5/541: read dc/d2f/d40/f48 [63069,87476] 0 2024-02-14T13:10:38.299 INFO:tasks.workunit.client.0.smithi012.stdout:5/542: write dc/d17/d20/d8e/f9e [60447,15322] 0 2024-02-14T13:10:38.300 INFO:tasks.workunit.client.0.smithi012.stdout:5/543: creat dc/d2f/d3e/fa4 x:0 0 0 2024-02-14T13:10:38.303 INFO:tasks.workunit.client.0.smithi012.stdout:5/544: rename dc/d17/d20/d4c/d7b/l9c to dc/d2f/d40/d93/la5 0 2024-02-14T13:10:38.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/473: dwrite d1/d1e/d1b/d3e/f8c [0,4194304] 0 2024-02-14T13:10:38.319 INFO:tasks.workunit.client.0.smithi012.stdout:6/474: chown d1/d1e/dc/d38/l70 5115 1 2024-02-14T13:10:38.322 INFO:tasks.workunit.client.0.smithi012.stdout:6/475: link d1/d1e/dc/d38/l41 d1/d1e/d1b/l99 0 2024-02-14T13:10:38.322 INFO:tasks.workunit.client.0.smithi012.stdout:5/545: dread dc/d17/d20/f36 [0,4194304] 0 2024-02-14T13:10:38.322 INFO:tasks.workunit.client.0.smithi012.stdout:5/546: fdatasync dc/d2f/d89/f8b 0 2024-02-14T13:10:38.323 INFO:tasks.workunit.client.0.smithi012.stdout:2/622: dwrite d0/d8/f58 [0,4194304] 0 2024-02-14T13:10:38.323 INFO:tasks.workunit.client.0.smithi012.stdout:6/476: symlink d1/d17/d5a/l9a 0 2024-02-14T13:10:38.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/547: unlink dc/c25 0 2024-02-14T13:10:38.325 INFO:tasks.workunit.client.0.smithi012.stdout:5/548: readlink dc/d47/d6e/l96 0 2024-02-14T13:10:38.326 INFO:tasks.workunit.client.0.smithi012.stdout:2/623: rmdir d0/d20/d75 39 2024-02-14T13:10:38.327 INFO:tasks.workunit.client.0.smithi012.stdout:2/624: read d0/d5/f42 [4155127,121279] 0 2024-02-14T13:10:38.327 INFO:tasks.workunit.client.0.smithi012.stdout:5/549: link dc/c66 dc/d2f/d40/d93/ca6 0 2024-02-14T13:10:38.328 INFO:tasks.workunit.client.0.smithi012.stdout:2/625: creat d0/d6/d37/fdd x:0 0 0 2024-02-14T13:10:38.328 INFO:tasks.workunit.client.0.smithi012.stdout:2/626: write d0/d1a/fd7 [157472,36998] 0 2024-02-14T13:10:38.328 INFO:tasks.workunit.client.0.smithi012.stdout:0/542: dwrite d10/d14/d51/f73 [0,4194304] 0 2024-02-14T13:10:38.329 INFO:tasks.workunit.client.0.smithi012.stdout:9/604: dwrite da/dd/d19/d30/f81 [0,4194304] 0 2024-02-14T13:10:38.329 INFO:tasks.workunit.client.0.smithi012.stdout:9/605: chown da/dd/d57/d59/d73/l84 570067587 1 2024-02-14T13:10:38.330 INFO:tasks.workunit.client.0.smithi012.stdout:0/543: mkdir d10/d14/d20/daa 0 2024-02-14T13:10:38.332 INFO:tasks.workunit.client.0.smithi012.stdout:9/606: creat da/dd/d57/db2/fd3 x:0 0 0 2024-02-14T13:10:38.332 INFO:tasks.workunit.client.0.smithi012.stdout:8/511: dwrite d9/dc/d38/d6a/f7e [0,4194304] 0 2024-02-14T13:10:38.333 INFO:tasks.workunit.client.0.smithi012.stdout:0/544: creat d10/d14/d41/d52/d99/d9b/fab x:0 0 0 2024-02-14T13:10:38.333 INFO:tasks.workunit.client.0.smithi012.stdout:0/545: fsync d10/d14/d2b/d3b/f4d 0 2024-02-14T13:10:38.335 INFO:tasks.workunit.client.0.smithi012.stdout:9/607: rename da/c47 to da/dd/d39/cd4 0 2024-02-14T13:10:38.335 INFO:tasks.workunit.client.0.smithi012.stdout:9/608: chown da/dd/d18/l9b 3126 1 2024-02-14T13:10:38.335 INFO:tasks.workunit.client.0.smithi012.stdout:9/609: dread - da/dd/d57/d59/fb5 zero size 2024-02-14T13:10:38.336 INFO:tasks.workunit.client.0.smithi012.stdout:2/627: dread d0/d6/f5f [0,4194304] 0 2024-02-14T13:10:38.336 INFO:tasks.workunit.client.0.smithi012.stdout:2/628: read - d0/d6/de/f4e zero size 2024-02-14T13:10:38.339 INFO:tasks.workunit.client.0.smithi012.stdout:8/512: dread d9/f84 [0,4194304] 0 2024-02-14T13:10:38.343 INFO:tasks.workunit.client.0.smithi012.stdout:0/546: symlink d10/d14/d41/lac 0 2024-02-14T13:10:38.344 INFO:tasks.workunit.client.0.smithi012.stdout:9/610: getdents da/dd/d57 0 2024-02-14T13:10:38.344 INFO:tasks.workunit.client.0.smithi012.stdout:9/611: readlink da/dd/d19/d30/d45/l69 0 2024-02-14T13:10:38.346 INFO:tasks.workunit.client.0.smithi012.stdout:2/629: symlink d0/d20/d54/lde 0 2024-02-14T13:10:38.348 INFO:tasks.workunit.client.0.smithi012.stdout:8/513: mkdir d9/dc/d14/d23/d97/da3 0 2024-02-14T13:10:38.350 INFO:tasks.workunit.client.0.smithi012.stdout:0/547: rename d10/d14/d41/d61/d74/da0 to d10/dad 0 2024-02-14T13:10:38.352 INFO:tasks.workunit.client.0.smithi012.stdout:9/612: symlink da/dd/d38/d7e/d91/da6/ld5 0 2024-02-14T13:10:38.352 INFO:tasks.workunit.client.0.smithi012.stdout:5/550: dwrite dc/d17/d20/f36 [0,4194304] 0 2024-02-14T13:10:38.354 INFO:tasks.workunit.client.0.smithi012.stdout:2/630: getdents d0 0 2024-02-14T13:10:38.357 INFO:tasks.workunit.client.0.smithi012.stdout:8/514: truncate d9/dc/d14/d23/d97/d56/d57/f96 3608198 0 2024-02-14T13:10:38.359 INFO:tasks.workunit.client.0.smithi012.stdout:9/613: mknod da/dd/d39/cd6 0 2024-02-14T13:10:38.361 INFO:tasks.workunit.client.0.smithi012.stdout:5/551: symlink dc/d17/d4b/la7 0 2024-02-14T13:10:38.362 INFO:tasks.workunit.client.0.smithi012.stdout:2/631: mknod d0/d6/de/d7d/cdf 0 2024-02-14T13:10:38.363 INFO:tasks.workunit.client.0.smithi012.stdout:8/515: symlink d9/dc/la4 0 2024-02-14T13:10:38.363 INFO:tasks.workunit.client.0.smithi012.stdout:8/516: write d9/dc/d1b/f9f [792716,47170] 0 2024-02-14T13:10:38.363 INFO:tasks.workunit.client.0.smithi012.stdout:8/517: write d9/dc/d14/d23/d97/d56/d57/d7c/fa0 [964548,48339] 0 2024-02-14T13:10:38.365 INFO:tasks.workunit.client.0.smithi012.stdout:9/614: truncate da/dd/d18/d71/f75 4211098 0 2024-02-14T13:10:38.366 INFO:tasks.workunit.client.0.smithi012.stdout:5/552: truncate f7 703655 0 2024-02-14T13:10:38.367 INFO:tasks.workunit.client.0.smithi012.stdout:2/632: rmdir d0/d8/d11/d33 39 2024-02-14T13:10:38.367 INFO:tasks.workunit.client.0.smithi012.stdout:2/633: truncate d0/d6/d37/fdd 446802 0 2024-02-14T13:10:38.367 INFO:tasks.workunit.client.0.smithi012.stdout:2/634: write d0/d5/f42 [2283384,39297] 0 2024-02-14T13:10:38.367 INFO:tasks.workunit.client.0.smithi012.stdout:2/635: write d0/d6/de/fa7 [130627,3138] 0 2024-02-14T13:10:38.368 INFO:tasks.workunit.client.0.smithi012.stdout:8/518: mkdir d9/dc/d1b/d35/da5 0 2024-02-14T13:10:38.368 INFO:tasks.workunit.client.0.smithi012.stdout:8/519: readlink d9/dc/d38/l53 0 2024-02-14T13:10:38.368 INFO:tasks.workunit.client.0.smithi012.stdout:8/520: chown d9/dc/d14/d23/d97/da1 1059643 1 2024-02-14T13:10:38.369 INFO:tasks.workunit.client.0.smithi012.stdout:9/615: symlink da/dd/d38/d7e/ld7 0 2024-02-14T13:10:38.371 INFO:tasks.workunit.client.0.smithi012.stdout:5/553: creat dc/d47/fa8 x:0 0 0 2024-02-14T13:10:38.372 INFO:tasks.workunit.client.0.smithi012.stdout:2/636: symlink d0/d5/d50/d68/d9c/ddc/le0 0 2024-02-14T13:10:38.372 INFO:tasks.workunit.client.0.smithi012.stdout:2/637: truncate d0/d6/de/d7b/f61 2404093 0 2024-02-14T13:10:38.374 INFO:tasks.workunit.client.0.smithi012.stdout:0/548: dwrite d10/d14/f2e [4194304,4194304] 0 2024-02-14T13:10:38.374 INFO:tasks.workunit.client.0.smithi012.stdout:5/554: mkdir dc/d2f/d70/da9 0 2024-02-14T13:10:38.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/448: sync 2024-02-14T13:10:38.374 INFO:tasks.workunit.client.0.smithi012.stdout:4/484: sync 2024-02-14T13:10:38.374 INFO:tasks.workunit.client.0.smithi012.stdout:3/550: sync 2024-02-14T13:10:38.374 INFO:tasks.workunit.client.0.smithi012.stdout:1/600: sync 2024-02-14T13:10:38.375 INFO:tasks.workunit.client.0.smithi012.stdout:7/449: truncate df/d2d/f3e 464392 0 2024-02-14T13:10:38.376 INFO:tasks.workunit.client.0.smithi012.stdout:2/638: creat d0/d5/d15/d57/d6d/fe1 x:0 0 0 2024-02-14T13:10:38.376 INFO:tasks.workunit.client.0.smithi012.stdout:2/639: dread - d0/d5/d15/faa zero size 2024-02-14T13:10:38.376 INFO:tasks.workunit.client.0.smithi012.stdout:2/640: stat d0/f2 0 2024-02-14T13:10:38.378 INFO:tasks.workunit.client.0.smithi012.stdout:0/549: rename d10/d14/d41/d52/d78/d8c/d7f/c88 to d10/d14/d51/cae 0 2024-02-14T13:10:38.378 INFO:tasks.workunit.client.0.smithi012.stdout:0/550: dread - d10/d14/d41/d61/d74/f90 zero size 2024-02-14T13:10:38.379 INFO:tasks.workunit.client.0.smithi012.stdout:5/555: creat dc/d2f/d70/faa x:0 0 0 2024-02-14T13:10:38.380 INFO:tasks.workunit.client.0.smithi012.stdout:7/450: truncate df/f11 5624954 0 2024-02-14T13:10:38.380 INFO:tasks.workunit.client.0.smithi012.stdout:7/451: chown df/d2d/d82/d88/d90 60311 1 2024-02-14T13:10:38.382 INFO:tasks.workunit.client.0.smithi012.stdout:4/485: symlink d0/d10/d28/d4f/d6b/d8f/d56/d98/lb4 0 2024-02-14T13:10:38.382 INFO:tasks.workunit.client.0.smithi012.stdout:5/556: read dc/d2f/f74 [486046,33215] 0 2024-02-14T13:10:38.382 INFO:tasks.workunit.client.0.smithi012.stdout:5/557: fdatasync dc/f5a 0 2024-02-14T13:10:38.383 INFO:tasks.workunit.client.0.smithi012.stdout:3/551: rename d9/d8e/l98 to d9/dd/d30/d44/d66/db3/lc6 0 2024-02-14T13:10:38.384 INFO:tasks.workunit.client.0.smithi012.stdout:2/641: write d0/d8/d11/d35/dd0/d70/f7f [101448,51679] 0 2024-02-14T13:10:38.385 INFO:tasks.workunit.client.0.smithi012.stdout:0/551: symlink d10/d14/d41/laf 0 2024-02-14T13:10:38.388 INFO:tasks.workunit.client.0.smithi012.stdout:4/486: mkdir d0/d10/d28/da9/d86/db5 0 2024-02-14T13:10:38.389 INFO:tasks.workunit.client.0.smithi012.stdout:7/452: dread fd [0,4194304] 0 2024-02-14T13:10:38.391 INFO:tasks.workunit.client.0.smithi012.stdout:8/521: dwrite d9/dc/d14/d2e/f5d [0,4194304] 0 2024-02-14T13:10:38.391 INFO:tasks.workunit.client.0.smithi012.stdout:8/522: truncate d9/dc/d14/d23/d97/f9b 361391 0 2024-02-14T13:10:38.392 INFO:tasks.workunit.client.0.smithi012.stdout:1/601: rename d6/d35/c37 to d6/d10/d22/d31/d5b/d5d/d80/cc5 0 2024-02-14T13:10:38.394 INFO:tasks.workunit.client.0.smithi012.stdout:3/552: creat d9/dc4/fc7 x:0 0 0 2024-02-14T13:10:38.395 INFO:tasks.workunit.client.0.smithi012.stdout:4/487: creat d0/d10/fb6 x:0 0 0 2024-02-14T13:10:38.397 INFO:tasks.workunit.client.0.smithi012.stdout:5/558: unlink dc/d2f/c31 0 2024-02-14T13:10:38.401 INFO:tasks.workunit.client.0.smithi012.stdout:2/642: read d0/d8/f58 [3362801,41115] 0 2024-02-14T13:10:38.401 INFO:tasks.workunit.client.0.smithi012.stdout:8/523: rename d9/dc/d38/f55 to d9/dc/d14/d2e/fa6 0 2024-02-14T13:10:38.401 INFO:tasks.workunit.client.0.smithi012.stdout:1/602: rename d6/d10/d22/d31/d5b to d6/d10/d22/d31/d5b/d5e/d65/dc6 22 2024-02-14T13:10:38.402 INFO:tasks.workunit.client.0.smithi012.stdout:3/553: creat d9/d3f/d73/d5d/fc8 x:0 0 0 2024-02-14T13:10:38.402 INFO:tasks.workunit.client.0.smithi012.stdout:3/554: write d9/d18/daf/fb2 [1040503,101342] 0 2024-02-14T13:10:38.404 INFO:tasks.workunit.client.0.smithi012.stdout:4/488: chown d0/f5c 116 1 2024-02-14T13:10:38.405 INFO:tasks.workunit.client.0.smithi012.stdout:0/552: write d10/f62 [4122432,110107] 0 2024-02-14T13:10:38.405 INFO:tasks.workunit.client.0.smithi012.stdout:0/553: chown d10/d14/f2e 172218047 1 2024-02-14T13:10:38.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/643: mknod d0/d6/d37/d84/ce2 0 2024-02-14T13:10:38.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/644: write d0/d8/d11/d35/dd0/d7a/f8d [1078239,81650] 0 2024-02-14T13:10:38.406 INFO:tasks.workunit.client.0.smithi012.stdout:1/603: unlink d6/d10/d22/d31/d34/d3b/la9 0 2024-02-14T13:10:38.407 INFO:tasks.workunit.client.0.smithi012.stdout:3/555: mkdir d9/d8e/dc9 0 2024-02-14T13:10:38.407 INFO:tasks.workunit.client.0.smithi012.stdout:3/556: write d9/f35 [7197524,38183] 0 2024-02-14T13:10:38.407 INFO:tasks.workunit.client.0.smithi012.stdout:3/557: chown d9/d8e 368121124 1 2024-02-14T13:10:38.409 INFO:tasks.workunit.client.0.smithi012.stdout:0/554: creat d10/fb0 x:0 0 0 2024-02-14T13:10:38.410 INFO:tasks.workunit.client.0.smithi012.stdout:1/604: rename d6/d10/d22/d31/c39 to d6/d35/cc7 0 2024-02-14T13:10:38.411 INFO:tasks.workunit.client.0.smithi012.stdout:5/559: write dc/d17/d20/d4c/d58/f6b [576264,42283] 0 2024-02-14T13:10:38.411 INFO:tasks.workunit.client.0.smithi012.stdout:5/560: write dc/d17/d20/f22 [5181136,32694] 0 2024-02-14T13:10:38.412 INFO:tasks.workunit.client.0.smithi012.stdout:3/558: creat d9/dd/d30/fca x:0 0 0 2024-02-14T13:10:38.413 INFO:tasks.workunit.client.0.smithi012.stdout:0/555: link d10/d14/d41/d52/d72/fa7 d10/d14/d20/d49/fb1 0 2024-02-14T13:10:38.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/489: write d0/f95 [5672069,67801] 0 2024-02-14T13:10:38.415 INFO:tasks.workunit.client.0.smithi012.stdout:4/490: dread - d0/d10/d28/d4f/d6b/d83/d99/fa3 zero size 2024-02-14T13:10:38.416 INFO:tasks.workunit.client.0.smithi012.stdout:2/645: write d0/d8/f30 [356840,17953] 0 2024-02-14T13:10:38.416 INFO:tasks.workunit.client.0.smithi012.stdout:2/646: write d0/d8/f30 [5139470,89667] 0 2024-02-14T13:10:38.417 INFO:tasks.workunit.client.0.smithi012.stdout:4/491: write d0/d10/d28/d4f/d6b/d83/d17/f47 [801008,122338] 0 2024-02-14T13:10:38.417 INFO:tasks.workunit.client.0.smithi012.stdout:5/561: rename dc/d2f/d40/d93 to dc/d17/d20/d4c/d63/dab 0 2024-02-14T13:10:38.417 INFO:tasks.workunit.client.0.smithi012.stdout:5/562: readlink dc/d17/l3c 0 2024-02-14T13:10:38.417 INFO:tasks.workunit.client.0.smithi012.stdout:0/556: creat d10/dad/fb2 x:0 0 0 2024-02-14T13:10:38.418 INFO:tasks.workunit.client.0.smithi012.stdout:5/563: truncate dc/d2f/d89/f8b 196773 0 2024-02-14T13:10:38.418 INFO:tasks.workunit.client.0.smithi012.stdout:0/557: creat d10/d14/d41/d61/d74/fb3 x:0 0 0 2024-02-14T13:10:38.420 INFO:tasks.workunit.client.0.smithi012.stdout:5/564: creat dc/d17/d20/d4c/fac x:0 0 0 2024-02-14T13:10:38.420 INFO:tasks.workunit.client.0.smithi012.stdout:8/524: dwrite d9/dc/d14/d23/d97/f9b [0,4194304] 0 2024-02-14T13:10:38.421 INFO:tasks.workunit.client.0.smithi012.stdout:5/565: mknod dc/d17/d20/d4c/d63/dab/cad 0 2024-02-14T13:10:38.421 INFO:tasks.workunit.client.0.smithi012.stdout:5/566: readlink dc/d17/d20/l44 0 2024-02-14T13:10:38.424 INFO:tasks.workunit.client.0.smithi012.stdout:8/525: creat d9/dc/d14/d23/d97/d56/fa7 x:0 0 0 2024-02-14T13:10:38.424 INFO:tasks.workunit.client.0.smithi012.stdout:7/453: dwrite df/f30 [0,4194304] 0 2024-02-14T13:10:38.425 INFO:tasks.workunit.client.0.smithi012.stdout:7/454: dread df/d24/f71 [0,4194304] 0 2024-02-14T13:10:38.426 INFO:tasks.workunit.client.0.smithi012.stdout:2/647: dread d0/d6/f81 [0,4194304] 0 2024-02-14T13:10:38.427 INFO:tasks.workunit.client.0.smithi012.stdout:7/455: creat df/d27/d4b/d8d/fa0 x:0 0 0 2024-02-14T13:10:38.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/492: dread d0/d10/d28/d4f/d6b/d8f/f76 [0,4194304] 0 2024-02-14T13:10:38.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/493: chown d0/d10/d1f/l5a 1010566176 1 2024-02-14T13:10:38.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/494: chown d0/d10/d28/d4f/d6b/d8f/d56/d98 9546 1 2024-02-14T13:10:38.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/495: chown d0/d10/d28/da9/d86/db5 92 1 2024-02-14T13:10:38.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/496: write d0/f5c [2882133,38773] 0 2024-02-14T13:10:38.429 INFO:tasks.workunit.client.0.smithi012.stdout:2/648: mknod d0/d8/d11/d33/d5c/ce3 0 2024-02-14T13:10:38.431 INFO:tasks.workunit.client.0.smithi012.stdout:4/497: creat d0/d10/d1f/fb7 x:0 0 0 2024-02-14T13:10:38.432 INFO:tasks.workunit.client.0.smithi012.stdout:5/567: dread dc/d2f/d40/f45 [0,4194304] 0 2024-02-14T13:10:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:4/498: readlink d0/l5 0 2024-02-14T13:10:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:4/499: chown d0/d10/d28/d4f/d6b/d83/f2d 9811 1 2024-02-14T13:10:38.434 INFO:tasks.workunit.client.0.smithi012.stdout:4/500: dread - d0/d10/d28/f45 zero size 2024-02-14T13:10:38.441 INFO:tasks.workunit.client.0.smithi012.stdout:1/605: dwrite d6/d10/d22/d31/d5b/d5d/f17 [0,4194304] 0 2024-02-14T13:10:38.441 INFO:tasks.workunit.client.0.smithi012.stdout:1/606: fsync d6/d10/d22/d31/d5b/d5e/d3d/f51 0 2024-02-14T13:10:38.442 INFO:tasks.workunit.client.0.smithi012.stdout:1/607: fsync d6/d10/d22/d31/d5b/d5d/d6d/f7b 0 2024-02-14T13:10:38.442 INFO:tasks.workunit.client.0.smithi012.stdout:8/526: write d9/dc/d1b/d35/f78 [2288185,108844] 0 2024-02-14T13:10:38.442 INFO:tasks.workunit.client.0.smithi012.stdout:8/527: read d9/dc/f6d [415153,118762] 0 2024-02-14T13:10:38.443 INFO:tasks.workunit.client.0.smithi012.stdout:9/616: truncate da/dd/d57/db2/fd0 3063756 0 2024-02-14T13:10:38.443 INFO:tasks.workunit.client.0.smithi012.stdout:9/617: chown da/d4f/c74 108605 1 2024-02-14T13:10:38.443 INFO:tasks.workunit.client.0.smithi012.stdout:9/618: read - da/d33/d63/f86 zero size 2024-02-14T13:10:38.444 INFO:tasks.workunit.client.0.smithi012.stdout:0/558: dread d10/d14/d51/fa1 [0,4194304] 0 2024-02-14T13:10:38.447 INFO:tasks.workunit.client.0.smithi012.stdout:2/649: dread d0/d8/d9/d90/dab/f59 [0,4194304] 0 2024-02-14T13:10:38.447 INFO:tasks.workunit.client.0.smithi012.stdout:2/650: write d0/d1a/f47 [787521,80346] 0 2024-02-14T13:10:38.447 INFO:tasks.workunit.client.0.smithi012.stdout:1/608: rmdir d6/d10/d22/d31/d34/d58 39 2024-02-14T13:10:38.449 INFO:tasks.workunit.client.0.smithi012.stdout:9/619: truncate da/dd/d57/f41 2826004 0 2024-02-14T13:10:38.450 INFO:tasks.workunit.client.0.smithi012.stdout:0/559: rmdir d10/d14/d41/d52/d78/d8c 39 2024-02-14T13:10:38.450 INFO:tasks.workunit.client.0.smithi012.stdout:0/560: write d10/d14/d1b/f8a [608221,55677] 0 2024-02-14T13:10:38.450 INFO:tasks.workunit.client.0.smithi012.stdout:3/559: dread d9/f35 [0,4194304] 0 2024-02-14T13:10:38.452 INFO:tasks.workunit.client.0.smithi012.stdout:1/609: stat d6/d35/l69 0 2024-02-14T13:10:38.452 INFO:tasks.workunit.client.0.smithi012.stdout:7/456: dwrite df/d27/d4b/d5a/f9d [0,4194304] 0 2024-02-14T13:10:38.452 INFO:tasks.workunit.client.0.smithi012.stdout:7/457: stat df/d36/f7d 0 2024-02-14T13:10:38.452 INFO:tasks.workunit.client.0.smithi012.stdout:7/458: write df/d24/f31 [5237408,118142] 0 2024-02-14T13:10:38.453 INFO:tasks.workunit.client.0.smithi012.stdout:9/620: rename da/dd/d39/d8d/f92 to da/dd/d57/fd8 0 2024-02-14T13:10:38.454 INFO:tasks.workunit.client.0.smithi012.stdout:9/621: write da/f14 [1267634,128576] 0 2024-02-14T13:10:38.454 INFO:tasks.workunit.client.0.smithi012.stdout:9/622: fsync da/d4f/fcc 0 2024-02-14T13:10:38.455 INFO:tasks.workunit.client.0.smithi012.stdout:1/610: unlink d6/d10/d22/d31/d5b/d5e/d3d/f68 0 2024-02-14T13:10:38.455 INFO:tasks.workunit.client.0.smithi012.stdout:1/611: readlink d6/d10/d22/d31/d5b/d5e/l1e 0 2024-02-14T13:10:38.459 INFO:tasks.workunit.client.0.smithi012.stdout:8/528: dwrite d9/dc/d14/d23/d97/d56/d57/d5c/f61 [0,4194304] 0 2024-02-14T13:10:38.465 INFO:tasks.workunit.client.0.smithi012.stdout:4/501: dwrite d0/d10/d28/d4f/d6b/d8f/d56/f5d [0,4194304] 0 2024-02-14T13:10:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:38 smithi012 ceph-mon[32370]: pgmap v405: 97 pgs: 97 active+clean; 639 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 88 MiB/s wr, 1.45k op/s 2024-02-14T13:10:38.473 INFO:tasks.workunit.client.0.smithi012.stdout:7/459: symlink df/d24/d56/la1 0 2024-02-14T13:10:38.475 INFO:tasks.workunit.client.0.smithi012.stdout:9/623: link da/c8c da/dd/d57/cd9 0 2024-02-14T13:10:38.475 INFO:tasks.workunit.client.0.smithi012.stdout:9/624: chown da/dd/d57/l7a 819 1 2024-02-14T13:10:38.476 INFO:tasks.workunit.client.0.smithi012.stdout:3/560: truncate d9/f35 1429999 0 2024-02-14T13:10:38.476 INFO:tasks.workunit.client.0.smithi012.stdout:3/561: chown d9/dd/d30/d34/d78/cb0 54702 1 2024-02-14T13:10:38.476 INFO:tasks.workunit.client.0.smithi012.stdout:3/562: write d9/d8e/f9b [1530802,32211] 0 2024-02-14T13:10:38.477 INFO:tasks.workunit.client.0.smithi012.stdout:8/529: creat d9/dc/d14/d23/d97/da3/fa8 x:0 0 0 2024-02-14T13:10:38.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/502: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/fb8 x:0 0 0 2024-02-14T13:10:38.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/503: stat d0/d10/d28/d4f 0 2024-02-14T13:10:38.479 INFO:tasks.workunit.client.0.smithi012.stdout:4/504: write d0/d10/d28/f51 [232775,3609] 0 2024-02-14T13:10:38.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/625: unlink da/dd/d19/d30/c42 0 2024-02-14T13:10:38.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/626: truncate da/dd/d39/d8d/fa9 556350 0 2024-02-14T13:10:38.481 INFO:tasks.workunit.client.0.smithi012.stdout:9/627: chown da/dd/d57/d59/d73/ca5 3270330 1 2024-02-14T13:10:38.482 INFO:tasks.workunit.client.0.smithi012.stdout:3/563: mknod d9/ccb 0 2024-02-14T13:10:38.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/530: mknod d9/dc/d1b/d6b/ca9 0 2024-02-14T13:10:38.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/531: write d9/dc/d14/d23/d97/da3/fa8 [376109,64323] 0 2024-02-14T13:10:38.484 INFO:tasks.workunit.client.0.smithi012.stdout:4/505: creat d0/d10/d28/d4f/d6b/d8f/d56/d8c/fb9 x:0 0 0 2024-02-14T13:10:38.484 INFO:tasks.workunit.client.0.smithi012.stdout:9/628: rmdir da/dd/d38/d7e/d91 39 2024-02-14T13:10:38.484 INFO:tasks.workunit.client.0.smithi012.stdout:7/460: dread df/f30 [0,4194304] 0 2024-02-14T13:10:38.484 INFO:tasks.workunit.client.0.smithi012.stdout:7/461: chown df/d36 1069971 1 2024-02-14T13:10:38.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/564: creat d9/dd/d30/fcc x:0 0 0 2024-02-14T13:10:38.485 INFO:tasks.workunit.client.0.smithi012.stdout:4/506: getdents d0/d10/d1f 0 2024-02-14T13:10:38.486 INFO:tasks.workunit.client.0.smithi012.stdout:9/629: chown da/dd/d38/c58 14566 1 2024-02-14T13:10:38.487 INFO:tasks.workunit.client.0.smithi012.stdout:3/565: mkdir d9/dcd 0 2024-02-14T13:10:38.488 INFO:tasks.workunit.client.0.smithi012.stdout:4/507: symlink d0/d10/d28/d4f/d6b/d83/lba 0 2024-02-14T13:10:38.489 INFO:tasks.workunit.client.0.smithi012.stdout:2/651: dwrite d0/d6/d37/fad [0,4194304] 0 2024-02-14T13:10:38.489 INFO:tasks.workunit.client.0.smithi012.stdout:5/568: dwrite dc/d47/d69/f9b [0,4194304] 0 2024-02-14T13:10:38.489 INFO:tasks.workunit.client.0.smithi012.stdout:5/569: dread - dc/d2f/d3e/fa4 zero size 2024-02-14T13:10:38.489 INFO:tasks.workunit.client.0.smithi012.stdout:1/612: dwrite d6/d10/d22/d44/f48 [4194304,4194304] 0 2024-02-14T13:10:38.489 INFO:tasks.workunit.client.0.smithi012.stdout:1/613: chown d6/f1b 27377616 1 2024-02-14T13:10:38.489 INFO:tasks.workunit.client.0.smithi012.stdout:1/614: chown d6/d10/d64/l8d 857606 1 2024-02-14T13:10:38.490 INFO:tasks.workunit.client.0.smithi012.stdout:1/615: truncate d6/d10/d22/d31/d3e/fc4 960364 0 2024-02-14T13:10:38.490 INFO:tasks.workunit.client.0.smithi012.stdout:0/561: dwrite d10/d14/d2b/d3b/f86 [0,4194304] 0 2024-02-14T13:10:38.490 INFO:tasks.workunit.client.0.smithi012.stdout:0/562: read - d10/d14/d20/f5a zero size 2024-02-14T13:10:38.491 INFO:tasks.workunit.client.0.smithi012.stdout:9/630: unlink da/dd/d38/d7e/ld7 0 2024-02-14T13:10:38.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:38 smithi103 ceph-mon[36921]: pgmap v405: 97 pgs: 97 active+clean; 639 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 88 MiB/s wr, 1.45k op/s 2024-02-14T13:10:38.492 INFO:tasks.workunit.client.0.smithi012.stdout:3/566: symlink d9/d18/d39/lce 0 2024-02-14T13:10:38.495 INFO:tasks.workunit.client.0.smithi012.stdout:4/508: unlink d0/d10/d28/d4f/d6b/d83/l4d 0 2024-02-14T13:10:38.500 INFO:tasks.workunit.client.0.smithi012.stdout:8/532: read d9/dc/d14/d23/d97/f9b [154113,14610] 0 2024-02-14T13:10:38.500 INFO:tasks.workunit.client.0.smithi012.stdout:8/533: chown d9/dc/d1b/d35 0 1 2024-02-14T13:10:38.502 INFO:tasks.workunit.client.0.smithi012.stdout:0/563: link d10/d14/d20/f69 d10/dad/fb4 0 2024-02-14T13:10:38.503 INFO:tasks.workunit.client.0.smithi012.stdout:9/631: creat da/dd/d38/d7e/fda x:0 0 0 2024-02-14T13:10:38.503 INFO:tasks.workunit.client.0.smithi012.stdout:8/534: write d9/dc/d14/d23/f39 [2479562,15851] 0 2024-02-14T13:10:38.504 INFO:tasks.workunit.client.0.smithi012.stdout:3/567: creat d9/d68/fcf x:0 0 0 2024-02-14T13:10:38.510 INFO:tasks.workunit.client.0.smithi012.stdout:6/477: sync 2024-02-14T13:10:38.510 INFO:tasks.workunit.client.0.smithi012.stdout:6/478: stat d1/d1e/d1b/f57 0 2024-02-14T13:10:38.513 INFO:tasks.workunit.client.0.smithi012.stdout:7/462: dwrite df/d24/f71 [0,4194304] 0 2024-02-14T13:10:38.515 INFO:tasks.workunit.client.0.smithi012.stdout:9/632: stat da/dd/c5e 0 2024-02-14T13:10:38.517 INFO:tasks.workunit.client.0.smithi012.stdout:3/568: mkdir d9/dd/d30/d44/d66/dd0 0 2024-02-14T13:10:38.519 INFO:tasks.workunit.client.0.smithi012.stdout:6/479: mkdir d1/d17/d5a/d9b 0 2024-02-14T13:10:38.519 INFO:tasks.workunit.client.0.smithi012.stdout:8/535: dread d9/dc/d1b/d35/f8a [0,4194304] 0 2024-02-14T13:10:38.519 INFO:tasks.workunit.client.0.smithi012.stdout:8/536: dread - d9/dc/d14/d23/d97/d56/fa7 zero size 2024-02-14T13:10:38.520 INFO:tasks.workunit.client.0.smithi012.stdout:0/564: dread d10/d14/d2b/d3b/f86 [0,4194304] 0 2024-02-14T13:10:38.520 INFO:tasks.workunit.client.0.smithi012.stdout:0/565: write d10/d14/d23/f45 [2025771,48975] 0 2024-02-14T13:10:38.520 INFO:tasks.workunit.client.0.smithi012.stdout:0/566: write d10/d14/d1b/d30/f6f [998576,30844] 0 2024-02-14T13:10:38.522 INFO:tasks.workunit.client.0.smithi012.stdout:9/633: unlink da/dd/d38/c94 0 2024-02-14T13:10:38.523 INFO:tasks.workunit.client.0.smithi012.stdout:3/569: getdents d9/dd/d30/d44/d66/db3/db9 0 2024-02-14T13:10:38.524 INFO:tasks.workunit.client.0.smithi012.stdout:6/480: creat d1/df/d16/d7c/d97/d82/f9c x:0 0 0 2024-02-14T13:10:38.526 INFO:tasks.workunit.client.0.smithi012.stdout:8/537: symlink d9/dc/d14/d23/d97/d56/d57/d5c/laa 0 2024-02-14T13:10:38.526 INFO:tasks.workunit.client.0.smithi012.stdout:8/538: chown d9/dc/d1b/f9f 3293292 1 2024-02-14T13:10:38.526 INFO:tasks.workunit.client.0.smithi012.stdout:8/539: read d9/dc/d14/d23/f67 [1477232,126068] 0 2024-02-14T13:10:38.526 INFO:tasks.workunit.client.0.smithi012.stdout:8/540: write d9/dc/d1b/d35/f87 [199016,94124] 0 2024-02-14T13:10:38.527 INFO:tasks.workunit.client.0.smithi012.stdout:1/616: dwrite d6/ff [0,4194304] 0 2024-02-14T13:10:38.528 INFO:tasks.workunit.client.0.smithi012.stdout:1/617: readlink d6/d10/d22/d31/d5b/d5e/l1e 0 2024-02-14T13:10:38.528 INFO:tasks.workunit.client.0.smithi012.stdout:1/618: dread - d6/d10/d22/d31/d34/f8b zero size 2024-02-14T13:10:38.528 INFO:tasks.workunit.client.0.smithi012.stdout:4/509: dwrite d0/d10/d28/d4f/d6b/d8f/d56/fad [0,4194304] 0 2024-02-14T13:10:38.528 INFO:tasks.workunit.client.0.smithi012.stdout:4/510: chown d0/d10/d28/c75 691072 1 2024-02-14T13:10:38.528 INFO:tasks.workunit.client.0.smithi012.stdout:5/570: dwrite dc/d17/d4b/f7c [0,4194304] 0 2024-02-14T13:10:38.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/567: mknod d10/d14/d41/d52/cb5 0 2024-02-14T13:10:38.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/568: chown d10/d14/d41/lac 244 1 2024-02-14T13:10:38.529 INFO:tasks.workunit.client.0.smithi012.stdout:0/569: chown d10/d14/d20/f37 2066243 1 2024-02-14T13:10:38.530 INFO:tasks.workunit.client.0.smithi012.stdout:9/634: write da/dd/d57/d59/fb5 [220127,124064] 0 2024-02-14T13:10:38.530 INFO:tasks.workunit.client.0.smithi012.stdout:9/635: fsync da/f23 0 2024-02-14T13:10:38.530 INFO:tasks.workunit.client.0.smithi012.stdout:9/636: chown da/dd/d38/d7e/fb9 0 1 2024-02-14T13:10:38.531 INFO:tasks.workunit.client.0.smithi012.stdout:3/570: truncate d9/d3f/da8/fa9 3464074 0 2024-02-14T13:10:38.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/481: creat d1/d1e/d1b/d21/d69/f9d x:0 0 0 2024-02-14T13:10:38.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/482: dread - d1/d1e/d1b/f87 zero size 2024-02-14T13:10:38.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/483: chown d1/d17/f53 571841420 1 2024-02-14T13:10:38.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/484: chown d1/d1e/f20 0 1 2024-02-14T13:10:38.532 INFO:tasks.workunit.client.0.smithi012.stdout:6/485: write d1/d1e/d1b/f87 [368888,56998] 0 2024-02-14T13:10:38.533 INFO:tasks.workunit.client.0.smithi012.stdout:8/541: mkdir d9/dc/d38/d6a/dab 0 2024-02-14T13:10:38.536 INFO:tasks.workunit.client.0.smithi012.stdout:7/463: dwrite df/d24/d56/f64 [0,4194304] 0 2024-02-14T13:10:38.536 INFO:tasks.workunit.client.0.smithi012.stdout:5/571: dread dc/d17/d20/d4c/d58/f6b [0,4194304] 0 2024-02-14T13:10:38.536 INFO:tasks.workunit.client.0.smithi012.stdout:4/511: symlink d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/lbb 0 2024-02-14T13:10:38.539 INFO:tasks.workunit.client.0.smithi012.stdout:0/570: mkdir d10/db6 0 2024-02-14T13:10:38.540 INFO:tasks.workunit.client.0.smithi012.stdout:9/637: fsync da/dd/d57/fc7 0 2024-02-14T13:10:38.540 INFO:tasks.workunit.client.0.smithi012.stdout:9/638: write da/dd/d18/f22 [949823,16605] 0 2024-02-14T13:10:38.543 INFO:tasks.workunit.client.0.smithi012.stdout:8/542: write d9/f3c [510402,6808] 0 2024-02-14T13:10:38.543 INFO:tasks.workunit.client.0.smithi012.stdout:5/572: symlink dc/d47/d69/lae 0 2024-02-14T13:10:38.543 INFO:tasks.workunit.client.0.smithi012.stdout:8/543: write d9/f84 [4976438,86542] 0 2024-02-14T13:10:38.544 INFO:tasks.workunit.client.0.smithi012.stdout:1/619: dwrite d6/d10/d22/d31/f40 [0,4194304] 0 2024-02-14T13:10:38.544 INFO:tasks.workunit.client.0.smithi012.stdout:7/464: creat df/d27/fa2 x:0 0 0 2024-02-14T13:10:38.544 INFO:tasks.workunit.client.0.smithi012.stdout:1/620: dread d6/d10/d22/d31/d34/d58/d61/f93 [0,4194304] 0 2024-02-14T13:10:38.545 INFO:tasks.workunit.client.0.smithi012.stdout:4/512: chown d0/d10/d28/d4f/d6b/d8f/d56/d8c/f9d 30969743 1 2024-02-14T13:10:38.545 INFO:tasks.workunit.client.0.smithi012.stdout:4/513: stat d0/d10/d28/d4f/d6b/d83/d17/d5f/l67 0 2024-02-14T13:10:38.547 INFO:tasks.workunit.client.0.smithi012.stdout:0/571: unlink d10/d14/d41/f48 0 2024-02-14T13:10:38.547 INFO:tasks.workunit.client.0.smithi012.stdout:0/572: chown d10/d84 31013059 1 2024-02-14T13:10:38.547 INFO:tasks.workunit.client.0.smithi012.stdout:0/573: write d10/d14/d41/f6a [1142551,52864] 0 2024-02-14T13:10:38.548 INFO:tasks.workunit.client.0.smithi012.stdout:9/639: symlink da/dd/d39/d8d/ldb 0 2024-02-14T13:10:38.548 INFO:tasks.workunit.client.0.smithi012.stdout:7/465: dread df/d2d/d5d/d72/f77 [0,4194304] 0 2024-02-14T13:10:38.551 INFO:tasks.workunit.client.0.smithi012.stdout:8/544: unlink d9/dc/f6d 0 2024-02-14T13:10:38.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/573: write dc/d2f/d40/f6f [1362943,111330] 0 2024-02-14T13:10:38.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/574: fdatasync dc/d47/d6e/f77 0 2024-02-14T13:10:38.555 INFO:tasks.workunit.client.0.smithi012.stdout:4/514: creat d0/d10/d28/d62/fbc x:0 0 0 2024-02-14T13:10:38.556 INFO:tasks.workunit.client.0.smithi012.stdout:0/574: getdents d10/d14/d1b/d54 0 2024-02-14T13:10:38.557 INFO:tasks.workunit.client.0.smithi012.stdout:6/486: getdents d1/df/d16/d7c/d97/d82 0 2024-02-14T13:10:38.558 INFO:tasks.workunit.client.0.smithi012.stdout:7/466: creat df/d24/d9e/fa3 x:0 0 0 2024-02-14T13:10:38.558 INFO:tasks.workunit.client.0.smithi012.stdout:7/467: fsync df/d2d/f3f 0 2024-02-14T13:10:38.559 INFO:tasks.workunit.client.0.smithi012.stdout:9/640: write da/dd/fb4 [3294110,28310] 0 2024-02-14T13:10:38.559 INFO:tasks.workunit.client.0.smithi012.stdout:4/515: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fbd x:0 0 0 2024-02-14T13:10:38.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:38 smithi055 ceph-mon[36853]: pgmap v405: 97 pgs: 97 active+clean; 639 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 88 MiB/s wr, 1.45k op/s 2024-02-14T13:10:38.561 INFO:tasks.workunit.client.0.smithi012.stdout:0/575: creat d10/db6/fb7 x:0 0 0 2024-02-14T13:10:38.561 INFO:tasks.workunit.client.0.smithi012.stdout:0/576: dread - d10/d14/d41/d52/d78/d8c/d7f/fa5 zero size 2024-02-14T13:10:38.561 INFO:tasks.workunit.client.0.smithi012.stdout:0/577: read - d10/d14/d41/d61/d74/f90 zero size 2024-02-14T13:10:38.563 INFO:tasks.workunit.client.0.smithi012.stdout:6/487: unlink d1/d1e/d1b/l46 0 2024-02-14T13:10:38.563 INFO:tasks.workunit.client.0.smithi012.stdout:3/571: dwrite d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:38.565 INFO:tasks.workunit.client.0.smithi012.stdout:7/468: creat df/d2d/d5d/d72/d8a/fa4 x:0 0 0 2024-02-14T13:10:38.565 INFO:tasks.workunit.client.0.smithi012.stdout:9/641: mkdir da/dd/d38/d7e/ddc 0 2024-02-14T13:10:38.565 INFO:tasks.workunit.client.0.smithi012.stdout:0/578: link d10/d14/d1b/d30/f6f d10/dad/fb8 0 2024-02-14T13:10:38.566 INFO:tasks.workunit.client.0.smithi012.stdout:4/516: dread d0/d10/d28/d4f/d6b/d83/d17/f47 [0,4194304] 0 2024-02-14T13:10:38.567 INFO:tasks.workunit.client.0.smithi012.stdout:3/572: rmdir d9/dd/d30/d44/d66 39 2024-02-14T13:10:38.568 INFO:tasks.workunit.client.0.smithi012.stdout:0/579: dread d10/d14/d2b/d3b/f4f [0,4194304] 0 2024-02-14T13:10:38.569 INFO:tasks.workunit.client.0.smithi012.stdout:4/517: unlink d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/l8e 0 2024-02-14T13:10:38.572 INFO:tasks.workunit.client.0.smithi012.stdout:0/580: creat d10/d14/d1b/d8e/fb9 x:0 0 0 2024-02-14T13:10:38.573 INFO:tasks.workunit.client.0.smithi012.stdout:3/573: symlink d9/dd/d30/d34/ld1 0 2024-02-14T13:10:38.575 INFO:tasks.workunit.client.0.smithi012.stdout:0/581: dread d10/d14/d1b/f22 [0,4194304] 0 2024-02-14T13:10:38.577 INFO:tasks.workunit.client.0.smithi012.stdout:3/574: rename d9/d3f/d73/d5d/l85 to d9/ld2 0 2024-02-14T13:10:38.577 INFO:tasks.workunit.client.0.smithi012.stdout:3/575: chown d9/d18/c5c 154798940 1 2024-02-14T13:10:38.580 INFO:tasks.workunit.client.0.smithi012.stdout:0/582: unlink d10/d14/d20/d49/c76 0 2024-02-14T13:10:38.582 INFO:tasks.workunit.client.0.smithi012.stdout:0/583: creat d10/d14/fba x:0 0 0 2024-02-14T13:10:38.584 INFO:tasks.workunit.client.0.smithi012.stdout:0/584: mkdir d10/d14/d2b/da4/dbb 0 2024-02-14T13:10:38.585 INFO:tasks.workunit.client.0.smithi012.stdout:0/585: creat d10/d14/d2b/da4/dbb/fbc x:0 0 0 2024-02-14T13:10:38.587 INFO:tasks.workunit.client.0.smithi012.stdout:0/586: rename d10/d14/d23 to d10/d84/dbd 0 2024-02-14T13:10:38.587 INFO:tasks.workunit.client.0.smithi012.stdout:0/587: stat d10/d84/dbd 0 2024-02-14T13:10:38.587 INFO:tasks.workunit.client.0.smithi012.stdout:0/588: write d10/d14/d1b/d8e/fb9 [1017255,98496] 0 2024-02-14T13:10:38.591 INFO:tasks.workunit.client.0.smithi012.stdout:0/589: rmdir d10/d14/d41 39 2024-02-14T13:10:38.592 INFO:tasks.workunit.client.0.smithi012.stdout:0/590: write d10/d14/d41/d52/d78/d8c/f36 [67713,71220] 0 2024-02-14T13:10:38.593 INFO:tasks.workunit.client.0.smithi012.stdout:0/591: fdatasync d10/d14/d41/d61/d74/f90 0 2024-02-14T13:10:38.594 INFO:tasks.workunit.client.0.smithi012.stdout:0/592: creat d10/d14/d2b/fbe x:0 0 0 2024-02-14T13:10:38.594 INFO:tasks.workunit.client.0.smithi012.stdout:0/593: mknod d10/d84/d93/cbf 0 2024-02-14T13:10:38.596 INFO:tasks.workunit.client.0.smithi012.stdout:0/594: rename d10/d14/d51/f73 to d10/d14/d41/fc0 0 2024-02-14T13:10:38.599 INFO:tasks.workunit.client.0.smithi012.stdout:1/621: dwrite d6/d10/d22/d31/d5b/d5d/f1a [0,4194304] 0 2024-02-14T13:10:38.599 INFO:tasks.workunit.client.0.smithi012.stdout:0/595: dread d10/d14/d1b/f22 [0,4194304] 0 2024-02-14T13:10:38.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/575: dwrite dc/d2f/f39 [0,4194304] 0 2024-02-14T13:10:38.599 INFO:tasks.workunit.client.0.smithi012.stdout:5/576: write dc/d2f/d70/faa [596748,21579] 0 2024-02-14T13:10:38.600 INFO:tasks.workunit.client.0.smithi012.stdout:0/596: truncate d10/f62 463790 0 2024-02-14T13:10:38.600 INFO:tasks.workunit.client.0.smithi012.stdout:0/597: chown d10/d14/d41/d52/d72/c9c 8 1 2024-02-14T13:10:38.601 INFO:tasks.workunit.client.0.smithi012.stdout:5/577: symlink dc/d47/d6e/laf 0 2024-02-14T13:10:38.602 INFO:tasks.workunit.client.0.smithi012.stdout:0/598: symlink d10/d14/d20/d49/lc1 0 2024-02-14T13:10:38.602 INFO:tasks.workunit.client.0.smithi012.stdout:3/576: dwrite d9/dd/de/f3e [0,4194304] 0 2024-02-14T13:10:38.602 INFO:tasks.workunit.client.0.smithi012.stdout:0/599: chown d10/d14/d1b/f3a 208394215 1 2024-02-14T13:10:38.602 INFO:tasks.workunit.client.0.smithi012.stdout:1/622: write d6/d10/d22/d31/d34/d3b/f43 [1654325,104410] 0 2024-02-14T13:10:38.602 INFO:tasks.workunit.client.0.smithi012.stdout:8/545: dwrite d9/dc/d1b/d35/f5e [0,4194304] 0 2024-02-14T13:10:38.602 INFO:tasks.workunit.client.0.smithi012.stdout:8/546: stat d9/dc/d14/d2e 0 2024-02-14T13:10:38.603 INFO:tasks.workunit.client.0.smithi012.stdout:5/578: creat dc/d2f/d40/d53/d97/d98/fb0 x:0 0 0 2024-02-14T13:10:38.603 INFO:tasks.workunit.client.0.smithi012.stdout:9/642: dwrite da/dd/d38/fab [0,4194304] 0 2024-02-14T13:10:38.603 INFO:tasks.workunit.client.0.smithi012.stdout:6/488: dwrite d1/df/d24/d3f/f47 [0,4194304] 0 2024-02-14T13:10:38.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/469: dwrite df/d27/d4b/d6b/d6d/f81 [0,4194304] 0 2024-02-14T13:10:38.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/470: chown df/d27/d4b/d8d/c94 40630 1 2024-02-14T13:10:38.604 INFO:tasks.workunit.client.0.smithi012.stdout:7/471: fdatasync df/d36/f39 0 2024-02-14T13:10:38.606 INFO:tasks.workunit.client.0.smithi012.stdout:3/577: rmdir d9/d18 39 2024-02-14T13:10:38.606 INFO:tasks.workunit.client.0.smithi012.stdout:3/578: read d9/d3f/f81 [439139,85533] 0 2024-02-14T13:10:38.606 INFO:tasks.workunit.client.0.smithi012.stdout:3/579: fsync d9/dd/de/d58/d65/d6c/f94 0 2024-02-14T13:10:38.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/600: symlink d10/lc2 0 2024-02-14T13:10:38.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/601: fdatasync d10/db6/fb7 0 2024-02-14T13:10:38.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/602: truncate d10/d14/fba 503462 0 2024-02-14T13:10:38.613 INFO:tasks.workunit.client.0.smithi012.stdout:5/579: write dc/d17/d20/f37 [3769039,55176] 0 2024-02-14T13:10:38.614 INFO:tasks.workunit.client.0.smithi012.stdout:1/623: mknod d6/d10/d22/d31/d5b/d5d/d80/da4/cc8 0 2024-02-14T13:10:38.615 INFO:tasks.workunit.client.0.smithi012.stdout:1/624: write d6/d10/d22/d31/d5b/d5e/d3d/f51 [1056140,104418] 0 2024-02-14T13:10:38.617 INFO:tasks.workunit.client.0.smithi012.stdout:3/580: write d9/d3f/f4c [1349773,17326] 0 2024-02-14T13:10:38.617 INFO:tasks.workunit.client.0.smithi012.stdout:3/581: chown d9/dd 4926 1 2024-02-14T13:10:38.617 INFO:tasks.workunit.client.0.smithi012.stdout:3/582: stat d9/dc4/lc5 0 2024-02-14T13:10:38.630 INFO:tasks.workunit.client.0.smithi012.stdout:7/472: dwrite df/d27/f28 [4194304,4194304] 0 2024-02-14T13:10:38.630 INFO:tasks.workunit.client.0.smithi012.stdout:7/473: chown df/d2d/d5d 2019 1 2024-02-14T13:10:38.632 INFO:tasks.workunit.client.0.smithi012.stdout:7/474: dread df/f26 [0,4194304] 0 2024-02-14T13:10:38.632 INFO:tasks.workunit.client.0.smithi012.stdout:0/603: link d10/d14/d1b/d30/l79 d10/d14/d20/daa/lc3 0 2024-02-14T13:10:38.633 INFO:tasks.workunit.client.0.smithi012.stdout:7/475: dread df/d24/d56/f61 [0,4194304] 0 2024-02-14T13:10:38.633 INFO:tasks.workunit.client.0.smithi012.stdout:7/476: chown df/d24/d56/la1 345622 1 2024-02-14T13:10:38.635 INFO:tasks.workunit.client.0.smithi012.stdout:5/580: link dc/d2f/d40/d53/f7a dc/d47/d69/fb1 0 2024-02-14T13:10:38.635 INFO:tasks.workunit.client.0.smithi012.stdout:5/581: chown dc/d2f/d70/faa 1107064218 1 2024-02-14T13:10:38.635 INFO:tasks.workunit.client.0.smithi012.stdout:5/582: chown dc/d17/d20/d4c/d63/l6d 3 1 2024-02-14T13:10:38.637 INFO:tasks.workunit.client.0.smithi012.stdout:1/625: rmdir d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2 39 2024-02-14T13:10:38.638 INFO:tasks.workunit.client.0.smithi012.stdout:1/626: stat d6/d10/d22/d31/d5b/d5e/fb3 0 2024-02-14T13:10:38.640 INFO:tasks.workunit.client.0.smithi012.stdout:8/547: dwrite d9/dc/d38/d6a/f7e [4194304,4194304] 0 2024-02-14T13:10:38.640 INFO:tasks.workunit.client.0.smithi012.stdout:8/548: chown d9/dc/d1b/f80 2 1 2024-02-14T13:10:38.644 INFO:tasks.workunit.client.0.smithi012.stdout:0/604: symlink d10/d14/d2b/da4/lc4 0 2024-02-14T13:10:38.647 INFO:tasks.workunit.client.0.smithi012.stdout:5/583: truncate dc/d17/f43 3964899 0 2024-02-14T13:10:38.647 INFO:tasks.workunit.client.0.smithi012.stdout:9/643: dwrite da/dd/d19/f4d [4194304,4194304] 0 2024-02-14T13:10:38.647 INFO:tasks.workunit.client.0.smithi012.stdout:9/644: fdatasync da/dd/d57/d59/fb5 0 2024-02-14T13:10:38.648 INFO:tasks.workunit.client.0.smithi012.stdout:9/645: write da/dd/d39/fa3 [1686858,102248] 0 2024-02-14T13:10:38.648 INFO:tasks.workunit.client.0.smithi012.stdout:6/489: dwrite d1/d1e/d1b/d21/d69/f8e [0,4194304] 0 2024-02-14T13:10:38.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/605: rmdir d10/d84/d93 39 2024-02-14T13:10:38.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/606: truncate d10/d14/d41/d52/d72/fa7 1019071 0 2024-02-14T13:10:38.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/607: write d10/d14/d2b/d3b/f63 [56566,4873] 0 2024-02-14T13:10:38.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/608: fsync d10/d14/d1b/f3a 0 2024-02-14T13:10:38.649 INFO:tasks.workunit.client.0.smithi012.stdout:0/609: readlink d10/d14/d41/lac 0 2024-02-14T13:10:38.651 INFO:tasks.workunit.client.0.smithi012.stdout:5/584: rmdir dc/d17/d20/d4c 39 2024-02-14T13:10:38.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/583: dwrite d9/f35 [0,4194304] 0 2024-02-14T13:10:38.652 INFO:tasks.workunit.client.0.smithi012.stdout:3/584: stat d9/dd/de/d58/f99 0 2024-02-14T13:10:38.656 INFO:tasks.workunit.client.0.smithi012.stdout:0/610: creat d10/d14/d41/d52/d78/d8c/fc5 x:0 0 0 2024-02-14T13:10:38.656 INFO:tasks.workunit.client.0.smithi012.stdout:5/585: creat dc/d47/fb2 x:0 0 0 2024-02-14T13:10:38.657 INFO:tasks.workunit.client.0.smithi012.stdout:3/585: rename d9/d3f/c5b to d9/d3f/dac/cd3 0 2024-02-14T13:10:38.665 INFO:tasks.workunit.client.0.smithi012.stdout:5/586: rename dc/f5a to dc/d17/d20/d4c/d58/fb3 0 2024-02-14T13:10:38.667 INFO:tasks.workunit.client.0.smithi012.stdout:3/586: unlink d9/dd/de/c2e 0 2024-02-14T13:10:38.670 INFO:tasks.workunit.client.0.smithi012.stdout:0/611: write d10/d14/d41/d52/d67/f8b [4171348,22018] 0 2024-02-14T13:10:38.670 INFO:tasks.workunit.client.0.smithi012.stdout:3/587: link d9/d18/d39/l47 d9/d3f/d73/ld4 0 2024-02-14T13:10:38.672 INFO:tasks.workunit.client.0.smithi012.stdout:0/612: creat d10/d14/d41/d61/fc6 x:0 0 0 2024-02-14T13:10:38.676 INFO:tasks.workunit.client.0.smithi012.stdout:2/652: sync 2024-02-14T13:10:38.676 INFO:tasks.workunit.client.0.smithi012.stdout:2/653: chown d0/d8/d11/f17 83 1 2024-02-14T13:10:38.679 INFO:tasks.workunit.client.0.smithi012.stdout:2/654: rename d0/d5 to d0/d1a/de4 0 2024-02-14T13:10:38.684 INFO:tasks.workunit.client.0.smithi012.stdout:5/587: dwrite dc/d2f/f52 [0,4194304] 0 2024-02-14T13:10:38.684 INFO:tasks.workunit.client.0.smithi012.stdout:7/477: dwrite df/f30 [0,4194304] 0 2024-02-14T13:10:38.684 INFO:tasks.workunit.client.0.smithi012.stdout:7/478: readlink df/l16 0 2024-02-14T13:10:38.684 INFO:tasks.workunit.client.0.smithi012.stdout:5/588: write dc/d17/d20/d4c/d58/f6b [3364491,117598] 0 2024-02-14T13:10:38.684 INFO:tasks.workunit.client.0.smithi012.stdout:5/589: chown dc/d17/d20/f35 37297 1 2024-02-14T13:10:38.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/590: write dc/d47/f61 [1458759,91589] 0 2024-02-14T13:10:38.685 INFO:tasks.workunit.client.0.smithi012.stdout:9/646: dwrite da/dd/d19/d30/d9d/f9f [0,4194304] 0 2024-02-14T13:10:38.685 INFO:tasks.workunit.client.0.smithi012.stdout:9/647: chown da/dd/d57/d59/fbe 830 1 2024-02-14T13:10:38.685 INFO:tasks.workunit.client.0.smithi012.stdout:6/490: dwrite d1/df/d24/d3f/d56/f76 [0,4194304] 0 2024-02-14T13:10:38.685 INFO:tasks.workunit.client.0.smithi012.stdout:1/627: dwrite d6/d10/d22/d31/d5b/d5d/d6d/f7b [0,4194304] 0 2024-02-14T13:10:38.686 INFO:tasks.workunit.client.0.smithi012.stdout:7/479: creat df/d27/d4b/d6b/fa5 x:0 0 0 2024-02-14T13:10:38.692 INFO:tasks.workunit.client.0.smithi012.stdout:9/648: link da/dd/f2b da/d4f/fdd 0 2024-02-14T13:10:38.692 INFO:tasks.workunit.client.0.smithi012.stdout:9/649: write da/f3f [4668268,104774] 0 2024-02-14T13:10:38.692 INFO:tasks.workunit.client.0.smithi012.stdout:9/650: chown da/dd/d19/d30/d45/l69 1822 1 2024-02-14T13:10:38.693 INFO:tasks.workunit.client.0.smithi012.stdout:2/655: write d0/d1a/f49 [2454357,107589] 0 2024-02-14T13:10:38.695 INFO:tasks.workunit.client.0.smithi012.stdout:2/656: dread d0/d6/d37/fdd [0,4194304] 0 2024-02-14T13:10:38.695 INFO:tasks.workunit.client.0.smithi012.stdout:2/657: write d0/d8/d9/d90/fbc [568539,102140] 0 2024-02-14T13:10:38.696 INFO:tasks.workunit.client.0.smithi012.stdout:1/628: dread d6/d10/d22/d31/d34/d58/f92 [0,4194304] 0 2024-02-14T13:10:38.696 INFO:tasks.workunit.client.0.smithi012.stdout:1/629: chown d6/d10/d22/l7f 423100961 1 2024-02-14T13:10:38.698 INFO:tasks.workunit.client.0.smithi012.stdout:5/591: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:38.698 INFO:tasks.workunit.client.0.smithi012.stdout:3/588: dwrite d9/d8e/f9f [0,4194304] 0 2024-02-14T13:10:38.698 INFO:tasks.workunit.client.0.smithi012.stdout:3/589: chown d9/d3f/dac 3688215 1 2024-02-14T13:10:38.698 INFO:tasks.workunit.client.0.smithi012.stdout:3/590: readlink d9/dd/d30/lb4 0 2024-02-14T13:10:38.703 INFO:tasks.workunit.client.0.smithi012.stdout:0/613: dwrite d10/dad/fb4 [0,4194304] 0 2024-02-14T13:10:38.710 INFO:tasks.workunit.client.0.smithi012.stdout:5/592: rmdir dc 39 2024-02-14T13:10:38.710 INFO:tasks.workunit.client.0.smithi012.stdout:5/593: read dc/d17/f41 [1002496,5667] 0 2024-02-14T13:10:38.711 INFO:tasks.workunit.client.0.smithi012.stdout:5/594: chown dc/l18 228510 1 2024-02-14T13:10:38.711 INFO:tasks.workunit.client.0.smithi012.stdout:0/614: read d10/d14/f15 [897997,59283] 0 2024-02-14T13:10:38.712 INFO:tasks.workunit.client.0.smithi012.stdout:9/651: rmdir da/dd/d57/db2 39 2024-02-14T13:10:38.716 INFO:tasks.workunit.client.0.smithi012.stdout:6/491: dwrite d1/d1e/d66/f88 [0,4194304] 0 2024-02-14T13:10:38.716 INFO:tasks.workunit.client.0.smithi012.stdout:2/658: dwrite d0/d8/f31 [0,4194304] 0 2024-02-14T13:10:38.716 INFO:tasks.workunit.client.0.smithi012.stdout:2/659: stat d0/d20/f45 0 2024-02-14T13:10:38.716 INFO:tasks.workunit.client.0.smithi012.stdout:5/595: chown dc/d47/d59/d6a/f95 5 1 2024-02-14T13:10:38.718 INFO:tasks.workunit.client.0.smithi012.stdout:0/615: creat d10/d84/dbd/fc7 x:0 0 0 2024-02-14T13:10:38.719 INFO:tasks.workunit.client.0.smithi012.stdout:9/652: creat da/dd/d18/d71/d85/d48/fde x:0 0 0 2024-02-14T13:10:38.719 INFO:tasks.workunit.client.0.smithi012.stdout:9/653: fsync da/dd/d39/f9a 0 2024-02-14T13:10:38.719 INFO:tasks.workunit.client.0.smithi012.stdout:7/480: rmdir df 39 2024-02-14T13:10:38.725 INFO:tasks.workunit.client.0.smithi012.stdout:2/660: creat d0/d8/d9/d90/fe5 x:0 0 0 2024-02-14T13:10:38.726 INFO:tasks.workunit.client.0.smithi012.stdout:7/481: dread df/d24/f29 [0,4194304] 0 2024-02-14T13:10:38.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/596: rmdir dc/d17/d20/d4c/d58 39 2024-02-14T13:10:38.729 INFO:tasks.workunit.client.0.smithi012.stdout:0/616: creat d10/d14/d20/daa/fc8 x:0 0 0 2024-02-14T13:10:38.731 INFO:tasks.workunit.client.0.smithi012.stdout:2/661: rename d0/d6/de/d7b/f7e to d0/d8/d9/d90/fe6 0 2024-02-14T13:10:38.732 INFO:tasks.workunit.client.0.smithi012.stdout:7/482: mknod df/d36/ca6 0 2024-02-14T13:10:38.734 INFO:tasks.workunit.client.0.smithi012.stdout:2/662: mkdir d0/d1a/de4/d15/de7 0 2024-02-14T13:10:38.734 INFO:tasks.workunit.client.0.smithi012.stdout:0/617: write d10/dad/fb4 [4595724,3993] 0 2024-02-14T13:10:38.734 INFO:tasks.workunit.client.0.smithi012.stdout:0/618: chown d10/d14/d20/d49/lc1 2 1 2024-02-14T13:10:38.734 INFO:tasks.workunit.client.0.smithi012.stdout:2/663: mkdir d0/d6/de/de8 0 2024-02-14T13:10:38.736 INFO:tasks.workunit.client.0.smithi012.stdout:4/518: sync 2024-02-14T13:10:38.736 INFO:tasks.workunit.client.0.smithi012.stdout:5/597: write dc/d2f/f39 [3685945,8023] 0 2024-02-14T13:10:38.736 INFO:tasks.workunit.client.0.smithi012.stdout:5/598: chown dc/d17/d20/f64 4254003 1 2024-02-14T13:10:38.737 INFO:tasks.workunit.client.0.smithi012.stdout:5/599: fsync dc/d2f/d40/f48 0 2024-02-14T13:10:38.737 INFO:tasks.workunit.client.0.smithi012.stdout:4/519: read d0/d10/d1f/f2f [26696,107404] 0 2024-02-14T13:10:38.738 INFO:tasks.workunit.client.0.smithi012.stdout:6/492: dwrite d1/df/d16/f59 [0,4194304] 0 2024-02-14T13:10:38.740 INFO:tasks.workunit.client.0.smithi012.stdout:5/600: rename dc/d17/d20/d4c/d7b/l85 to dc/d2f/d40/d53/d97/lb4 0 2024-02-14T13:10:38.740 INFO:tasks.workunit.client.0.smithi012.stdout:0/619: dread d10/d14/d2b/d3b/f4f [0,4194304] 0 2024-02-14T13:10:38.742 INFO:tasks.workunit.client.0.smithi012.stdout:5/601: creat dc/d2f/d94/fb5 x:0 0 0 2024-02-14T13:10:38.744 INFO:tasks.workunit.client.0.smithi012.stdout:9/654: dwrite da/dd/f2b [0,4194304] 0 2024-02-14T13:10:38.744 INFO:tasks.workunit.client.0.smithi012.stdout:9/655: dread - da/d4f/f60 zero size 2024-02-14T13:10:38.744 INFO:tasks.workunit.client.0.smithi012.stdout:0/620: rename d10/d14/fa8 to d10/d14/d20/d49/fc9 0 2024-02-14T13:10:38.745 INFO:tasks.workunit.client.0.smithi012.stdout:0/621: write d10/d14/d41/d52/d78/d8c/f35 [419587,110201] 0 2024-02-14T13:10:38.746 INFO:tasks.workunit.client.0.smithi012.stdout:4/520: symlink d0/d10/d28/d4f/d6b/d8f/d56/d8c/lbe 0 2024-02-14T13:10:38.747 INFO:tasks.workunit.client.0.smithi012.stdout:4/521: truncate d0/d10/d1f/fa7 69418 0 2024-02-14T13:10:38.748 INFO:tasks.workunit.client.0.smithi012.stdout:5/602: mknod dc/d2f/d70/d78/d99/cb6 0 2024-02-14T13:10:38.753 INFO:tasks.workunit.client.0.smithi012.stdout:9/656: rename da/dd/d99 to da/dd/d57/d59/ddf 0 2024-02-14T13:10:38.756 INFO:tasks.workunit.client.0.smithi012.stdout:5/603: mknod dc/d17/d20/cb7 0 2024-02-14T13:10:38.756 INFO:tasks.workunit.client.0.smithi012.stdout:6/493: dwrite d1/d1e/d1b/d21/f32 [0,4194304] 0 2024-02-14T13:10:38.756 INFO:tasks.workunit.client.0.smithi012.stdout:6/494: stat d1/d1e/dc/d38/c83 0 2024-02-14T13:10:38.756 INFO:tasks.workunit.client.0.smithi012.stdout:9/657: creat da/dd/d38/fe0 x:0 0 0 2024-02-14T13:10:38.757 INFO:tasks.workunit.client.0.smithi012.stdout:7/483: dwrite df/d36/f3a [0,4194304] 0 2024-02-14T13:10:38.757 INFO:tasks.workunit.client.0.smithi012.stdout:5/604: mknod dc/d17/d20/d8e/cb8 0 2024-02-14T13:10:38.758 INFO:tasks.workunit.client.0.smithi012.stdout:6/495: mknod d1/df/d24/d3f/d56/d93/c9e 0 2024-02-14T13:10:38.758 INFO:tasks.workunit.client.0.smithi012.stdout:6/496: dread - d1/d1e/d1b/f85 zero size 2024-02-14T13:10:38.760 INFO:tasks.workunit.client.0.smithi012.stdout:7/484: getdents df/d2d/d82/d88 0 2024-02-14T13:10:38.760 INFO:tasks.workunit.client.0.smithi012.stdout:7/485: write df/f59 [750234,58917] 0 2024-02-14T13:10:38.760 INFO:tasks.workunit.client.0.smithi012.stdout:7/486: chown df/d2d/f83 0 1 2024-02-14T13:10:38.760 INFO:tasks.workunit.client.0.smithi012.stdout:7/487: readlink df/l13 0 2024-02-14T13:10:38.761 INFO:tasks.workunit.client.0.smithi012.stdout:5/605: creat dc/d2f/d3e/fb9 x:0 0 0 2024-02-14T13:10:38.761 INFO:tasks.workunit.client.0.smithi012.stdout:4/522: dread d0/d10/d28/f37 [0,4194304] 0 2024-02-14T13:10:38.762 INFO:tasks.workunit.client.0.smithi012.stdout:4/523: dread d0/d10/d28/d4f/d6b/d83/d17/f47 [0,4194304] 0 2024-02-14T13:10:38.763 INFO:tasks.workunit.client.0.smithi012.stdout:6/497: getdents d1/d1e/d1b 0 2024-02-14T13:10:38.766 INFO:tasks.workunit.client.0.smithi012.stdout:7/488: unlink df/d2d/d5d/d72/d78/c7e 0 2024-02-14T13:10:38.766 INFO:tasks.workunit.client.0.smithi012.stdout:7/489: write df/d2d/f83 [727944,87633] 0 2024-02-14T13:10:38.767 INFO:tasks.workunit.client.0.smithi012.stdout:5/606: mknod dc/d2f/d70/d78/cba 0 2024-02-14T13:10:38.768 INFO:tasks.workunit.client.0.smithi012.stdout:0/622: dwrite d10/d14/d2b/d3b/f63 [4194304,4194304] 0 2024-02-14T13:10:38.769 INFO:tasks.workunit.client.0.smithi012.stdout:4/524: symlink d0/d10/d1f/lbf 0 2024-02-14T13:10:38.770 INFO:tasks.workunit.client.0.smithi012.stdout:6/498: creat d1/f9f x:0 0 0 2024-02-14T13:10:38.770 INFO:tasks.workunit.client.0.smithi012.stdout:6/499: write d1/d1e/d1b/f33 [819864,115033] 0 2024-02-14T13:10:38.770 INFO:tasks.workunit.client.0.smithi012.stdout:6/500: fdatasync d1/d1e/d1b/d21/d69/f8e 0 2024-02-14T13:10:38.770 INFO:tasks.workunit.client.0.smithi012.stdout:6/501: chown d1/d1e/d1b/f57 2548 1 2024-02-14T13:10:38.772 INFO:tasks.workunit.client.0.smithi012.stdout:5/607: mkdir dc/d17/d20/d4c/d58/dbb 0 2024-02-14T13:10:38.772 INFO:tasks.workunit.client.0.smithi012.stdout:5/608: dread - dc/d47/d69/fb1 zero size 2024-02-14T13:10:38.772 INFO:tasks.workunit.client.0.smithi012.stdout:9/658: dwrite da/dd/d39/f9e [0,4194304] 0 2024-02-14T13:10:38.773 INFO:tasks.workunit.client.0.smithi012.stdout:9/659: truncate da/dd/f53 1192730 0 2024-02-14T13:10:38.773 INFO:tasks.workunit.client.0.smithi012.stdout:9/660: read da/d33/d63/fcd [78266,82237] 0 2024-02-14T13:10:38.775 INFO:tasks.workunit.client.0.smithi012.stdout:7/490: rename df/d2d/d5d/d72/d78/f86 to df/d36/d67/fa7 0 2024-02-14T13:10:38.776 INFO:tasks.workunit.client.0.smithi012.stdout:5/609: mkdir dc/d2f/d70/dbc 0 2024-02-14T13:10:38.779 INFO:tasks.workunit.client.0.smithi012.stdout:7/491: creat df/d24/d56/fa8 x:0 0 0 2024-02-14T13:10:38.779 INFO:tasks.workunit.client.0.smithi012.stdout:6/502: dread d1/d1e/d66/f88 [0,4194304] 0 2024-02-14T13:10:38.779 INFO:tasks.workunit.client.0.smithi012.stdout:6/503: write d1/d17/d5a/f68 [1225212,93930] 0 2024-02-14T13:10:38.779 INFO:tasks.workunit.client.0.smithi012.stdout:6/504: write d1/d17/d5a/f68 [1477300,67217] 0 2024-02-14T13:10:38.781 INFO:tasks.workunit.client.0.smithi012.stdout:6/505: mkdir d1/df/d24/d5f/da0 0 2024-02-14T13:10:38.782 INFO:tasks.workunit.client.0.smithi012.stdout:5/610: mknod dc/d47/d59/cbd 0 2024-02-14T13:10:38.782 INFO:tasks.workunit.client.0.smithi012.stdout:5/611: dread - dc/d47/fa8 zero size 2024-02-14T13:10:38.783 INFO:tasks.workunit.client.0.smithi012.stdout:5/612: creat dc/d2f/d40/d53/d97/fbe x:0 0 0 2024-02-14T13:10:38.784 INFO:tasks.workunit.client.0.smithi012.stdout:5/613: write dc/d2f/d40/f48 [853224,94178] 0 2024-02-14T13:10:38.784 INFO:tasks.workunit.client.0.smithi012.stdout:5/614: write dc/f29 [3244603,49442] 0 2024-02-14T13:10:38.785 INFO:tasks.workunit.client.0.smithi012.stdout:5/615: mknod dc/d17/d20/d4c/cbf 0 2024-02-14T13:10:38.785 INFO:tasks.workunit.client.0.smithi012.stdout:8/549: sync 2024-02-14T13:10:38.787 INFO:tasks.workunit.client.0.smithi012.stdout:4/525: dwrite d0/d10/d1f/f70 [4194304,4194304] 0 2024-02-14T13:10:38.787 INFO:tasks.workunit.client.0.smithi012.stdout:4/526: dread - d0/d10/d1f/f9b zero size 2024-02-14T13:10:38.787 INFO:tasks.workunit.client.0.smithi012.stdout:5/616: link f6 dc/d2f/d40/d53/d97/fc0 0 2024-02-14T13:10:38.788 INFO:tasks.workunit.client.0.smithi012.stdout:6/506: dread d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:38.790 INFO:tasks.workunit.client.0.smithi012.stdout:5/617: mknod dc/d2f/d3e/cc1 0 2024-02-14T13:10:38.791 INFO:tasks.workunit.client.0.smithi012.stdout:5/618: read - dc/d47/fb2 zero size 2024-02-14T13:10:38.793 INFO:tasks.workunit.client.0.smithi012.stdout:8/550: rename d9/dc/d14/l47 to d9/dc/d1b/lac 0 2024-02-14T13:10:38.793 INFO:tasks.workunit.client.0.smithi012.stdout:8/551: fdatasync d9/dc/d14/f1f 0 2024-02-14T13:10:38.793 INFO:tasks.workunit.client.0.smithi012.stdout:8/552: dread - d9/dc/d14/d23/d97/d56/fa7 zero size 2024-02-14T13:10:38.793 INFO:tasks.workunit.client.0.smithi012.stdout:8/553: readlink d9/l43 0 2024-02-14T13:10:38.794 INFO:tasks.workunit.client.0.smithi012.stdout:5/619: mkdir dc/dc2 0 2024-02-14T13:10:38.794 INFO:tasks.workunit.client.0.smithi012.stdout:5/620: fdatasync dc/d2f/d94/fb5 0 2024-02-14T13:10:38.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/527: rename d0/d10/d28/d62/c85 to d0/d10/d28/d4f/d6b/d8f/d56/cc0 0 2024-02-14T13:10:38.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/528: read d0/d10/d28/d4f/d6b/d83/d17/f47 [838494,81135] 0 2024-02-14T13:10:38.796 INFO:tasks.workunit.client.0.smithi012.stdout:4/529: write d0/d10/d28/d4f/d6b/d8f/d56/fad [4319138,76672] 0 2024-02-14T13:10:38.798 INFO:tasks.workunit.client.0.smithi012.stdout:4/530: link d0/d10/d28/d4f/d6b/d83/lba d0/d10/d28/d4f/d6b/d8f/lc1 0 2024-02-14T13:10:38.800 INFO:tasks.workunit.client.0.smithi012.stdout:6/507: dread d1/d1e/dc/f2e [0,4194304] 0 2024-02-14T13:10:38.800 INFO:tasks.workunit.client.0.smithi012.stdout:6/508: dread - d1/df/d16/d7c/d97/d82/f9c zero size 2024-02-14T13:10:38.801 INFO:tasks.workunit.client.0.smithi012.stdout:0/623: dwrite fc [0,4194304] 0 2024-02-14T13:10:38.802 INFO:tasks.workunit.client.0.smithi012.stdout:0/624: write fd [4651532,77552] 0 2024-02-14T13:10:38.802 INFO:tasks.workunit.client.0.smithi012.stdout:9/661: dwrite f0 [0,4194304] 0 2024-02-14T13:10:38.802 INFO:tasks.workunit.client.0.smithi012.stdout:7/492: dwrite df/f51 [0,4194304] 0 2024-02-14T13:10:38.804 INFO:tasks.workunit.client.0.smithi012.stdout:9/662: write da/dd/d18/d71/d85/d48/fb8 [421344,5527] 0 2024-02-14T13:10:38.804 INFO:tasks.workunit.client.0.smithi012.stdout:9/663: read da/dd/d39/f9a [911100,76930] 0 2024-02-14T13:10:38.809 INFO:tasks.workunit.client.0.smithi012.stdout:0/625: dread d10/d14/d51/fa1 [0,4194304] 0 2024-02-14T13:10:38.814 INFO:tasks.workunit.client.0.smithi012.stdout:7/493: mknod df/d2d/d82/ca9 0 2024-02-14T13:10:38.816 INFO:tasks.workunit.client.0.smithi012.stdout:9/664: creat da/dd/d38/d7e/d91/da6/fe1 x:0 0 0 2024-02-14T13:10:38.816 INFO:tasks.workunit.client.0.smithi012.stdout:9/665: dread - da/dd/d57/d59/f6f zero size 2024-02-14T13:10:38.819 INFO:tasks.workunit.client.0.smithi012.stdout:9/666: creat da/dd/d38/d7e/ddc/fe2 x:0 0 0 2024-02-14T13:10:38.819 INFO:tasks.workunit.client.0.smithi012.stdout:9/667: chown da/dd/d38/d7e/f87 53136 1 2024-02-14T13:10:38.823 INFO:tasks.workunit.client.0.smithi012.stdout:8/554: dwrite d9/dc/d14/f90 [0,4194304] 0 2024-02-14T13:10:38.823 INFO:tasks.workunit.client.0.smithi012.stdout:6/509: dwrite d1/d1e/f20 [8388608,4194304] 0 2024-02-14T13:10:38.828 INFO:tasks.workunit.client.0.smithi012.stdout:1/630: sync 2024-02-14T13:10:38.828 INFO:tasks.workunit.client.0.smithi012.stdout:9/668: dread f2 [0,4194304] 0 2024-02-14T13:10:38.831 INFO:tasks.workunit.client.0.smithi012.stdout:1/631: unlink d6/d10/d22/l28 0 2024-02-14T13:10:38.831 INFO:tasks.workunit.client.0.smithi012.stdout:5/621: dwrite dc/d17/d20/f36 [0,4194304] 0 2024-02-14T13:10:38.831 INFO:tasks.workunit.client.0.smithi012.stdout:4/531: dwrite d0/d10/fb6 [0,4194304] 0 2024-02-14T13:10:38.831 INFO:tasks.workunit.client.0.smithi012.stdout:4/532: chown d0/d10/d28/d4f/d6b/d8f/la4 6600971 1 2024-02-14T13:10:38.831 INFO:tasks.workunit.client.0.smithi012.stdout:4/533: write d0/d10/d28/d62/fbc [361779,40809] 0 2024-02-14T13:10:38.833 INFO:tasks.workunit.client.0.smithi012.stdout:9/669: link da/dd/l4e da/dd/d38/d7e/d91/da6/le3 0 2024-02-14T13:10:38.834 INFO:tasks.workunit.client.0.smithi012.stdout:8/555: write d9/dc/d14/d23/d97/d56/d57/f6e [3344951,37152] 0 2024-02-14T13:10:38.834 INFO:tasks.workunit.client.0.smithi012.stdout:8/556: chown d9/dc/d14/d2e/c46 98090 1 2024-02-14T13:10:38.834 INFO:tasks.workunit.client.0.smithi012.stdout:8/557: fdatasync d9/dc/d38/f51 0 2024-02-14T13:10:38.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/632: rmdir d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/da2/dbd 0 2024-02-14T13:10:38.835 INFO:tasks.workunit.client.0.smithi012.stdout:1/633: write d6/d10/d22/d31/d5b/d5e/d65/db4/fb8 [634804,88295] 0 2024-02-14T13:10:38.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/622: dread dc/d17/d20/d4c/d58/f6b [0,4194304] 0 2024-02-14T13:10:38.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/623: fsync dc/d17/d20/f36 0 2024-02-14T13:10:38.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/624: chown dc/d2f/d40/f6f 56491421 1 2024-02-14T13:10:38.838 INFO:tasks.workunit.client.0.smithi012.stdout:9/670: creat da/dd/d39/fe4 x:0 0 0 2024-02-14T13:10:38.838 INFO:tasks.workunit.client.0.smithi012.stdout:5/625: truncate dc/d2f/f74 263194 0 2024-02-14T13:10:38.839 INFO:tasks.workunit.client.0.smithi012.stdout:5/626: rmdir dc/d47/d6e 39 2024-02-14T13:10:38.841 INFO:tasks.workunit.client.0.smithi012.stdout:4/534: dread d0/d55/f73 [4194304,4194304] 0 2024-02-14T13:10:38.842 INFO:tasks.workunit.client.0.smithi012.stdout:4/535: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fc2 x:0 0 0 2024-02-14T13:10:38.842 INFO:tasks.workunit.client.0.smithi012.stdout:8/558: write d9/dc/d14/d23/d97/d56/f77 [2830011,45769] 0 2024-02-14T13:10:38.842 INFO:tasks.workunit.client.0.smithi012.stdout:1/634: write d6/d10/d22/d31/d5b/d5e/d65/f75 [3778214,11062] 0 2024-02-14T13:10:38.843 INFO:tasks.workunit.client.0.smithi012.stdout:8/559: truncate d9/dc/d14/d23/d97/d56/d57/d5c/f61 937557 0 2024-02-14T13:10:38.844 INFO:tasks.workunit.client.0.smithi012.stdout:1/635: link d6/d10/d22/d31/d5b/d5e/l2c d6/d10/d22/d31/d5b/lc9 0 2024-02-14T13:10:38.849 INFO:tasks.workunit.client.0.smithi012.stdout:5/627: read f6 [2754805,124099] 0 2024-02-14T13:10:38.849 INFO:tasks.workunit.client.0.smithi012.stdout:7/494: dwrite df/f23 [0,4194304] 0 2024-02-14T13:10:38.850 INFO:tasks.workunit.client.0.smithi012.stdout:4/536: write d0/d10/d28/d4f/d6b/d8f/d56/f5d [3019644,73882] 0 2024-02-14T13:10:38.854 INFO:tasks.workunit.client.0.smithi012.stdout:7/495: creat df/d24/d9e/faa x:0 0 0 2024-02-14T13:10:38.855 INFO:tasks.workunit.client.0.smithi012.stdout:6/510: dwrite d1/d1e/dc/d43/f89 [0,4194304] 0 2024-02-14T13:10:38.855 INFO:tasks.workunit.client.0.smithi012.stdout:6/511: write d1/d1e/f94 [908497,57159] 0 2024-02-14T13:10:38.856 INFO:tasks.workunit.client.0.smithi012.stdout:9/671: dread da/d4f/fdd [0,4194304] 0 2024-02-14T13:10:38.860 INFO:tasks.workunit.client.0.smithi012.stdout:2/664: sync 2024-02-14T13:10:38.861 INFO:tasks.workunit.client.0.smithi012.stdout:3/591: sync 2024-02-14T13:10:38.861 INFO:tasks.workunit.client.0.smithi012.stdout:7/496: rename df/d27/d4b/d8d/c94 to df/d2d/d57/cab 0 2024-02-14T13:10:38.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/665: write d0/d8/d9/d90/fe6 [882616,98830] 0 2024-02-14T13:10:38.862 INFO:tasks.workunit.client.0.smithi012.stdout:8/560: dwrite d9/dc/d14/d23/d97/d56/d57/d7c/fa0 [0,4194304] 0 2024-02-14T13:10:38.862 INFO:tasks.workunit.client.0.smithi012.stdout:2/666: chown d0/d8/d11/d33/l8e 1998 1 2024-02-14T13:10:38.865 INFO:tasks.workunit.client.0.smithi012.stdout:6/512: symlink d1/df/la1 0 2024-02-14T13:10:38.865 INFO:tasks.workunit.client.0.smithi012.stdout:9/672: unlink da/c8c 0 2024-02-14T13:10:38.865 INFO:tasks.workunit.client.0.smithi012.stdout:9/673: write da/dd/d57/d59/fb5 [1323511,83500] 0 2024-02-14T13:10:38.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/592: mkdir d9/dd/d30/d34/d78/dd5 0 2024-02-14T13:10:38.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/593: chown d9/d3f/d4e/c71 538 1 2024-02-14T13:10:38.869 INFO:tasks.workunit.client.0.smithi012.stdout:3/594: write d9/d18/f23 [541900,79498] 0 2024-02-14T13:10:38.875 INFO:tasks.workunit.client.0.smithi012.stdout:2/667: rename d0/d8/f58 to d0/d6/d37/d84/fe9 0 2024-02-14T13:10:38.875 INFO:tasks.workunit.client.0.smithi012.stdout:2/668: fsync d0/d1a/fd7 0 2024-02-14T13:10:38.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/561: creat d9/dc/d1b/d6b/fad x:0 0 0 2024-02-14T13:10:38.876 INFO:tasks.workunit.client.0.smithi012.stdout:7/497: dwrite df/d24/f38 [0,4194304] 0 2024-02-14T13:10:38.878 INFO:tasks.workunit.client.0.smithi012.stdout:8/562: dread d9/dc/d14/d23/d97/da3/fa8 [0,4194304] 0 2024-02-14T13:10:38.881 INFO:tasks.workunit.client.0.smithi012.stdout:9/674: creat da/dd/d38/d65/fe5 x:0 0 0 2024-02-14T13:10:38.881 INFO:tasks.workunit.client.0.smithi012.stdout:5/628: dwrite dc/d47/f61 [0,4194304] 0 2024-02-14T13:10:38.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/537: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f9e [0,4194304] 0 2024-02-14T13:10:38.882 INFO:tasks.workunit.client.0.smithi012.stdout:2/669: truncate d0/d1a/de4/d15/d57/f66 1706147 0 2024-02-14T13:10:38.886 INFO:tasks.workunit.client.0.smithi012.stdout:7/498: symlink df/d2d/d5d/d72/d8a/lac 0 2024-02-14T13:10:38.887 INFO:tasks.workunit.client.0.smithi012.stdout:8/563: symlink d9/dc/d14/d23/d97/d56/lae 0 2024-02-14T13:10:38.887 INFO:tasks.workunit.client.0.smithi012.stdout:3/595: dwrite d9/d18/f5e [4194304,4194304] 0 2024-02-14T13:10:38.887 INFO:tasks.workunit.client.0.smithi012.stdout:3/596: write d9/d3f/d73/d5d/fc8 [642678,20326] 0 2024-02-14T13:10:38.889 INFO:tasks.workunit.client.0.smithi012.stdout:5/629: getdents dc/d2f/d94 0 2024-02-14T13:10:38.890 INFO:tasks.workunit.client.0.smithi012.stdout:6/513: rmdir d1 39 2024-02-14T13:10:38.892 INFO:tasks.workunit.client.0.smithi012.stdout:4/538: getdents d0/d55 0 2024-02-14T13:10:38.894 INFO:tasks.workunit.client.0.smithi012.stdout:2/670: rename d0/d1a/de4/d39/db8/cd2 to d0/d6/de/d7b/da8/cea 0 2024-02-14T13:10:38.896 INFO:tasks.workunit.client.0.smithi012.stdout:5/630: write dc/d17/d20/d4c/d58/f6b [5970990,17551] 0 2024-02-14T13:10:38.896 INFO:tasks.workunit.client.0.smithi012.stdout:5/631: write dc/d17/f41 [2216245,15747] 0 2024-02-14T13:10:38.896 INFO:tasks.workunit.client.0.smithi012.stdout:5/632: chown dc/d2f/d3e 1915229 1 2024-02-14T13:10:38.896 INFO:tasks.workunit.client.0.smithi012.stdout:4/539: dread d0/d10/d28/d62/fbc [0,4194304] 0 2024-02-14T13:10:38.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/540: write d0/d10/d1f/f20 [5572770,68743] 0 2024-02-14T13:10:38.900 INFO:tasks.workunit.client.0.smithi012.stdout:7/499: getdents df/d2d/d57 0 2024-02-14T13:10:38.903 INFO:tasks.workunit.client.0.smithi012.stdout:7/500: dread df/d2d/d5d/d72/f77 [0,4194304] 0 2024-02-14T13:10:38.903 INFO:tasks.workunit.client.0.smithi012.stdout:2/671: dread d0/d6/f5f [0,4194304] 0 2024-02-14T13:10:38.904 INFO:tasks.workunit.client.0.smithi012.stdout:8/564: link d9/dc/d1b/d35/f87 d9/dc/d14/d23/d97/d56/faf 0 2024-02-14T13:10:38.905 INFO:tasks.workunit.client.0.smithi012.stdout:3/597: mknod d9/d68/d6a/cd6 0 2024-02-14T13:10:38.908 INFO:tasks.workunit.client.0.smithi012.stdout:6/514: dwrite d1/d1e/d1b/d3e/f8c [4194304,4194304] 0 2024-02-14T13:10:38.912 INFO:tasks.workunit.client.0.smithi012.stdout:7/501: unlink df/d2d/f41 0 2024-02-14T13:10:38.914 INFO:tasks.workunit.client.0.smithi012.stdout:6/515: truncate d1/d1e/d1b/d21/f35 2691178 0 2024-02-14T13:10:38.914 INFO:tasks.workunit.client.0.smithi012.stdout:6/516: write d1/d1e/d1b/f87 [1103477,112399] 0 2024-02-14T13:10:38.923 INFO:tasks.workunit.client.0.smithi012.stdout:4/541: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa [0,4194304] 0 2024-02-14T13:10:38.927 INFO:tasks.workunit.client.0.smithi012.stdout:4/542: creat d0/d10/d28/da9/fc3 x:0 0 0 2024-02-14T13:10:38.931 INFO:tasks.workunit.client.0.smithi012.stdout:2/672: dwrite d0/d6/d37/d84/d51/f73 [0,4194304] 0 2024-02-14T13:10:38.931 INFO:tasks.workunit.client.0.smithi012.stdout:2/673: write d0/d8/d11/d35/dd0/d70/fd9 [69445,91407] 0 2024-02-14T13:10:38.936 INFO:tasks.workunit.client.0.smithi012.stdout:2/674: creat d0/d20/feb x:0 0 0 2024-02-14T13:10:38.936 INFO:tasks.workunit.client.0.smithi012.stdout:2/675: readlink d0/d6/d37/d84/lb9 0 2024-02-14T13:10:38.937 INFO:tasks.workunit.client.0.smithi012.stdout:7/502: dwrite df/d2d/d57/f6a [0,4194304] 0 2024-02-14T13:10:38.938 INFO:tasks.workunit.client.0.smithi012.stdout:2/676: mkdir d0/d1a/de4/d50/d68/d9c/ddc/dec 0 2024-02-14T13:10:38.938 INFO:tasks.workunit.client.0.smithi012.stdout:2/677: write d0/f2f [1318999,21975] 0 2024-02-14T13:10:38.939 INFO:tasks.workunit.client.0.smithi012.stdout:8/565: dwrite d9/dc/d14/d23/f63 [0,4194304] 0 2024-02-14T13:10:38.940 INFO:tasks.workunit.client.0.smithi012.stdout:7/503: creat df/d27/d4b/d6b/d6d/d85/fad x:0 0 0 2024-02-14T13:10:38.940 INFO:tasks.workunit.client.0.smithi012.stdout:4/543: dwrite d0/d10/f3b [4194304,4194304] 0 2024-02-14T13:10:38.941 INFO:tasks.workunit.client.0.smithi012.stdout:2/678: getdents d0/d6 0 2024-02-14T13:10:38.941 INFO:tasks.workunit.client.0.smithi012.stdout:2/679: dread - d0/d8/d11/d33/d53/d6b/f6c zero size 2024-02-14T13:10:38.946 INFO:tasks.workunit.client.0.smithi012.stdout:8/566: rmdir d9/dc/d38/d6a 39 2024-02-14T13:10:38.949 INFO:tasks.workunit.client.0.smithi012.stdout:4/544: symlink d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/lc4 0 2024-02-14T13:10:38.951 INFO:tasks.workunit.client.0.smithi012.stdout:2/680: unlink d0/d6/d37/d84/f4b 0 2024-02-14T13:10:38.951 INFO:tasks.workunit.client.0.smithi012.stdout:4/545: stat d0/lc 0 2024-02-14T13:10:38.951 INFO:tasks.workunit.client.0.smithi012.stdout:8/567: dread d9/dc/d1b/d35/f8a [0,4194304] 0 2024-02-14T13:10:38.952 INFO:tasks.workunit.client.0.smithi012.stdout:2/681: getdents d0/d8/d11/d35/dd0/d7a 0 2024-02-14T13:10:38.953 INFO:tasks.workunit.client.0.smithi012.stdout:4/546: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/cc5 0 2024-02-14T13:10:38.953 INFO:tasks.workunit.client.0.smithi012.stdout:7/504: dwrite df/d36/f46 [0,4194304] 0 2024-02-14T13:10:38.954 INFO:tasks.workunit.client.0.smithi012.stdout:8/568: creat d9/dc/d1b/d35/da5/fb0 x:0 0 0 2024-02-14T13:10:38.956 INFO:tasks.workunit.client.0.smithi012.stdout:4/547: creat d0/d10/d28/da9/d86/db5/fc6 x:0 0 0 2024-02-14T13:10:38.960 INFO:tasks.workunit.client.0.smithi012.stdout:8/569: unlink d9/l43 0 2024-02-14T13:10:38.961 INFO:tasks.workunit.client.0.smithi012.stdout:6/517: truncate d1/d1e/d1b/d21/f35 1171853 0 2024-02-14T13:10:38.961 INFO:tasks.workunit.client.0.smithi012.stdout:4/548: stat d0/d10/d28/c3d 0 2024-02-14T13:10:38.961 INFO:tasks.workunit.client.0.smithi012.stdout:4/549: chown d0/d10/l32 772255 1 2024-02-14T13:10:38.961 INFO:tasks.workunit.client.0.smithi012.stdout:4/550: chown d0/d10/d1f/f9b 1810163803 1 2024-02-14T13:10:38.963 INFO:tasks.workunit.client.0.smithi012.stdout:7/505: rename df/d36/c92 to df/d36/d67/cae 0 2024-02-14T13:10:38.964 INFO:tasks.workunit.client.0.smithi012.stdout:8/570: getdents d9/dc/d14/d23/d97/d56/d57 0 2024-02-14T13:10:38.964 INFO:tasks.workunit.client.0.smithi012.stdout:8/571: chown d9/dc/f9d 745203 1 2024-02-14T13:10:38.965 INFO:tasks.workunit.client.0.smithi012.stdout:4/551: unlink d0/d10/d28/d4f/d6b/d83/d17/d5f/cc5 0 2024-02-14T13:10:38.973 INFO:tasks.workunit.client.0.smithi012.stdout:4/552: write d0/d10/d1f/f70 [7517304,100149] 0 2024-02-14T13:10:38.973 INFO:tasks.workunit.client.0.smithi012.stdout:8/572: dread d9/dc/d1b/f20 [0,4194304] 0 2024-02-14T13:10:38.974 INFO:tasks.workunit.client.0.smithi012.stdout:4/553: mkdir d0/d10/d28/d4f/dc7 0 2024-02-14T13:10:38.974 INFO:tasks.workunit.client.0.smithi012.stdout:4/554: rename d0/d10/d28/d4f/d6b/d83/d17 to d0/d10/d28/d4f/d6b/d83/d17/d5f/dc8 22 2024-02-14T13:10:38.976 INFO:tasks.workunit.client.0.smithi012.stdout:4/555: creat d0/d10/d28/da9/d86/db5/fc9 x:0 0 0 2024-02-14T13:10:38.977 INFO:tasks.workunit.client.0.smithi012.stdout:2/682: dwrite d0/d1a/de4/d15/d57/f66 [0,4194304] 0 2024-02-14T13:10:38.978 INFO:tasks.workunit.client.0.smithi012.stdout:8/573: symlink d9/dc/d14/d23/lb1 0 2024-02-14T13:10:38.981 INFO:tasks.workunit.client.0.smithi012.stdout:2/683: mkdir d0/d8/d9/ded 0 2024-02-14T13:10:38.981 INFO:tasks.workunit.client.0.smithi012.stdout:0/626: sync 2024-02-14T13:10:38.983 INFO:tasks.workunit.client.0.smithi012.stdout:2/684: symlink d0/d1a/de4/d50/d68/d9c/ddc/dec/lee 0 2024-02-14T13:10:38.985 INFO:tasks.workunit.client.0.smithi012.stdout:6/518: dwrite d1/d1e/dc/d43/d75/f92 [0,4194304] 0 2024-02-14T13:10:38.986 INFO:tasks.workunit.client.0.smithi012.stdout:2/685: mknod d0/d8/d11/d33/d5c/dc2/cef 0 2024-02-14T13:10:38.989 INFO:tasks.workunit.client.0.smithi012.stdout:8/574: dread d9/dc/f2c [4194304,4194304] 0 2024-02-14T13:10:38.992 INFO:tasks.workunit.client.0.smithi012.stdout:2/686: rmdir d0/d6/de 39 2024-02-14T13:10:38.992 INFO:tasks.workunit.client.0.smithi012.stdout:2/687: fdatasync d0/d1a/de4/d15/d57/f78 0 2024-02-14T13:10:38.995 INFO:tasks.workunit.client.0.smithi012.stdout:2/688: unlink d0/d6/d37/f3b 0 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:2/689: mkdir d0/d8/d11/d35/dd0/df0 0 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:5/633: sync 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:9/675: sync 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:1/636: sync 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:3/598: sync 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:3/599: dread - d9/dc4/fc7 zero size 2024-02-14T13:10:38.997 INFO:tasks.workunit.client.0.smithi012.stdout:8/575: dread d9/dc/d1b/d35/f8a [0,4194304] 0 2024-02-14T13:10:38.998 INFO:tasks.workunit.client.0.smithi012.stdout:2/690: readlink d0/d1a/de4/l10 0 2024-02-14T13:10:38.999 INFO:tasks.workunit.client.0.smithi012.stdout:1/637: write d6/d10/d22/d31/d34/d3b/f43 [2010986,96679] 0 2024-02-14T13:10:39.000 INFO:tasks.workunit.client.0.smithi012.stdout:3/600: mknod d9/dd/d30/d44/d66/db3/cd7 0 2024-02-14T13:10:39.000 INFO:tasks.workunit.client.0.smithi012.stdout:3/601: fdatasync d9/d3f/d73/d5d/fc8 0 2024-02-14T13:10:39.001 INFO:tasks.workunit.client.0.smithi012.stdout:8/576: symlink d9/dc/d14/d23/d97/d56/lb2 0 2024-02-14T13:10:39.001 INFO:tasks.workunit.client.0.smithi012.stdout:2/691: creat d0/d8/d11/d35/dd0/df0/ff1 x:0 0 0 2024-02-14T13:10:39.002 INFO:tasks.workunit.client.0.smithi012.stdout:1/638: getdents d6/d10/d22/d31/d5b/d5e/d65 0 2024-02-14T13:10:39.003 INFO:tasks.workunit.client.0.smithi012.stdout:3/602: creat d9/d3f/fd8 x:0 0 0 2024-02-14T13:10:39.003 INFO:tasks.workunit.client.0.smithi012.stdout:3/603: write d9/dd/fb8 [868577,70962] 0 2024-02-14T13:10:39.003 INFO:tasks.workunit.client.0.smithi012.stdout:8/577: mknod d9/dc/d14/d2e/cb3 0 2024-02-14T13:10:39.004 INFO:tasks.workunit.client.0.smithi012.stdout:2/692: truncate d0/d8/d9/d90/fbc 235750 0 2024-02-14T13:10:39.006 INFO:tasks.workunit.client.0.smithi012.stdout:1/639: rename d6/d10/d22/d31/d5b/d5e/d65/d87/f6a to d6/d35/fca 0 2024-02-14T13:10:39.007 INFO:tasks.workunit.client.0.smithi012.stdout:0/627: dwrite d10/fb0 [0,4194304] 0 2024-02-14T13:10:39.008 INFO:tasks.workunit.client.0.smithi012.stdout:2/693: mknod d0/d8/d11/d35/cf2 0 2024-02-14T13:10:39.008 INFO:tasks.workunit.client.0.smithi012.stdout:5/634: dread dc/d17/d20/f64 [0,4194304] 0 2024-02-14T13:10:39.011 INFO:tasks.workunit.client.0.smithi012.stdout:1/640: getdents d6/d10/d22 0 2024-02-14T13:10:39.011 INFO:tasks.workunit.client.0.smithi012.stdout:1/641: dread - d6/d10/d22/d31/d34/d58/f9a zero size 2024-02-14T13:10:39.013 INFO:tasks.workunit.client.0.smithi012.stdout:0/628: mkdir d10/d14/d20/daa/dca 0 2024-02-14T13:10:39.013 INFO:tasks.workunit.client.0.smithi012.stdout:9/676: dread da/faa [0,4194304] 0 2024-02-14T13:10:39.013 INFO:tasks.workunit.client.0.smithi012.stdout:2/694: symlink d0/d1a/de4/d39/db8/lf3 0 2024-02-14T13:10:39.015 INFO:tasks.workunit.client.0.smithi012.stdout:8/578: rename d9/dc/d1b/f1e to d9/dc/d38/d6a/fb4 0 2024-02-14T13:10:39.015 INFO:tasks.workunit.client.0.smithi012.stdout:9/677: mknod da/dd/d57/d59/da8/ce6 0 2024-02-14T13:10:39.016 INFO:tasks.workunit.client.0.smithi012.stdout:2/695: creat d0/d8/d11/d35/dd0/ff4 x:0 0 0 2024-02-14T13:10:39.017 INFO:tasks.workunit.client.0.smithi012.stdout:1/642: rename d6/d10/d22/d31/d5b/d5e/d65/d87/d9b/l9c to d6/d10/d22/d44/dbb/lcb 0 2024-02-14T13:10:39.018 INFO:tasks.workunit.client.0.smithi012.stdout:1/643: write d6/d10/d22/f54 [239014,58713] 0 2024-02-14T13:10:39.018 INFO:tasks.workunit.client.0.smithi012.stdout:8/579: getdents d9/dc/d1b/d35/da5 0 2024-02-14T13:10:39.019 INFO:tasks.workunit.client.0.smithi012.stdout:2/696: symlink d0/d6/de/de8/lf5 0 2024-02-14T13:10:39.021 INFO:tasks.workunit.client.0.smithi012.stdout:1/644: unlink d6/d10/d22/d44/f82 0 2024-02-14T13:10:39.021 INFO:tasks.workunit.client.0.smithi012.stdout:8/580: creat d9/dc/d14/d23/d97/d56/fb5 x:0 0 0 2024-02-14T13:10:39.022 INFO:tasks.workunit.client.0.smithi012.stdout:1/645: truncate d6/d10/d22/d31/d5b/d5d/d6d/f7b 1783003 0 2024-02-14T13:10:39.023 INFO:tasks.workunit.client.0.smithi012.stdout:2/697: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:39.023 INFO:tasks.workunit.client.0.smithi012.stdout:2/698: readlink d0/d1a/de4/d50/d68/d9c/ddc/le0 0 2024-02-14T13:10:39.023 INFO:tasks.workunit.client.0.smithi012.stdout:8/581: creat d9/dc/d1b/d35/da5/fb6 x:0 0 0 2024-02-14T13:10:39.024 INFO:tasks.workunit.client.0.smithi012.stdout:1/646: mkdir d6/d10/d22/d31/d5b/d5e/d65/d87/dcc 0 2024-02-14T13:10:39.025 INFO:tasks.workunit.client.0.smithi012.stdout:5/635: dwrite dc/d2f/fa1 [0,4194304] 0 2024-02-14T13:10:39.025 INFO:tasks.workunit.client.0.smithi012.stdout:5/636: getdents dc/d2f/d70/da9 0 2024-02-14T13:10:39.026 INFO:tasks.workunit.client.0.smithi012.stdout:2/699: mkdir d0/d8/d11/d35/dd0/df6 0 2024-02-14T13:10:39.028 INFO:tasks.workunit.client.0.smithi012.stdout:5/637: creat dc/d2f/d40/fc3 x:0 0 0 2024-02-14T13:10:39.029 INFO:tasks.workunit.client.0.smithi012.stdout:5/638: write dc/d2f/d70/faa [976942,77829] 0 2024-02-14T13:10:39.029 INFO:tasks.workunit.client.0.smithi012.stdout:2/700: mknod d0/d8/d11/d33/d53/d6b/cf7 0 2024-02-14T13:10:39.030 INFO:tasks.workunit.client.0.smithi012.stdout:5/639: mkdir dc/d2f/d70/d78/dc4 0 2024-02-14T13:10:39.030 INFO:tasks.workunit.client.0.smithi012.stdout:2/701: stat d0/d8/d9/d90/dab/cc7 0 2024-02-14T13:10:39.033 INFO:tasks.workunit.client.0.smithi012.stdout:5/640: unlink dc/d17/d20/d4c/fac 0 2024-02-14T13:10:39.033 INFO:tasks.workunit.client.0.smithi012.stdout:2/702: mknod d0/d8/d11/d33/d53/cf8 0 2024-02-14T13:10:39.035 INFO:tasks.workunit.client.0.smithi012.stdout:5/641: unlink dc/d2f/f52 0 2024-02-14T13:10:39.035 INFO:tasks.workunit.client.0.smithi012.stdout:5/642: dread - dc/d2f/d40/fc3 zero size 2024-02-14T13:10:39.037 INFO:tasks.workunit.client.0.smithi012.stdout:2/703: unlink d0/d20/f45 0 2024-02-14T13:10:39.039 INFO:tasks.workunit.client.0.smithi012.stdout:5/643: dread dc/f33 [0,4194304] 0 2024-02-14T13:10:39.039 INFO:tasks.workunit.client.0.smithi012.stdout:5/644: getdents dc/d2f/d40/d53/d8a 0 2024-02-14T13:10:39.040 INFO:tasks.workunit.client.0.smithi012.stdout:0/629: dwrite d10/d14/f15 [0,4194304] 0 2024-02-14T13:10:39.041 INFO:tasks.workunit.client.0.smithi012.stdout:5/645: truncate dc/d17/d4b/f7c 1949108 0 2024-02-14T13:10:39.041 INFO:tasks.workunit.client.0.smithi012.stdout:5/646: read f0 [1839318,35712] 0 2024-02-14T13:10:39.043 INFO:tasks.workunit.client.0.smithi012.stdout:2/704: dread d0/d20/f23 [0,4194304] 0 2024-02-14T13:10:39.046 INFO:tasks.workunit.client.0.smithi012.stdout:2/705: write d0/d6/f5f [3727206,52589] 0 2024-02-14T13:10:39.049 INFO:tasks.workunit.client.0.smithi012.stdout:2/706: creat d0/d1a/de4/d15/de7/ff9 x:0 0 0 2024-02-14T13:10:39.052 INFO:tasks.workunit.client.0.smithi012.stdout:2/707: mkdir d0/d1a/de4/d50/d68/d9c/dfa 0 2024-02-14T13:10:39.052 INFO:tasks.workunit.client.0.smithi012.stdout:2/708: chown d0/d20/d54/lcd 305129 1 2024-02-14T13:10:39.052 INFO:tasks.workunit.client.0.smithi012.stdout:2/709: write d0/d1a/de4/d15/de7/ff9 [594737,118475] 0 2024-02-14T13:10:39.052 INFO:tasks.workunit.client.0.smithi012.stdout:0/630: dread d10/d14/d20/f37 [4194304,4194304] 0 2024-02-14T13:10:39.053 INFO:tasks.workunit.client.0.smithi012.stdout:2/710: mkdir d0/d8/d11/d35/dd0/df0/dfb 0 2024-02-14T13:10:39.054 INFO:tasks.workunit.client.0.smithi012.stdout:0/631: creat d10/d14/d1b/d8e/fcb x:0 0 0 2024-02-14T13:10:39.056 INFO:tasks.workunit.client.0.smithi012.stdout:2/711: rename d0/d1a/de4/d15/dbd to d0/d1a/dfc 0 2024-02-14T13:10:39.057 INFO:tasks.workunit.client.0.smithi012.stdout:0/632: rmdir d10/d14/d1b/d30 39 2024-02-14T13:10:39.058 INFO:tasks.workunit.client.0.smithi012.stdout:0/633: creat d10/d14/d20/fcc x:0 0 0 2024-02-14T13:10:39.058 INFO:tasks.workunit.client.0.smithi012.stdout:0/634: write d10/d14/d2b/fbe [443142,100026] 0 2024-02-14T13:10:39.059 INFO:tasks.workunit.client.0.smithi012.stdout:0/635: write d10/d14/d1b/f22 [8459284,122528] 0 2024-02-14T13:10:39.059 INFO:tasks.workunit.client.0.smithi012.stdout:0/636: truncate d10/f13 158579 0 2024-02-14T13:10:39.059 INFO:tasks.workunit.client.0.smithi012.stdout:0/637: chown d10/d14/d41/laf 240 1 2024-02-14T13:10:39.064 INFO:tasks.workunit.client.0.smithi012.stdout:5/647: dwrite dc/f12 [4194304,4194304] 0 2024-02-14T13:10:39.065 INFO:tasks.workunit.client.0.smithi012.stdout:5/648: read dc/f4d [95460,36441] 0 2024-02-14T13:10:39.066 INFO:tasks.workunit.client.0.smithi012.stdout:9/678: dwrite da/dd/d19/d30/f17 [8388608,4194304] 0 2024-02-14T13:10:39.066 INFO:tasks.workunit.client.0.smithi012.stdout:1/647: dwrite d6/d10/f99 [0,4194304] 0 2024-02-14T13:10:39.082 INFO:tasks.workunit.client.0.smithi012.stdout:2/712: dwrite d0/d20/d54/f82 [0,4194304] 0 2024-02-14T13:10:39.083 INFO:tasks.workunit.client.0.smithi012.stdout:4/556: dwrite d0/d10/d28/d4f/d6b/d8f/f94 [0,4194304] 0 2024-02-14T13:10:39.087 INFO:tasks.workunit.client.0.smithi012.stdout:4/557: link d0/d10/d1f/d71/l7e d0/d10/d28/d4f/lca 0 2024-02-14T13:10:39.087 INFO:tasks.workunit.client.0.smithi012.stdout:4/558: readlink d0/d10/d28/d62/l8b 0 2024-02-14T13:10:39.088 INFO:tasks.workunit.client.0.smithi012.stdout:4/559: stat d0/d10/d28/d4f/d6b/d8f/f76 0 2024-02-14T13:10:39.088 INFO:tasks.workunit.client.0.smithi012.stdout:4/560: chown d0/d10/d28/d4f/f7a 69077 1 2024-02-14T13:10:39.088 INFO:tasks.workunit.client.0.smithi012.stdout:4/561: fdatasync d0/d10/d28/da9/fc3 0 2024-02-14T13:10:39.088 INFO:tasks.workunit.client.0.smithi012.stdout:4/562: creat d0/d10/d28/d4f/d6b/d83/d17/fcb x:0 0 0 2024-02-14T13:10:39.089 INFO:tasks.workunit.client.0.smithi012.stdout:4/563: mkdir d0/d10/d28/d4f/d6b/d83/d17/d5f/dcc 0 2024-02-14T13:10:39.090 INFO:tasks.workunit.client.0.smithi012.stdout:8/582: dwrite d9/dc/d14/d23/d97/d56/d57/d7c/f99 [0,4194304] 0 2024-02-14T13:10:39.090 INFO:tasks.workunit.client.0.smithi012.stdout:5/649: dwrite dc/d2f/fa3 [0,4194304] 0 2024-02-14T13:10:39.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/679: dwrite da/dd/d19/d30/f17 [8388608,4194304] 0 2024-02-14T13:10:39.092 INFO:tasks.workunit.client.0.smithi012.stdout:9/680: write da/dd/d18/d71/d85/d48/fde [902429,117967] 0 2024-02-14T13:10:39.094 INFO:tasks.workunit.client.0.smithi012.stdout:8/583: readlink d9/dc/d1b/lac 0 2024-02-14T13:10:39.094 INFO:tasks.workunit.client.0.smithi012.stdout:8/584: chown d9/dc/d14/d23 414 1 2024-02-14T13:10:39.098 INFO:tasks.workunit.client.0.smithi012.stdout:5/650: link dc/l16 dc/d2f/d89/lc5 0 2024-02-14T13:10:39.098 INFO:tasks.workunit.client.0.smithi012.stdout:5/651: read - dc/d17/f65 zero size 2024-02-14T13:10:39.101 INFO:tasks.workunit.client.0.smithi012.stdout:5/652: creat dc/d2f/d70/da9/fc6 x:0 0 0 2024-02-14T13:10:39.103 INFO:tasks.workunit.client.0.smithi012.stdout:5/653: symlink dc/dc2/lc7 0 2024-02-14T13:10:39.104 INFO:tasks.workunit.client.0.smithi012.stdout:5/654: dread - dc/d2f/d70/da9/fc6 zero size 2024-02-14T13:10:39.106 INFO:tasks.workunit.client.0.smithi012.stdout:5/655: link dc/d2f/d40/c73 dc/d17/d20/d4c/d63/d81/cc8 0 2024-02-14T13:10:39.111 INFO:tasks.workunit.client.0.smithi012.stdout:4/564: dwrite d0/d10/d28/d4f/d6b/d83/d17/fcb [0,4194304] 0 2024-02-14T13:10:39.111 INFO:tasks.workunit.client.0.smithi012.stdout:5/656: rename dc/l55 to dc/d2f/lc9 0 2024-02-14T13:10:39.111 INFO:tasks.workunit.client.0.smithi012.stdout:5/657: dread - dc/d2f/d70/da9/fc6 zero size 2024-02-14T13:10:39.114 INFO:tasks.workunit.client.0.smithi012.stdout:5/658: mkdir dc/d2f/d40/d53/dca 0 2024-02-14T13:10:39.114 INFO:tasks.workunit.client.0.smithi012.stdout:5/659: truncate f7 1006790 0 2024-02-14T13:10:39.114 INFO:tasks.workunit.client.0.smithi012.stdout:5/660: read dc/f29 [1836454,129826] 0 2024-02-14T13:10:39.118 INFO:tasks.workunit.client.0.smithi012.stdout:4/565: write d0/d10/d28/d4f/d6b/d8f/f76 [3683698,127571] 0 2024-02-14T13:10:39.121 INFO:tasks.workunit.client.0.smithi012.stdout:5/661: write dc/d47/f61 [2606515,108815] 0 2024-02-14T13:10:39.121 INFO:tasks.workunit.client.0.smithi012.stdout:4/566: creat d0/d10/d1f/fcd x:0 0 0 2024-02-14T13:10:39.122 INFO:tasks.workunit.client.0.smithi012.stdout:9/681: dwrite da/dd/d57/d59/da8/fbd [0,4194304] 0 2024-02-14T13:10:39.123 INFO:tasks.workunit.client.0.smithi012.stdout:8/585: dwrite d9/dc/d14/d2e/f54 [4194304,4194304] 0 2024-02-14T13:10:39.124 INFO:tasks.workunit.client.0.smithi012.stdout:4/567: mkdir d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/dce 0 2024-02-14T13:10:39.129 INFO:tasks.workunit.client.0.smithi012.stdout:0/638: write d10/f13 [703027,80909] 0 2024-02-14T13:10:39.129 INFO:tasks.workunit.client.0.smithi012.stdout:0/639: fsync d10/d14/d20/f37 0 2024-02-14T13:10:39.132 INFO:tasks.workunit.client.0.smithi012.stdout:9/682: unlink da/dd/d19/d30/f17 0 2024-02-14T13:10:39.133 INFO:tasks.workunit.client.0.smithi012.stdout:8/586: unlink d9/dc/d14/d23/d97/d56/lae 0 2024-02-14T13:10:39.135 INFO:tasks.workunit.client.0.smithi012.stdout:5/662: dwrite dc/d2f/f75 [0,4194304] 0 2024-02-14T13:10:39.136 INFO:tasks.workunit.client.0.smithi012.stdout:0/640: unlink d10/d14/d2b/d3b/f86 0 2024-02-14T13:10:39.136 INFO:tasks.workunit.client.0.smithi012.stdout:0/641: dread - d10/d14/d41/d52/d78/d8c/d7f/fa5 zero size 2024-02-14T13:10:39.138 INFO:tasks.workunit.client.0.smithi012.stdout:9/683: rmdir da/dd/d18/d71 39 2024-02-14T13:10:39.140 INFO:tasks.workunit.client.0.smithi012.stdout:4/568: mkdir d0/d10/d28/d4f/d6b/d8f/d56/d8c/dcf 0 2024-02-14T13:10:39.144 INFO:tasks.workunit.client.0.smithi012.stdout:9/684: getdents da/dd/d19 0 2024-02-14T13:10:39.144 INFO:tasks.workunit.client.0.smithi012.stdout:5/663: write dc/f15 [4398793,62202] 0 2024-02-14T13:10:39.145 INFO:tasks.workunit.client.0.smithi012.stdout:8/587: symlink d9/dc/d14/d23/lb7 0 2024-02-14T13:10:39.145 INFO:tasks.workunit.client.0.smithi012.stdout:8/588: chown d9/dc/d14/d2e/fa6 14976785 1 2024-02-14T13:10:39.146 INFO:tasks.workunit.client.0.smithi012.stdout:4/569: creat d0/d10/d28/da9/d86/fd0 x:0 0 0 2024-02-14T13:10:39.146 INFO:tasks.workunit.client.0.smithi012.stdout:4/570: dread - d0/d10/d28/d4f/d6b/d8f/d56/d8c/f9d zero size 2024-02-14T13:10:39.147 INFO:tasks.workunit.client.0.smithi012.stdout:9/685: dread - da/dd/d57/f9c zero size 2024-02-14T13:10:39.149 INFO:tasks.workunit.client.0.smithi012.stdout:5/664: symlink dc/d47/d69/lcb 0 2024-02-14T13:10:39.149 INFO:tasks.workunit.client.0.smithi012.stdout:5/665: chown dc/d47/d59/d6a/fa2 758566 1 2024-02-14T13:10:39.151 INFO:tasks.workunit.client.0.smithi012.stdout:9/686: rename da/dd/d39/c66 to da/dd/d57/d59/dc4/ce7 0 2024-02-14T13:10:39.153 INFO:tasks.workunit.client.0.smithi012.stdout:9/687: write da/dd/f53 [4142,105197] 0 2024-02-14T13:10:39.153 INFO:tasks.workunit.client.0.smithi012.stdout:0/642: dwrite d10/d14/d20/d49/f5e [0,4194304] 0 2024-02-14T13:10:39.153 INFO:tasks.workunit.client.0.smithi012.stdout:0/643: write d10/d14/d41/d61/d74/fb3 [256439,12131] 0 2024-02-14T13:10:39.156 INFO:tasks.workunit.client.0.smithi012.stdout:8/589: link d9/dc/d1b/d6b/fad d9/dc/d38/fb8 0 2024-02-14T13:10:39.156 INFO:tasks.workunit.client.0.smithi012.stdout:8/590: readlink d9/dc/d14/d2e/l8e 0 2024-02-14T13:10:39.158 INFO:tasks.workunit.client.0.smithi012.stdout:5/666: write dc/d2f/fa1 [2206764,119064] 0 2024-02-14T13:10:39.159 INFO:tasks.workunit.client.0.smithi012.stdout:0/644: creat d10/d84/fcd x:0 0 0 2024-02-14T13:10:39.161 INFO:tasks.workunit.client.0.smithi012.stdout:4/571: dwrite d0/d10/f60 [4194304,4194304] 0 2024-02-14T13:10:39.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/667: dread dc/d17/d20/f64 [0,4194304] 0 2024-02-14T13:10:39.164 INFO:tasks.workunit.client.0.smithi012.stdout:5/668: read dc/d17/f67 [939487,90951] 0 2024-02-14T13:10:39.165 INFO:tasks.workunit.client.0.smithi012.stdout:0/645: mkdir d10/d14/d41/d52/d78/d8c/dce 0 2024-02-14T13:10:39.168 INFO:tasks.workunit.client.0.smithi012.stdout:5/669: rename dc/d47/d59/d6a/l82 to dc/d2f/d40/d53/d8a/lcc 0 2024-02-14T13:10:39.170 INFO:tasks.workunit.client.0.smithi012.stdout:0/646: link d10/d14/d1b/d7e/f97 d10/d14/d41/d52/fcf 0 2024-02-14T13:10:39.170 INFO:tasks.workunit.client.0.smithi012.stdout:7/506: sync 2024-02-14T13:10:39.171 INFO:tasks.workunit.client.0.smithi012.stdout:4/572: link d0/l12 d0/d10/d1f/d71/ld1 0 2024-02-14T13:10:39.172 INFO:tasks.workunit.client.0.smithi012.stdout:0/647: mkdir d10/d14/d41/d52/d99/d9b/dd0 0 2024-02-14T13:10:39.172 INFO:tasks.workunit.client.0.smithi012.stdout:0/648: write d10/d14/d1b/d8e/fcb [661658,119931] 0 2024-02-14T13:10:39.173 INFO:tasks.workunit.client.0.smithi012.stdout:9/688: dwrite da/dd/d18/d71/d85/d48/fb8 [0,4194304] 0 2024-02-14T13:10:39.174 INFO:tasks.workunit.client.0.smithi012.stdout:7/507: rename df/d27/d4b/l58 to df/d27/d4b/d6b/d6d/d85/laf 0 2024-02-14T13:10:39.175 INFO:tasks.workunit.client.0.smithi012.stdout:4/573: symlink d0/d10/d28/d4f/d6b/d83/ld2 0 2024-02-14T13:10:39.178 INFO:tasks.workunit.client.0.smithi012.stdout:9/689: creat da/dd/fe8 x:0 0 0 2024-02-14T13:10:39.178 INFO:tasks.workunit.client.0.smithi012.stdout:9/690: fsync da/d33/d63/f8a 0 2024-02-14T13:10:39.179 INFO:tasks.workunit.client.0.smithi012.stdout:7/508: read df/d2d/f3e [371161,50582] 0 2024-02-14T13:10:39.180 INFO:tasks.workunit.client.0.smithi012.stdout:4/574: truncate d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f9e 3362278 0 2024-02-14T13:10:39.181 INFO:tasks.workunit.client.0.smithi012.stdout:9/691: mknod da/dd/d19/ce9 0 2024-02-14T13:10:39.181 INFO:tasks.workunit.client.0.smithi012.stdout:9/692: truncate da/dd/d38/d65/fe5 947091 0 2024-02-14T13:10:39.182 INFO:tasks.workunit.client.0.smithi012.stdout:0/649: dread d10/d14/d20/d49/f5e [0,4194304] 0 2024-02-14T13:10:39.183 INFO:tasks.workunit.client.0.smithi012.stdout:5/670: dwrite dc/d47/d69/fb1 [0,4194304] 0 2024-02-14T13:10:39.184 INFO:tasks.workunit.client.0.smithi012.stdout:7/509: rename fd to df/fb0 0 2024-02-14T13:10:39.184 INFO:tasks.workunit.client.0.smithi012.stdout:5/671: write dc/d17/d20/d4c/d58/f83 [514392,123992] 0 2024-02-14T13:10:39.184 INFO:tasks.workunit.client.0.smithi012.stdout:5/672: stat dc/f4d 0 2024-02-14T13:10:39.186 INFO:tasks.workunit.client.0.smithi012.stdout:9/693: unlink da/dd/d19/c27 0 2024-02-14T13:10:39.188 INFO:tasks.workunit.client.0.smithi012.stdout:0/650: link d10/d14/d1b/d8e/fcb d10/d14/d41/d52/d99/d9b/fd1 0 2024-02-14T13:10:39.188 INFO:tasks.workunit.client.0.smithi012.stdout:0/651: chown d10/d14/d1b/d54/d96 12 1 2024-02-14T13:10:39.190 INFO:tasks.workunit.client.0.smithi012.stdout:8/591: rmdir d9/dc/d14 39 2024-02-14T13:10:39.191 INFO:tasks.workunit.client.0.smithi012.stdout:7/510: stat df/d36/d67/l89 0 2024-02-14T13:10:39.191 INFO:tasks.workunit.client.0.smithi012.stdout:7/511: read df/fb0 [2916988,64775] 0 2024-02-14T13:10:39.192 INFO:tasks.workunit.client.0.smithi012.stdout:5/673: link dc/d17/d20/f42 dc/d17/d20/d4c/d63/d81/fcd 0 2024-02-14T13:10:39.196 INFO:tasks.workunit.client.0.smithi012.stdout:7/512: unlink df/d2d/d5d/d72/d8a/fa4 0 2024-02-14T13:10:39.197 INFO:tasks.workunit.client.0.smithi012.stdout:5/674: mknod dc/d2f/d40/d53/cce 0 2024-02-14T13:10:39.200 INFO:tasks.workunit.client.0.smithi012.stdout:8/592: dread d9/dc/d14/d23/d97/d56/d57/f82 [0,4194304] 0 2024-02-14T13:10:39.203 INFO:tasks.workunit.client.0.smithi012.stdout:7/513: mkdir df/db1 0 2024-02-14T13:10:39.204 INFO:tasks.workunit.client.0.smithi012.stdout:0/652: read fc [6650404,106194] 0 2024-02-14T13:10:39.204 INFO:tasks.workunit.client.0.smithi012.stdout:0/653: write d10/d14/d1b/d30/f3f [4009200,96128] 0 2024-02-14T13:10:39.204 INFO:tasks.workunit.client.0.smithi012.stdout:5/675: truncate f6 1006868 0 2024-02-14T13:10:39.205 INFO:tasks.workunit.client.0.smithi012.stdout:8/593: mkdir d9/db9 0 2024-02-14T13:10:39.207 INFO:tasks.workunit.client.0.smithi012.stdout:7/514: rename df/d2d/d5d/d72/d78 to df/d2d/d82/d88/db2 0 2024-02-14T13:10:39.208 INFO:tasks.workunit.client.0.smithi012.stdout:0/654: truncate d10/d14/d41/f89 10287404 0 2024-02-14T13:10:39.208 INFO:tasks.workunit.client.0.smithi012.stdout:0/655: truncate d10/d14/d1b/f8a 1180534 0 2024-02-14T13:10:39.209 INFO:tasks.workunit.client.0.smithi012.stdout:5/676: rmdir dc/d17/d20/d4c/d63/d81 39 2024-02-14T13:10:39.211 INFO:tasks.workunit.client.0.smithi012.stdout:7/515: symlink df/d2d/d82/d88/db2/lb3 0 2024-02-14T13:10:39.213 INFO:tasks.workunit.client.0.smithi012.stdout:7/516: write df/f11 [5338205,37045] 0 2024-02-14T13:10:39.213 INFO:tasks.workunit.client.0.smithi012.stdout:5/677: symlink dc/d2f/d3e/lcf 0 2024-02-14T13:10:39.216 INFO:tasks.workunit.client.0.smithi012.stdout:7/517: creat df/d36/fb4 x:0 0 0 2024-02-14T13:10:39.219 INFO:tasks.workunit.client.0.smithi012.stdout:9/694: getdents da/dd 0 2024-02-14T13:10:39.219 INFO:tasks.workunit.client.0.smithi012.stdout:9/695: write da/dd/d57/d59/fbe [512568,69364] 0 2024-02-14T13:10:39.220 INFO:tasks.workunit.client.0.smithi012.stdout:4/575: write d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f9e [4102267,26068] 0 2024-02-14T13:10:39.220 INFO:tasks.workunit.client.0.smithi012.stdout:9/696: symlink da/dd/lea 0 2024-02-14T13:10:39.222 INFO:tasks.workunit.client.0.smithi012.stdout:4/576: creat d0/d10/d28/da9/fd3 x:0 0 0 2024-02-14T13:10:39.222 INFO:tasks.workunit.client.0.smithi012.stdout:4/577: chown d0/d10/d28/d4f/d6b/d8f/d56/c8a 95459342 1 2024-02-14T13:10:39.223 INFO:tasks.workunit.client.0.smithi012.stdout:9/697: creat da/dd/d19/d30/d45/feb x:0 0 0 2024-02-14T13:10:39.225 INFO:tasks.workunit.client.0.smithi012.stdout:4/578: creat d0/d10/d28/fd4 x:0 0 0 2024-02-14T13:10:39.226 INFO:tasks.workunit.client.0.smithi012.stdout:9/698: mknod da/dd/d19/d30/d9d/dce/cec 0 2024-02-14T13:10:39.229 INFO:tasks.workunit.client.0.smithi012.stdout:8/594: dwrite d9/dc/d1b/d35/f78 [0,4194304] 0 2024-02-14T13:10:39.229 INFO:tasks.workunit.client.0.smithi012.stdout:9/699: rename da/dd/d38/d7e/f87 to da/d4f/fed 0 2024-02-14T13:10:39.229 INFO:tasks.workunit.client.0.smithi012.stdout:9/700: dread - da/dd/d39/fbb zero size 2024-02-14T13:10:39.231 INFO:tasks.workunit.client.0.smithi012.stdout:8/595: mkdir d9/dc/d14/d23/d97/da1/dba 0 2024-02-14T13:10:39.232 INFO:tasks.workunit.client.0.smithi012.stdout:9/701: creat da/dd/d39/d8d/fee x:0 0 0 2024-02-14T13:10:39.233 INFO:tasks.workunit.client.0.smithi012.stdout:0/656: dwrite d10/d14/f43 [0,4194304] 0 2024-02-14T13:10:39.236 INFO:tasks.workunit.client.0.smithi012.stdout:8/596: rename d9/dc/d14/d23/d97/d56/d57/d5c/l98 to d9/dc/d14/d2e/lbb 0 2024-02-14T13:10:39.236 INFO:tasks.workunit.client.0.smithi012.stdout:8/597: fdatasync d9/dc/d38/d6a/f79 0 2024-02-14T13:10:39.237 INFO:tasks.workunit.client.0.smithi012.stdout:9/702: mknod da/cef 0 2024-02-14T13:10:39.237 INFO:tasks.workunit.client.0.smithi012.stdout:9/703: write da/d33/d63/f76 [333692,3324] 0 2024-02-14T13:10:39.237 INFO:tasks.workunit.client.0.smithi012.stdout:9/704: chown da/dd/d57/d59/ddf 7978 1 2024-02-14T13:10:39.239 INFO:tasks.workunit.client.0.smithi012.stdout:5/678: dwrite dc/f4d [0,4194304] 0 2024-02-14T13:10:39.240 INFO:tasks.workunit.client.0.smithi012.stdout:9/705: dread da/dd/f5d [0,4194304] 0 2024-02-14T13:10:39.241 INFO:tasks.workunit.client.0.smithi012.stdout:3/604: sync 2024-02-14T13:10:39.241 INFO:tasks.workunit.client.0.smithi012.stdout:6/519: sync 2024-02-14T13:10:39.241 INFO:tasks.workunit.client.0.smithi012.stdout:9/706: dread da/dd/d18/f32 [0,4194304] 0 2024-02-14T13:10:39.247 INFO:tasks.workunit.client.0.smithi012.stdout:0/657: mknod d10/dad/cd2 0 2024-02-14T13:10:39.247 INFO:tasks.workunit.client.0.smithi012.stdout:0/658: stat d10/d14/d1b/d30/f7b 0 2024-02-14T13:10:39.247 INFO:tasks.workunit.client.0.smithi012.stdout:0/659: chown d10/d14/d41/d52/d78 15866 1 2024-02-14T13:10:39.248 INFO:tasks.workunit.client.0.smithi012.stdout:6/520: write d1/df/d24/d3f/f47 [1443039,40344] 0 2024-02-14T13:10:39.248 INFO:tasks.workunit.client.0.smithi012.stdout:8/598: creat d9/dc/d14/fbc x:0 0 0 2024-02-14T13:10:39.248 INFO:tasks.workunit.client.0.smithi012.stdout:8/599: chown d9/dc/d1b/d6b/fad 6 1 2024-02-14T13:10:39.250 INFO:tasks.workunit.client.0.smithi012.stdout:9/707: truncate da/dd/fb4 1013145 0 2024-02-14T13:10:39.251 INFO:tasks.workunit.client.0.smithi012.stdout:0/660: symlink d10/d14/d41/d52/d78/d8c/d7f/ld3 0 2024-02-14T13:10:39.252 INFO:tasks.workunit.client.0.smithi012.stdout:4/579: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/fa0 [0,4194304] 0 2024-02-14T13:10:39.252 INFO:tasks.workunit.client.0.smithi012.stdout:7/518: dwrite df/d36/d67/fa7 [0,4194304] 0 2024-02-14T13:10:39.253 INFO:tasks.workunit.client.0.smithi012.stdout:6/521: mknod d1/d1e/d66/ca2 0 2024-02-14T13:10:39.255 INFO:tasks.workunit.client.0.smithi012.stdout:8/600: link d9/dc/d14/d23/l2a d9/dc/d14/d23/d97/d56/d57/d7c/lbd 0 2024-02-14T13:10:39.257 INFO:tasks.workunit.client.0.smithi012.stdout:0/661: rename d10/d14/d2b/da4/dbb/fbc to d10/d14/d1b/d54/d96/fd4 0 2024-02-14T13:10:39.259 INFO:tasks.workunit.client.0.smithi012.stdout:9/708: dread da/dd/d18/d71/d85/f51 [0,4194304] 0 2024-02-14T13:10:39.260 INFO:tasks.workunit.client.0.smithi012.stdout:4/580: creat d0/d10/d1f/d71/fd5 x:0 0 0 2024-02-14T13:10:39.266 INFO:tasks.workunit.client.0.smithi012.stdout:4/581: dread d0/d10/f2a [0,4194304] 0 2024-02-14T13:10:39.266 INFO:tasks.workunit.client.0.smithi012.stdout:4/582: truncate d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa 4862445 0 2024-02-14T13:10:39.267 INFO:tasks.workunit.client.0.smithi012.stdout:7/519: rename df/d2d/d57/f6a to df/d2d/d82/d88/db2/fb5 0 2024-02-14T13:10:39.268 INFO:tasks.workunit.client.0.smithi012.stdout:0/662: mkdir d10/d14/d2b/d3b/dd5 0 2024-02-14T13:10:39.269 INFO:tasks.workunit.client.0.smithi012.stdout:0/663: chown d10/d14/d51/f7a 242 1 2024-02-14T13:10:39.269 INFO:tasks.workunit.client.0.smithi012.stdout:0/664: fdatasync d10/d14/d20/f69 0 2024-02-14T13:10:39.270 INFO:tasks.workunit.client.0.smithi012.stdout:9/709: mkdir da/dd/d38/d65/df0 0 2024-02-14T13:10:39.273 INFO:tasks.workunit.client.0.smithi012.stdout:4/583: link d0/d10/d1f/f70 d0/d10/d28/da9/d86/fd6 0 2024-02-14T13:10:39.273 INFO:tasks.workunit.client.0.smithi012.stdout:4/584: write d0/d10/d1f/d71/fd5 [412129,39050] 0 2024-02-14T13:10:39.273 INFO:tasks.workunit.client.0.smithi012.stdout:4/585: stat d0/d10/d28/d4f/d6b/d8f/f3f 0 2024-02-14T13:10:39.274 INFO:tasks.workunit.client.0.smithi012.stdout:7/520: creat df/d2d/d57/fb6 x:0 0 0 2024-02-14T13:10:39.275 INFO:tasks.workunit.client.0.smithi012.stdout:0/665: getdents d10 0 2024-02-14T13:10:39.276 INFO:tasks.workunit.client.0.smithi012.stdout:4/586: mknod d0/d10/d28/d62/cd7 0 2024-02-14T13:10:39.278 INFO:tasks.workunit.client.0.smithi012.stdout:7/521: creat df/d2d/d82/d88/fb7 x:0 0 0 2024-02-14T13:10:39.278 INFO:tasks.workunit.client.0.smithi012.stdout:5/679: dwrite dc/d17/d20/d4c/d58/f83 [0,4194304] 0 2024-02-14T13:10:39.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/522: dwrite d1/d1e/dc/f8d [0,4194304] 0 2024-02-14T13:10:39.279 INFO:tasks.workunit.client.0.smithi012.stdout:0/666: creat d10/d14/d41/d52/d78/d8c/dce/fd6 x:0 0 0 2024-02-14T13:10:39.279 INFO:tasks.workunit.client.0.smithi012.stdout:2/713: sync 2024-02-14T13:10:39.279 INFO:tasks.workunit.client.0.smithi012.stdout:1/648: sync 2024-02-14T13:10:39.279 INFO:tasks.workunit.client.0.smithi012.stdout:2/714: fdatasync d0/f2f 0 2024-02-14T13:10:39.279 INFO:tasks.workunit.client.0.smithi012.stdout:1/649: fdatasync d6/d10/d22/d31/d5b/d5d/f17 0 2024-02-14T13:10:39.280 INFO:tasks.workunit.client.0.smithi012.stdout:1/650: dread - d6/d10/d22/d31/d3e/fbf zero size 2024-02-14T13:10:39.280 INFO:tasks.workunit.client.0.smithi012.stdout:1/651: readlink d6/d10/d22/d31/d5b/d5e/l2c 0 2024-02-14T13:10:39.280 INFO:tasks.workunit.client.0.smithi012.stdout:4/587: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/dce/cd8 0 2024-02-14T13:10:39.281 INFO:tasks.workunit.client.0.smithi012.stdout:7/522: mkdir df/d27/d4b/d6b/d6d/d85/db8 0 2024-02-14T13:10:39.285 INFO:tasks.workunit.client.0.smithi012.stdout:5/680: creat dc/dc2/fd0 x:0 0 0 2024-02-14T13:10:39.286 INFO:tasks.workunit.client.0.smithi012.stdout:6/523: mkdir d1/df/d24/d3f/d56/da3 0 2024-02-14T13:10:39.289 INFO:tasks.workunit.client.0.smithi012.stdout:0/667: creat d10/d14/d2b/d3b/dd5/fd7 x:0 0 0 2024-02-14T13:10:39.289 INFO:tasks.workunit.client.0.smithi012.stdout:0/668: write d10/d14/d51/f7a [1242903,43455] 0 2024-02-14T13:10:39.289 INFO:tasks.workunit.client.0.smithi012.stdout:8/601: dwrite d9/dc/d38/d6a/f7e [0,4194304] 0 2024-02-14T13:10:39.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/715: mkdir d0/d1a/de4/d50/d68/d9c/ddc/dfd 0 2024-02-14T13:10:39.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/716: stat d0/l4 0 2024-02-14T13:10:39.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/717: chown d0/d20/d54/f82 118 1 2024-02-14T13:10:39.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/718: dread - d0/d1a/de4/d39/db8/fc9 zero size 2024-02-14T13:10:39.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/719: dread - d0/d1a/de4/d15/faa zero size 2024-02-14T13:10:39.293 INFO:tasks.workunit.client.0.smithi012.stdout:9/710: dwrite da/dd/d19/d30/d9d/fc9 [0,4194304] 0 2024-02-14T13:10:39.293 INFO:tasks.workunit.client.0.smithi012.stdout:4/588: write d0/d10/d28/d4f/d6b/d8f/f94 [3909372,94426] 0 2024-02-14T13:10:39.295 INFO:tasks.workunit.client.0.smithi012.stdout:1/652: rename d6/d10/d22/d31/d5b/d5e/d65/d87/d9b to d6/d10/d22/d31/d5b/dcd 0 2024-02-14T13:10:39.295 INFO:tasks.workunit.client.0.smithi012.stdout:1/653: chown d6/d10/d22/d31/d34/d58/d61/f93 13 1 2024-02-14T13:10:39.296 INFO:tasks.workunit.client.0.smithi012.stdout:6/524: creat d1/d1e/d1b/d21/d78/fa4 x:0 0 0 2024-02-14T13:10:39.298 INFO:tasks.workunit.client.0.smithi012.stdout:8/602: creat d9/dc/d14/d23/d97/d56/fbe x:0 0 0 2024-02-14T13:10:39.300 INFO:tasks.workunit.client.0.smithi012.stdout:2/720: mknod d0/d8/d11/d33/d53/cfe 0 2024-02-14T13:10:39.300 INFO:tasks.workunit.client.0.smithi012.stdout:2/721: fdatasync d0/d1a/f25 0 2024-02-14T13:10:39.304 INFO:tasks.workunit.client.0.smithi012.stdout:9/711: write da/d33/d63/f8a [135549,87200] 0 2024-02-14T13:10:39.305 INFO:tasks.workunit.client.0.smithi012.stdout:4/589: mkdir d0/d55/dd9 0 2024-02-14T13:10:39.305 INFO:tasks.workunit.client.0.smithi012.stdout:0/669: dwrite d10/d14/d41/d52/d78/d8c/f4e [0,4194304] 0 2024-02-14T13:10:39.305 INFO:tasks.workunit.client.0.smithi012.stdout:0/670: stat d10/d14/d1b/d54/c5c 0 2024-02-14T13:10:39.305 INFO:tasks.workunit.client.0.smithi012.stdout:0/671: write d10/f13 [979554,80284] 0 2024-02-14T13:10:39.305 INFO:tasks.workunit.client.0.smithi012.stdout:0/672: getdents d10 0 2024-02-14T13:10:39.307 INFO:tasks.workunit.client.0.smithi012.stdout:1/654: rename d6/c42 to d6/d10/d22/d31/d5b/dcd/da2/cce 0 2024-02-14T13:10:39.307 INFO:tasks.workunit.client.0.smithi012.stdout:7/523: dwrite df/d36/f5e [0,4194304] 0 2024-02-14T13:10:39.308 INFO:tasks.workunit.client.0.smithi012.stdout:8/603: fsync d9/dc/d1b/f20 0 2024-02-14T13:10:39.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/722: link d0/f2f d0/d6/d37/fff 0 2024-02-14T13:10:39.310 INFO:tasks.workunit.client.0.smithi012.stdout:7/524: dread df/d2d/f3f [0,4194304] 0 2024-02-14T13:10:39.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/673: truncate d10/dad/fb8 840697 0 2024-02-14T13:10:39.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/674: fsync d10/d14/d1b/d8e/fb9 0 2024-02-14T13:10:39.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/675: readlink d10/d14/d20/d49/lc1 0 2024-02-14T13:10:39.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/676: read - d10/d84/f9d zero size 2024-02-14T13:10:39.313 INFO:tasks.workunit.client.0.smithi012.stdout:0/677: read d10/d14/d41/f6a [50350,44362] 0 2024-02-14T13:10:39.316 INFO:tasks.workunit.client.0.smithi012.stdout:1/655: mknod d6/d10/d22/d31/d34/d58/ccf 0 2024-02-14T13:10:39.318 INFO:tasks.workunit.client.0.smithi012.stdout:8/604: rename d9/dc/d14/f90 to d9/fbf 0 2024-02-14T13:10:39.319 INFO:tasks.workunit.client.0.smithi012.stdout:2/723: creat d0/d1a/de4/d50/d68/d9c/f100 x:0 0 0 2024-02-14T13:10:39.321 INFO:tasks.workunit.client.0.smithi012.stdout:5/681: dwrite dc/d17/d20/f3a [0,4194304] 0 2024-02-14T13:10:39.321 INFO:tasks.workunit.client.0.smithi012.stdout:0/678: link d10/d14/d41/d52/d78/d8c/fc5 d10/d14/d1b/d54/fd8 0 2024-02-14T13:10:39.322 INFO:tasks.workunit.client.0.smithi012.stdout:1/656: creat d6/d10/d22/d31/d3e/fd0 x:0 0 0 2024-02-14T13:10:39.322 INFO:tasks.workunit.client.0.smithi012.stdout:9/712: dwrite da/f14 [0,4194304] 0 2024-02-14T13:10:39.322 INFO:tasks.workunit.client.0.smithi012.stdout:1/657: fdatasync d6/d10/d22/f54 0 2024-02-14T13:10:39.322 INFO:tasks.workunit.client.0.smithi012.stdout:1/658: write d6/d10/d22/d31/d5b/d5e/f47 [699909,125212] 0 2024-02-14T13:10:39.322 INFO:tasks.workunit.client.0.smithi012.stdout:4/590: dwrite d0/d10/d28/da9/f69 [0,4194304] 0 2024-02-14T13:10:39.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/605: symlink d9/dc/d14/lc0 0 2024-02-14T13:10:39.323 INFO:tasks.workunit.client.0.smithi012.stdout:8/606: chown d9/dc/d14/d2e 78968 1 2024-02-14T13:10:39.324 INFO:tasks.workunit.client.0.smithi012.stdout:2/724: truncate d0/d8/d11/faf 3140679 0 2024-02-14T13:10:39.326 INFO:tasks.workunit.client.0.smithi012.stdout:5/682: mknod dc/d2f/d70/d78/dc4/cd1 0 2024-02-14T13:10:39.326 INFO:tasks.workunit.client.0.smithi012.stdout:5/683: chown dc/d47/d59/d6a/fa2 4359 1 2024-02-14T13:10:39.326 INFO:tasks.workunit.client.0.smithi012.stdout:5/684: fdatasync dc/d17/d4b/f7c 0 2024-02-14T13:10:39.327 INFO:tasks.workunit.client.0.smithi012.stdout:0/679: mknod d10/d14/d20/d49/cd9 0 2024-02-14T13:10:39.331 INFO:tasks.workunit.client.0.smithi012.stdout:4/591: truncate d0/d10/d28/d4f/d6b/d83/d17/d5f/fa0 3873945 0 2024-02-14T13:10:39.331 INFO:tasks.workunit.client.0.smithi012.stdout:4/592: readlink d0/d10/d28/d4f/d6b/d83/d17/l53 0 2024-02-14T13:10:39.333 INFO:tasks.workunit.client.0.smithi012.stdout:8/607: creat d9/dc/d14/d23/d97/d56/d57/d7c/fc1 x:0 0 0 2024-02-14T13:10:39.334 INFO:tasks.workunit.client.0.smithi012.stdout:2/725: truncate d0/d20/d54/f82 3243920 0 2024-02-14T13:10:39.335 INFO:tasks.workunit.client.0.smithi012.stdout:5/685: symlink dc/d17/d20/d4c/d63/d81/ld2 0 2024-02-14T13:10:39.336 INFO:tasks.workunit.client.0.smithi012.stdout:1/659: truncate d6/fe 6363092 0 2024-02-14T13:10:39.336 INFO:tasks.workunit.client.0.smithi012.stdout:1/660: read - d6/d10/d22/d31/d34/d58/f9a zero size 2024-02-14T13:10:39.338 INFO:tasks.workunit.client.0.smithi012.stdout:4/593: symlink d0/d55/dd9/lda 0 2024-02-14T13:10:39.339 INFO:tasks.workunit.client.0.smithi012.stdout:4/594: write d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 [291169,120724] 0 2024-02-14T13:10:39.339 INFO:tasks.workunit.client.0.smithi012.stdout:4/595: readlink d0/d10/d28/d4f/d6b/d83/d17/l23 0 2024-02-14T13:10:39.340 INFO:tasks.workunit.client.0.smithi012.stdout:8/608: unlink d9/dc/c9c 0 2024-02-14T13:10:39.341 INFO:tasks.workunit.client.0.smithi012.stdout:2/726: symlink d0/d6/de/l101 0 2024-02-14T13:10:39.341 INFO:tasks.workunit.client.0.smithi012.stdout:2/727: readlink d0/d20/ldb 0 2024-02-14T13:10:39.341 INFO:tasks.workunit.client.0.smithi012.stdout:2/728: chown d0/d1a/de4/d39/db8 65057116 1 2024-02-14T13:10:39.343 INFO:tasks.workunit.client.0.smithi012.stdout:5/686: mkdir dc/d2f/d70/da9/dd3 0 2024-02-14T13:10:39.343 INFO:tasks.workunit.client.0.smithi012.stdout:5/687: truncate dc/d17/d20/d4c/d58/fb3 951297 0 2024-02-14T13:10:39.345 INFO:tasks.workunit.client.0.smithi012.stdout:1/661: truncate d6/d10/d22/d31/d34/d3b/f43 294063 0 2024-02-14T13:10:39.346 INFO:tasks.workunit.client.0.smithi012.stdout:4/596: symlink d0/d55/dd9/ldb 0 2024-02-14T13:10:39.347 INFO:tasks.workunit.client.0.smithi012.stdout:8/609: symlink d9/dc/d38/lc2 0 2024-02-14T13:10:39.348 INFO:tasks.workunit.client.0.smithi012.stdout:2/729: creat d0/d8/d11/d33/d63/f102 x:0 0 0 2024-02-14T13:10:39.348 INFO:tasks.workunit.client.0.smithi012.stdout:2/730: chown d0/d8/d11/d33/d53/d6b/c71 466 1 2024-02-14T13:10:39.350 INFO:tasks.workunit.client.0.smithi012.stdout:5/688: rmdir dc/d47/d6e 39 2024-02-14T13:10:39.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/662: rename c3 to d6/d10/d22/d31/d5b/d5e/d3d/cd1 0 2024-02-14T13:10:39.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/663: fdatasync d6/d10/d22/d31/d5b/d5d/d6d/f7b 0 2024-02-14T13:10:39.354 INFO:tasks.workunit.client.0.smithi012.stdout:8/610: creat d9/dc/d14/d23/d97/d56/d57/d5c/fc3 x:0 0 0 2024-02-14T13:10:39.354 INFO:tasks.workunit.client.0.smithi012.stdout:2/731: mknod d0/d8/d11/d35/dd0/d70/db0/c103 0 2024-02-14T13:10:39.356 INFO:tasks.workunit.client.0.smithi012.stdout:5/689: creat dc/d17/d20/d4c/d63/d81/fd4 x:0 0 0 2024-02-14T13:10:39.358 INFO:tasks.workunit.client.0.smithi012.stdout:4/597: rename d0/d10/d28/d4f/d6b/d8f/d56/d8c/dcf to d0/d55/dd9/ddc 0 2024-02-14T13:10:39.358 INFO:tasks.workunit.client.0.smithi012.stdout:4/598: chown d0/d55/f73 65266100 1 2024-02-14T13:10:39.358 INFO:tasks.workunit.client.0.smithi012.stdout:4/599: write d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 [1072608,90621] 0 2024-02-14T13:10:39.365 INFO:tasks.workunit.client.0.smithi012.stdout:8/611: truncate d9/dc/f2c 7721382 0 2024-02-14T13:10:39.380 INFO:tasks.workunit.client.0.smithi012.stdout:3/605: sync 2024-02-14T13:10:39.381 INFO:tasks.workunit.client.0.smithi012.stdout:8/612: dread d9/dc/d1b/f27 [0,4194304] 0 2024-02-14T13:10:39.381 INFO:tasks.workunit.client.0.smithi012.stdout:4/600: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/fab [0,4194304] 0 2024-02-14T13:10:39.382 INFO:tasks.workunit.client.0.smithi012.stdout:5/690: dwrite dc/d2f/d70/faa [0,4194304] 0 2024-02-14T13:10:39.382 INFO:tasks.workunit.client.0.smithi012.stdout:5/691: write dc/d17/d20/d4c/d63/d81/fd4 [393766,21020] 0 2024-02-14T13:10:39.382 INFO:tasks.workunit.client.0.smithi012.stdout:3/606: mknod d9/dd/de/cd9 0 2024-02-14T13:10:39.382 INFO:tasks.workunit.client.0.smithi012.stdout:3/607: getdents d9/dcd 0 2024-02-14T13:10:39.386 INFO:tasks.workunit.client.0.smithi012.stdout:5/692: creat dc/d17/d20/d4c/d63/fd5 x:0 0 0 2024-02-14T13:10:39.387 INFO:tasks.workunit.client.0.smithi012.stdout:4/601: dread d0/d10/d28/d4f/d6b/d83/d17/f72 [0,4194304] 0 2024-02-14T13:10:39.388 INFO:tasks.workunit.client.0.smithi012.stdout:3/608: rename d9/dd/de/f38 to d9/dd/d30/d44/d66/db3/db9/fda 0 2024-02-14T13:10:39.390 INFO:tasks.workunit.client.0.smithi012.stdout:5/693: link dc/d17/f43 dc/d2f/d70/dbc/fd6 0 2024-02-14T13:10:39.390 INFO:tasks.workunit.client.0.smithi012.stdout:5/694: chown dc/d2f/d70/d78/dc4/cd1 3 1 2024-02-14T13:10:39.391 INFO:tasks.workunit.client.0.smithi012.stdout:4/602: unlink d0/d10/d28/d4f/l44 0 2024-02-14T13:10:39.393 INFO:tasks.workunit.client.0.smithi012.stdout:5/695: link dc/d2f/d89/l8c dc/d47/d6e/ld7 0 2024-02-14T13:10:39.394 INFO:tasks.workunit.client.0.smithi012.stdout:4/603: creat d0/d10/d28/d4f/d6b/fdd x:0 0 0 2024-02-14T13:10:39.395 INFO:tasks.workunit.client.0.smithi012.stdout:4/604: creat d0/d10/d28/d4f/d6b/fde x:0 0 0 2024-02-14T13:10:39.395 INFO:tasks.workunit.client.0.smithi012.stdout:4/605: write d0/d10/d1f/f2f [1053701,123782] 0 2024-02-14T13:10:39.402 INFO:tasks.workunit.client.0.smithi012.stdout:4/606: rmdir d0/d10/d28/d4f 39 2024-02-14T13:10:39.404 INFO:tasks.workunit.client.0.smithi012.stdout:4/607: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/fdf x:0 0 0 2024-02-14T13:10:39.415 INFO:tasks.workunit.client.0.smithi012.stdout:5/696: dwrite dc/d2f/d40/fc3 [0,4194304] 0 2024-02-14T13:10:39.415 INFO:tasks.workunit.client.0.smithi012.stdout:5/697: chown dc/d17/d20/d8e/cb8 74648 1 2024-02-14T13:10:39.417 INFO:tasks.workunit.client.0.smithi012.stdout:5/698: mkdir dc/d2f/d70/dbc/dd8 0 2024-02-14T13:10:39.418 INFO:tasks.workunit.client.0.smithi012.stdout:5/699: getdents dc/d47/d59/d6a 0 2024-02-14T13:10:39.418 INFO:tasks.workunit.client.0.smithi012.stdout:5/700: chown dc/d47/fa8 4087013 1 2024-02-14T13:10:39.430 INFO:tasks.workunit.client.0.smithi012.stdout:5/701: dwrite dc/d2f/d89/f8b [0,4194304] 0 2024-02-14T13:10:39.430 INFO:tasks.workunit.client.0.smithi012.stdout:5/702: chown dc/d17/d20/d4c/d63/dab/ca6 593993491 1 2024-02-14T13:10:39.432 INFO:tasks.workunit.client.0.smithi012.stdout:5/703: creat dc/d17/fd9 x:0 0 0 2024-02-14T13:10:39.432 INFO:tasks.workunit.client.0.smithi012.stdout:5/704: readlink dc/l1c 0 2024-02-14T13:10:39.438 INFO:tasks.workunit.client.0.smithi012.stdout:5/705: dread dc/f15 [0,4194304] 0 2024-02-14T13:10:39.438 INFO:tasks.workunit.client.0.smithi012.stdout:5/706: fdatasync dc/d17/d20/d4c/d63/d81/fd4 0 2024-02-14T13:10:39.443 INFO:tasks.workunit.client.0.smithi012.stdout:5/707: dread dc/d2f/d40/f45 [0,4194304] 0 2024-02-14T13:10:39.444 INFO:tasks.workunit.client.0.smithi012.stdout:5/708: mkdir dc/d17/d20/d4c/d58/dda 0 2024-02-14T13:10:39.444 INFO:tasks.workunit.client.0.smithi012.stdout:5/709: chown dc/d17/d20/d4c/cbf 4435 1 2024-02-14T13:10:39.445 INFO:tasks.workunit.client.0.smithi012.stdout:5/710: readlink dc/d2f/d40/d53/d97/lb4 0 2024-02-14T13:10:39.445 INFO:tasks.workunit.client.0.smithi012.stdout:5/711: getdents dc/d17/d20 0 2024-02-14T13:10:39.453 INFO:tasks.workunit.client.0.smithi012.stdout:5/712: write dc/d47/d69/f9b [3818075,122631] 0 2024-02-14T13:10:39.455 INFO:tasks.workunit.client.0.smithi012.stdout:5/713: symlink dc/d2f/d70/ldb 0 2024-02-14T13:10:39.456 INFO:tasks.workunit.client.0.smithi012.stdout:5/714: mkdir dc/d2f/d70/d78/dc4/ddc 0 2024-02-14T13:10:39.456 INFO:tasks.workunit.client.0.smithi012.stdout:5/715: fdatasync dc/d2f/d70/dbc/fd6 0 2024-02-14T13:10:39.458 INFO:tasks.workunit.client.0.smithi012.stdout:6/525: sync 2024-02-14T13:10:39.458 INFO:tasks.workunit.client.0.smithi012.stdout:6/526: truncate d1/d1e/dc/d43/f89 5185111 0 2024-02-14T13:10:39.458 INFO:tasks.workunit.client.0.smithi012.stdout:6/527: truncate d1/d1e/d1b/d21/d78/fa4 161108 0 2024-02-14T13:10:39.459 INFO:tasks.workunit.client.0.smithi012.stdout:6/528: dread d1/d1e/dc/d43/f89 [4194304,4194304] 0 2024-02-14T13:10:39.459 INFO:tasks.workunit.client.0.smithi012.stdout:6/529: stat d1/d1e/dc/c72 0 2024-02-14T13:10:39.463 INFO:tasks.workunit.client.0.smithi012.stdout:6/530: write d1/d17/d5a/f68 [1172119,128273] 0 2024-02-14T13:10:39.463 INFO:tasks.workunit.client.0.smithi012.stdout:5/716: dread dc/d2f/d40/f45 [0,4194304] 0 2024-02-14T13:10:39.464 INFO:tasks.workunit.client.0.smithi012.stdout:6/531: mkdir d1/df/d16/d7c/d97/d82/da5 0 2024-02-14T13:10:39.465 INFO:tasks.workunit.client.0.smithi012.stdout:6/532: fdatasync d1/df/d24/f8f 0 2024-02-14T13:10:39.466 INFO:tasks.workunit.client.0.smithi012.stdout:5/717: mkdir dc/d17/d20/d4c/d63/d81/ddd 0 2024-02-14T13:10:39.466 INFO:tasks.workunit.client.0.smithi012.stdout:5/718: readlink dc/l1c 0 2024-02-14T13:10:39.466 INFO:tasks.workunit.client.0.smithi012.stdout:5/719: fdatasync dc/d2f/f75 0 2024-02-14T13:10:39.466 INFO:tasks.workunit.client.0.smithi012.stdout:5/720: chown dc/d17/f43 95707 1 2024-02-14T13:10:39.466 INFO:tasks.workunit.client.0.smithi012.stdout:6/533: rename d1/df/d16/l3b to d1/d1e/d1b/d21/la6 0 2024-02-14T13:10:39.467 INFO:tasks.workunit.client.0.smithi012.stdout:5/721: creat dc/d2f/d3e/fde x:0 0 0 2024-02-14T13:10:39.468 INFO:tasks.workunit.client.0.smithi012.stdout:6/534: symlink d1/d1e/dc/d28/la7 0 2024-02-14T13:10:39.468 INFO:tasks.workunit.client.0.smithi012.stdout:6/535: readlink d1/df/d24/d3f/d56/l8a 0 2024-02-14T13:10:39.469 INFO:tasks.workunit.client.0.smithi012.stdout:5/722: unlink dc/d2f/d70/d78/dc4/cd1 0 2024-02-14T13:10:39.470 INFO:tasks.workunit.client.0.smithi012.stdout:6/536: rename d1/d17/d5a to d1/d1e/d1b/da8 0 2024-02-14T13:10:39.471 INFO:tasks.workunit.client.0.smithi012.stdout:5/723: creat dc/d2f/d3e/fdf x:0 0 0 2024-02-14T13:10:39.471 INFO:tasks.workunit.client.0.smithi012.stdout:5/724: getdents dc/d17/d20/d4c/d58/dbb 0 2024-02-14T13:10:39.472 INFO:tasks.workunit.client.0.smithi012.stdout:5/725: link dc/d17/d20/d4c/d63/d81/l8f dc/d17/d20/d4c/d58/dda/le0 0 2024-02-14T13:10:39.472 INFO:tasks.workunit.client.0.smithi012.stdout:6/537: dread d1/d1e/f94 [0,4194304] 0 2024-02-14T13:10:39.475 INFO:tasks.workunit.client.0.smithi012.stdout:6/538: dread d1/d1e/d1b/f33 [0,4194304] 0 2024-02-14T13:10:39.475 INFO:tasks.workunit.client.0.smithi012.stdout:6/539: chown d1/df/d16/c4a 0 1 2024-02-14T13:10:39.475 INFO:tasks.workunit.client.0.smithi012.stdout:6/540: fdatasync d1/df/d50/f96 0 2024-02-14T13:10:39.479 INFO:tasks.workunit.client.0.smithi012.stdout:6/541: getdents d1/df/d16/d7c/d97/d82 0 2024-02-14T13:10:39.480 INFO:tasks.workunit.client.0.smithi012.stdout:5/726: dread dc/d17/d20/f36 [0,4194304] 0 2024-02-14T13:10:39.481 INFO:tasks.workunit.client.0.smithi012.stdout:6/542: creat d1/d1e/d1b/d21/d69/fa9 x:0 0 0 2024-02-14T13:10:39.481 INFO:tasks.workunit.client.0.smithi012.stdout:6/543: fsync d1/df/d24/d3f/d56/f76 0 2024-02-14T13:10:39.496 INFO:tasks.workunit.client.0.smithi012.stdout:6/544: dread d1/df/d24/f36 [4194304,4194304] 0 2024-02-14T13:10:39.497 INFO:tasks.workunit.client.0.smithi012.stdout:6/545: stat d1/d1e/dc 0 2024-02-14T13:10:39.497 INFO:tasks.workunit.client.0.smithi012.stdout:6/546: truncate d1/df/f48 2229232 0 2024-02-14T13:10:39.505 INFO:tasks.workunit.client.0.smithi012.stdout:6/547: dread d1/d1e/d1b/da8/f68 [0,4194304] 0 2024-02-14T13:10:39.509 INFO:tasks.workunit.client.0.smithi012.stdout:5/727: dwrite dc/d17/d20/d4c/d58/f68 [0,4194304] 0 2024-02-14T13:10:39.510 INFO:tasks.workunit.client.0.smithi012.stdout:5/728: fdatasync dc/d17/d4b/f7c 0 2024-02-14T13:10:39.512 INFO:tasks.workunit.client.0.smithi012.stdout:5/729: rename dc/d2f/d3e/cc1 to dc/dc2/ce1 0 2024-02-14T13:10:39.512 INFO:tasks.workunit.client.0.smithi012.stdout:5/730: truncate dc/d2f/d94/fb5 1039063 0 2024-02-14T13:10:39.514 INFO:tasks.workunit.client.0.smithi012.stdout:5/731: creat dc/d47/d59/d6a/fe2 x:0 0 0 2024-02-14T13:10:39.514 INFO:tasks.workunit.client.0.smithi012.stdout:5/732: stat dc/d47/fb2 0 2024-02-14T13:10:39.514 INFO:tasks.workunit.client.0.smithi012.stdout:5/733: dread - dc/d2f/d40/d53/d97/fbe zero size 2024-02-14T13:10:39.515 INFO:tasks.workunit.client.0.smithi012.stdout:5/734: truncate f7 560053 0 2024-02-14T13:10:39.516 INFO:tasks.workunit.client.0.smithi012.stdout:5/735: mknod dc/d17/d20/d4c/ce3 0 2024-02-14T13:10:39.520 INFO:tasks.workunit.client.0.smithi012.stdout:6/548: dwrite d1/d1e/d1b/d21/d69/fa9 [0,4194304] 0 2024-02-14T13:10:39.520 INFO:tasks.workunit.client.0.smithi012.stdout:6/549: stat d1/d1e/d1b/f87 0 2024-02-14T13:10:39.522 INFO:tasks.workunit.client.0.smithi012.stdout:5/736: dread dc/d47/d69/f9b [0,4194304] 0 2024-02-14T13:10:39.531 INFO:tasks.workunit.client.0.smithi012.stdout:7/525: sync 2024-02-14T13:10:39.532 INFO:tasks.workunit.client.0.smithi012.stdout:7/526: mknod df/d24/d9e/cb9 0 2024-02-14T13:10:39.533 INFO:tasks.workunit.client.0.smithi012.stdout:6/550: read d1/d1e/dc/f1d [4031270,106337] 0 2024-02-14T13:10:39.533 INFO:tasks.workunit.client.0.smithi012.stdout:6/551: dread - d1/df/d24/f8f zero size 2024-02-14T13:10:39.533 INFO:tasks.workunit.client.0.smithi012.stdout:7/527: mknod df/d27/d4b/d8d/cba 0 2024-02-14T13:10:39.534 INFO:tasks.workunit.client.0.smithi012.stdout:6/552: creat d1/d1e/dc/d43/d75/faa x:0 0 0 2024-02-14T13:10:39.537 INFO:tasks.workunit.client.0.smithi012.stdout:6/553: rename d1/c22 to d1/d1e/dc/cab 0 2024-02-14T13:10:39.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/554: unlink d1/d1e/dc/cab 0 2024-02-14T13:10:39.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/555: rename d1/d1e/dc to d1/d1e/dc/dac 22 2024-02-14T13:10:39.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/556: chown d1/df/d24/d3f 3 1 2024-02-14T13:10:39.548 INFO:tasks.workunit.client.0.smithi012.stdout:6/557: mknod d1/df/d24/d3f/d56/cad 0 2024-02-14T13:10:39.549 INFO:tasks.workunit.client.0.smithi012.stdout:6/558: mkdir d1/dae 0 2024-02-14T13:10:39.550 INFO:tasks.workunit.client.0.smithi012.stdout:5/737: dwrite dc/d17/d20/f3a [0,4194304] 0 2024-02-14T13:10:39.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/738: getdents dc/d17/d20/d8e 0 2024-02-14T13:10:39.556 INFO:tasks.workunit.client.0.smithi012.stdout:7/528: dwrite df/f23 [0,4194304] 0 2024-02-14T13:10:39.556 INFO:tasks.workunit.client.0.smithi012.stdout:7/529: fsync df/d24/d56/f64 0 2024-02-14T13:10:39.556 INFO:tasks.workunit.client.0.smithi012.stdout:7/530: write df/f51 [4400150,34729] 0 2024-02-14T13:10:39.556 INFO:tasks.workunit.client.0.smithi012.stdout:7/531: rename df/d27/d4b/d8d to df/d27/d4b/d8d/dbb 22 2024-02-14T13:10:39.556 INFO:tasks.workunit.client.0.smithi012.stdout:7/532: chown df/d2d/f3f 7953 1 2024-02-14T13:10:39.557 INFO:tasks.workunit.client.0.smithi012.stdout:7/533: symlink df/lbc 0 2024-02-14T13:10:39.558 INFO:tasks.workunit.client.0.smithi012.stdout:7/534: rename df/d36/c98 to df/d27/d4b/d6b/cbd 0 2024-02-14T13:10:39.559 INFO:tasks.workunit.client.0.smithi012.stdout:7/535: link df/d27/c84 df/d2d/d82/d88/cbe 0 2024-02-14T13:10:39.560 INFO:tasks.workunit.client.0.smithi012.stdout:7/536: mknod df/d2d/d82/d88/cbf 0 2024-02-14T13:10:39.560 INFO:tasks.workunit.client.0.smithi012.stdout:7/537: stat df/d36/f63 0 2024-02-14T13:10:39.562 INFO:tasks.workunit.client.0.smithi012.stdout:7/538: rename df/d2d/d82/d88/cbe to df/d24/d56/cc0 0 2024-02-14T13:10:39.562 INFO:tasks.workunit.client.0.smithi012.stdout:7/539: chown df/d24/l2a 84 1 2024-02-14T13:10:39.562 INFO:tasks.workunit.client.0.smithi012.stdout:7/540: fdatasync df/d36/f7d 0 2024-02-14T13:10:39.562 INFO:tasks.workunit.client.0.smithi012.stdout:7/541: symlink df/d2d/d82/lc1 0 2024-02-14T13:10:39.563 INFO:tasks.workunit.client.0.smithi012.stdout:7/542: creat df/d27/d4b/d6b/fc2 x:0 0 0 2024-02-14T13:10:39.563 INFO:tasks.workunit.client.0.smithi012.stdout:7/543: chown df/d27/d4b/d6b/fc2 893945500 1 2024-02-14T13:10:39.564 INFO:tasks.workunit.client.0.smithi012.stdout:7/544: chown df/d36 6370 1 2024-02-14T13:10:39.564 INFO:tasks.workunit.client.0.smithi012.stdout:7/545: mknod df/d2d/d5d/d72/cc3 0 2024-02-14T13:10:39.565 INFO:tasks.workunit.client.0.smithi012.stdout:6/559: dwrite d1/df/d24/d3f/d56/f76 [0,4194304] 0 2024-02-14T13:10:39.565 INFO:tasks.workunit.client.0.smithi012.stdout:7/546: mknod df/d2d/d5d/d72/cc4 0 2024-02-14T13:10:39.567 INFO:tasks.workunit.client.0.smithi012.stdout:6/560: rename d1/d17 to d1/df/d24/daf 0 2024-02-14T13:10:39.568 INFO:tasks.workunit.client.0.smithi012.stdout:6/561: creat d1/d1e/d1b/da8/d9b/fb0 x:0 0 0 2024-02-14T13:10:39.570 INFO:tasks.workunit.client.0.smithi012.stdout:6/562: rename d1/d1e/d1b/d21/d69/f8e to d1/d1e/d1b/d3e/fb1 0 2024-02-14T13:10:39.572 INFO:tasks.workunit.client.0.smithi012.stdout:6/563: link d1/df/d24/f40 d1/fb2 0 2024-02-14T13:10:39.572 INFO:tasks.workunit.client.0.smithi012.stdout:6/564: stat d1/df/d24/d3f/d56/d93 0 2024-02-14T13:10:39.584 INFO:tasks.workunit.client.0.smithi012.stdout:6/565: write d1/d1e/dc/f15 [2235498,111763] 0 2024-02-14T13:10:39.585 INFO:tasks.workunit.client.0.smithi012.stdout:6/566: dread d1/d1e/d1b/d21/d78/fa4 [0,4194304] 0 2024-02-14T13:10:39.585 INFO:tasks.workunit.client.0.smithi012.stdout:7/547: dwrite df/d27/d4b/f8f [0,4194304] 0 2024-02-14T13:10:39.585 INFO:tasks.workunit.client.0.smithi012.stdout:7/548: fdatasync df/d24/d56/f64 0 2024-02-14T13:10:39.585 INFO:tasks.workunit.client.0.smithi012.stdout:7/549: readlink df/d2d/d5d/d72/d8a/lac 0 2024-02-14T13:10:39.589 INFO:tasks.workunit.client.0.smithi012.stdout:7/550: symlink df/d2d/lc5 0 2024-02-14T13:10:39.590 INFO:tasks.workunit.client.0.smithi012.stdout:7/551: creat df/d2d/d5d/d72/d8a/fc6 x:0 0 0 2024-02-14T13:10:39.591 INFO:tasks.workunit.client.0.smithi012.stdout:7/552: dread df/f15 [0,4194304] 0 2024-02-14T13:10:39.595 INFO:tasks.workunit.client.0.smithi012.stdout:6/567: getdents d1/d1e/d1b/d21/d69 0 2024-02-14T13:10:39.596 INFO:tasks.workunit.client.0.smithi012.stdout:6/568: creat d1/fb3 x:0 0 0 2024-02-14T13:10:39.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/569: mkdir d1/df/d50/db4 0 2024-02-14T13:10:39.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/570: chown d1/df/d24/d5f/da0 0 1 2024-02-14T13:10:39.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/571: stat d1/df/f48 0 2024-02-14T13:10:39.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/572: chown d1/d1e/dc/d38 233 1 2024-02-14T13:10:39.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/573: read - d1/d1e/d1b/d21/d69/f9d zero size 2024-02-14T13:10:39.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/574: truncate d1/f9f 585815 0 2024-02-14T13:10:39.603 INFO:tasks.workunit.client.0.smithi012.stdout:6/575: dread d1/d1e/f20 [0,4194304] 0 2024-02-14T13:10:39.604 INFO:tasks.workunit.client.0.smithi012.stdout:6/576: truncate d1/d1e/d1b/d3e/fb1 2187415 0 2024-02-14T13:10:39.607 INFO:tasks.workunit.client.0.smithi012.stdout:7/553: dwrite df/d24/d56/f64 [0,4194304] 0 2024-02-14T13:10:39.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/554: write df/f21 [990545,106513] 0 2024-02-14T13:10:39.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/555: chown df/d27/d4b/d6b/fc2 94 1 2024-02-14T13:10:39.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/556: chown df/d2d/d82 336 1 2024-02-14T13:10:39.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/557: dread - df/d27/fa2 zero size 2024-02-14T13:10:39.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/558: write df/d27/fa2 [981494,48888] 0 2024-02-14T13:10:39.608 INFO:tasks.workunit.client.0.smithi012.stdout:7/559: write df/d2d/d82/d88/fb7 [4373,96759] 0 2024-02-14T13:10:39.609 INFO:tasks.workunit.client.0.smithi012.stdout:7/560: symlink df/lc7 0 2024-02-14T13:10:39.609 INFO:tasks.workunit.client.0.smithi012.stdout:6/577: getdents d1/df/d50 0 2024-02-14T13:10:39.611 INFO:tasks.workunit.client.0.smithi012.stdout:7/561: mkdir df/d27/d4b/d5a/dc8 0 2024-02-14T13:10:39.611 INFO:tasks.workunit.client.0.smithi012.stdout:7/562: truncate df/d36/f39 1385372 0 2024-02-14T13:10:39.612 INFO:tasks.workunit.client.0.smithi012.stdout:6/578: creat d1/df/d24/d3f/d56/da3/fb5 x:0 0 0 2024-02-14T13:10:39.613 INFO:tasks.workunit.client.0.smithi012.stdout:7/563: getdents df/d27/d4b/d6b 0 2024-02-14T13:10:39.613 INFO:tasks.workunit.client.0.smithi012.stdout:7/564: fdatasync df/d27/d4b/d6b/fa5 0 2024-02-14T13:10:39.613 INFO:tasks.workunit.client.0.smithi012.stdout:7/565: chown df/d27/l3d 80360 1 2024-02-14T13:10:39.613 INFO:tasks.workunit.client.0.smithi012.stdout:7/566: write df/d24/d56/f60 [457743,7328] 0 2024-02-14T13:10:39.614 INFO:tasks.workunit.client.0.smithi012.stdout:7/567: creat df/d2d/d82/d88/d90/fc9 x:0 0 0 2024-02-14T13:10:39.614 INFO:tasks.workunit.client.0.smithi012.stdout:7/568: fdatasync df/d27/f2b 0 2024-02-14T13:10:39.614 INFO:tasks.workunit.client.0.smithi012.stdout:7/569: chown df/d27/d4b/f8e 143429 1 2024-02-14T13:10:39.614 INFO:tasks.workunit.client.0.smithi012.stdout:7/570: chown df/d2d/d57 4268402 1 2024-02-14T13:10:39.614 INFO:tasks.workunit.client.0.smithi012.stdout:6/579: dread d1/d1e/d1b/da8/f68 [0,4194304] 0 2024-02-14T13:10:39.615 INFO:tasks.workunit.client.0.smithi012.stdout:7/571: symlink df/lca 0 2024-02-14T13:10:39.616 INFO:tasks.workunit.client.0.smithi012.stdout:6/580: symlink d1/d1e/dc/d28/lb6 0 2024-02-14T13:10:39.616 INFO:tasks.workunit.client.0.smithi012.stdout:7/572: rmdir df 39 2024-02-14T13:10:39.617 INFO:tasks.workunit.client.0.smithi012.stdout:6/581: truncate d1/d1e/d1b/d3e/f4c 1104029 0 2024-02-14T13:10:39.617 INFO:tasks.workunit.client.0.smithi012.stdout:6/582: dread - d1/d1e/d1b/da8/d9b/fb0 zero size 2024-02-14T13:10:39.618 INFO:tasks.workunit.client.0.smithi012.stdout:7/573: creat df/d27/d4b/d8d/fcb x:0 0 0 2024-02-14T13:10:39.619 INFO:tasks.workunit.client.0.smithi012.stdout:6/583: creat d1/d1e/dc/d38/fb7 x:0 0 0 2024-02-14T13:10:39.620 INFO:tasks.workunit.client.0.smithi012.stdout:6/584: truncate d1/df/d16/f59 735020 0 2024-02-14T13:10:39.620 INFO:tasks.workunit.client.0.smithi012.stdout:6/585: chown d1/d1e/dc/d38 74982000 1 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:4/608: sync 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:3/609: sync 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:8/613: sync 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:4/609: fsync d0/d10/d28/d4f/d6b/fdd 0 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:9/713: sync 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:1/664: sync 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:9/714: read f0 [5409120,70803] 0 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/680: sync 2024-02-14T13:10:39.622 INFO:tasks.workunit.client.0.smithi012.stdout:2/732: sync 2024-02-14T13:10:39.623 INFO:tasks.workunit.client.0.smithi012.stdout:2/733: write d0/d8/d11/d33/d53/d6b/f6c [981241,110161] 0 2024-02-14T13:10:39.623 INFO:tasks.workunit.client.0.smithi012.stdout:4/610: getdents d0/d10/d28/d4f/d6b/d8f/d56/d8c 0 2024-02-14T13:10:39.624 INFO:tasks.workunit.client.0.smithi012.stdout:1/665: creat d6/d10/d22/d31/d5b/d5e/d65/fd2 x:0 0 0 2024-02-14T13:10:39.626 INFO:tasks.workunit.client.0.smithi012.stdout:9/715: rename da/dd/d39 to da/dd/d57/d59/d73/db6/df1 0 2024-02-14T13:10:39.627 INFO:tasks.workunit.client.0.smithi012.stdout:7/574: dread df/d24/f71 [4194304,4194304] 0 2024-02-14T13:10:39.628 INFO:tasks.workunit.client.0.smithi012.stdout:0/681: creat d10/d84/fda x:0 0 0 2024-02-14T13:10:39.628 INFO:tasks.workunit.client.0.smithi012.stdout:0/682: stat d10/d14/d41/d61/d74 0 2024-02-14T13:10:39.630 INFO:tasks.workunit.client.0.smithi012.stdout:2/734: creat d0/d1a/dfc/f104 x:0 0 0 2024-02-14T13:10:39.630 INFO:tasks.workunit.client.0.smithi012.stdout:2/735: truncate d0/d1a/de4/d39/fda 3225353 0 2024-02-14T13:10:39.631 INFO:tasks.workunit.client.0.smithi012.stdout:8/614: link d9/dc/d1b/l33 d9/dc/d14/d23/d97/da3/lc4 0 2024-02-14T13:10:39.632 INFO:tasks.workunit.client.0.smithi012.stdout:3/610: dread d9/d3f/d4e/f5a [4194304,4194304] 0 2024-02-14T13:10:39.633 INFO:tasks.workunit.client.0.smithi012.stdout:4/611: creat d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 x:0 0 0 2024-02-14T13:10:39.634 INFO:tasks.workunit.client.0.smithi012.stdout:3/611: dread d9/d3f/f81 [0,4194304] 0 2024-02-14T13:10:39.635 INFO:tasks.workunit.client.0.smithi012.stdout:0/683: write d10/d14/f43 [4043821,118750] 0 2024-02-14T13:10:39.636 INFO:tasks.workunit.client.0.smithi012.stdout:1/666: unlink d6/d10/d22/d31/d5b/d5e/l1e 0 2024-02-14T13:10:39.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/716: creat da/dd/d38/ff2 x:0 0 0 2024-02-14T13:10:39.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/717: fsync da/f44 0 2024-02-14T13:10:39.637 INFO:tasks.workunit.client.0.smithi012.stdout:9/718: stat da/dd/d57/d59/fc6 0 2024-02-14T13:10:39.637 INFO:tasks.workunit.client.0.smithi012.stdout:6/586: dwrite d1/d1e/d1b/f85 [0,4194304] 0 2024-02-14T13:10:39.637 INFO:tasks.workunit.client.0.smithi012.stdout:7/575: creat df/d24/d9e/fcc x:0 0 0 2024-02-14T13:10:39.638 INFO:tasks.workunit.client.0.smithi012.stdout:7/576: dread - df/d24/d56/fa8 zero size 2024-02-14T13:10:39.638 INFO:tasks.workunit.client.0.smithi012.stdout:7/577: write df/d2d/d57/fb6 [543676,5931] 0 2024-02-14T13:10:39.638 INFO:tasks.workunit.client.0.smithi012.stdout:2/736: mkdir d0/d20/d75/d8a/d105 0 2024-02-14T13:10:39.640 INFO:tasks.workunit.client.0.smithi012.stdout:8/615: rmdir d9/dc/d14 39 2024-02-14T13:10:39.643 INFO:tasks.workunit.client.0.smithi012.stdout:3/612: link d9/dd/d30/d34/d78/fb1 d9/dcd/fdb 0 2024-02-14T13:10:39.645 INFO:tasks.workunit.client.0.smithi012.stdout:0/684: unlink d10/d14/d2b/fbe 0 2024-02-14T13:10:39.645 INFO:tasks.workunit.client.0.smithi012.stdout:0/685: stat d10/d14/d41/d52/f92 0 2024-02-14T13:10:39.646 INFO:tasks.workunit.client.0.smithi012.stdout:1/667: symlink d6/d10/d22/d31/d5b/d5e/d65/d87/ld3 0 2024-02-14T13:10:39.648 INFO:tasks.workunit.client.0.smithi012.stdout:9/719: rename da/dd/d18/d71 to da/dd/d19/df3 0 2024-02-14T13:10:39.648 INFO:tasks.workunit.client.0.smithi012.stdout:9/720: chown da/dd/d57/d59/da8 119227775 1 2024-02-14T13:10:39.649 INFO:tasks.workunit.client.0.smithi012.stdout:6/587: mkdir d1/d1e/d1b/db8 0 2024-02-14T13:10:39.650 INFO:tasks.workunit.client.0.smithi012.stdout:7/578: mkdir df/d2d/d5d/d72/d8a/dcd 0 2024-02-14T13:10:39.651 INFO:tasks.workunit.client.0.smithi012.stdout:7/579: dread df/d24/f70 [0,4194304] 0 2024-02-14T13:10:39.651 INFO:tasks.workunit.client.0.smithi012.stdout:7/580: dread df/d24/f70 [0,4194304] 0 2024-02-14T13:10:39.651 INFO:tasks.workunit.client.0.smithi012.stdout:2/737: unlink d0/d20/d54/f9b 0 2024-02-14T13:10:39.652 INFO:tasks.workunit.client.0.smithi012.stdout:2/738: write d0/d1a/de4/d15/f4a [2307639,36101] 0 2024-02-14T13:10:39.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/581: dread df/d24/d56/f61 [0,4194304] 0 2024-02-14T13:10:39.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/582: stat df/d36/f5e 0 2024-02-14T13:10:39.659 INFO:tasks.workunit.client.0.smithi012.stdout:8/616: creat d9/dc/d14/d23/d97/d56/d57/d7c/fc5 x:0 0 0 2024-02-14T13:10:39.660 INFO:tasks.workunit.client.0.smithi012.stdout:4/612: mkdir d0/de1 0 2024-02-14T13:10:39.660 INFO:tasks.workunit.client.0.smithi012.stdout:4/613: fsync d0/d10/d28/d4f/d6b/d8f/f94 0 2024-02-14T13:10:39.660 INFO:tasks.workunit.client.0.smithi012.stdout:4/614: dread - d0/d10/d28/da9/fd3 zero size 2024-02-14T13:10:39.660 INFO:tasks.workunit.client.0.smithi012.stdout:3/613: creat d9/d3f/dac/fdc x:0 0 0 2024-02-14T13:10:39.661 INFO:tasks.workunit.client.0.smithi012.stdout:0/686: mknod d10/d14/d1b/d54/d96/cdb 0 2024-02-14T13:10:39.661 INFO:tasks.workunit.client.0.smithi012.stdout:0/687: fdatasync d10/d14/d1b/f8a 0 2024-02-14T13:10:39.662 INFO:tasks.workunit.client.0.smithi012.stdout:1/668: creat d6/d10/d22/d31/d5b/d5d/d80/fd4 x:0 0 0 2024-02-14T13:10:39.663 INFO:tasks.workunit.client.0.smithi012.stdout:6/588: dwrite d1/d1e/d1b/f57 [0,4194304] 0 2024-02-14T13:10:39.663 INFO:tasks.workunit.client.0.smithi012.stdout:9/721: mknod da/dd/d38/d65/df0/cf4 0 2024-02-14T13:10:39.663 INFO:tasks.workunit.client.0.smithi012.stdout:9/722: chown da/d4f 17 1 2024-02-14T13:10:39.664 INFO:tasks.workunit.client.0.smithi012.stdout:9/723: dread da/dd/fb4 [0,4194304] 0 2024-02-14T13:10:39.665 INFO:tasks.workunit.client.0.smithi012.stdout:7/583: rename df/d24/d56/f61 to df/d2d/d5d/d72/d8a/dcd/fce 0 2024-02-14T13:10:39.666 INFO:tasks.workunit.client.0.smithi012.stdout:3/614: rmdir d9/dd/d30/d44/d3d 39 2024-02-14T13:10:39.666 INFO:tasks.workunit.client.0.smithi012.stdout:3/615: write d9/dd/f4a [675313,103754] 0 2024-02-14T13:10:39.666 INFO:tasks.workunit.client.0.smithi012.stdout:3/616: truncate d9/dd/fb8 1800263 0 2024-02-14T13:10:39.667 INFO:tasks.workunit.client.0.smithi012.stdout:0/688: mkdir d10/d14/d41/d52/d99/ddc 0 2024-02-14T13:10:39.668 INFO:tasks.workunit.client.0.smithi012.stdout:1/669: creat d6/d10/d22/d31/d5b/dcd/da2/fd5 x:0 0 0 2024-02-14T13:10:39.669 INFO:tasks.workunit.client.0.smithi012.stdout:9/724: dread da/dd/d19/df3/d85/f51 [0,4194304] 0 2024-02-14T13:10:39.671 INFO:tasks.workunit.client.0.smithi012.stdout:6/589: symlink d1/df/d16/d7c/d97/lb9 0 2024-02-14T13:10:39.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/739: link d0/d6/d37/c5b d0/d8/d11/d35/dd0/c106 0 2024-02-14T13:10:39.674 INFO:tasks.workunit.client.0.smithi012.stdout:8/617: rename d9/dc/d14/d23/d97/d56/d57/d5c/l83 to d9/dc/d14/d23/d97/lc6 0 2024-02-14T13:10:39.675 INFO:tasks.workunit.client.0.smithi012.stdout:7/584: symlink df/d2d/d82/d88/db2/lcf 0 2024-02-14T13:10:39.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/739: sync 2024-02-14T13:10:39.676 INFO:tasks.workunit.client.0.smithi012.stdout:0/689: creat d10/d14/d41/d52/d78/d8c/dce/fdd x:0 0 0 2024-02-14T13:10:39.678 INFO:tasks.workunit.client.0.smithi012.stdout:9/725: unlink da/dd/d19/lb1 0 2024-02-14T13:10:39.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/740: dread d0/d8/d11/d33/d53/d6b/f6c [0,4194304] 0 2024-02-14T13:10:39.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/741: chown d0/d8/d11/d33/d63 100847 1 2024-02-14T13:10:39.680 INFO:tasks.workunit.client.0.smithi012.stdout:4/615: rename d0/d10/d28/d4f/d6b/d8f/f3f to d0/d10/d28/d4f/d6b/d83/d17/d5f/fe2 0 2024-02-14T13:10:39.682 INFO:tasks.workunit.client.0.smithi012.stdout:8/618: symlink d9/dc/d38/d6a/dab/lc7 0 2024-02-14T13:10:39.684 INFO:tasks.workunit.client.0.smithi012.stdout:7/585: mknod df/d24/d56/cd0 0 2024-02-14T13:10:39.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/740: creat dc/d2f/d40/d53/d97/fe4 x:0 0 0 2024-02-14T13:10:39.688 INFO:tasks.workunit.client.0.smithi012.stdout:2/742: getdents d0/d1a/de4/d15 0 2024-02-14T13:10:39.688 INFO:tasks.workunit.client.0.smithi012.stdout:2/743: chown d0/d20/d54/lcd 0 1 2024-02-14T13:10:39.690 INFO:tasks.workunit.client.0.smithi012.stdout:0/690: dread d10/d84/dbd/f45 [0,4194304] 0 2024-02-14T13:10:39.690 INFO:tasks.workunit.client.0.smithi012.stdout:0/691: write d10/d14/d20/f64 [703669,125567] 0 2024-02-14T13:10:39.690 INFO:tasks.workunit.client.0.smithi012.stdout:0/692: dread - d10/d14/d41/d52/d78/d8c/fc5 zero size 2024-02-14T13:10:39.691 INFO:tasks.workunit.client.0.smithi012.stdout:3/617: rename d9/d3f/fd8 to d9/dc4/fdd 0 2024-02-14T13:10:39.692 INFO:tasks.workunit.client.0.smithi012.stdout:4/616: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fe3 x:0 0 0 2024-02-14T13:10:39.693 INFO:tasks.workunit.client.0.smithi012.stdout:7/586: mknod df/d27/d4b/d6b/d6d/cd1 0 2024-02-14T13:10:39.694 INFO:tasks.workunit.client.0.smithi012.stdout:5/741: mkdir dc/d47/d59/d6a/de5 0 2024-02-14T13:10:39.695 INFO:tasks.workunit.client.0.smithi012.stdout:1/670: dwrite d6/ff [4194304,4194304] 0 2024-02-14T13:10:39.695 INFO:tasks.workunit.client.0.smithi012.stdout:1/671: fdatasync d6/d10/d22/d31/d5b/d5e/d3d/f45 0 2024-02-14T13:10:39.695 INFO:tasks.workunit.client.0.smithi012.stdout:9/726: getdents da/dd/d57/db2 0 2024-02-14T13:10:39.695 INFO:tasks.workunit.client.0.smithi012.stdout:9/727: truncate da/d4f/f60 942232 0 2024-02-14T13:10:39.695 INFO:tasks.workunit.client.0.smithi012.stdout:9/728: dread - da/dd/d57/d59/d73/db6/df1/d8d/fee zero size 2024-02-14T13:10:39.696 INFO:tasks.workunit.client.0.smithi012.stdout:2/744: unlink d0/d8/d9/d90/dab/cc7 0 2024-02-14T13:10:39.696 INFO:tasks.workunit.client.0.smithi012.stdout:0/693: creat d10/dad/fde x:0 0 0 2024-02-14T13:10:39.698 INFO:tasks.workunit.client.0.smithi012.stdout:3/618: dread d9/d68/f90 [0,4194304] 0 2024-02-14T13:10:39.698 INFO:tasks.workunit.client.0.smithi012.stdout:4/617: link d0/d10/d1f/f20 d0/d10/d28/d4f/d6b/d8f/d56/fe4 0 2024-02-14T13:10:39.700 INFO:tasks.workunit.client.0.smithi012.stdout:6/590: dwrite d1/d1e/f94 [0,4194304] 0 2024-02-14T13:10:39.700 INFO:tasks.workunit.client.0.smithi012.stdout:6/591: chown d1/df/d24/d3f/d56 96455452 1 2024-02-14T13:10:39.700 INFO:tasks.workunit.client.0.smithi012.stdout:1/672: creat d6/d10/d22/d31/d3e/d71/fd6 x:0 0 0 2024-02-14T13:10:39.700 INFO:tasks.workunit.client.0.smithi012.stdout:9/729: readlink da/dd/d57/l7a 0 2024-02-14T13:10:39.700 INFO:tasks.workunit.client.0.smithi012.stdout:9/730: fsync da/d33/d63/f86 0 2024-02-14T13:10:39.702 INFO:tasks.workunit.client.0.smithi012.stdout:0/694: creat d10/d14/d1b/d54/d96/fdf x:0 0 0 2024-02-14T13:10:39.702 INFO:tasks.workunit.client.0.smithi012.stdout:0/695: stat d10/d14/d1b/d7e 0 2024-02-14T13:10:39.703 INFO:tasks.workunit.client.0.smithi012.stdout:3/619: truncate d9/d13/d28/f40 2632760 0 2024-02-14T13:10:39.704 INFO:tasks.workunit.client.0.smithi012.stdout:4/618: creat d0/d10/fe5 x:0 0 0 2024-02-14T13:10:39.706 INFO:tasks.workunit.client.0.smithi012.stdout:7/587: dread df/f30 [0,4194304] 0 2024-02-14T13:10:39.707 INFO:tasks.workunit.client.0.smithi012.stdout:6/592: unlink d1/df/d24/d3f/l65 0 2024-02-14T13:10:39.708 INFO:tasks.workunit.client.0.smithi012.stdout:1/673: creat d6/d10/d22/d31/d5b/d5d/d80/fd7 x:0 0 0 2024-02-14T13:10:39.709 INFO:tasks.workunit.client.0.smithi012.stdout:9/731: rename da/dd/d19/df3/c93 to da/dd/d19/cf5 0 2024-02-14T13:10:39.711 INFO:tasks.workunit.client.0.smithi012.stdout:0/696: mkdir d10/d14/d20/daa/de0 0 2024-02-14T13:10:39.714 INFO:tasks.workunit.client.0.smithi012.stdout:5/742: dwrite dc/d17/fd9 [0,4194304] 0 2024-02-14T13:10:39.715 INFO:tasks.workunit.client.0.smithi012.stdout:7/588: mknod df/d27/d4b/d6b/d6d/cd2 0 2024-02-14T13:10:39.716 INFO:tasks.workunit.client.0.smithi012.stdout:7/589: write df/d36/f39 [298749,116144] 0 2024-02-14T13:10:39.718 INFO:tasks.workunit.client.0.smithi012.stdout:6/593: link d1/d1e/dc/f8d d1/d1e/dc/d38/fba 0 2024-02-14T13:10:39.720 INFO:tasks.workunit.client.0.smithi012.stdout:1/674: creat d6/d10/d22/d31/d5b/dcd/fd8 x:0 0 0 2024-02-14T13:10:39.721 INFO:tasks.workunit.client.0.smithi012.stdout:9/732: symlink da/dd/d38/d65/lf6 0 2024-02-14T13:10:39.727 INFO:tasks.workunit.client.0.smithi012.stdout:0/697: creat d10/d14/d2b/d3b/dd5/fe1 x:0 0 0 2024-02-14T13:10:39.727 INFO:tasks.workunit.client.0.smithi012.stdout:0/698: fdatasync d10/d84/fcd 0 2024-02-14T13:10:39.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/620: dwrite d9/d3f/f87 [0,4194304] 0 2024-02-14T13:10:39.730 INFO:tasks.workunit.client.0.smithi012.stdout:3/621: stat d9/l1e 0 2024-02-14T13:10:39.730 INFO:tasks.workunit.client.0.smithi012.stdout:8/619: dwrite d9/dc/d1b/f9a [0,4194304] 0 2024-02-14T13:10:39.730 INFO:tasks.workunit.client.0.smithi012.stdout:4/619: dwrite d0/d10/d28/d4f/d6b/d83/d17/fcb [0,4194304] 0 2024-02-14T13:10:39.732 INFO:tasks.workunit.client.0.smithi012.stdout:6/594: creat d1/d1e/dc/d43/fbb x:0 0 0 2024-02-14T13:10:39.733 INFO:tasks.workunit.client.0.smithi012.stdout:0/699: creat d10/dad/fe2 x:0 0 0 2024-02-14T13:10:39.737 INFO:tasks.workunit.client.0.smithi012.stdout:4/620: chown d0/lf 5 1 2024-02-14T13:10:39.739 INFO:tasks.workunit.client.0.smithi012.stdout:6/595: creat d1/d1e/d1b/d6d/fbc x:0 0 0 2024-02-14T13:10:39.742 INFO:tasks.workunit.client.0.smithi012.stdout:0/700: creat d10/d14/d1b/d54/fe3 x:0 0 0 2024-02-14T13:10:39.742 INFO:tasks.workunit.client.0.smithi012.stdout:3/622: write d9/dd/f17 [1516601,22600] 0 2024-02-14T13:10:39.742 INFO:tasks.workunit.client.0.smithi012.stdout:4/621: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fe6 x:0 0 0 2024-02-14T13:10:39.744 INFO:tasks.workunit.client.0.smithi012.stdout:3/623: fsync d9/f35 0 2024-02-14T13:10:39.744 INFO:tasks.workunit.client.0.smithi012.stdout:6/596: dread d1/d1e/d1b/f3d [0,4194304] 0 2024-02-14T13:10:39.744 INFO:tasks.workunit.client.0.smithi012.stdout:6/597: chown d1/df/d24/f8f 1338 1 2024-02-14T13:10:39.745 INFO:tasks.workunit.client.0.smithi012.stdout:0/701: symlink d10/d14/d41/le4 0 2024-02-14T13:10:39.746 INFO:tasks.workunit.client.0.smithi012.stdout:3/624: truncate d9/f61 1175137 0 2024-02-14T13:10:39.747 INFO:tasks.workunit.client.0.smithi012.stdout:3/625: truncate d9/dd/d30/fca 78197 0 2024-02-14T13:10:39.747 INFO:tasks.workunit.client.0.smithi012.stdout:6/598: mknod d1/df/d24/cbd 0 2024-02-14T13:10:39.747 INFO:tasks.workunit.client.0.smithi012.stdout:6/599: write d1/d1e/d1b/d21/d78/fa4 [407567,40518] 0 2024-02-14T13:10:39.749 INFO:tasks.workunit.client.0.smithi012.stdout:0/702: rename d10/d14/d1b/f94 to d10/d14/d41/d52/d78/fe5 0 2024-02-14T13:10:39.749 INFO:tasks.workunit.client.0.smithi012.stdout:0/703: chown d10/d14/d1b/d30/f83 51113 1 2024-02-14T13:10:39.750 INFO:tasks.workunit.client.0.smithi012.stdout:3/626: getdents d9/d3f/da8 0 2024-02-14T13:10:39.750 INFO:tasks.workunit.client.0.smithi012.stdout:3/627: readlink d9/d3f/l9d 0 2024-02-14T13:10:39.752 INFO:tasks.workunit.client.0.smithi012.stdout:6/600: creat d1/d1e/d1b/fbe x:0 0 0 2024-02-14T13:10:39.753 INFO:tasks.workunit.client.0.smithi012.stdout:0/704: rmdir d10/d84/dbd 39 2024-02-14T13:10:39.754 INFO:tasks.workunit.client.0.smithi012.stdout:6/601: creat d1/d1e/dc/d28/d7b/fbf x:0 0 0 2024-02-14T13:10:39.755 INFO:tasks.workunit.client.0.smithi012.stdout:0/705: creat d10/d84/d93/fe6 x:0 0 0 2024-02-14T13:10:39.755 INFO:tasks.workunit.client.0.smithi012.stdout:8/620: dwrite d9/dc/f2c [4194304,4194304] 0 2024-02-14T13:10:39.756 INFO:tasks.workunit.client.0.smithi012.stdout:9/733: dwrite da/dd/d57/d59/fc6 [0,4194304] 0 2024-02-14T13:10:39.756 INFO:tasks.workunit.client.0.smithi012.stdout:9/734: truncate da/f44 4395910 0 2024-02-14T13:10:39.756 INFO:tasks.workunit.client.0.smithi012.stdout:9/735: chown da/dd/d38/d65/fe5 1936 1 2024-02-14T13:10:39.757 INFO:tasks.workunit.client.0.smithi012.stdout:6/602: mkdir d1/dc0 0 2024-02-14T13:10:39.757 INFO:tasks.workunit.client.0.smithi012.stdout:5/743: dwrite f0 [0,4194304] 0 2024-02-14T13:10:39.757 INFO:tasks.workunit.client.0.smithi012.stdout:5/744: write dc/d2f/d3e/fdf [723364,20938] 0 2024-02-14T13:10:39.757 INFO:tasks.workunit.client.0.smithi012.stdout:5/745: chown dc/d17/d20/d4c/d63/d81/c9d 6676 1 2024-02-14T13:10:39.757 INFO:tasks.workunit.client.0.smithi012.stdout:7/590: dwrite df/d27/d4b/d8d/fa0 [0,4194304] 0 2024-02-14T13:10:39.758 INFO:tasks.workunit.client.0.smithi012.stdout:8/621: mknod d9/dc/d1b/d6b/cc8 0 2024-02-14T13:10:39.758 INFO:tasks.workunit.client.0.smithi012.stdout:8/622: readlink d9/dc/d1b/lac 0 2024-02-14T13:10:39.763 INFO:tasks.workunit.client.0.smithi012.stdout:9/736: symlink da/dd/lf7 0 2024-02-14T13:10:39.765 INFO:tasks.workunit.client.0.smithi012.stdout:6/603: creat d1/df/d24/d5f/da0/fc1 x:0 0 0 2024-02-14T13:10:39.765 INFO:tasks.workunit.client.0.smithi012.stdout:4/622: dwrite d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:39.765 INFO:tasks.workunit.client.0.smithi012.stdout:4/623: fdatasync d0/d10/d28/d4f/d6b/d8f/f48 0 2024-02-14T13:10:39.765 INFO:tasks.workunit.client.0.smithi012.stdout:4/624: write d0/d10/d28/d4f/d6b/d83/d17/f38 [308715,19430] 0 2024-02-14T13:10:39.768 INFO:tasks.workunit.client.0.smithi012.stdout:5/746: write dc/d2f/d89/f8b [2560890,57734] 0 2024-02-14T13:10:39.770 INFO:tasks.workunit.client.0.smithi012.stdout:7/591: symlink df/d2d/d57/ld3 0 2024-02-14T13:10:39.771 INFO:tasks.workunit.client.0.smithi012.stdout:8/623: fdatasync d9/dc/d1b/f80 0 2024-02-14T13:10:39.771 INFO:tasks.workunit.client.0.smithi012.stdout:8/624: write d9/dc/d14/d23/d97/d56/d57/f6c [2044939,71049] 0 2024-02-14T13:10:39.772 INFO:tasks.workunit.client.0.smithi012.stdout:6/604: write d1/d1e/d1b/d3e/f8c [2062243,15812] 0 2024-02-14T13:10:39.772 INFO:tasks.workunit.client.0.smithi012.stdout:6/605: fdatasync d1/df/d24/d3f/d56/da3/fb5 0 2024-02-14T13:10:39.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/606: read d1/df/d24/daf/f53 [1438906,98565] 0 2024-02-14T13:10:39.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/607: chown d1/d1e/d1b/da8/d9b 15 1 2024-02-14T13:10:39.773 INFO:tasks.workunit.client.0.smithi012.stdout:6/608: chown d1/fb2 52 1 2024-02-14T13:10:39.773 INFO:tasks.workunit.client.0.smithi012.stdout:9/737: mknod da/dd/d57/d59/d73/db6/cf8 0 2024-02-14T13:10:39.776 INFO:tasks.workunit.client.0.smithi012.stdout:5/747: mknod dc/d47/ce6 0 2024-02-14T13:10:39.776 INFO:tasks.workunit.client.0.smithi012.stdout:5/748: chown dc/d17/d20/d4c/d58/f83 218093 1 2024-02-14T13:10:39.777 INFO:tasks.workunit.client.0.smithi012.stdout:7/592: mkdir df/d27/d4b/d8d/dd4 0 2024-02-14T13:10:39.778 INFO:tasks.workunit.client.0.smithi012.stdout:8/625: fdatasync d9/dc/d1b/f9f 0 2024-02-14T13:10:39.779 INFO:tasks.workunit.client.0.smithi012.stdout:5/749: rmdir dc/d17/d20/d4c/d63 39 2024-02-14T13:10:39.780 INFO:tasks.workunit.client.0.smithi012.stdout:5/750: readlink dc/d47/d6e/laf 0 2024-02-14T13:10:39.780 INFO:tasks.workunit.client.0.smithi012.stdout:5/751: readlink dc/d2f/d89/l8c 0 2024-02-14T13:10:39.781 INFO:tasks.workunit.client.0.smithi012.stdout:7/593: creat df/d27/d4b/d6b/d6d/d85/fd5 x:0 0 0 2024-02-14T13:10:39.783 INFO:tasks.workunit.client.0.smithi012.stdout:3/628: dwrite d9/d18/d39/f59 [4194304,4194304] 0 2024-02-14T13:10:39.783 INFO:tasks.workunit.client.0.smithi012.stdout:8/626: rename d9/dc/d1b/lac to d9/dc/d14/d23/d97/lc9 0 2024-02-14T13:10:39.785 INFO:tasks.workunit.client.0.smithi012.stdout:5/752: mkdir dc/d2f/d40/d53/dca/de7 0 2024-02-14T13:10:39.787 INFO:tasks.workunit.client.0.smithi012.stdout:8/627: mkdir d9/dc/d14/d23/d97/d56/d57/dca 0 2024-02-14T13:10:39.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/594: rename df/d36/c37 to df/d2d/d82/cd6 0 2024-02-14T13:10:39.789 INFO:tasks.workunit.client.0.smithi012.stdout:7/595: write df/d2d/d82/d88/fb7 [632631,63443] 0 2024-02-14T13:10:39.789 INFO:tasks.workunit.client.0.smithi012.stdout:9/738: dwrite da/dd/d38/d7e/fda [0,4194304] 0 2024-02-14T13:10:39.790 INFO:tasks.workunit.client.0.smithi012.stdout:8/628: dread d9/dc/d1b/f9f [0,4194304] 0 2024-02-14T13:10:39.791 INFO:tasks.workunit.client.0.smithi012.stdout:4/625: dwrite d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 [0,4194304] 0 2024-02-14T13:10:39.792 INFO:tasks.workunit.client.0.smithi012.stdout:0/706: dwrite d10/d14/d20/f64 [0,4194304] 0 2024-02-14T13:10:39.793 INFO:tasks.workunit.client.0.smithi012.stdout:6/609: dwrite d1/d1e/d1b/fbe [0,4194304] 0 2024-02-14T13:10:39.797 INFO:tasks.workunit.client.0.smithi012.stdout:4/626: mkdir d0/d10/d28/d4f/d6b/de7 0 2024-02-14T13:10:39.797 INFO:tasks.workunit.client.0.smithi012.stdout:4/627: fdatasync d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fc2 0 2024-02-14T13:10:39.800 INFO:tasks.workunit.client.0.smithi012.stdout:9/739: write da/dd/d19/d30/d9d/fc9 [2971139,53998] 0 2024-02-14T13:10:39.802 INFO:tasks.workunit.client.0.smithi012.stdout:0/707: link fd d10/d14/d41/d61/d74/fe7 0 2024-02-14T13:10:39.811 INFO:tasks.workunit.client.0.smithi012.stdout:7/596: dwrite df/d36/f3c [0,4194304] 0 2024-02-14T13:10:39.811 INFO:tasks.workunit.client.0.smithi012.stdout:5/753: dwrite dc/d17/f67 [0,4194304] 0 2024-02-14T13:10:39.811 INFO:tasks.workunit.client.0.smithi012.stdout:5/754: stat dc/d2f/d40/d53/d97/fbe 0 2024-02-14T13:10:39.811 INFO:tasks.workunit.client.0.smithi012.stdout:6/610: link d1/d1e/c81 d1/df/d24/d3f/d56/da3/cc2 0 2024-02-14T13:10:39.812 INFO:tasks.workunit.client.0.smithi012.stdout:4/628: rmdir d0/d10/d28/d4f/d6b/d83 39 2024-02-14T13:10:39.812 INFO:tasks.workunit.client.0.smithi012.stdout:7/597: dread df/d2d/d5d/d72/f77 [0,4194304] 0 2024-02-14T13:10:39.813 INFO:tasks.workunit.client.0.smithi012.stdout:9/740: truncate da/d33/d63/f8a 3863432 0 2024-02-14T13:10:39.815 INFO:tasks.workunit.client.0.smithi012.stdout:0/708: creat d10/d14/d41/d52/d78/d8c/d7f/fe8 x:0 0 0 2024-02-14T13:10:39.816 INFO:tasks.workunit.client.0.smithi012.stdout:0/709: fdatasync d10/d14/d1b/d30/f6f 0 2024-02-14T13:10:39.820 INFO:tasks.workunit.client.0.smithi012.stdout:5/755: symlink dc/d2f/d40/d53/dca/de7/le8 0 2024-02-14T13:10:39.822 INFO:tasks.workunit.client.0.smithi012.stdout:8/629: dwrite d9/dc/d38/d6a/f79 [0,4194304] 0 2024-02-14T13:10:39.822 INFO:tasks.workunit.client.0.smithi012.stdout:4/629: dread d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 [0,4194304] 0 2024-02-14T13:10:39.823 INFO:tasks.workunit.client.0.smithi012.stdout:6/611: rename d1/d1e/d1b/f33 to d1/d1e/d1b/d21/d78/fc3 0 2024-02-14T13:10:39.825 INFO:tasks.workunit.client.0.smithi012.stdout:6/612: read d1/d1e/d1b/f3d [108946,130960] 0 2024-02-14T13:10:39.825 INFO:tasks.workunit.client.0.smithi012.stdout:7/598: creat df/d27/d4b/d6b/d6d/d85/db8/fd7 x:0 0 0 2024-02-14T13:10:39.826 INFO:tasks.workunit.client.0.smithi012.stdout:0/710: write d10/d14/d20/f69 [1674735,74029] 0 2024-02-14T13:10:39.828 INFO:tasks.workunit.client.0.smithi012.stdout:4/630: dread - d0/d10/d28/d4f/d6b/d8f/d56/d8c/fb9 zero size 2024-02-14T13:10:39.828 INFO:tasks.workunit.client.0.smithi012.stdout:9/741: dwrite da/dd/d57/d59/d73/db6/df1/fbb [0,4194304] 0 2024-02-14T13:10:39.829 INFO:tasks.workunit.client.0.smithi012.stdout:8/630: truncate d9/dc/d1b/d35/f78 3354524 0 2024-02-14T13:10:39.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/599: mkdir df/d27/d4b/d6b/dd8 0 2024-02-14T13:10:39.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/711: rmdir d10/d14/d41/d52 39 2024-02-14T13:10:39.835 INFO:tasks.workunit.client.0.smithi012.stdout:4/631: rename d0/d55 to d0/de1/de8 0 2024-02-14T13:10:39.838 INFO:tasks.workunit.client.0.smithi012.stdout:7/600: stat df/d24/d56/cc0 0 2024-02-14T13:10:39.840 INFO:tasks.workunit.client.0.smithi012.stdout:9/742: write da/dd/d19/df3/fd1 [821360,81691] 0 2024-02-14T13:10:39.840 INFO:tasks.workunit.client.0.smithi012.stdout:9/743: chown da/dd/f2a 6334975 1 2024-02-14T13:10:39.841 INFO:tasks.workunit.client.0.smithi012.stdout:4/632: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fe9 x:0 0 0 2024-02-14T13:10:39.842 INFO:tasks.workunit.client.0.smithi012.stdout:9/744: dread da/dd/d38/d7e/fa7 [0,4194304] 0 2024-02-14T13:10:39.843 INFO:tasks.workunit.client.0.smithi012.stdout:0/712: dread d10/d14/f2e [4194304,4194304] 0 2024-02-14T13:10:39.843 INFO:tasks.workunit.client.0.smithi012.stdout:0/713: write d10/d84/d93/fe6 [769797,87413] 0 2024-02-14T13:10:39.844 INFO:tasks.workunit.client.0.smithi012.stdout:4/633: creat d0/d10/d28/d4f/d6b/d83/d99/fea x:0 0 0 2024-02-14T13:10:39.846 INFO:tasks.workunit.client.0.smithi012.stdout:0/714: mkdir d10/d14/d41/d52/d99/d9b/de9 0 2024-02-14T13:10:39.846 INFO:tasks.workunit.client.0.smithi012.stdout:0/715: chown d10/d14/d41/d52/d72/fa7 2213902 1 2024-02-14T13:10:39.848 INFO:tasks.workunit.client.0.smithi012.stdout:4/634: truncate d0/d10/d1f/f70 1455984 0 2024-02-14T13:10:39.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/716: mkdir d10/d14/d41/d52/d78/dea 0 2024-02-14T13:10:39.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/717: read - d10/f57 zero size 2024-02-14T13:10:39.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/718: chown d10/d14/d41/ca2 4754670 1 2024-02-14T13:10:39.850 INFO:tasks.workunit.client.0.smithi012.stdout:0/719: symlink d10/d14/d1b/d30/leb 0 2024-02-14T13:10:39.851 INFO:tasks.workunit.client.0.smithi012.stdout:8/631: dwrite d9/dc/d14/d23/d97/d56/fb5 [0,4194304] 0 2024-02-14T13:10:39.851 INFO:tasks.workunit.client.0.smithi012.stdout:0/720: read - d10/d84/f9d zero size 2024-02-14T13:10:39.853 INFO:tasks.workunit.client.0.smithi012.stdout:8/632: creat d9/dc/d1b/d6b/fcb x:0 0 0 2024-02-14T13:10:39.854 INFO:tasks.workunit.client.0.smithi012.stdout:0/721: mknod d10/d14/d1b/cec 0 2024-02-14T13:10:39.855 INFO:tasks.workunit.client.0.smithi012.stdout:8/633: creat d9/dc/d14/d23/d97/d56/d57/d7c/fcc x:0 0 0 2024-02-14T13:10:39.855 INFO:tasks.workunit.client.0.smithi012.stdout:8/634: fsync d9/dc/d14/d23/d97/d56/fb5 0 2024-02-14T13:10:39.856 INFO:tasks.workunit.client.0.smithi012.stdout:8/635: chown f4 293 1 2024-02-14T13:10:39.856 INFO:tasks.workunit.client.0.smithi012.stdout:8/636: chown d9/dc/d14/d23/d97/d56/fb5 3035141 1 2024-02-14T13:10:39.856 INFO:tasks.workunit.client.0.smithi012.stdout:0/722: creat d10/d14/d41/d61/fed x:0 0 0 2024-02-14T13:10:39.856 INFO:tasks.workunit.client.0.smithi012.stdout:0/723: write d10/d84/fda [524083,51237] 0 2024-02-14T13:10:39.857 INFO:tasks.workunit.client.0.smithi012.stdout:8/637: creat d9/db9/fcd x:0 0 0 2024-02-14T13:10:39.857 INFO:tasks.workunit.client.0.smithi012.stdout:2/745: sync 2024-02-14T13:10:39.858 INFO:tasks.workunit.client.0.smithi012.stdout:0/724: creat d10/d14/d41/d52/d78/dea/fee x:0 0 0 2024-02-14T13:10:39.858 INFO:tasks.workunit.client.0.smithi012.stdout:0/725: stat d10/d14/d1b/d54 0 2024-02-14T13:10:39.860 INFO:tasks.workunit.client.0.smithi012.stdout:8/638: rename d9/ca2 to d9/dc/d14/d23/d97/d56/cce 0 2024-02-14T13:10:39.860 INFO:tasks.workunit.client.0.smithi012.stdout:5/756: dwrite dc/d17/d20/d4c/f51 [0,4194304] 0 2024-02-14T13:10:39.861 INFO:tasks.workunit.client.0.smithi012.stdout:6/613: dwrite d1/d1e/d66/f88 [0,4194304] 0 2024-02-14T13:10:39.861 INFO:tasks.workunit.client.0.smithi012.stdout:6/614: fdatasync d1/d1e/dc/d28/f4d 0 2024-02-14T13:10:39.864 INFO:tasks.workunit.client.0.smithi012.stdout:8/639: unlink d9/dc/d1b/d35/l66 0 2024-02-14T13:10:39.864 INFO:tasks.workunit.client.0.smithi012.stdout:7/601: dwrite df/f15 [0,4194304] 0 2024-02-14T13:10:39.865 INFO:tasks.workunit.client.0.smithi012.stdout:8/640: write d9/f84 [4604593,107963] 0 2024-02-14T13:10:39.869 INFO:tasks.workunit.client.0.smithi012.stdout:6/615: write d1/df/d16/f59 [256291,52129] 0 2024-02-14T13:10:39.869 INFO:tasks.workunit.client.0.smithi012.stdout:4/635: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa [0,4194304] 0 2024-02-14T13:10:39.871 INFO:tasks.workunit.client.0.smithi012.stdout:7/602: creat df/d24/d9e/fd9 x:0 0 0 2024-02-14T13:10:39.872 INFO:tasks.workunit.client.0.smithi012.stdout:8/641: getdents d9/dc/d14/d2e 0 2024-02-14T13:10:39.874 INFO:tasks.workunit.client.0.smithi012.stdout:6/616: link d1/d1e/c81 d1/df/d50/db4/cc4 0 2024-02-14T13:10:39.875 INFO:tasks.workunit.client.0.smithi012.stdout:4/636: chown d0/l2c 12626286 1 2024-02-14T13:10:39.875 INFO:tasks.workunit.client.0.smithi012.stdout:0/726: dwrite d10/d14/d20/d49/f5e [0,4194304] 0 2024-02-14T13:10:39.877 INFO:tasks.workunit.client.0.smithi012.stdout:7/603: link df/d2d/d82/d88/cbf df/d27/d4b/d8d/dd4/cda 0 2024-02-14T13:10:39.879 INFO:tasks.workunit.client.0.smithi012.stdout:4/637: dread d0/d10/d28/d4f/d6b/d83/f16 [4194304,4194304] 0 2024-02-14T13:10:39.880 INFO:tasks.workunit.client.0.smithi012.stdout:6/617: symlink d1/df/d16/d7c/d97/lc5 0 2024-02-14T13:10:39.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/638: link d0/f68 d0/d10/feb 0 2024-02-14T13:10:39.882 INFO:tasks.workunit.client.0.smithi012.stdout:4/639: truncate d0/d10/d28/d62/fbc 1090164 0 2024-02-14T13:10:39.883 INFO:tasks.workunit.client.0.smithi012.stdout:6/618: creat d1/df/d24/d3f/d56/d93/fc6 x:0 0 0 2024-02-14T13:10:39.884 INFO:tasks.workunit.client.0.smithi012.stdout:4/640: link d0/d10/d1f/d71/fd5 d0/d10/d28/d4f/d6b/d83/fec 0 2024-02-14T13:10:39.885 INFO:tasks.workunit.client.0.smithi012.stdout:6/619: mkdir d1/df/d24/d3f/d56/d93/d95/dc7 0 2024-02-14T13:10:39.886 INFO:tasks.workunit.client.0.smithi012.stdout:4/641: symlink d0/d10/d28/d4f/d6b/de7/led 0 2024-02-14T13:10:39.886 INFO:tasks.workunit.client.0.smithi012.stdout:4/642: readlink d0/d10/d28/l2b 0 2024-02-14T13:10:39.887 INFO:tasks.workunit.client.0.smithi012.stdout:6/620: creat d1/df/d24/d3f/d56/da3/fc8 x:0 0 0 2024-02-14T13:10:39.888 INFO:tasks.workunit.client.0.smithi012.stdout:4/643: mknod d0/d10/d28/d4f/d6b/d83/cee 0 2024-02-14T13:10:39.888 INFO:tasks.workunit.client.0.smithi012.stdout:4/644: stat d0/f68 0 2024-02-14T13:10:39.888 INFO:tasks.workunit.client.0.smithi012.stdout:4/645: stat d0/d10/d28/d4f/l52 0 2024-02-14T13:10:39.888 INFO:tasks.workunit.client.0.smithi012.stdout:4/646: fdatasync d0/d10/d28/da9/d86/fd0 0 2024-02-14T13:10:39.891 INFO:tasks.workunit.client.0.smithi012.stdout:8/642: rename d9/dc/d1b/d35 to d9/dc/d14/d23/d97/d56/d57/d5c/dcf 0 2024-02-14T13:10:39.891 INFO:tasks.workunit.client.0.smithi012.stdout:4/647: dread d0/d10/d28/d4f/f7a [0,4194304] 0 2024-02-14T13:10:39.892 INFO:tasks.workunit.client.0.smithi012.stdout:4/648: getdents d0/d10/d28/d4f 0 2024-02-14T13:10:39.892 INFO:tasks.workunit.client.0.smithi012.stdout:4/649: chown d0/d10/d28/d4f/d6b/d8f/f8d 5281877 1 2024-02-14T13:10:39.893 INFO:tasks.workunit.client.0.smithi012.stdout:8/643: symlink d9/dc/d14/d23/ld0 0 2024-02-14T13:10:39.893 INFO:tasks.workunit.client.0.smithi012.stdout:1/675: sync 2024-02-14T13:10:39.894 INFO:tasks.workunit.client.0.smithi012.stdout:8/644: creat d9/dc/d14/d23/d97/fd1 x:0 0 0 2024-02-14T13:10:39.895 INFO:tasks.workunit.client.0.smithi012.stdout:4/650: dread d0/d10/d28/d4f/d6b/d8f/d56/f7f [0,4194304] 0 2024-02-14T13:10:39.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/645: symlink d9/dc/d14/d23/d97/da1/ld2 0 2024-02-14T13:10:39.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/646: write d9/dc/d14/d23/d97/d56/d57/d5c/fc3 [722162,51905] 0 2024-02-14T13:10:39.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/647: write f4 [1236773,93887] 0 2024-02-14T13:10:39.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/651: rename d0/d10/d28/d62/fbc to d0/de1/fef 0 2024-02-14T13:10:39.901 INFO:tasks.workunit.client.0.smithi012.stdout:6/621: dwrite d1/d1e/dc/d43/fbb [0,4194304] 0 2024-02-14T13:10:39.901 INFO:tasks.workunit.client.0.smithi012.stdout:7/604: dwrite df/d24/f87 [0,4194304] 0 2024-02-14T13:10:39.902 INFO:tasks.workunit.client.0.smithi012.stdout:1/676: write d6/d10/d22/d44/f48 [7797609,55517] 0 2024-02-14T13:10:39.903 INFO:tasks.workunit.client.0.smithi012.stdout:7/605: read df/d2d/f3f [873486,44981] 0 2024-02-14T13:10:39.907 INFO:tasks.workunit.client.0.smithi012.stdout:1/677: truncate d6/d10/f99 3373915 0 2024-02-14T13:10:39.908 INFO:tasks.workunit.client.0.smithi012.stdout:6/622: read d1/df/d24/f36 [1716260,112389] 0 2024-02-14T13:10:39.909 INFO:tasks.workunit.client.0.smithi012.stdout:6/623: stat d1/df/d24/d3f/d56/da3/fc8 0 2024-02-14T13:10:39.909 INFO:tasks.workunit.client.0.smithi012.stdout:7/606: link df/d2d/d57/l5f df/d2d/d5d/d72/ldb 0 2024-02-14T13:10:39.910 INFO:tasks.workunit.client.0.smithi012.stdout:6/624: rmdir d1/d1e/d66 39 2024-02-14T13:10:39.912 INFO:tasks.workunit.client.0.smithi012.stdout:1/678: truncate d6/d10/d22/d31/d5b/d5d/f6e 25332 0 2024-02-14T13:10:39.912 INFO:tasks.workunit.client.0.smithi012.stdout:1/679: chown d6/d10/d22/d31/d3e/fd0 9262526 1 2024-02-14T13:10:39.912 INFO:tasks.workunit.client.0.smithi012.stdout:1/680: truncate d6/d10/d22/d31/d5b/d5e/d65/fa6 4815312 0 2024-02-14T13:10:39.913 INFO:tasks.workunit.client.0.smithi012.stdout:6/625: mkdir d1/df/d16/d7c/d97/d82/da5/dc9 0 2024-02-14T13:10:39.914 INFO:tasks.workunit.client.0.smithi012.stdout:1/681: mkdir d6/d10/d22/d31/dd9 0 2024-02-14T13:10:39.916 INFO:tasks.workunit.client.0.smithi012.stdout:8/648: dwrite d9/dc/d14/d23/d97/d56/fa7 [0,4194304] 0 2024-02-14T13:10:39.916 INFO:tasks.workunit.client.0.smithi012.stdout:8/649: write d9/dc/d1b/f80 [738422,39384] 0 2024-02-14T13:10:39.917 INFO:tasks.workunit.client.0.smithi012.stdout:1/682: link d6/d10/d22/d31/d34/d58/f92 d6/d10/d22/d31/d34/d58/d61/fda 0 2024-02-14T13:10:39.917 INFO:tasks.workunit.client.0.smithi012.stdout:1/683: read d6/fc [1258878,61032] 0 2024-02-14T13:10:39.918 INFO:tasks.workunit.client.0.smithi012.stdout:1/684: dread d6/d10/d22/fb5 [0,4194304] 0 2024-02-14T13:10:39.918 INFO:tasks.workunit.client.0.smithi012.stdout:1/685: truncate d6/d10/d22/d31/d34/d58/d61/fda 4950400 0 2024-02-14T13:10:39.921 INFO:tasks.workunit.client.0.smithi012.stdout:8/650: mknod d9/dc/d38/d6a/cd3 0 2024-02-14T13:10:39.921 INFO:tasks.workunit.client.0.smithi012.stdout:8/651: fdatasync d9/dc/d14/d23/d97/d56/fa7 0 2024-02-14T13:10:39.921 INFO:tasks.workunit.client.0.smithi012.stdout:8/652: stat d9/dc/d14/d2e 0 2024-02-14T13:10:39.922 INFO:tasks.workunit.client.0.smithi012.stdout:1/686: mknod d6/d10/d22/d31/d34/d89/cdb 0 2024-02-14T13:10:39.923 INFO:tasks.workunit.client.0.smithi012.stdout:8/653: getdents d9/dc/d1b/d6b 0 2024-02-14T13:10:39.925 INFO:tasks.workunit.client.0.smithi012.stdout:1/687: link d6/d10/d22/d31/lad d6/d10/d22/d31/ldc 0 2024-02-14T13:10:39.926 INFO:tasks.workunit.client.0.smithi012.stdout:8/654: getdents d9/dc/d14/d23/d97/da1 0 2024-02-14T13:10:39.926 INFO:tasks.workunit.client.0.smithi012.stdout:8/655: chown d9/cf 56843 1 2024-02-14T13:10:39.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/688: stat d6/d10/d22/d31/d34/d89/c9e 0 2024-02-14T13:10:39.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/689: fsync d6/fe 0 2024-02-14T13:10:39.928 INFO:tasks.workunit.client.0.smithi012.stdout:8/656: rmdir d9/dc/d1b 39 2024-02-14T13:10:39.930 INFO:tasks.workunit.client.0.smithi012.stdout:8/657: creat d9/dc/d14/fd4 x:0 0 0 2024-02-14T13:10:39.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/658: write d9/dc/f2c [8630856,12321] 0 2024-02-14T13:10:39.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/659: read d9/dc/d14/d23/d97/d56/faf [287233,60736] 0 2024-02-14T13:10:39.938 INFO:tasks.workunit.client.0.smithi012.stdout:7/607: dwrite df/f30 [0,4194304] 0 2024-02-14T13:10:39.938 INFO:tasks.workunit.client.0.smithi012.stdout:6/626: dwrite d1/d1e/dc/d28/f4d [0,4194304] 0 2024-02-14T13:10:39.939 INFO:tasks.workunit.client.0.smithi012.stdout:8/660: mkdir d9/dc/d14/d23/d97/d56/d57/d5c/dcf/dd5 0 2024-02-14T13:10:39.940 INFO:tasks.workunit.client.0.smithi012.stdout:7/608: creat df/d27/fdc x:0 0 0 2024-02-14T13:10:39.940 INFO:tasks.workunit.client.0.smithi012.stdout:7/609: chown df/d27/l7f 26264945 1 2024-02-14T13:10:39.945 INFO:tasks.workunit.client.0.smithi012.stdout:8/661: unlink d9/dc/la4 0 2024-02-14T13:10:39.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/629: sync 2024-02-14T13:10:39.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/630: chown d9/dd/d30/fca 39 1 2024-02-14T13:10:39.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/631: write d9/d3f/dac/fdc [339245,74544] 0 2024-02-14T13:10:39.947 INFO:tasks.workunit.client.0.smithi012.stdout:3/632: mknod d9/d3f/da8/cde 0 2024-02-14T13:10:39.948 INFO:tasks.workunit.client.0.smithi012.stdout:3/633: truncate d9/dd/f17 1800397 0 2024-02-14T13:10:39.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/634: mknod d9/dcd/cdf 0 2024-02-14T13:10:39.950 INFO:tasks.workunit.client.0.smithi012.stdout:6/627: read d1/d1e/d66/f88 [340152,91128] 0 2024-02-14T13:10:39.950 INFO:tasks.workunit.client.0.smithi012.stdout:6/628: chown d1/d1e/d1b/d21/d69/fa9 3407 1 2024-02-14T13:10:39.950 INFO:tasks.workunit.client.0.smithi012.stdout:7/610: write df/d24/f38 [1551021,60564] 0 2024-02-14T13:10:39.950 INFO:tasks.workunit.client.0.smithi012.stdout:7/611: dread - df/d27/d4b/d6b/fc2 zero size 2024-02-14T13:10:39.954 INFO:tasks.workunit.client.0.smithi012.stdout:3/635: write d9/dd/f17 [103079,127904] 0 2024-02-14T13:10:39.959 INFO:tasks.workunit.client.0.smithi012.stdout:8/662: dwrite d9/dc/d14/d23/d97/d56/d57/d5c/f61 [0,4194304] 0 2024-02-14T13:10:39.959 INFO:tasks.workunit.client.0.smithi012.stdout:8/663: dread - d9/dc/d14/fbc zero size 2024-02-14T13:10:39.961 INFO:tasks.workunit.client.0.smithi012.stdout:8/664: creat d9/dc/d14/d23/d97/d56/d57/fd6 x:0 0 0 2024-02-14T13:10:39.961 INFO:tasks.workunit.client.0.smithi012.stdout:8/665: fsync d9/dc/d38/fb8 0 2024-02-14T13:10:39.966 INFO:tasks.workunit.client.0.smithi012.stdout:8/666: dread d9/dc/d1b/f21 [4194304,4194304] 0 2024-02-14T13:10:39.967 INFO:tasks.workunit.client.0.smithi012.stdout:8/667: symlink d9/db9/ld7 0 2024-02-14T13:10:39.968 INFO:tasks.workunit.client.0.smithi012.stdout:8/668: mknod d9/dc/d14/d23/d97/d56/d57/d5c/dcf/cd8 0 2024-02-14T13:10:39.970 INFO:tasks.workunit.client.0.smithi012.stdout:8/669: dread d9/dc/d14/d23/d97/da3/fa8 [0,4194304] 0 2024-02-14T13:10:39.971 INFO:tasks.workunit.client.0.smithi012.stdout:8/670: creat d9/dc/d38/d6a/dab/fd9 x:0 0 0 2024-02-14T13:10:39.971 INFO:tasks.workunit.client.0.smithi012.stdout:7/612: dwrite df/f40 [0,4194304] 0 2024-02-14T13:10:39.972 INFO:tasks.workunit.client.0.smithi012.stdout:8/671: mkdir d9/dc/d14/d23/d97/d56/d57/dda 0 2024-02-14T13:10:39.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/672: creat d9/dc/d38/fdb x:0 0 0 2024-02-14T13:10:39.974 INFO:tasks.workunit.client.0.smithi012.stdout:8/673: chown d9/c76 3320 1 2024-02-14T13:10:39.975 INFO:tasks.workunit.client.0.smithi012.stdout:8/674: creat d9/dc/d38/d6a/fdc x:0 0 0 2024-02-14T13:10:39.976 INFO:tasks.workunit.client.0.smithi012.stdout:8/675: truncate d9/dc/d14/d23/d97/f59 1573310 0 2024-02-14T13:10:39.980 INFO:tasks.workunit.client.0.smithi012.stdout:6/629: dwrite d1/fb3 [0,4194304] 0 2024-02-14T13:10:39.980 INFO:tasks.workunit.client.0.smithi012.stdout:6/630: truncate d1/df/d16/d7c/d97/d82/f9c 362292 0 2024-02-14T13:10:39.980 INFO:tasks.workunit.client.0.smithi012.stdout:7/613: write df/d27/d4b/d5a/f9d [2492561,85735] 0 2024-02-14T13:10:39.981 INFO:tasks.workunit.client.0.smithi012.stdout:3/636: dwrite d9/f35 [0,4194304] 0 2024-02-14T13:10:39.981 INFO:tasks.workunit.client.0.smithi012.stdout:8/676: dread d9/dc/d14/d23/d97/d56/d57/d5c/dcf/f8a [0,4194304] 0 2024-02-14T13:10:39.983 INFO:tasks.workunit.client.0.smithi012.stdout:6/631: rename d1/d1e/dc/d38/l41 to d1/d1e/d1b/lca 0 2024-02-14T13:10:39.983 INFO:tasks.workunit.client.0.smithi012.stdout:6/632: write d1/df/d24/f8f [684590,26050] 0 2024-02-14T13:10:39.983 INFO:tasks.workunit.client.0.smithi012.stdout:6/633: truncate d1/d1e/d1b/d21/f35 1690046 0 2024-02-14T13:10:39.983 INFO:tasks.workunit.client.0.smithi012.stdout:6/634: chown d1/d1e/d1b/d21/d78/l7f 249 1 2024-02-14T13:10:39.984 INFO:tasks.workunit.client.0.smithi012.stdout:6/635: read d1/d1e/d1b/d21/d78/fa4 [53016,127552] 0 2024-02-14T13:10:39.985 INFO:tasks.workunit.client.0.smithi012.stdout:6/636: dread d1/df/d16/d7c/d97/d82/f9c [0,4194304] 0 2024-02-14T13:10:39.991 INFO:tasks.workunit.client.0.smithi012.stdout:3/637: mknod d9/dd/d30/d44/d66/db3/ce0 0 2024-02-14T13:10:39.992 INFO:tasks.workunit.client.0.smithi012.stdout:6/637: unlink d1/df/d24/d3f/d56/cad 0 2024-02-14T13:10:39.992 INFO:tasks.workunit.client.0.smithi012.stdout:7/614: dwrite df/d24/d9e/fa3 [0,4194304] 0 2024-02-14T13:10:39.992 INFO:tasks.workunit.client.0.smithi012.stdout:7/615: write df/d2d/d5d/d72/d8a/dcd/fce [35025,20910] 0 2024-02-14T13:10:39.992 INFO:tasks.workunit.client.0.smithi012.stdout:7/616: write df/d24/f38 [4608833,118692] 0 2024-02-14T13:10:39.993 INFO:tasks.workunit.client.0.smithi012.stdout:8/677: write d9/dc/d14/d23/d97/d56/d57/d7c/f99 [3199486,13005] 0 2024-02-14T13:10:39.993 INFO:tasks.workunit.client.0.smithi012.stdout:3/638: truncate d9/dd/de/d58/d65/d6c/f7c 3387472 0 2024-02-14T13:10:39.996 INFO:tasks.workunit.client.0.smithi012.stdout:7/617: creat df/d27/d4b/d6b/d6d/d85/fdd x:0 0 0 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:1/690: sync 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:5/757: sync 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:2/746: sync 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:9/745: sync 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:9/746: fdatasync da/dd/d57/d59/d73/db6/df1/fbb 0 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:8/678: creat d9/dc/d14/d23/d62/fdd x:0 0 0 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:4/652: sync 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:0/727: sync 2024-02-14T13:10:39.998 INFO:tasks.workunit.client.0.smithi012.stdout:0/728: dread - d10/d14/d41/d52/d78/d8c/fc5 zero size 2024-02-14T13:10:39.999 INFO:tasks.workunit.client.0.smithi012.stdout:3/639: mkdir d9/dd/d30/d34/d78/de1 0 2024-02-14T13:10:39.999 INFO:tasks.workunit.client.0.smithi012.stdout:3/640: truncate d9/d8e/f9b 2061397 0 2024-02-14T13:10:40.001 INFO:tasks.workunit.client.0.smithi012.stdout:7/618: unlink df/f15 0 2024-02-14T13:10:40.001 INFO:tasks.workunit.client.0.smithi012.stdout:7/619: fsync df/f26 0 2024-02-14T13:10:40.001 INFO:tasks.workunit.client.0.smithi012.stdout:7/620: chown df/d2d/d82/d88/d90/fc9 5022 1 2024-02-14T13:10:40.001 INFO:tasks.workunit.client.0.smithi012.stdout:7/621: truncate df/d2d/d5d/d72/d8a/fc6 1653 0 2024-02-14T13:10:40.001 INFO:tasks.workunit.client.0.smithi012.stdout:7/622: write df/d2d/d82/f97 [433513,2363] 0 2024-02-14T13:10:40.002 INFO:tasks.workunit.client.0.smithi012.stdout:7/623: write df/d27/d4b/d8d/fa0 [4993213,57763] 0 2024-02-14T13:10:40.002 INFO:tasks.workunit.client.0.smithi012.stdout:1/691: rename d6/d10/d22/d44/f48 to d6/d10/d22/d31/fdd 0 2024-02-14T13:10:40.003 INFO:tasks.workunit.client.0.smithi012.stdout:2/747: creat d0/d1a/de4/d50/d68/f107 x:0 0 0 2024-02-14T13:10:40.005 INFO:tasks.workunit.client.0.smithi012.stdout:9/747: link da/dd/d19/df3/lac da/dd/d38/d7e/d91/da6/lf9 0 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:0/729: getdents d10/d14/d41/d61 0 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:0/730: truncate d10/d14/d41/d52/d78/d8c/f4e 4196596 0 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:4/653: read d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/fab [1556797,110090] 0 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:4/654: dread - d0/d10/d28/d4f/d6b/fdd zero size 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:4/655: truncate d0/d10/fe5 983400 0 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:4/656: write d0/d10/d28/d4f/d6b/d8f/d56/fe4 [637856,49445] 0 2024-02-14T13:10:40.007 INFO:tasks.workunit.client.0.smithi012.stdout:4/657: getdents d0/d10/d28/d4f/dc7 0 2024-02-14T13:10:40.009 INFO:tasks.workunit.client.0.smithi012.stdout:1/692: unlink d6/d10/d22/d31/d3e/f77 0 2024-02-14T13:10:40.010 INFO:tasks.workunit.client.0.smithi012.stdout:6/638: dwrite d1/df/d24/d3f/d56/d93/fc6 [0,4194304] 0 2024-02-14T13:10:40.010 INFO:tasks.workunit.client.0.smithi012.stdout:5/758: rename dc/d2f/f39 to dc/d2f/d94/fe9 0 2024-02-14T13:10:40.010 INFO:tasks.workunit.client.0.smithi012.stdout:5/759: chown dc/d2f/d40/f45 0 1 2024-02-14T13:10:40.010 INFO:tasks.workunit.client.0.smithi012.stdout:5/760: write dc/f33 [495492,2775] 0 2024-02-14T13:10:40.011 INFO:tasks.workunit.client.0.smithi012.stdout:2/748: truncate d0/d6/f81 273500 0 2024-02-14T13:10:40.016 INFO:tasks.workunit.client.0.smithi012.stdout:0/731: link d10/d14/d20/f69 d10/d14/d41/d61/d74/fef 0 2024-02-14T13:10:40.017 INFO:tasks.workunit.client.0.smithi012.stdout:4/658: truncate d0/d10/d28/d4f/d6b/d8f/d56/fad 3219923 0 2024-02-14T13:10:40.017 INFO:tasks.workunit.client.0.smithi012.stdout:4/659: dread - d0/d10/d28/d4f/d6b/d8f/d56/d8c/fb9 zero size 2024-02-14T13:10:40.021 INFO:tasks.workunit.client.0.smithi012.stdout:6/639: symlink d1/d1e/dc/d28/d7b/lcb 0 2024-02-14T13:10:40.022 INFO:tasks.workunit.client.0.smithi012.stdout:3/641: dwrite d9/dd/d30/d44/d66/db3/db9/fda [0,4194304] 0 2024-02-14T13:10:40.023 INFO:tasks.workunit.client.0.smithi012.stdout:6/640: dread d1/df/d16/f59 [0,4194304] 0 2024-02-14T13:10:40.024 INFO:tasks.workunit.client.0.smithi012.stdout:8/679: rename d9/dc/d14/d23/d97 to d9/dc/d14/d2e/dde 0 2024-02-14T13:10:40.025 INFO:tasks.workunit.client.0.smithi012.stdout:5/761: creat dc/d17/d20/d4c/d58/dda/fea x:0 0 0 2024-02-14T13:10:40.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/748: rmdir da/dd/d38/d7e/d91/da6 39 2024-02-14T13:10:40.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/749: write f2 [2021511,81270] 0 2024-02-14T13:10:40.026 INFO:tasks.workunit.client.0.smithi012.stdout:2/749: rmdir d0/d1a/de4/d15/d57/d6d 39 2024-02-14T13:10:40.027 INFO:tasks.workunit.client.0.smithi012.stdout:2/750: readlink d0/l4 0 2024-02-14T13:10:40.029 INFO:tasks.workunit.client.0.smithi012.stdout:3/642: mkdir d9/d13/daa/de2 0 2024-02-14T13:10:40.029 INFO:tasks.workunit.client.0.smithi012.stdout:3/643: fdatasync d9/dc4/fdd 0 2024-02-14T13:10:40.029 INFO:tasks.workunit.client.0.smithi012.stdout:3/644: write d9/d3f/f4c [1168093,123255] 0 2024-02-14T13:10:40.030 INFO:tasks.workunit.client.0.smithi012.stdout:2/751: dread d0/d1a/f47 [0,4194304] 0 2024-02-14T13:10:40.030 INFO:tasks.workunit.client.0.smithi012.stdout:2/752: chown d0/f2f 4918 1 2024-02-14T13:10:40.030 INFO:tasks.workunit.client.0.smithi012.stdout:2/753: fdatasync d0/d8/d11/d33/f38 0 2024-02-14T13:10:40.030 INFO:tasks.workunit.client.0.smithi012.stdout:6/641: getdents d1/df/d24/d3f/d56/d93/d95 0 2024-02-14T13:10:40.032 INFO:tasks.workunit.client.0.smithi012.stdout:7/624: rename df/d24/d56/cc0 to df/db1/cde 0 2024-02-14T13:10:40.034 INFO:tasks.workunit.client.0.smithi012.stdout:1/693: dwrite d6/d10/d22/d31/d3e/d71/f95 [4194304,4194304] 0 2024-02-14T13:10:40.034 INFO:tasks.workunit.client.0.smithi012.stdout:1/694: write d6/d35/f67 [1370395,90652] 0 2024-02-14T13:10:40.034 INFO:tasks.workunit.client.0.smithi012.stdout:1/695: chown d6/d10/d22/d31/d5b/d5d/f1a 1744896486 1 2024-02-14T13:10:40.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/732: symlink d10/d14/lf0 0 2024-02-14T13:10:40.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/733: fsync d10/d14/d41/d52/d78/d8c/dce/fdd 0 2024-02-14T13:10:40.038 INFO:tasks.workunit.client.0.smithi012.stdout:4/660: mkdir d0/df0 0 2024-02-14T13:10:40.038 INFO:tasks.workunit.client.0.smithi012.stdout:4/661: readlink d0/d10/d1f/d71/l7e 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:5/762: write dc/d17/d20/f22 [3115343,77677] 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:7/625: read df/d27/fa2 [408550,97903] 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:7/626: write df/d24/d9e/fd9 [1042103,121932] 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:9/750: write da/dd/d57/d59/d73/db6/df1/f9e [1951766,66272] 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:9/751: readlink da/l10 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:3/645: rmdir d9/d3f/d73 39 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:3/646: truncate d9/dc4/fc7 286626 0 2024-02-14T13:10:40.039 INFO:tasks.workunit.client.0.smithi012.stdout:3/647: readlink d9/dd/d30/d44/d66/db3/db9/lba 0 2024-02-14T13:10:40.041 INFO:tasks.workunit.client.0.smithi012.stdout:2/754: truncate d0/d1a/f49 4125976 0 2024-02-14T13:10:40.041 INFO:tasks.workunit.client.0.smithi012.stdout:2/755: chown d0/d6/de/l41 9270216 1 2024-02-14T13:10:40.042 INFO:tasks.workunit.client.0.smithi012.stdout:6/642: creat d1/df/fcc x:0 0 0 2024-02-14T13:10:40.044 INFO:tasks.workunit.client.0.smithi012.stdout:8/680: mkdir d9/dc/d14/d23/ddf 0 2024-02-14T13:10:40.048 INFO:tasks.workunit.client.0.smithi012.stdout:4/662: rename d0/d10/d28/d4f/d6b/d83/d17/d5f/c9f to d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/cf1 0 2024-02-14T13:10:40.050 INFO:tasks.workunit.client.0.smithi012.stdout:7/627: rmdir df/d36/d67 39 2024-02-14T13:10:40.050 INFO:tasks.workunit.client.0.smithi012.stdout:5/763: read dc/d17/d20/d4c/d58/f83 [2451675,92330] 0 2024-02-14T13:10:40.051 INFO:tasks.workunit.client.0.smithi012.stdout:2/756: dread d0/d8/f31 [8388608,4194304] 0 2024-02-14T13:10:40.052 INFO:tasks.workunit.client.0.smithi012.stdout:9/752: mknod da/dd/d19/d30/d9d/dce/cfa 0 2024-02-14T13:10:40.054 INFO:tasks.workunit.client.0.smithi012.stdout:3/648: creat d9/dd/de/fe3 x:0 0 0 2024-02-14T13:10:40.054 INFO:tasks.workunit.client.0.smithi012.stdout:5/764: dread dc/d47/d69/f9b [0,4194304] 0 2024-02-14T13:10:40.061 INFO:tasks.workunit.client.0.smithi012.stdout:3/649: dread d9/dd/d30/d34/d78/fb1 [0,4194304] 0 2024-02-14T13:10:40.061 INFO:tasks.workunit.client.0.smithi012.stdout:3/650: write d9/d18/f4d [1127075,84379] 0 2024-02-14T13:10:40.062 INFO:tasks.workunit.client.0.smithi012.stdout:0/734: dwrite d10/d14/d41/d52/d78/d8c/fc5 [0,4194304] 0 2024-02-14T13:10:40.066 INFO:tasks.workunit.client.0.smithi012.stdout:4/663: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/fa0 [0,4194304] 0 2024-02-14T13:10:40.066 INFO:tasks.workunit.client.0.smithi012.stdout:4/664: chown d0/d10/d1f/fa7 0 1 2024-02-14T13:10:40.066 INFO:tasks.workunit.client.0.smithi012.stdout:4/665: write d0/d10/d28/d4f/d6b/d83/d17/d5f/f61 [558022,83974] 0 2024-02-14T13:10:40.066 INFO:tasks.workunit.client.0.smithi012.stdout:4/666: chown d0/d10/d28/d4f/d6b/d83/d17/d5f/dcc 2217015 1 2024-02-14T13:10:40.067 INFO:tasks.workunit.client.0.smithi012.stdout:6/643: creat d1/df/d24/d5f/fcd x:0 0 0 2024-02-14T13:10:40.069 INFO:tasks.workunit.client.0.smithi012.stdout:2/757: dwrite d0/d6/de/f4e [0,4194304] 0 2024-02-14T13:10:40.069 INFO:tasks.workunit.client.0.smithi012.stdout:2/758: truncate d0/d6/de/d7b/f61 4109341 0 2024-02-14T13:10:40.069 INFO:tasks.workunit.client.0.smithi012.stdout:8/681: rename d9/dc/d14/d2e/dde/d56/d57/d7c/fcc to d9/dc/d1b/d6b/fe0 0 2024-02-14T13:10:40.071 INFO:tasks.workunit.client.0.smithi012.stdout:7/628: symlink df/d2d/d82/d88/d90/ldf 0 2024-02-14T13:10:40.072 INFO:tasks.workunit.client.0.smithi012.stdout:5/765: creat dc/d47/d69/feb x:0 0 0 2024-02-14T13:10:40.074 INFO:tasks.workunit.client.0.smithi012.stdout:3/651: symlink d9/d13/le4 0 2024-02-14T13:10:40.074 INFO:tasks.workunit.client.0.smithi012.stdout:3/652: stat d9/dd/de/d58/f64 0 2024-02-14T13:10:40.074 INFO:tasks.workunit.client.0.smithi012.stdout:3/653: chown d9/dc4/fdd 1997568 1 2024-02-14T13:10:40.076 INFO:tasks.workunit.client.0.smithi012.stdout:0/735: getdents d10/d14/d1b 0 2024-02-14T13:10:40.078 INFO:tasks.workunit.client.0.smithi012.stdout:2/759: symlink d0/d8/d11/d35/l108 0 2024-02-14T13:10:40.081 INFO:tasks.workunit.client.0.smithi012.stdout:6/644: rename d1/df/d24/d5f/c91 to d1/df/d24/d3f/d56/da3/cce 0 2024-02-14T13:10:40.083 INFO:tasks.workunit.client.0.smithi012.stdout:8/682: mkdir d9/dc/d14/d2e/dde/d56/d57/d92/de1 0 2024-02-14T13:10:40.083 INFO:tasks.workunit.client.0.smithi012.stdout:8/683: fsync d9/dc/d38/d6a/fb4 0 2024-02-14T13:10:40.083 INFO:tasks.workunit.client.0.smithi012.stdout:8/684: write d9/dc/d14/fbc [351342,8273] 0 2024-02-14T13:10:40.085 INFO:tasks.workunit.client.0.smithi012.stdout:7/629: rmdir df/d27/d4b/d5a/dc8 0 2024-02-14T13:10:40.085 INFO:tasks.workunit.client.0.smithi012.stdout:7/630: truncate df/d2d/d82/d88/db2/fb5 4383230 0 2024-02-14T13:10:40.086 INFO:tasks.workunit.client.0.smithi012.stdout:9/753: mkdir da/dd/d57/dfb 0 2024-02-14T13:10:40.087 INFO:tasks.workunit.client.0.smithi012.stdout:5/766: mkdir dc/dec 0 2024-02-14T13:10:40.087 INFO:tasks.workunit.client.0.smithi012.stdout:4/667: dwrite d0/d10/d28/d4f/d6b/d83/fec [0,4194304] 0 2024-02-14T13:10:40.089 INFO:tasks.workunit.client.0.smithi012.stdout:0/736: creat d10/d14/d41/ff1 x:0 0 0 2024-02-14T13:10:40.089 INFO:tasks.workunit.client.0.smithi012.stdout:0/737: dread - d10/f57 zero size 2024-02-14T13:10:40.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/645: creat d1/df/d24/d5f/da0/fcf x:0 0 0 2024-02-14T13:10:40.090 INFO:tasks.workunit.client.0.smithi012.stdout:6/646: chown d1/d1e/d66/f88 1629300 1 2024-02-14T13:10:40.093 INFO:tasks.workunit.client.0.smithi012.stdout:8/685: creat d9/dc/d38/d6a/dab/fe2 x:0 0 0 2024-02-14T13:10:40.094 INFO:tasks.workunit.client.0.smithi012.stdout:7/631: creat df/d27/d4b/d6b/fe0 x:0 0 0 2024-02-14T13:10:40.095 INFO:tasks.workunit.client.0.smithi012.stdout:9/754: rmdir da/dd/d19/df3/d85/d48 39 2024-02-14T13:10:40.095 INFO:tasks.workunit.client.0.smithi012.stdout:4/668: write d0/d10/d28/d4f/d6b/d8f/d56/fad [2361717,4584] 0 2024-02-14T13:10:40.097 INFO:tasks.workunit.client.0.smithi012.stdout:3/654: dwrite d9/dc4/fdd [0,4194304] 0 2024-02-14T13:10:40.098 INFO:tasks.workunit.client.0.smithi012.stdout:3/655: readlink d9/dd/d30/l76 0 2024-02-14T13:10:40.102 INFO:tasks.workunit.client.0.smithi012.stdout:6/647: creat d1/df/d24/d3f/d56/d93/d95/fd0 x:0 0 0 2024-02-14T13:10:40.102 INFO:tasks.workunit.client.0.smithi012.stdout:4/669: truncate d0/d10/d28/d4f/d6b/d8f/d56/d8c/f9d 841505 0 2024-02-14T13:10:40.104 INFO:tasks.workunit.client.0.smithi012.stdout:3/656: dread d9/d3f/d4e/f6d [0,4194304] 0 2024-02-14T13:10:40.106 INFO:tasks.workunit.client.0.smithi012.stdout:6/648: link d1/df/d50/db4/cc4 d1/df/d16/cd1 0 2024-02-14T13:10:40.106 INFO:tasks.workunit.client.0.smithi012.stdout:3/657: link d9/dc4/fdd d9/d3f/d88/fe5 0 2024-02-14T13:10:40.107 INFO:tasks.workunit.client.0.smithi012.stdout:8/686: dread d9/fbf [0,4194304] 0 2024-02-14T13:10:40.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/687: creat d9/fe3 x:0 0 0 2024-02-14T13:10:40.109 INFO:tasks.workunit.client.0.smithi012.stdout:8/688: chown l5 4670896 1 2024-02-14T13:10:40.113 INFO:tasks.workunit.client.0.smithi012.stdout:5/767: dwrite dc/d47/f61 [0,4194304] 0 2024-02-14T13:10:40.117 INFO:tasks.workunit.client.0.smithi012.stdout:5/768: rename dc/d47/d59/d6a to dc/d17/ded 0 2024-02-14T13:10:40.117 INFO:tasks.workunit.client.0.smithi012.stdout:5/769: write dc/d17/ded/fa2 [765042,107123] 0 2024-02-14T13:10:40.123 INFO:tasks.workunit.client.0.smithi012.stdout:0/738: dwrite d10/d14/d41/d61/d74/fe7 [0,4194304] 0 2024-02-14T13:10:40.125 INFO:tasks.workunit.client.0.smithi012.stdout:0/739: stat c8 0 2024-02-14T13:10:40.127 INFO:tasks.workunit.client.0.smithi012.stdout:6/649: dread d1/d1e/d1b/d21/f32 [0,4194304] 0 2024-02-14T13:10:40.130 INFO:tasks.workunit.client.0.smithi012.stdout:6/650: unlink d1/df/d24/d3f/d56/l6b 0 2024-02-14T13:10:40.133 INFO:tasks.workunit.client.0.smithi012.stdout:6/651: symlink d1/df/d16/d7c/d97/d82/da5/ld2 0 2024-02-14T13:10:40.133 INFO:tasks.workunit.client.0.smithi012.stdout:6/652: readlink d1/d1e/d1b/lca 0 2024-02-14T13:10:40.133 INFO:tasks.workunit.client.0.smithi012.stdout:7/632: dwrite df/d27/d4b/d5a/f9d [0,4194304] 0 2024-02-14T13:10:40.135 INFO:tasks.workunit.client.0.smithi012.stdout:6/653: symlink d1/df/d24/d3f/d56/da3/ld3 0 2024-02-14T13:10:40.136 INFO:tasks.workunit.client.0.smithi012.stdout:7/633: rename df/d2d/c45 to df/d2d/d82/d88/d90/ce1 0 2024-02-14T13:10:40.137 INFO:tasks.workunit.client.0.smithi012.stdout:7/634: dread df/d2d/d5d/d72/d8a/fc6 [0,4194304] 0 2024-02-14T13:10:40.138 INFO:tasks.workunit.client.0.smithi012.stdout:7/635: fsync df/f42 0 2024-02-14T13:10:40.138 INFO:tasks.workunit.client.0.smithi012.stdout:7/636: fsync df/f59 0 2024-02-14T13:10:40.138 INFO:tasks.workunit.client.0.smithi012.stdout:7/637: chown df/d27/c79 32661273 1 2024-02-14T13:10:40.138 INFO:tasks.workunit.client.0.smithi012.stdout:7/638: write df/d27/fdc [982404,51193] 0 2024-02-14T13:10:40.142 INFO:tasks.workunit.client.0.smithi012.stdout:9/755: dwrite da/f44 [0,4194304] 0 2024-02-14T13:10:40.143 INFO:tasks.workunit.client.0.smithi012.stdout:5/770: dwrite dc/d17/d20/f2b [0,4194304] 0 2024-02-14T13:10:40.143 INFO:tasks.workunit.client.0.smithi012.stdout:5/771: write dc/d17/d20/d4c/d58/f68 [5098056,107250] 0 2024-02-14T13:10:40.143 INFO:tasks.workunit.client.0.smithi012.stdout:9/756: mkdir da/dd/d18/dfc 0 2024-02-14T13:10:40.146 INFO:tasks.workunit.client.0.smithi012.stdout:6/654: write d1/d1e/dc/f8d [3472678,127911] 0 2024-02-14T13:10:40.148 INFO:tasks.workunit.client.0.smithi012.stdout:6/655: mkdir d1/d1e/dc/d43/dd4 0 2024-02-14T13:10:40.148 INFO:tasks.workunit.client.0.smithi012.stdout:7/639: dread df/d27/f28 [4194304,4194304] 0 2024-02-14T13:10:40.149 INFO:tasks.workunit.client.0.smithi012.stdout:6/656: symlink d1/df/d24/daf/ld5 0 2024-02-14T13:10:40.150 INFO:tasks.workunit.client.0.smithi012.stdout:7/640: creat df/d27/d4b/d8d/fe2 x:0 0 0 2024-02-14T13:10:40.151 INFO:tasks.workunit.client.0.smithi012.stdout:6/657: creat d1/df/fd6 x:0 0 0 2024-02-14T13:10:40.151 INFO:tasks.workunit.client.0.smithi012.stdout:6/658: write d1/df/d24/daf/f53 [489710,128884] 0 2024-02-14T13:10:40.151 INFO:tasks.workunit.client.0.smithi012.stdout:6/659: read d1/d1e/d1b/da8/f68 [67303,29544] 0 2024-02-14T13:10:40.151 INFO:tasks.workunit.client.0.smithi012.stdout:7/641: creat df/d2d/d82/d88/d90/fe3 x:0 0 0 2024-02-14T13:10:40.155 INFO:tasks.workunit.client.0.smithi012.stdout:7/642: rename df/d36/f7d to df/d27/d4b/d6b/d6d/d85/db8/fe4 0 2024-02-14T13:10:40.156 INFO:tasks.workunit.client.0.smithi012.stdout:7/643: rmdir df/d2d/d5d/d72/d8a 39 2024-02-14T13:10:40.157 INFO:tasks.workunit.client.0.smithi012.stdout:7/644: creat df/d27/d4b/d8d/fe5 x:0 0 0 2024-02-14T13:10:40.158 INFO:tasks.workunit.client.0.smithi012.stdout:5/772: dwrite dc/d2f/d89/f8b [4194304,4194304] 0 2024-02-14T13:10:40.159 INFO:tasks.workunit.client.0.smithi012.stdout:7/645: rename df/d24/d56/la1 to df/d24/d9e/le6 0 2024-02-14T13:10:40.160 INFO:tasks.workunit.client.0.smithi012.stdout:5/773: symlink dc/dec/lee 0 2024-02-14T13:10:40.161 INFO:tasks.workunit.client.0.smithi012.stdout:5/774: creat dc/d17/d20/d4c/fef x:0 0 0 2024-02-14T13:10:40.163 INFO:tasks.workunit.client.0.smithi012.stdout:8/689: dwrite d9/dc/d14/d2e/dde/d56/d57/d5c/dcf/f87 [0,4194304] 0 2024-02-14T13:10:40.163 INFO:tasks.workunit.client.0.smithi012.stdout:4/670: dwrite d0/d10/d28/da9/d86/db5/fc9 [0,4194304] 0 2024-02-14T13:10:40.165 INFO:tasks.workunit.client.0.smithi012.stdout:3/658: dwrite d9/d3f/d73/f86 [0,4194304] 0 2024-02-14T13:10:40.165 INFO:tasks.workunit.client.0.smithi012.stdout:0/740: dwrite d10/d14/d41/d61/d74/f90 [0,4194304] 0 2024-02-14T13:10:40.165 INFO:tasks.workunit.client.0.smithi012.stdout:0/741: fsync d10/d14/d41/d52/d99/d9b/fab 0 2024-02-14T13:10:40.165 INFO:tasks.workunit.client.0.smithi012.stdout:8/690: symlink d9/dc/d14/le4 0 2024-02-14T13:10:40.165 INFO:tasks.workunit.client.0.smithi012.stdout:8/691: chown d9/dc/d14 4929 1 2024-02-14T13:10:40.168 INFO:tasks.workunit.client.0.smithi012.stdout:9/757: dwrite da/dd/d57/fd8 [0,4194304] 0 2024-02-14T13:10:40.169 INFO:tasks.workunit.client.0.smithi012.stdout:7/646: write df/d24/f87 [942010,41250] 0 2024-02-14T13:10:40.176 INFO:tasks.workunit.client.0.smithi012.stdout:6/660: getdents d1/d1e/dc/d43 0 2024-02-14T13:10:40.176 INFO:tasks.workunit.client.0.smithi012.stdout:6/661: fdatasync d1/d1e/d1b/d21/d78/fa4 0 2024-02-14T13:10:40.180 INFO:tasks.workunit.client.0.smithi012.stdout:4/671: dread d0/d10/d28/d4f/d6b/d83/fec [0,4194304] 0 2024-02-14T13:10:40.180 INFO:tasks.workunit.client.0.smithi012.stdout:3/659: dread d9/d3f/d73/f86 [0,4194304] 0 2024-02-14T13:10:40.184 INFO:tasks.workunit.client.0.smithi012.stdout:5/775: dwrite dc/d2f/d94/fe9 [0,4194304] 0 2024-02-14T13:10:40.186 INFO:tasks.workunit.client.0.smithi012.stdout:8/692: mknod d9/dc/d14/d2e/dde/d56/d57/d92/ce5 0 2024-02-14T13:10:40.191 INFO:tasks.workunit.client.0.smithi012.stdout:9/758: dwrite da/dd/d38/ff2 [0,4194304] 0 2024-02-14T13:10:40.191 INFO:tasks.workunit.client.0.smithi012.stdout:6/662: rename d1/d1e/dc/d38/l8b to d1/df/d50/ld7 0 2024-02-14T13:10:40.191 INFO:tasks.workunit.client.0.smithi012.stdout:8/693: rename d9/dc/d14/d2e/dde/da1/dba to d9/dc/d14/d2e/dde/da1/dba/de6 22 2024-02-14T13:10:40.191 INFO:tasks.workunit.client.0.smithi012.stdout:6/663: dread - d1/df/d24/d3f/d56/da3/fc8 zero size 2024-02-14T13:10:40.192 INFO:tasks.workunit.client.0.smithi012.stdout:4/672: creat d0/de1/de8/dd9/ff2 x:0 0 0 2024-02-14T13:10:40.193 INFO:tasks.workunit.client.0.smithi012.stdout:3/660: symlink d9/d3f/d88/dc0/le6 0 2024-02-14T13:10:40.195 INFO:tasks.workunit.client.0.smithi012.stdout:5/776: mkdir dc/d47/d6e/df0 0 2024-02-14T13:10:40.195 INFO:tasks.workunit.client.0.smithi012.stdout:5/777: read - dc/d2f/d40/d53/d97/fbe zero size 2024-02-14T13:10:40.195 INFO:tasks.workunit.client.0.smithi012.stdout:5/778: stat dc/d47/f61 0 2024-02-14T13:10:40.196 INFO:tasks.workunit.client.0.smithi012.stdout:5/779: write dc/d2f/d40/d53/d97/d98/fb0 [1030236,12495] 0 2024-02-14T13:10:40.199 INFO:tasks.workunit.client.0.smithi012.stdout:6/664: dread d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:40.199 INFO:tasks.workunit.client.0.smithi012.stdout:9/759: rename da/dd/d38/d65/lf6 to da/d4f/lfd 0 2024-02-14T13:10:40.201 INFO:tasks.workunit.client.0.smithi012.stdout:9/760: dread da/d33/d63/f76 [0,4194304] 0 2024-02-14T13:10:40.201 INFO:tasks.workunit.client.0.smithi012.stdout:9/761: chown da/dd/d57/d59/fc6 30 1 2024-02-14T13:10:40.201 INFO:tasks.workunit.client.0.smithi012.stdout:4/673: symlink d0/d10/d1f/d71/lf3 0 2024-02-14T13:10:40.202 INFO:tasks.workunit.client.0.smithi012.stdout:3/661: creat d9/d8e/dc9/fe7 x:0 0 0 2024-02-14T13:10:40.202 INFO:tasks.workunit.client.0.smithi012.stdout:3/662: write d9/d13/f2b [3359125,96479] 0 2024-02-14T13:10:40.203 INFO:tasks.workunit.client.0.smithi012.stdout:6/665: creat d1/df/d24/daf/fd8 x:0 0 0 2024-02-14T13:10:40.203 INFO:tasks.workunit.client.0.smithi012.stdout:1/696: sync 2024-02-14T13:10:40.203 INFO:tasks.workunit.client.0.smithi012.stdout:7/647: dwrite df/d27/d4b/d8d/fe2 [0,4194304] 0 2024-02-14T13:10:40.204 INFO:tasks.workunit.client.0.smithi012.stdout:5/780: rename dc/d2f/d94/fe9 to dc/d2f/d70/dbc/dd8/ff1 0 2024-02-14T13:10:40.205 INFO:tasks.workunit.client.0.smithi012.stdout:4/674: rmdir d0/d10/d28/d4f/d6b/de7 39 2024-02-14T13:10:40.205 INFO:tasks.workunit.client.0.smithi012.stdout:4/675: readlink d0/d10/d1f/l5a 0 2024-02-14T13:10:40.205 INFO:tasks.workunit.client.0.smithi012.stdout:4/676: dread - d0/d10/d28/da9/fd3 zero size 2024-02-14T13:10:40.205 INFO:tasks.workunit.client.0.smithi012.stdout:2/760: sync 2024-02-14T13:10:40.206 INFO:tasks.workunit.client.0.smithi012.stdout:2/761: write d0/d20/f23 [1405187,60438] 0 2024-02-14T13:10:40.206 INFO:tasks.workunit.client.0.smithi012.stdout:3/663: creat d9/dd/d30/d44/d66/db3/fe8 x:0 0 0 2024-02-14T13:10:40.206 INFO:tasks.workunit.client.0.smithi012.stdout:3/664: fdatasync d9/d13/f20 0 2024-02-14T13:10:40.207 INFO:tasks.workunit.client.0.smithi012.stdout:6/666: getdents d1/d1e 0 2024-02-14T13:10:40.209 INFO:tasks.workunit.client.0.smithi012.stdout:1/697: creat d6/d10/d22/dc0/fde x:0 0 0 2024-02-14T13:10:40.209 INFO:tasks.workunit.client.0.smithi012.stdout:1/698: fsync d6/d10/d22/d31/d5b/d5d/d80/da4/fbc 0 2024-02-14T13:10:40.209 INFO:tasks.workunit.client.0.smithi012.stdout:1/699: stat d6/d10/d22/d31 0 2024-02-14T13:10:40.209 INFO:tasks.workunit.client.0.smithi012.stdout:8/694: dwrite d9/dc/d14/d2e/dde/d56/d57/d5c/dcf/da5/fb6 [0,4194304] 0 2024-02-14T13:10:40.212 INFO:tasks.workunit.client.0.smithi012.stdout:9/762: rename da/dd/d19/d30/d45/l69 to da/d33/d63/lfe 0 2024-02-14T13:10:40.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/763: chown da/d4f/fdd 3740 1 2024-02-14T13:10:40.213 INFO:tasks.workunit.client.0.smithi012.stdout:9/764: write da/dd/d57/d59/d73/db6/df1/f9e [2650686,55925] 0 2024-02-14T13:10:40.214 INFO:tasks.workunit.client.0.smithi012.stdout:5/781: dread dc/f12 [0,4194304] 0 2024-02-14T13:10:40.214 INFO:tasks.workunit.client.0.smithi012.stdout:2/762: truncate d0/d8/d9/d90/fbc 148688 0 2024-02-14T13:10:40.214 INFO:tasks.workunit.client.0.smithi012.stdout:2/763: chown d0/d8/d9/d90/dab/c69 1498961652 1 2024-02-14T13:10:40.215 INFO:tasks.workunit.client.0.smithi012.stdout:3/665: creat d9/d13/daa/de2/fe9 x:0 0 0 2024-02-14T13:10:40.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/700: read d6/d10/d22/d31/d34/fb0 [2284457,1238] 0 2024-02-14T13:10:40.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/701: fdatasync d6/d35/fca 0 2024-02-14T13:10:40.217 INFO:tasks.workunit.client.0.smithi012.stdout:6/667: link d1/df/f48 d1/d1e/dc/d28/fd9 0 2024-02-14T13:10:40.217 INFO:tasks.workunit.client.0.smithi012.stdout:2/764: dread d0/d1a/f47 [0,4194304] 0 2024-02-14T13:10:40.219 INFO:tasks.workunit.client.0.smithi012.stdout:8/695: creat d9/dc/d14/d23/ddf/fe7 x:0 0 0 2024-02-14T13:10:40.221 INFO:tasks.workunit.client.0.smithi012.stdout:7/648: rename df/f42 to df/d2d/d57/fe7 0 2024-02-14T13:10:40.223 INFO:tasks.workunit.client.0.smithi012.stdout:9/765: mknod da/dd/d19/d30/d9d/dce/cff 0 2024-02-14T13:10:40.224 INFO:tasks.workunit.client.0.smithi012.stdout:3/666: dread d9/d3f/d88/fe5 [0,4194304] 0 2024-02-14T13:10:40.224 INFO:tasks.workunit.client.0.smithi012.stdout:6/668: getdents d1/d1e/d1b/da8 0 2024-02-14T13:10:40.226 INFO:tasks.workunit.client.0.smithi012.stdout:2/765: symlink d0/d1a/de4/d50/l109 0 2024-02-14T13:10:40.228 INFO:tasks.workunit.client.0.smithi012.stdout:8/696: creat d9/dc/fe8 x:0 0 0 2024-02-14T13:10:40.230 INFO:tasks.workunit.client.0.smithi012.stdout:4/677: rename d0/d10/d28/da9/d86/db5/fc6 to d0/d10/d28/d4f/d6b/d8f/d56/ff4 0 2024-02-14T13:10:40.230 INFO:tasks.workunit.client.0.smithi012.stdout:4/678: truncate d0/d10/d28/fd4 280402 0 2024-02-14T13:10:40.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/649: rmdir df/d24/d9e 39 2024-02-14T13:10:40.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/650: fsync df/d2d/d82/d88/d90/fe3 0 2024-02-14T13:10:40.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/651: truncate df/d2d/f52 6276727 0 2024-02-14T13:10:40.233 INFO:tasks.workunit.client.0.smithi012.stdout:1/702: dwrite d6/d10/d22/d31/d34/fbe [4194304,4194304] 0 2024-02-14T13:10:40.233 INFO:tasks.workunit.client.0.smithi012.stdout:1/703: write d6/d10/d22/d31/d5b/d5e/d65/fd2 [712394,49367] 0 2024-02-14T13:10:40.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/766: mkdir da/dd/d38/d7e/d91/d100 0 2024-02-14T13:10:40.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/767: write da/dd/d57/f9c [224986,15944] 0 2024-02-14T13:10:40.235 INFO:tasks.workunit.client.0.smithi012.stdout:6/669: mkdir d1/df/d24/d5f/da0/dda 0 2024-02-14T13:10:40.238 INFO:tasks.workunit.client.0.smithi012.stdout:3/667: rename d9/d8e to d9/d13/dea 0 2024-02-14T13:10:40.240 INFO:tasks.workunit.client.0.smithi012.stdout:4/679: creat d0/df0/ff5 x:0 0 0 2024-02-14T13:10:40.241 INFO:tasks.workunit.client.0.smithi012.stdout:7/652: mkdir df/d2d/d5d/d72/de8 0 2024-02-14T13:10:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:1/704: getdents d6/d10/d22/d31 0 2024-02-14T13:10:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:1/705: readlink d6/d10/d22/d31/lad 0 2024-02-14T13:10:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:7/653: write df/d2d/d57/fe7 [215083,13866] 0 2024-02-14T13:10:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:1/706: chown d6/d10/d22/d31/d5b/d5d/f1a 3773617 1 2024-02-14T13:10:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:7/654: fdatasync df/d27/fa2 0 2024-02-14T13:10:40.243 INFO:tasks.workunit.client.0.smithi012.stdout:1/707: chown d6/d10/d22/d31/d5b/d5e/d65/f75 4 1 2024-02-14T13:10:40.245 INFO:tasks.workunit.client.0.smithi012.stdout:9/768: link da/dd/d19/f4d da/dd/d38/d7e/f101 0 2024-02-14T13:10:40.245 INFO:tasks.workunit.client.0.smithi012.stdout:9/769: write da/dd/fb4 [1774887,88014] 0 2024-02-14T13:10:40.245 INFO:tasks.workunit.client.0.smithi012.stdout:3/668: dread d9/d13/f2b [0,4194304] 0 2024-02-14T13:10:40.245 INFO:tasks.workunit.client.0.smithi012.stdout:3/669: write d9/d13/d28/f9a [24393,62518] 0 2024-02-14T13:10:40.245 INFO:tasks.workunit.client.0.smithi012.stdout:3/670: write d9/dd/d30/d34/d78/f96 [681134,41965] 0 2024-02-14T13:10:40.246 INFO:tasks.workunit.client.0.smithi012.stdout:6/670: creat d1/df/d50/db4/fdb x:0 0 0 2024-02-14T13:10:40.246 INFO:tasks.workunit.client.0.smithi012.stdout:6/671: readlink d1/df/la1 0 2024-02-14T13:10:40.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/697: rename d9/dc/d38/d6a/dab to d9/dc/d14/d2e/dde/da3/de9 0 2024-02-14T13:10:40.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/698: dread - d9/db9/fcd zero size 2024-02-14T13:10:40.249 INFO:tasks.workunit.client.0.smithi012.stdout:8/699: dread - d9/dc/d14/d2e/dde/f88 zero size 2024-02-14T13:10:40.251 INFO:tasks.workunit.client.0.smithi012.stdout:7/655: getdents df/d2d/d5d/d72/d8a/dcd 0 2024-02-14T13:10:40.253 INFO:tasks.workunit.client.0.smithi012.stdout:1/708: creat d6/d10/d22/d31/d34/d89/fdf x:0 0 0 2024-02-14T13:10:40.254 INFO:tasks.workunit.client.0.smithi012.stdout:3/671: mkdir d9/d13/deb 0 2024-02-14T13:10:40.254 INFO:tasks.workunit.client.0.smithi012.stdout:3/672: fdatasync d9/dd/de/d58/d65/d6c/f94 0 2024-02-14T13:10:40.256 INFO:tasks.workunit.client.0.smithi012.stdout:2/766: dwrite d0/d6/d37/fad [4194304,4194304] 0 2024-02-14T13:10:40.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/672: rename d1/d1e/l98 to d1/d1e/dc/d43/dd4/ldc 0 2024-02-14T13:10:40.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/673: stat d1/df/d24/d3f/d56/d93/fc6 0 2024-02-14T13:10:40.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/674: readlink d1/df/d24/d3f/d56/l8a 0 2024-02-14T13:10:40.258 INFO:tasks.workunit.client.0.smithi012.stdout:8/700: creat d9/dc/d14/d2e/dde/d56/d57/d7c/fea x:0 0 0 2024-02-14T13:10:40.259 INFO:tasks.workunit.client.0.smithi012.stdout:4/680: mkdir d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6 0 2024-02-14T13:10:40.261 INFO:tasks.workunit.client.0.smithi012.stdout:7/656: mknod df/d27/d4b/d6b/d6d/d85/db8/ce9 0 2024-02-14T13:10:40.261 INFO:tasks.workunit.client.0.smithi012.stdout:7/657: stat df/d36/f3c 0 2024-02-14T13:10:40.261 INFO:tasks.workunit.client.0.smithi012.stdout:7/658: chown df/d2d/d5d/l80 0 1 2024-02-14T13:10:40.262 INFO:tasks.workunit.client.0.smithi012.stdout:3/673: link d9/dd/d30/d34/d78/ca7 d9/d3f/d88/cec 0 2024-02-14T13:10:40.263 INFO:tasks.workunit.client.0.smithi012.stdout:9/770: dwrite da/dd/f2a [0,4194304] 0 2024-02-14T13:10:40.266 INFO:tasks.workunit.client.0.smithi012.stdout:6/675: write d1/d1e/dc/f1d [862238,56338] 0 2024-02-14T13:10:40.267 INFO:tasks.workunit.client.0.smithi012.stdout:2/767: truncate d0/f2f 1304021 0 2024-02-14T13:10:40.272 INFO:tasks.workunit.client.0.smithi012.stdout:8/701: creat d9/dc/d14/d2e/dde/d56/d57/dca/feb x:0 0 0 2024-02-14T13:10:40.273 INFO:tasks.workunit.client.0.smithi012.stdout:4/681: mkdir d0/d10/d28/d4f/d6b/d8f/d56/df7 0 2024-02-14T13:10:40.275 INFO:tasks.workunit.client.0.smithi012.stdout:7/659: rename df/d27/d4b/d6b/fe0 to df/d27/d4b/d8d/dd4/fea 0 2024-02-14T13:10:40.275 INFO:tasks.workunit.client.0.smithi012.stdout:7/660: stat df/l1c 0 2024-02-14T13:10:40.276 INFO:tasks.workunit.client.0.smithi012.stdout:9/771: mkdir da/dd/d57/db2/d102 0 2024-02-14T13:10:40.277 INFO:tasks.workunit.client.0.smithi012.stdout:9/772: write f0 [4573296,84729] 0 2024-02-14T13:10:40.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/676: link d1/df/d50/ld7 d1/df/d24/d3f/d56/ldd 0 2024-02-14T13:10:40.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/677: fsync d1/df/d24/daf/f53 0 2024-02-14T13:10:40.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/678: fsync d1/df/d24/d3f/d56/d93/d95/fd0 0 2024-02-14T13:10:40.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/679: dread - d1/df/d24/d5f/da0/fcf zero size 2024-02-14T13:10:40.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/680: truncate d1/df/d24/d3f/f47 4971776 0 2024-02-14T13:10:40.278 INFO:tasks.workunit.client.0.smithi012.stdout:6/681: write d1/df/d16/d7c/d97/d82/f9c [1398662,96460] 0 2024-02-14T13:10:40.279 INFO:tasks.workunit.client.0.smithi012.stdout:2/768: symlink d0/d1a/de4/d50/l10a 0 2024-02-14T13:10:40.281 INFO:tasks.workunit.client.0.smithi012.stdout:2/769: dread d0/d8/d11/d33/d53/d6b/f6c [0,4194304] 0 2024-02-14T13:10:40.281 INFO:tasks.workunit.client.0.smithi012.stdout:8/702: unlink d9/dc/d1b/f20 0 2024-02-14T13:10:40.281 INFO:tasks.workunit.client.0.smithi012.stdout:8/703: readlink d9/dc/d14/d2e/lbb 0 2024-02-14T13:10:40.283 INFO:tasks.workunit.client.0.smithi012.stdout:7/661: mkdir df/d24/d56/deb 0 2024-02-14T13:10:40.286 INFO:tasks.workunit.client.0.smithi012.stdout:3/674: dwrite d9/d3f/d73/f86 [0,4194304] 0 2024-02-14T13:10:40.286 INFO:tasks.workunit.client.0.smithi012.stdout:6/682: unlink d1/d1e/c29 0 2024-02-14T13:10:40.286 INFO:tasks.workunit.client.0.smithi012.stdout:6/683: dread - d1/df/d24/d5f/da0/fcf zero size 2024-02-14T13:10:40.286 INFO:tasks.workunit.client.0.smithi012.stdout:6/684: write d1/df/d24/daf/fd8 [238351,84853] 0 2024-02-14T13:10:40.287 INFO:tasks.workunit.client.0.smithi012.stdout:2/770: unlink d0/d6/de/d7d/db7/cc1 0 2024-02-14T13:10:40.288 INFO:tasks.workunit.client.0.smithi012.stdout:8/704: getdents d9/dc/d14 0 2024-02-14T13:10:40.289 INFO:tasks.workunit.client.0.smithi012.stdout:7/662: mknod df/cec 0 2024-02-14T13:10:40.291 INFO:tasks.workunit.client.0.smithi012.stdout:4/682: dwrite d0/d10/f24 [0,4194304] 0 2024-02-14T13:10:40.291 INFO:tasks.workunit.client.0.smithi012.stdout:3/675: mknod d9/dd/d30/d44/d66/ced 0 2024-02-14T13:10:40.291 INFO:tasks.workunit.client.0.smithi012.stdout:3/676: truncate d9/d18/daf/fb2 1363062 0 2024-02-14T13:10:40.292 INFO:tasks.workunit.client.0.smithi012.stdout:3/677: dread - d9/dd/d30/d44/d66/db3/fe8 zero size 2024-02-14T13:10:40.293 INFO:tasks.workunit.client.0.smithi012.stdout:6/685: rename d1/df/d16/f59 to d1/d1e/d1b/d21/d78/fde 0 2024-02-14T13:10:40.293 INFO:tasks.workunit.client.0.smithi012.stdout:6/686: getdents d1/df/d16/d7c/d97/d82/da5/dc9 0 2024-02-14T13:10:40.294 INFO:tasks.workunit.client.0.smithi012.stdout:6/687: write d1/d1e/dc/d38/fb7 [723047,30935] 0 2024-02-14T13:10:40.294 INFO:tasks.workunit.client.0.smithi012.stdout:6/688: dread - d1/df/d24/d5f/da0/fc1 zero size 2024-02-14T13:10:40.294 INFO:tasks.workunit.client.0.smithi012.stdout:6/689: fsync d1/df/d24/d5f/da0/fc1 0 2024-02-14T13:10:40.294 INFO:tasks.workunit.client.0.smithi012.stdout:8/705: mknod d9/dc/d14/d23/d62/cec 0 2024-02-14T13:10:40.295 INFO:tasks.workunit.client.0.smithi012.stdout:7/663: rmdir df/d2d/d82 39 2024-02-14T13:10:40.295 INFO:tasks.workunit.client.0.smithi012.stdout:9/773: dread f0 [0,4194304] 0 2024-02-14T13:10:40.297 INFO:tasks.workunit.client.0.smithi012.stdout:4/683: unlink d0/d10/d28/da9/f69 0 2024-02-14T13:10:40.298 INFO:tasks.workunit.client.0.smithi012.stdout:2/771: rename d0/d1a/de4/d15/f4a to d0/d1a/de4/d15/d57/dc4/f10b 0 2024-02-14T13:10:40.300 INFO:tasks.workunit.client.0.smithi012.stdout:6/690: truncate d1/d1e/dc/d43/d75/f92 888530 0 2024-02-14T13:10:40.303 INFO:tasks.workunit.client.0.smithi012.stdout:8/706: getdents d9/db9 0 2024-02-14T13:10:40.305 INFO:tasks.workunit.client.0.smithi012.stdout:7/664: creat df/d27/fed x:0 0 0 2024-02-14T13:10:40.306 INFO:tasks.workunit.client.0.smithi012.stdout:9/774: link da/dd/lf7 da/dd/d38/d7e/l103 0 2024-02-14T13:10:40.306 INFO:tasks.workunit.client.0.smithi012.stdout:9/775: chown da/dd/d19/df3/d85/d48 71662129 1 2024-02-14T13:10:40.306 INFO:tasks.workunit.client.0.smithi012.stdout:9/776: write da/dd/d18/f22 [3721746,14183] 0 2024-02-14T13:10:40.310 INFO:tasks.workunit.client.0.smithi012.stdout:6/691: mkdir d1/d1e/d1b/d21/d78/ddf 0 2024-02-14T13:10:40.316 INFO:tasks.workunit.client.0.smithi012.stdout:2/772: rename d0/d1a/de4/d15/d57/dc4 to d0/d8/d10c 0 2024-02-14T13:10:40.324 INFO:tasks.workunit.client.0.smithi012.stdout:9/777: mknod da/d33/c104 0 2024-02-14T13:10:40.326 INFO:tasks.workunit.client.0.smithi012.stdout:8/707: rename d9/dc/d14/d2e/dde/d56/d57/d5c/dcf to d9/dc/d14/d2e/dde/da3/ded 0 2024-02-14T13:10:40.326 INFO:tasks.workunit.client.0.smithi012.stdout:8/708: read - d9/db9/fcd zero size 2024-02-14T13:10:40.328 INFO:tasks.workunit.client.0.smithi012.stdout:9/778: symlink da/dd/d38/d65/df0/l105 0 2024-02-14T13:10:40.328 INFO:tasks.workunit.client.0.smithi012.stdout:9/779: write da/d4f/fdd [2149540,107591] 0 2024-02-14T13:10:40.329 INFO:tasks.workunit.client.0.smithi012.stdout:8/709: creat d9/dc/d14/d23/ddf/fee x:0 0 0 2024-02-14T13:10:40.329 INFO:tasks.workunit.client.0.smithi012.stdout:8/710: chown d9/dc/d38/d6a/fdc 1303 1 2024-02-14T13:10:40.329 INFO:tasks.workunit.client.0.smithi012.stdout:8/711: dread - d9/dc/d14/d2e/dde/d56/d57/d7c/fc1 zero size 2024-02-14T13:10:40.330 INFO:tasks.workunit.client.0.smithi012.stdout:7/665: dwrite df/d27/fed [0,4194304] 0 2024-02-14T13:10:40.331 INFO:tasks.workunit.client.0.smithi012.stdout:7/666: readlink df/d2d/d5d/d72/d8a/l91 0 2024-02-14T13:10:40.335 INFO:tasks.workunit.client.0.smithi012.stdout:0/742: sync 2024-02-14T13:10:40.335 INFO:tasks.workunit.client.0.smithi012.stdout:6/692: dwrite d1/df/d24/d3f/d56/d93/d95/fd0 [0,4194304] 0 2024-02-14T13:10:40.335 INFO:tasks.workunit.client.0.smithi012.stdout:6/693: dread - d1/d1e/dc/d43/d75/faa zero size 2024-02-14T13:10:40.338 INFO:tasks.workunit.client.0.smithi012.stdout:7/667: dread df/d24/f87 [0,4194304] 0 2024-02-14T13:10:40.339 INFO:tasks.workunit.client.0.smithi012.stdout:6/694: creat d1/df/d24/fe0 x:0 0 0 2024-02-14T13:10:40.339 INFO:tasks.workunit.client.0.smithi012.stdout:6/695: write d1/d1e/d1b/f87 [1481130,87108] 0 2024-02-14T13:10:40.341 INFO:tasks.workunit.client.0.smithi012.stdout:9/780: rename da/dd/d38/d65 to da/d33/d63/d106 0 2024-02-14T13:10:40.342 INFO:tasks.workunit.client.0.smithi012.stdout:6/696: creat d1/d1e/d1b/d21/fe1 x:0 0 0 2024-02-14T13:10:40.356 INFO:tasks.workunit.client.0.smithi012.stdout:7/668: dwrite df/d2d/d82/d88/d90/fe3 [0,4194304] 0 2024-02-14T13:10:40.356 INFO:tasks.workunit.client.0.smithi012.stdout:7/669: stat df/f51 0 2024-02-14T13:10:40.356 INFO:tasks.workunit.client.0.smithi012.stdout:7/670: truncate df/d27/d4b/d6b/d6d/d85/fd5 384067 0 2024-02-14T13:10:40.372 INFO:tasks.workunit.client.0.smithi012.stdout:0/743: dwrite d10/d14/d41/d61/d74/f91 [0,4194304] 0 2024-02-14T13:10:40.372 INFO:tasks.workunit.client.0.smithi012.stdout:9/781: dwrite da/dd/f2b [0,4194304] 0 2024-02-14T13:10:40.372 INFO:tasks.workunit.client.0.smithi012.stdout:9/782: readlink da/dd/d19/d30/lba 0 2024-02-14T13:10:40.372 INFO:tasks.workunit.client.0.smithi012.stdout:8/712: dwrite d9/dc/d14/d2e/dde/d56/f77 [0,4194304] 0 2024-02-14T13:10:40.376 INFO:tasks.workunit.client.0.smithi012.stdout:0/744: mkdir d10/d14/d41/df2 0 2024-02-14T13:10:40.378 INFO:tasks.workunit.client.0.smithi012.stdout:9/783: rmdir da/dd/d57/db2/d102 0 2024-02-14T13:10:40.378 INFO:tasks.workunit.client.0.smithi012.stdout:9/784: fsync da/dd/d19/df3/d85/f31 0 2024-02-14T13:10:40.379 INFO:tasks.workunit.client.0.smithi012.stdout:8/713: creat d9/dc/d14/d2e/dde/d56/d57/d7c/fef x:0 0 0 2024-02-14T13:10:40.380 INFO:tasks.workunit.client.0.smithi012.stdout:0/745: creat d10/d14/d41/d52/d99/ff3 x:0 0 0 2024-02-14T13:10:40.381 INFO:tasks.workunit.client.0.smithi012.stdout:8/714: link d9/dc/d14/d2e/l4c d9/dc/d14/lf0 0 2024-02-14T13:10:40.382 INFO:tasks.workunit.client.0.smithi012.stdout:0/746: symlink d10/d14/d41/df2/lf4 0 2024-02-14T13:10:40.382 INFO:tasks.workunit.client.0.smithi012.stdout:0/747: write d10/d14/d41/d52/d67/f8b [3422808,8279] 0 2024-02-14T13:10:40.384 INFO:tasks.workunit.client.0.smithi012.stdout:9/785: write da/dd/d57/d59/d73/db6/df1/fbb [3123496,37178] 0 2024-02-14T13:10:40.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/748: mkdir d10/d14/d41/d52/d78/d8c/dce/df5 0 2024-02-14T13:10:40.384 INFO:tasks.workunit.client.0.smithi012.stdout:0/749: stat d10/d14/d41/d52/d78/d8c/c87 0 2024-02-14T13:10:40.391 INFO:tasks.workunit.client.0.smithi012.stdout:5/782: sync 2024-02-14T13:10:40.393 INFO:tasks.workunit.client.0.smithi012.stdout:9/786: read f4 [237010,107181] 0 2024-02-14T13:10:40.394 INFO:tasks.workunit.client.0.smithi012.stdout:9/787: creat da/dd/d57/d59/d73/f107 x:0 0 0 2024-02-14T13:10:40.395 INFO:tasks.workunit.client.0.smithi012.stdout:9/788: getdents da/dd/d57/d59/da8 0 2024-02-14T13:10:40.396 INFO:tasks.workunit.client.0.smithi012.stdout:9/789: mknod da/dd/d18/dfc/c108 0 2024-02-14T13:10:40.397 INFO:tasks.workunit.client.0.smithi012.stdout:0/750: dwrite d10/d14/d41/f6a [0,4194304] 0 2024-02-14T13:10:40.398 INFO:tasks.workunit.client.0.smithi012.stdout:9/790: unlink da/d33/l78 0 2024-02-14T13:10:40.398 INFO:tasks.workunit.client.0.smithi012.stdout:9/791: fsync da/dd/d38/ff2 0 2024-02-14T13:10:40.402 INFO:tasks.workunit.client.0.smithi012.stdout:5/783: write dc/d17/d20/d4c/d58/f68 [2416849,75110] 0 2024-02-14T13:10:40.412 INFO:tasks.workunit.client.0.smithi012.stdout:9/792: dread da/dd/d57/db2/fd0 [0,4194304] 0 2024-02-14T13:10:40.412 INFO:tasks.workunit.client.0.smithi012.stdout:0/751: write d10/d14/d20/f64 [1925955,121752] 0 2024-02-14T13:10:40.413 INFO:tasks.workunit.client.0.smithi012.stdout:9/793: rename da/dd/d19/d30/lc2 to da/dd/d19/df3/l109 0 2024-02-14T13:10:40.414 INFO:tasks.workunit.client.0.smithi012.stdout:9/794: getdents da/dd/d57/d59/d73/db6/df1/d8d 0 2024-02-14T13:10:40.414 INFO:tasks.workunit.client.0.smithi012.stdout:9/795: chown da/dd/c25 210677 1 2024-02-14T13:10:40.414 INFO:tasks.workunit.client.0.smithi012.stdout:9/796: fsync da/dd/d38/d7e/f101 0 2024-02-14T13:10:40.415 INFO:tasks.workunit.client.0.smithi012.stdout:9/797: creat da/dd/d57/d59/f10a x:0 0 0 2024-02-14T13:10:40.416 INFO:tasks.workunit.client.0.smithi012.stdout:9/798: creat da/dd/d38/d7e/d91/f10b x:0 0 0 2024-02-14T13:10:40.416 INFO:tasks.workunit.client.0.smithi012.stdout:9/799: stat da/dd/d57/d59/d73/db6/df1/d8d 0 2024-02-14T13:10:40.416 INFO:tasks.workunit.client.0.smithi012.stdout:9/800: chown da/dd/d57/d59/d73/db6/df1/f9e 215328 1 2024-02-14T13:10:40.417 INFO:tasks.workunit.client.0.smithi012.stdout:9/801: mknod da/dd/d19/df3/d85/c10c 0 2024-02-14T13:10:40.419 INFO:tasks.workunit.client.0.smithi012.stdout:5/784: dwrite dc/d2f/d3e/fde [0,4194304] 0 2024-02-14T13:10:40.419 INFO:tasks.workunit.client.0.smithi012.stdout:0/752: write fd [3943491,125115] 0 2024-02-14T13:10:40.420 INFO:tasks.workunit.client.0.smithi012.stdout:5/785: mknod dc/d17/d20/d4c/d63/cf2 0 2024-02-14T13:10:40.422 INFO:tasks.workunit.client.0.smithi012.stdout:5/786: dread dc/d17/d20/d8e/f9e [0,4194304] 0 2024-02-14T13:10:40.422 INFO:tasks.workunit.client.0.smithi012.stdout:0/753: creat d10/d84/ff6 x:0 0 0 2024-02-14T13:10:40.423 INFO:tasks.workunit.client.0.smithi012.stdout:5/787: link dc/d2f/fa1 dc/d17/d20/d4c/ff3 0 2024-02-14T13:10:40.424 INFO:tasks.workunit.client.0.smithi012.stdout:5/788: creat dc/d17/d20/d4c/d58/dda/ff4 x:0 0 0 2024-02-14T13:10:40.424 INFO:tasks.workunit.client.0.smithi012.stdout:5/789: fdatasync dc/d17/d20/d4c/fef 0 2024-02-14T13:10:40.424 INFO:tasks.workunit.client.0.smithi012.stdout:5/790: chown dc/d47/d6e/l96 434603 1 2024-02-14T13:10:40.425 INFO:tasks.workunit.client.0.smithi012.stdout:5/791: write dc/d17/d20/d4c/d58/dda/ff4 [382013,79717] 0 2024-02-14T13:10:40.426 INFO:tasks.workunit.client.0.smithi012.stdout:5/792: mknod dc/d2f/d40/d53/d8a/cf5 0 2024-02-14T13:10:40.426 INFO:tasks.workunit.client.0.smithi012.stdout:5/793: fdatasync dc/d2f/d40/d53/d97/fc0 0 2024-02-14T13:10:40.426 INFO:tasks.workunit.client.0.smithi012.stdout:9/802: dread da/dd/d57/d59/d73/db6/df1/f52 [0,4194304] 0 2024-02-14T13:10:40.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/794: mkdir dc/d17/ded/df6 0 2024-02-14T13:10:40.427 INFO:tasks.workunit.client.0.smithi012.stdout:5/795: write dc/d17/ded/fa2 [1251305,6315] 0 2024-02-14T13:10:40.428 INFO:tasks.workunit.client.0.smithi012.stdout:5/796: unlink f7 0 2024-02-14T13:10:40.429 INFO:tasks.workunit.client.0.smithi012.stdout:5/797: link dc/d2f/d3e/fde dc/d47/d6e/ff7 0 2024-02-14T13:10:40.430 INFO:tasks.workunit.client.0.smithi012.stdout:5/798: mkdir dc/d47/d69/df8 0 2024-02-14T13:10:40.430 INFO:tasks.workunit.client.0.smithi012.stdout:5/799: readlink dc/dec/lee 0 2024-02-14T13:10:40.431 INFO:tasks.workunit.client.0.smithi012.stdout:5/800: chown dc/d2f/d40/d53/d8a/lcc 61191542 1 2024-02-14T13:10:40.431 INFO:tasks.workunit.client.0.smithi012.stdout:5/801: getdents dc/d2f/d70/da9 0 2024-02-14T13:10:40.436 INFO:tasks.workunit.client.0.smithi012.stdout:9/803: dread da/dd/d19/df3/d85/d48/f67 [0,4194304] 0 2024-02-14T13:10:40.447 INFO:tasks.workunit.client.0.smithi012.stdout:0/754: dwrite d10/d14/d1b/d54/d96/fd4 [0,4194304] 0 2024-02-14T13:10:40.449 INFO:tasks.workunit.client.0.smithi012.stdout:5/802: dwrite dc/d2f/d89/f8b [0,4194304] 0 2024-02-14T13:10:40.449 INFO:tasks.workunit.client.0.smithi012.stdout:5/803: fsync dc/d47/fa8 0 2024-02-14T13:10:40.453 INFO:tasks.workunit.client.0.smithi012.stdout:5/804: dread dc/d17/d20/d4c/d58/f83 [0,4194304] 0 2024-02-14T13:10:40.455 INFO:tasks.workunit.client.0.smithi012.stdout:5/805: getdents dc/d47/d59 0 2024-02-14T13:10:40.455 INFO:tasks.workunit.client.0.smithi012.stdout:5/806: write dc/d47/fb2 [426638,101030] 0 2024-02-14T13:10:40.456 INFO:tasks.workunit.client.0.smithi012.stdout:0/755: write d10/d14/d20/f37 [591962,126782] 0 2024-02-14T13:10:40.456 INFO:tasks.workunit.client.0.smithi012.stdout:0/756: write d10/f57 [264158,115350] 0 2024-02-14T13:10:40.456 INFO:tasks.workunit.client.0.smithi012.stdout:0/757: write d10/d14/d41/f6a [4354479,119701] 0 2024-02-14T13:10:40.457 INFO:tasks.workunit.client.0.smithi012.stdout:5/807: symlink dc/d2f/d70/d78/d99/lf9 0 2024-02-14T13:10:40.460 INFO:tasks.workunit.client.0.smithi012.stdout:5/808: rename dc/d2f/d40/d53/dca to dc/d17/d20/d4c/d7b/dfa 0 2024-02-14T13:10:40.460 INFO:tasks.workunit.client.0.smithi012.stdout:3/678: sync 2024-02-14T13:10:40.461 INFO:tasks.workunit.client.0.smithi012.stdout:1/709: sync 2024-02-14T13:10:40.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:40 smithi012 ceph-mon[32370]: pgmap v406: 97 pgs: 97 active+clean; 699 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s rd, 93 MiB/s wr, 1.01k op/s 2024-02-14T13:10:40.469 INFO:tasks.workunit.client.0.smithi012.stdout:1/710: write d6/d10/d22/d31/d5b/d5d/f55 [4170429,1606] 0 2024-02-14T13:10:40.481 INFO:tasks.workunit.client.0.smithi012.stdout:0/758: dwrite d10/d14/d20/fcc [0,4194304] 0 2024-02-14T13:10:40.481 INFO:tasks.workunit.client.0.smithi012.stdout:0/759: stat d10/d14/d41/d52/d78/dea/fee 0 2024-02-14T13:10:40.481 INFO:tasks.workunit.client.0.smithi012.stdout:0/760: write d10/d14/d2b/d3b/f4b [712811,129907] 0 2024-02-14T13:10:40.481 INFO:tasks.workunit.client.0.smithi012.stdout:0/761: chown d10/dad/fe2 0 1 2024-02-14T13:10:40.483 INFO:tasks.workunit.client.0.smithi012.stdout:0/762: creat d10/d14/d1b/d30/ff7 x:0 0 0 2024-02-14T13:10:40.484 INFO:tasks.workunit.client.0.smithi012.stdout:0/763: mkdir d10/d14/d41/d52/d78/d8c/d7f/df8 0 2024-02-14T13:10:40.488 INFO:tasks.workunit.client.0.smithi012.stdout:5/809: dwrite dc/d17/d20/d4c/d58/f83 [0,4194304] 0 2024-02-14T13:10:40.488 INFO:tasks.workunit.client.0.smithi012.stdout:5/810: chown dc/d2f/d40/d53/d97/lb4 24527031 1 2024-02-14T13:10:40.489 INFO:tasks.workunit.client.0.smithi012.stdout:5/811: mknod dc/d17/d20/d4c/d7b/cfb 0 2024-02-14T13:10:40.489 INFO:tasks.workunit.client.0.smithi012.stdout:5/812: chown dc/d17/d20/d8e/cb8 20 1 2024-02-14T13:10:40.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:40 smithi103 ceph-mon[36921]: pgmap v406: 97 pgs: 97 active+clean; 699 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s rd, 93 MiB/s wr, 1.01k op/s 2024-02-14T13:10:40.493 INFO:tasks.workunit.client.0.smithi012.stdout:3/679: dwrite d9/dd/de/d58/f99 [0,4194304] 0 2024-02-14T13:10:40.493 INFO:tasks.workunit.client.0.smithi012.stdout:3/680: read - d9/dd/d30/fcc zero size 2024-02-14T13:10:40.493 INFO:tasks.workunit.client.0.smithi012.stdout:1/711: dwrite d6/d10/f99 [0,4194304] 0 2024-02-14T13:10:40.493 INFO:tasks.workunit.client.0.smithi012.stdout:3/681: chown d9/d3f/d88/dc0 52833 1 2024-02-14T13:10:40.498 INFO:tasks.workunit.client.0.smithi012.stdout:3/682: mkdir d9/dd/d30/d44/d66/db3/dee 0 2024-02-14T13:10:40.499 INFO:tasks.workunit.client.0.smithi012.stdout:1/712: dread d6/d10/d22/d31/d5b/d5e/d3d/f51 [0,4194304] 0 2024-02-14T13:10:40.499 INFO:tasks.workunit.client.0.smithi012.stdout:3/683: mknod d9/d3f/d88/cef 0 2024-02-14T13:10:40.499 INFO:tasks.workunit.client.0.smithi012.stdout:3/684: chown d9/dd/d30/d44/f9e 0 1 2024-02-14T13:10:40.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/713: rmdir d6/d10/d22/d31/d5b/d5d/d80/da4 39 2024-02-14T13:10:40.509 INFO:tasks.workunit.client.0.smithi012.stdout:0/764: dwrite d10/d14/d1b/d54/d96/fdf [0,4194304] 0 2024-02-14T13:10:40.509 INFO:tasks.workunit.client.0.smithi012.stdout:0/765: write d10/d14/d20/fcc [4670390,129420] 0 2024-02-14T13:10:40.509 INFO:tasks.workunit.client.0.smithi012.stdout:0/766: readlink d10/d14/d2b/da4/lc4 0 2024-02-14T13:10:40.509 INFO:tasks.workunit.client.0.smithi012.stdout:0/767: stat d10/d14/d1b/d30/f83 0 2024-02-14T13:10:40.509 INFO:tasks.workunit.client.0.smithi012.stdout:1/714: write d6/d10/d22/d31/d5b/d5d/f17 [1316856,109133] 0 2024-02-14T13:10:40.513 INFO:tasks.workunit.client.0.smithi012.stdout:5/813: dwrite dc/d2f/d70/faa [4194304,4194304] 0 2024-02-14T13:10:40.521 INFO:tasks.workunit.client.0.smithi012.stdout:5/814: creat dc/d17/d20/d4c/d63/d81/ddd/ffc x:0 0 0 2024-02-14T13:10:40.522 INFO:tasks.workunit.client.0.smithi012.stdout:5/815: symlink dc/d17/d20/d4c/lfd 0 2024-02-14T13:10:40.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/715: dread d6/d35/f8c [0,4194304] 0 2024-02-14T13:10:40.523 INFO:tasks.workunit.client.0.smithi012.stdout:1/716: chown d6/d10/d22/d31/d5b/dcd/fd8 56803478 1 2024-02-14T13:10:40.523 INFO:tasks.workunit.client.0.smithi012.stdout:5/816: mkdir dc/d2f/d70/dbc/dd8/dfe 0 2024-02-14T13:10:40.523 INFO:tasks.workunit.client.0.smithi012.stdout:5/817: fdatasync dc/d17/ded/fa2 0 2024-02-14T13:10:40.523 INFO:tasks.workunit.client.0.smithi012.stdout:5/818: chown dc/d17/d20/d4c/d58/c7e 12895235 1 2024-02-14T13:10:40.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/819: mknod dc/d2f/d40/cff 0 2024-02-14T13:10:40.525 INFO:tasks.workunit.client.0.smithi012.stdout:0/768: dwrite d10/d84/d93/fe6 [0,4194304] 0 2024-02-14T13:10:40.526 INFO:tasks.workunit.client.0.smithi012.stdout:1/717: link d6/d10/f4a d6/d10/d22/d31/d5b/d5d/d80/da4/fe0 0 2024-02-14T13:10:40.528 INFO:tasks.workunit.client.0.smithi012.stdout:0/769: unlink d10/d14/d41/d61/d74/fe7 0 2024-02-14T13:10:40.528 INFO:tasks.workunit.client.0.smithi012.stdout:0/770: stat d10/d14/d2b/f6e 0 2024-02-14T13:10:40.529 INFO:tasks.workunit.client.0.smithi012.stdout:1/718: mknod d6/d10/d22/d31/d5b/d5d/d80/ce1 0 2024-02-14T13:10:40.530 INFO:tasks.workunit.client.0.smithi012.stdout:1/719: dread d6/d10/d22/fb5 [0,4194304] 0 2024-02-14T13:10:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:7/671: sync 2024-02-14T13:10:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:6/697: sync 2024-02-14T13:10:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:8/715: sync 2024-02-14T13:10:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:4/684: sync 2024-02-14T13:10:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:2/773: sync 2024-02-14T13:10:40.531 INFO:tasks.workunit.client.0.smithi012.stdout:5/820: dread dc/d17/d20/f2b [0,4194304] 0 2024-02-14T13:10:40.532 INFO:tasks.workunit.client.0.smithi012.stdout:0/771: mkdir d10/d14/d41/d52/d78/df9 0 2024-02-14T13:10:40.532 INFO:tasks.workunit.client.0.smithi012.stdout:1/720: symlink d6/d35/le2 0 2024-02-14T13:10:40.533 INFO:tasks.workunit.client.0.smithi012.stdout:8/716: mkdir d9/dc/d14/d2e/dde/d56/d57/d92/df1 0 2024-02-14T13:10:40.534 INFO:tasks.workunit.client.0.smithi012.stdout:4/685: getdents d0/de1/de8 0 2024-02-14T13:10:40.535 INFO:tasks.workunit.client.0.smithi012.stdout:5/821: creat dc/d17/d20/d4c/d7b/dfa/f100 x:0 0 0 2024-02-14T13:10:40.539 INFO:tasks.workunit.client.0.smithi012.stdout:0/772: mkdir d10/d14/d1b/d30/dfa 0 2024-02-14T13:10:40.539 INFO:tasks.workunit.client.0.smithi012.stdout:6/698: dread d1/d1e/d1b/d3e/fb1 [0,4194304] 0 2024-02-14T13:10:40.539 INFO:tasks.workunit.client.0.smithi012.stdout:1/721: truncate d6/d10/d22/d44/f52 271577 0 2024-02-14T13:10:40.540 INFO:tasks.workunit.client.0.smithi012.stdout:1/722: write d6/d10/d22/d31/d34/d58/d61/f9d [85404,68562] 0 2024-02-14T13:10:40.540 INFO:tasks.workunit.client.0.smithi012.stdout:1/723: chown d6/d10/d22/d44/dbb/lcb 794278124 1 2024-02-14T13:10:40.540 INFO:tasks.workunit.client.0.smithi012.stdout:0/773: truncate d10/dad/fb4 4085420 0 2024-02-14T13:10:40.542 INFO:tasks.workunit.client.0.smithi012.stdout:6/699: rename d1/d1e/d1b/da8/d9b/fb0 to d1/d1e/d1b/d21/fe2 0 2024-02-14T13:10:40.544 INFO:tasks.workunit.client.0.smithi012.stdout:1/724: mkdir d6/d10/d22/d31/d5b/d5d/de3 0 2024-02-14T13:10:40.546 INFO:tasks.workunit.client.0.smithi012.stdout:0/774: rename d10/d14/d41/d52/d78/d8c/c65 to d10/d14/d41/d52/d78/dea/cfb 0 2024-02-14T13:10:40.546 INFO:tasks.workunit.client.0.smithi012.stdout:0/775: write d10/dad/fb2 [724443,55815] 0 2024-02-14T13:10:40.546 INFO:tasks.workunit.client.0.smithi012.stdout:9/804: sync 2024-02-14T13:10:40.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/700: creat d1/d1e/dc/d43/d75/fe3 x:0 0 0 2024-02-14T13:10:40.549 INFO:tasks.workunit.client.0.smithi012.stdout:1/725: link d6/d10/d22/d31/d34/f57 d6/d10/d22/d31/d5b/d5d/d80/da4/fe4 0 2024-02-14T13:10:40.549 INFO:tasks.workunit.client.0.smithi012.stdout:1/726: write d6/d10/d22/d31/d34/d58/f92 [3696242,740] 0 2024-02-14T13:10:40.554 INFO:tasks.workunit.client.0.smithi012.stdout:9/805: mknod da/dd/d38/d7e/d91/d100/c10d 0 2024-02-14T13:10:40.555 INFO:tasks.workunit.client.0.smithi012.stdout:6/701: creat d1/d1e/d1b/da8/d9b/fe4 x:0 0 0 2024-02-14T13:10:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:1/727: creat d6/d10/d22/d44/dbb/fe5 x:0 0 0 2024-02-14T13:10:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:1/728: chown d6/d10/d22/c30 0 1 2024-02-14T13:10:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:1/729: chown d6/d10/d22/d31/d5b/d5e/f47 1 1 2024-02-14T13:10:40.556 INFO:tasks.workunit.client.0.smithi012.stdout:5/822: read dc/d17/d20/d4c/f51 [1430663,37472] 0 2024-02-14T13:10:40.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/774: dwrite d0/d6/d37/fdd [0,4194304] 0 2024-02-14T13:10:40.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/775: write d0/d8/f6f [4886800,45091] 0 2024-02-14T13:10:40.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/776: write d0/d8/d11/d35/dd0/d70/fd9 [398553,53750] 0 2024-02-14T13:10:40.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/777: stat d0/d1a/de4/d50/d68/d9c/f9f 0 2024-02-14T13:10:40.557 INFO:tasks.workunit.client.0.smithi012.stdout:2/778: write d0/d1a/de4/d39/fda [4364382,57945] 0 2024-02-14T13:10:40.558 INFO:tasks.workunit.client.0.smithi012.stdout:9/806: creat da/dd/d57/d59/f10e x:0 0 0 2024-02-14T13:10:40.559 INFO:tasks.workunit.client.0.smithi012.stdout:0/776: rename d10/d14/d2b/d3b to d10/d14/d41/d61/d74/dfc 0 2024-02-14T13:10:40.559 INFO:tasks.workunit.client.0.smithi012.stdout:0/777: readlink d10/l85 0 2024-02-14T13:10:40.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:40 smithi055 ceph-mon[36853]: pgmap v406: 97 pgs: 97 active+clean; 699 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 MiB/s rd, 93 MiB/s wr, 1.01k op/s 2024-02-14T13:10:40.560 INFO:tasks.workunit.client.0.smithi012.stdout:6/702: creat d1/d1e/dc/fe5 x:0 0 0 2024-02-14T13:10:40.561 INFO:tasks.workunit.client.0.smithi012.stdout:1/730: getdents d6/d10/d22/d31/d5b/d5e/d65/db4 0 2024-02-14T13:10:40.562 INFO:tasks.workunit.client.0.smithi012.stdout:5/823: unlink dc/d17/d20/d4c/l91 0 2024-02-14T13:10:40.563 INFO:tasks.workunit.client.0.smithi012.stdout:6/703: dread d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:40.563 INFO:tasks.workunit.client.0.smithi012.stdout:6/704: stat d1/d1e/f20 0 2024-02-14T13:10:40.566 INFO:tasks.workunit.client.0.smithi012.stdout:2/779: mknod d0/d8/d11/d33/d5c/dc2/c10d 0 2024-02-14T13:10:40.566 INFO:tasks.workunit.client.0.smithi012.stdout:8/717: dwrite d9/dc/d14/d2e/dde/d56/d57/d7c/fea [0,4194304] 0 2024-02-14T13:10:40.568 INFO:tasks.workunit.client.0.smithi012.stdout:4/686: dwrite d0/de1/fef [0,4194304] 0 2024-02-14T13:10:40.568 INFO:tasks.workunit.client.0.smithi012.stdout:4/687: dread - d0/d10/d28/f45 zero size 2024-02-14T13:10:40.568 INFO:tasks.workunit.client.0.smithi012.stdout:9/807: creat da/dd/d19/df3/f10f x:0 0 0 2024-02-14T13:10:40.569 INFO:tasks.workunit.client.0.smithi012.stdout:1/731: rename d6/d10/d22/d31/d5b/d5e/f9f to d6/d10/d22/d31/d34/fe6 0 2024-02-14T13:10:40.571 INFO:tasks.workunit.client.0.smithi012.stdout:5/824: unlink dc/d47/c62 0 2024-02-14T13:10:40.574 INFO:tasks.workunit.client.0.smithi012.stdout:6/705: write d1/df/d24/d3f/d56/f76 [1718848,7075] 0 2024-02-14T13:10:40.574 INFO:tasks.workunit.client.0.smithi012.stdout:6/706: readlink d1/df/d24/daf/ld5 0 2024-02-14T13:10:40.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/718: mkdir d9/dc/d38/d6a/df2 0 2024-02-14T13:10:40.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/719: dread - d9/dc/d38/fdb zero size 2024-02-14T13:10:40.577 INFO:tasks.workunit.client.0.smithi012.stdout:4/688: creat d0/d10/d28/d4f/d6b/d83/d99/ff8 x:0 0 0 2024-02-14T13:10:40.579 INFO:tasks.workunit.client.0.smithi012.stdout:2/780: rename d0/d8/d11/d35/dd0/d70/f7f to d0/d6/de/d7b/da8/f10e 0 2024-02-14T13:10:40.580 INFO:tasks.workunit.client.0.smithi012.stdout:1/732: creat d6/d10/d22/d44/fe7 x:0 0 0 2024-02-14T13:10:40.581 INFO:tasks.workunit.client.0.smithi012.stdout:6/707: symlink d1/df/d24/d3f/d56/le6 0 2024-02-14T13:10:40.581 INFO:tasks.workunit.client.0.smithi012.stdout:6/708: stat d1/d1e/d1b/d6d/fbc 0 2024-02-14T13:10:40.582 INFO:tasks.workunit.client.0.smithi012.stdout:0/778: dwrite d10/d14/d1b/d7e/f97 [0,4194304] 0 2024-02-14T13:10:40.582 INFO:tasks.workunit.client.0.smithi012.stdout:8/720: creat d9/dc/d14/d2e/dde/da3/ded/da5/ff3 x:0 0 0 2024-02-14T13:10:40.583 INFO:tasks.workunit.client.0.smithi012.stdout:8/721: write d9/dc/d1b/f9f [897247,101273] 0 2024-02-14T13:10:40.583 INFO:tasks.workunit.client.0.smithi012.stdout:8/722: write d9/dc/d14/d2e/dde/da3/de9/fd9 [192121,104478] 0 2024-02-14T13:10:40.583 INFO:tasks.workunit.client.0.smithi012.stdout:4/689: creat d0/d10/d28/da9/d86/db5/ff9 x:0 0 0 2024-02-14T13:10:40.584 INFO:tasks.workunit.client.0.smithi012.stdout:1/733: write d6/d10/d22/d31/d5b/d5d/d6d/f7b [1605470,128287] 0 2024-02-14T13:10:40.586 INFO:tasks.workunit.client.0.smithi012.stdout:6/709: creat d1/df/d24/fe7 x:0 0 0 2024-02-14T13:10:40.590 INFO:tasks.workunit.client.0.smithi012.stdout:0/779: creat d10/d14/d41/d52/d78/d8c/d7f/ffd x:0 0 0 2024-02-14T13:10:40.590 INFO:tasks.workunit.client.0.smithi012.stdout:8/723: write d9/dc/f2c [1681542,130317] 0 2024-02-14T13:10:40.592 INFO:tasks.workunit.client.0.smithi012.stdout:4/690: link d0/f6 d0/d10/d28/da9/d86/ffa 0 2024-02-14T13:10:40.593 INFO:tasks.workunit.client.0.smithi012.stdout:2/781: truncate d0/d6/d37/fdd 1117151 0 2024-02-14T13:10:40.596 INFO:tasks.workunit.client.0.smithi012.stdout:1/734: rename d6/d10/d22/d31/d34/d3b/f81 to d6/d10/d22/d31/d3e/d71/fe8 0 2024-02-14T13:10:40.596 INFO:tasks.workunit.client.0.smithi012.stdout:9/808: dwrite da/dd/d19/df3/d85/f51 [0,4194304] 0 2024-02-14T13:10:40.597 INFO:tasks.workunit.client.0.smithi012.stdout:0/780: mkdir d10/d14/d1b/d30/dfe 0 2024-02-14T13:10:40.597 INFO:tasks.workunit.client.0.smithi012.stdout:0/781: chown d10/d14/d41/d52/d56 260 1 2024-02-14T13:10:40.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/735: rmdir d6/d10/d22/d31/d34/d58/d61 39 2024-02-14T13:10:40.598 INFO:tasks.workunit.client.0.smithi012.stdout:1/736: chown d6/fe 10 1 2024-02-14T13:10:40.599 INFO:tasks.workunit.client.0.smithi012.stdout:4/691: dread d0/d10/f3b [0,4194304] 0 2024-02-14T13:10:40.599 INFO:tasks.workunit.client.0.smithi012.stdout:4/692: fdatasync d0/d10/f3b 0 2024-02-14T13:10:40.600 INFO:tasks.workunit.client.0.smithi012.stdout:0/782: mkdir d10/d14/d41/d52/d78/df9/dff 0 2024-02-14T13:10:40.600 INFO:tasks.workunit.client.0.smithi012.stdout:2/782: mknod d0/d8/d11/d35/dd0/c10f 0 2024-02-14T13:10:40.601 INFO:tasks.workunit.client.0.smithi012.stdout:1/737: mkdir d6/d10/d22/d31/d5b/d5d/d6d/de9 0 2024-02-14T13:10:40.601 INFO:tasks.workunit.client.0.smithi012.stdout:4/693: mkdir d0/d10/d28/d4f/dc7/dfb 0 2024-02-14T13:10:40.602 INFO:tasks.workunit.client.0.smithi012.stdout:4/694: dread - d0/d10/d28/da9/fc3 zero size 2024-02-14T13:10:40.602 INFO:tasks.workunit.client.0.smithi012.stdout:4/695: chown d0/d10/d28/da9/d86/db5/ff9 235795 1 2024-02-14T13:10:40.602 INFO:tasks.workunit.client.0.smithi012.stdout:1/738: dread d6/d10/d22/d44/f52 [0,4194304] 0 2024-02-14T13:10:40.602 INFO:tasks.workunit.client.0.smithi012.stdout:1/739: read d6/d10/d22/d44/f52 [95186,97139] 0 2024-02-14T13:10:40.602 INFO:tasks.workunit.client.0.smithi012.stdout:0/783: mknod d10/d14/d41/d61/d74/dfc/c100 0 2024-02-14T13:10:40.604 INFO:tasks.workunit.client.0.smithi012.stdout:8/724: fdatasync d9/dc/f2c 0 2024-02-14T13:10:40.604 INFO:tasks.workunit.client.0.smithi012.stdout:8/725: chown d9/dc/d14/d2e/f54 4813148 1 2024-02-14T13:10:40.605 INFO:tasks.workunit.client.0.smithi012.stdout:2/783: rename d0/d1a/de4/d15 to d0/d8/d11/d33/d53/d110 0 2024-02-14T13:10:40.605 INFO:tasks.workunit.client.0.smithi012.stdout:2/784: fdatasync d0/d1a/de4/d50/d68/f107 0 2024-02-14T13:10:40.605 INFO:tasks.workunit.client.0.smithi012.stdout:2/785: chown d0/d1a/de4/d50/d68/d9c/lb4 166373 1 2024-02-14T13:10:40.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/696: creat d0/d10/d28/ffc x:0 0 0 2024-02-14T13:10:40.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/697: chown d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fe3 5875 1 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/784: symlink d10/d14/d2b/da4/l101 0 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:0/785: write d10/d14/d41/d52/d78/d8c/dce/fd6 [626809,72329] 0 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/740: write d6/d35/f8c [160273,1123] 0 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/741: chown d6/d10/d22/d31/d34/fbe 21 1 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/742: chown d6/d10/d22/d31/d5b/dcd 0 1 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:5/825: dwrite dc/d47/fb2 [0,4194304] 0 2024-02-14T13:10:40.608 INFO:tasks.workunit.client.0.smithi012.stdout:5/826: read - dc/d17/d20/d4c/d63/d81/ddd/ffc zero size 2024-02-14T13:10:40.609 INFO:tasks.workunit.client.0.smithi012.stdout:5/827: dread dc/f33 [0,4194304] 0 2024-02-14T13:10:40.610 INFO:tasks.workunit.client.0.smithi012.stdout:8/726: unlink d9/dc/d14/d2e/dde/lc9 0 2024-02-14T13:10:40.611 INFO:tasks.workunit.client.0.smithi012.stdout:9/809: dread da/dd/d19/df3/fd1 [0,4194304] 0 2024-02-14T13:10:40.611 INFO:tasks.workunit.client.0.smithi012.stdout:9/810: readlink da/dd/l35 0 2024-02-14T13:10:40.612 INFO:tasks.workunit.client.0.smithi012.stdout:2/786: mkdir d0/d8/d11/d33/dc3/d111 0 2024-02-14T13:10:40.612 INFO:tasks.workunit.client.0.smithi012.stdout:2/787: fsync d0/f2f 0 2024-02-14T13:10:40.612 INFO:tasks.workunit.client.0.smithi012.stdout:2/788: chown d0/d8/d11/d33/d5c/dc2/cef 1 1 2024-02-14T13:10:40.612 INFO:tasks.workunit.client.0.smithi012.stdout:2/789: dread - d0/d8/d11/d33/d63/f102 zero size 2024-02-14T13:10:40.614 INFO:tasks.workunit.client.0.smithi012.stdout:4/698: link d0/d10/d28/d4f/d6b/fdd d0/d10/d28/d4f/d6b/d8f/d56/df7/ffd 0 2024-02-14T13:10:40.616 INFO:tasks.workunit.client.0.smithi012.stdout:0/786: rmdir d10/d84 39 2024-02-14T13:10:40.619 INFO:tasks.workunit.client.0.smithi012.stdout:9/811: write da/dd/d38/d7e/f101 [5337073,103411] 0 2024-02-14T13:10:40.622 INFO:tasks.workunit.client.0.smithi012.stdout:1/743: symlink d6/d10/d22/d31/d34/da0/lea 0 2024-02-14T13:10:40.625 INFO:tasks.workunit.client.0.smithi012.stdout:5/828: mkdir dc/d17/d20/d4c/d7b/d101 0 2024-02-14T13:10:40.626 INFO:tasks.workunit.client.0.smithi012.stdout:8/727: creat d9/dc/d14/d23/d62/ff4 x:0 0 0 2024-02-14T13:10:40.627 INFO:tasks.workunit.client.0.smithi012.stdout:2/790: mkdir d0/d8/d11/d33/d112 0 2024-02-14T13:10:40.628 INFO:tasks.workunit.client.0.smithi012.stdout:4/699: mknod d0/d10/d28/d4f/cfe 0 2024-02-14T13:10:40.628 INFO:tasks.workunit.client.0.smithi012.stdout:4/700: write d0/d10/d28/d4f/d6b/d83/d17/d5f/fdf [980475,109723] 0 2024-02-14T13:10:40.630 INFO:tasks.workunit.client.0.smithi012.stdout:0/787: rename c8 to d10/d84/d93/c102 0 2024-02-14T13:10:40.631 INFO:tasks.workunit.client.0.smithi012.stdout:9/812: symlink da/dd/l110 0 2024-02-14T13:10:40.633 INFO:tasks.workunit.client.0.smithi012.stdout:1/744: creat d6/d10/d22/d31/d34/d58/feb x:0 0 0 2024-02-14T13:10:40.633 INFO:tasks.workunit.client.0.smithi012.stdout:1/745: write d6/d10/d22/d31/d34/d58/d61/f9d [889767,27646] 0 2024-02-14T13:10:40.633 INFO:tasks.workunit.client.0.smithi012.stdout:5/829: symlink dc/d2f/d94/l102 0 2024-02-14T13:10:40.634 INFO:tasks.workunit.client.0.smithi012.stdout:8/728: symlink d9/dc/lf5 0 2024-02-14T13:10:40.635 INFO:tasks.workunit.client.0.smithi012.stdout:2/791: mkdir d0/d6/d37/d84/d51/d113 0 2024-02-14T13:10:40.635 INFO:tasks.workunit.client.0.smithi012.stdout:2/792: dread - d0/d1a/de4/d50/d68/d9c/f100 zero size 2024-02-14T13:10:40.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/793: stat d0/d8/d11/d35/dd0/d70/db0/c103 0 2024-02-14T13:10:40.638 INFO:tasks.workunit.client.0.smithi012.stdout:4/701: rename d0/d10/d28/d4f/d6b/d8f/l54 to d0/d10/d28/d4f/d6b/lff 0 2024-02-14T13:10:40.639 INFO:tasks.workunit.client.0.smithi012.stdout:0/788: creat d10/d14/d41/d61/f103 x:0 0 0 2024-02-14T13:10:40.639 INFO:tasks.workunit.client.0.smithi012.stdout:0/789: write d10/fa9 [817882,116598] 0 2024-02-14T13:10:40.642 INFO:tasks.workunit.client.0.smithi012.stdout:1/746: rename d6/d10/d22/dc0 to d6/d10/d22/d31/d5b/d5e/d65/dec 0 2024-02-14T13:10:40.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/702: creat d0/d10/d28/da9/f100 x:0 0 0 2024-02-14T13:10:40.646 INFO:tasks.workunit.client.0.smithi012.stdout:0/790: creat d10/f104 x:0 0 0 2024-02-14T13:10:40.646 INFO:tasks.workunit.client.0.smithi012.stdout:2/794: dread d0/d2d/f77 [0,4194304] 0 2024-02-14T13:10:40.651 INFO:tasks.workunit.client.0.smithi012.stdout:4/703: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/c101 0 2024-02-14T13:10:40.653 INFO:tasks.workunit.client.0.smithi012.stdout:5/830: dwrite dc/d2f/d40/d53/d97/d98/fb0 [0,4194304] 0 2024-02-14T13:10:40.653 INFO:tasks.workunit.client.0.smithi012.stdout:1/747: dread d6/d10/f7a [0,4194304] 0 2024-02-14T13:10:40.653 INFO:tasks.workunit.client.0.smithi012.stdout:9/813: dwrite da/dd/f53 [0,4194304] 0 2024-02-14T13:10:40.653 INFO:tasks.workunit.client.0.smithi012.stdout:9/814: write da/d4f/f60 [1522266,82282] 0 2024-02-14T13:10:40.654 INFO:tasks.workunit.client.0.smithi012.stdout:3/685: sync 2024-02-14T13:10:40.654 INFO:tasks.workunit.client.0.smithi012.stdout:7/672: sync 2024-02-14T13:10:40.656 INFO:tasks.workunit.client.0.smithi012.stdout:2/795: write d0/f2 [1775077,126327] 0 2024-02-14T13:10:40.665 INFO:tasks.workunit.client.0.smithi012.stdout:2/796: symlink d0/d8/d89/l114 0 2024-02-14T13:10:40.665 INFO:tasks.workunit.client.0.smithi012.stdout:2/797: chown d0/d1a/de4/d50/d68/d9c/f9f 77 1 2024-02-14T13:10:40.666 INFO:tasks.workunit.client.0.smithi012.stdout:9/815: dread f0 [4194304,4194304] 0 2024-02-14T13:10:40.666 INFO:tasks.workunit.client.0.smithi012.stdout:1/748: truncate d6/d10/f3a 1400635 0 2024-02-14T13:10:40.667 INFO:tasks.workunit.client.0.smithi012.stdout:9/816: creat da/dd/d18/f111 x:0 0 0 2024-02-14T13:10:40.668 INFO:tasks.workunit.client.0.smithi012.stdout:9/817: chown da/dd/d19/d30/d9d/fc9 15873430 1 2024-02-14T13:10:40.668 INFO:tasks.workunit.client.0.smithi012.stdout:9/818: truncate da/dd/d57/d59/d73/db6/df1/fbb 4471412 0 2024-02-14T13:10:40.669 INFO:tasks.workunit.client.0.smithi012.stdout:1/749: unlink d6/d10/d22/d44/fe7 0 2024-02-14T13:10:40.669 INFO:tasks.workunit.client.0.smithi012.stdout:1/750: write d6/d10/d22/d31/d5b/d5d/f6e [256303,69777] 0 2024-02-14T13:10:40.669 INFO:tasks.workunit.client.0.smithi012.stdout:2/798: write d0/d6/d37/fdd [365549,5615] 0 2024-02-14T13:10:40.669 INFO:tasks.workunit.client.0.smithi012.stdout:2/799: fdatasync d0/d8/d11/d35/dd0/df0/ff1 0 2024-02-14T13:10:40.669 INFO:tasks.workunit.client.0.smithi012.stdout:9/819: mknod da/d4f/c112 0 2024-02-14T13:10:40.671 INFO:tasks.workunit.client.0.smithi012.stdout:4/704: dwrite d0/d10/d1f/fb7 [0,4194304] 0 2024-02-14T13:10:40.671 INFO:tasks.workunit.client.0.smithi012.stdout:8/729: rename d9/dc/d14/d2e/c46 to d9/dc/d14/d2e/dde/d56/d57/d92/df1/cf6 0 2024-02-14T13:10:40.672 INFO:tasks.workunit.client.0.smithi012.stdout:1/751: creat d6/d10/d22/d31/d5b/d5e/d65/db4/fed x:0 0 0 2024-02-14T13:10:40.672 INFO:tasks.workunit.client.0.smithi012.stdout:1/752: getdents d6/d10/d22/d31/d5b/d5d/de3 0 2024-02-14T13:10:40.673 INFO:tasks.workunit.client.0.smithi012.stdout:2/800: creat d0/d8/d11/d35/dd0/d70/f115 x:0 0 0 2024-02-14T13:10:40.674 INFO:tasks.workunit.client.0.smithi012.stdout:9/820: creat da/dd/d38/d7e/ddc/f113 x:0 0 0 2024-02-14T13:10:40.676 INFO:tasks.workunit.client.0.smithi012.stdout:4/705: mknod d0/d10/d1f/c102 0 2024-02-14T13:10:40.676 INFO:tasks.workunit.client.0.smithi012.stdout:3/686: dwrite d9/d13/dea/dc9/fe7 [0,4194304] 0 2024-02-14T13:10:40.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/821: mkdir da/dd/d57/dfb/d114 0 2024-02-14T13:10:40.679 INFO:tasks.workunit.client.0.smithi012.stdout:7/673: dwrite df/d24/d9e/fa3 [0,4194304] 0 2024-02-14T13:10:40.682 INFO:tasks.workunit.client.0.smithi012.stdout:3/687: rename d9/d18/daf to d9/dd/de/d58/d65/df0 0 2024-02-14T13:10:40.682 INFO:tasks.workunit.client.0.smithi012.stdout:1/753: dread d6/d10/d22/d31/fdd [0,4194304] 0 2024-02-14T13:10:40.683 INFO:tasks.workunit.client.0.smithi012.stdout:8/730: mknod d9/dc/d14/d2e/dde/cf7 0 2024-02-14T13:10:40.685 INFO:tasks.workunit.client.0.smithi012.stdout:7/674: mknod df/d2d/d5d/d72/de8/cee 0 2024-02-14T13:10:40.686 INFO:tasks.workunit.client.0.smithi012.stdout:6/710: sync 2024-02-14T13:10:40.687 INFO:tasks.workunit.client.0.smithi012.stdout:3/688: creat d9/d3f/d88/dc0/ff1 x:0 0 0 2024-02-14T13:10:40.689 INFO:tasks.workunit.client.0.smithi012.stdout:8/731: creat d9/dc/d14/d2e/ff8 x:0 0 0 2024-02-14T13:10:40.689 INFO:tasks.workunit.client.0.smithi012.stdout:8/732: chown d9/dc/d14/d2e/dde/d56/d57/c91 499925 1 2024-02-14T13:10:40.690 INFO:tasks.workunit.client.0.smithi012.stdout:6/711: unlink d1/d1e/f20 0 2024-02-14T13:10:40.690 INFO:tasks.workunit.client.0.smithi012.stdout:6/712: stat d1/d1e/d1b/d21 0 2024-02-14T13:10:40.691 INFO:tasks.workunit.client.0.smithi012.stdout:1/754: dread d6/d10/d22/d31/f40 [0,4194304] 0 2024-02-14T13:10:40.691 INFO:tasks.workunit.client.0.smithi012.stdout:1/755: stat d6/d10/d22/d31/d5b/d5e/l4d 0 2024-02-14T13:10:40.697 INFO:tasks.workunit.client.0.smithi012.stdout:6/713: write d1/d1e/d1b/f57 [3091616,24968] 0 2024-02-14T13:10:40.698 INFO:tasks.workunit.client.0.smithi012.stdout:9/822: dwrite da/dd/d38/d7e/ddc/fe2 [0,4194304] 0 2024-02-14T13:10:40.698 INFO:tasks.workunit.client.0.smithi012.stdout:6/714: creat d1/d1e/d1b/d6d/fe8 x:0 0 0 2024-02-14T13:10:40.701 INFO:tasks.workunit.client.0.smithi012.stdout:6/715: unlink d1/d1e/dc/d38/fba 0 2024-02-14T13:10:40.701 INFO:tasks.workunit.client.0.smithi012.stdout:6/716: truncate d1/d1e/dc/d28/fd9 2386036 0 2024-02-14T13:10:40.701 INFO:tasks.workunit.client.0.smithi012.stdout:6/717: readlink d1/d1e/dc/d28/lb6 0 2024-02-14T13:10:40.702 INFO:tasks.workunit.client.0.smithi012.stdout:6/718: getdents d1/df/d16/d7c 0 2024-02-14T13:10:40.702 INFO:tasks.workunit.client.0.smithi012.stdout:6/719: write d1/d1e/d1b/d3e/f8c [9274400,82473] 0 2024-02-14T13:10:40.702 INFO:tasks.workunit.client.0.smithi012.stdout:6/720: write d1/df/d24/d5f/fcd [734471,24603] 0 2024-02-14T13:10:40.704 INFO:tasks.workunit.client.0.smithi012.stdout:6/721: unlink d1/d1e/dc/d43/fbb 0 2024-02-14T13:10:40.706 INFO:tasks.workunit.client.0.smithi012.stdout:6/722: rmdir d1/d1e/dc/d28 39 2024-02-14T13:10:40.707 INFO:tasks.workunit.client.0.smithi012.stdout:1/756: dread d6/d10/d22/d31/d5b/d5d/d6d/f72 [0,4194304] 0 2024-02-14T13:10:40.707 INFO:tasks.workunit.client.0.smithi012.stdout:6/723: mkdir d1/d1e/d1b/d21/d69/de9 0 2024-02-14T13:10:40.707 INFO:tasks.workunit.client.0.smithi012.stdout:6/724: fdatasync d1/df/fcc 0 2024-02-14T13:10:40.707 INFO:tasks.workunit.client.0.smithi012.stdout:9/823: write da/dd/f2b [1587402,60707] 0 2024-02-14T13:10:40.709 INFO:tasks.workunit.client.0.smithi012.stdout:9/824: symlink da/dd/d19/d30/d9d/dce/l115 0 2024-02-14T13:10:40.709 INFO:tasks.workunit.client.0.smithi012.stdout:9/825: fsync da/dd/d57/fc7 0 2024-02-14T13:10:40.717 INFO:tasks.workunit.client.0.smithi012.stdout:1/757: write d6/d10/d22/d31/d34/fb0 [2028249,4120] 0 2024-02-14T13:10:40.718 INFO:tasks.workunit.client.0.smithi012.stdout:1/758: creat d6/d10/d22/d31/d34/d3b/fee x:0 0 0 2024-02-14T13:10:40.719 INFO:tasks.workunit.client.0.smithi012.stdout:1/759: unlink d6/d10/d22/d31/ldc 0 2024-02-14T13:10:40.728 INFO:tasks.workunit.client.0.smithi012.stdout:6/725: dwrite d1/df/d24/daf/f53 [0,4194304] 0 2024-02-14T13:10:40.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/760: symlink d6/d10/d22/d31/d5b/d5d/d6d/de9/lef 0 2024-02-14T13:10:40.759 INFO:tasks.workunit.client.0.smithi012.stdout:1/761: write d6/d10/d22/d31/d34/f57 [4518911,8910] 0 2024-02-14T13:10:40.761 INFO:tasks.workunit.client.0.smithi012.stdout:4/706: getdents d0/d10/d1f 0 2024-02-14T13:10:40.764 INFO:tasks.workunit.client.0.smithi012.stdout:4/707: creat d0/d10/d28/d4f/d6b/d8f/f103 x:0 0 0 2024-02-14T13:10:40.764 INFO:tasks.workunit.client.0.smithi012.stdout:4/708: getdents d0/de1/de8/dd9/ddc 0 2024-02-14T13:10:40.766 INFO:tasks.workunit.client.0.smithi012.stdout:1/762: rename d6/d35 to d6/d10/df0 0 2024-02-14T13:10:40.768 INFO:tasks.workunit.client.0.smithi012.stdout:4/709: unlink d0/d10/d28/d4f/d6b/d8f/d56/d8c/fb9 0 2024-02-14T13:10:40.768 INFO:tasks.workunit.client.0.smithi012.stdout:1/763: creat d6/d10/d22/d31/d34/d3b/ff1 x:0 0 0 2024-02-14T13:10:40.769 INFO:tasks.workunit.client.0.smithi012.stdout:1/764: read d6/d10/d22/d31/d3e/d71/fe8 [310725,79004] 0 2024-02-14T13:10:40.769 INFO:tasks.workunit.client.0.smithi012.stdout:4/710: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/dce/c104 0 2024-02-14T13:10:40.770 INFO:tasks.workunit.client.0.smithi012.stdout:4/711: dread d0/d10/fe5 [0,4194304] 0 2024-02-14T13:10:40.770 INFO:tasks.workunit.client.0.smithi012.stdout:4/712: write d0/d10/d28/f45 [986118,35088] 0 2024-02-14T13:10:40.771 INFO:tasks.workunit.client.0.smithi012.stdout:1/765: dread d6/d10/d22/d31/d5b/d5e/d65/db4/fb8 [0,4194304] 0 2024-02-14T13:10:40.771 INFO:tasks.workunit.client.0.smithi012.stdout:1/766: chown d6/d10/d22/d31/d34/d3b/f43 22 1 2024-02-14T13:10:40.772 INFO:tasks.workunit.client.0.smithi012.stdout:4/713: rename d0/c31 to d0/d10/d28/d4f/d6b/d83/d17/d5f/dcc/c105 0 2024-02-14T13:10:40.779 INFO:tasks.workunit.client.0.smithi012.stdout:1/767: dread d6/d10/d22/d31/d5b/d5e/f3f [0,4194304] 0 2024-02-14T13:10:40.779 INFO:tasks.workunit.client.0.smithi012.stdout:7/675: dwrite df/d36/d67/fa7 [0,4194304] 0 2024-02-14T13:10:40.779 INFO:tasks.workunit.client.0.smithi012.stdout:1/768: read - d6/d10/d22/d31/d34/d58/f9a zero size 2024-02-14T13:10:40.779 INFO:tasks.workunit.client.0.smithi012.stdout:7/676: truncate df/d2d/d5d/d72/d8a/f9a 1045468 0 2024-02-14T13:10:40.779 INFO:tasks.workunit.client.0.smithi012.stdout:7/677: chown df/d27/d4b/f8e 1675936 1 2024-02-14T13:10:40.779 INFO:tasks.workunit.client.0.smithi012.stdout:7/678: chown df/d27/d4b/d6b/fc2 1832 1 2024-02-14T13:10:40.780 INFO:tasks.workunit.client.0.smithi012.stdout:6/726: dwrite d1/df/d24/d3f/d56/d93/d95/fd0 [4194304,4194304] 0 2024-02-14T13:10:40.780 INFO:tasks.workunit.client.0.smithi012.stdout:8/733: dwrite d9/dc/d38/d6a/fb4 [4194304,4194304] 0 2024-02-14T13:10:40.780 INFO:tasks.workunit.client.0.smithi012.stdout:9/826: dwrite da/dd/d57/d59/d73/db6/df1/f9a [0,4194304] 0 2024-02-14T13:10:40.784 INFO:tasks.workunit.client.0.smithi012.stdout:1/769: rename d6/d10/d22/d31/d5b/d5e/laf to d6/d10/d22/d31/d5b/d5d/d80/da4/lf2 0 2024-02-14T13:10:40.784 INFO:tasks.workunit.client.0.smithi012.stdout:1/770: read - d6/d10/d22/d31/d34/d3b/ff1 zero size 2024-02-14T13:10:40.784 INFO:tasks.workunit.client.0.smithi012.stdout:1/771: write d6/d10/d22/d31/d5b/dcd/da2/fd5 [388376,120220] 0 2024-02-14T13:10:40.784 INFO:tasks.workunit.client.0.smithi012.stdout:1/772: fsync d6/d10/d22/d31/d34/d3b/f53 0 2024-02-14T13:10:40.786 INFO:tasks.workunit.client.0.smithi012.stdout:6/727: getdents d1 0 2024-02-14T13:10:40.793 INFO:tasks.workunit.client.0.smithi012.stdout:4/714: dwrite d0/f5c [0,4194304] 0 2024-02-14T13:10:40.793 INFO:tasks.workunit.client.0.smithi012.stdout:4/715: truncate d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fbd 256688 0 2024-02-14T13:10:40.798 INFO:tasks.workunit.client.0.smithi012.stdout:7/679: dwrite df/d24/f87 [0,4194304] 0 2024-02-14T13:10:40.799 INFO:tasks.workunit.client.0.smithi012.stdout:9/827: mkdir da/dd/d57/d59/d116 0 2024-02-14T13:10:40.799 INFO:tasks.workunit.client.0.smithi012.stdout:9/828: dread - da/dd/d57/d59/d73/db6/df1/d8d/fee zero size 2024-02-14T13:10:40.799 INFO:tasks.workunit.client.0.smithi012.stdout:9/829: fsync da/f3f 0 2024-02-14T13:10:40.801 INFO:tasks.workunit.client.0.smithi012.stdout:8/734: dread d9/dc/d14/d2e/f54 [0,4194304] 0 2024-02-14T13:10:40.801 INFO:tasks.workunit.client.0.smithi012.stdout:8/735: write d9/dc/f9d [711049,9923] 0 2024-02-14T13:10:40.801 INFO:tasks.workunit.client.0.smithi012.stdout:8/736: dread - d9/dc/d14/d2e/dde/fd1 zero size 2024-02-14T13:10:40.801 INFO:tasks.workunit.client.0.smithi012.stdout:1/773: mkdir d6/d10/d22/d31/d34/df3 0 2024-02-14T13:10:40.802 INFO:tasks.workunit.client.0.smithi012.stdout:4/716: creat d0/d10/d28/d4f/d6b/d83/f106 x:0 0 0 2024-02-14T13:10:40.803 INFO:tasks.workunit.client.0.smithi012.stdout:4/717: write d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 [4899699,29339] 0 2024-02-14T13:10:40.803 INFO:tasks.workunit.client.0.smithi012.stdout:4/718: fdatasync d0/d10/feb 0 2024-02-14T13:10:40.803 INFO:tasks.workunit.client.0.smithi012.stdout:6/728: dwrite d1/d1e/d1b/da8/f68 [0,4194304] 0 2024-02-14T13:10:40.804 INFO:tasks.workunit.client.0.smithi012.stdout:4/719: creat d0/d10/f107 x:0 0 0 2024-02-14T13:10:40.806 INFO:tasks.workunit.client.0.smithi012.stdout:9/830: dread da/dd/d57/d59/d73/db6/df1/f9a [0,4194304] 0 2024-02-14T13:10:40.806 INFO:tasks.workunit.client.0.smithi012.stdout:9/831: write da/dd/fe8 [731004,14143] 0 2024-02-14T13:10:40.812 INFO:tasks.workunit.client.0.smithi012.stdout:4/720: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa [0,4194304] 0 2024-02-14T13:10:40.815 INFO:tasks.workunit.client.0.smithi012.stdout:6/729: mkdir d1/df/d50/db4/dea 0 2024-02-14T13:10:40.815 INFO:tasks.workunit.client.0.smithi012.stdout:6/730: chown d1/df/d24/d5f/da0/dda 35 1 2024-02-14T13:10:40.816 INFO:tasks.workunit.client.0.smithi012.stdout:7/680: dwrite df/d27/f66 [0,4194304] 0 2024-02-14T13:10:40.817 INFO:tasks.workunit.client.0.smithi012.stdout:4/721: rename d0/d10/d28/d4f/f7a to d0/d10/d28/d62/f108 0 2024-02-14T13:10:40.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/774: dread d6/d10/d22/d31/d3e/f4f [0,4194304] 0 2024-02-14T13:10:40.818 INFO:tasks.workunit.client.0.smithi012.stdout:6/731: creat d1/df/d24/d3f/d56/d93/feb x:0 0 0 2024-02-14T13:10:40.818 INFO:tasks.workunit.client.0.smithi012.stdout:6/732: stat d1/df/d16/d7c/d97/d82/da5/ld2 0 2024-02-14T13:10:40.825 INFO:tasks.workunit.client.0.smithi012.stdout:9/832: dwrite da/dd/d19/df3/d85/d48/fde [0,4194304] 0 2024-02-14T13:10:40.825 INFO:tasks.workunit.client.0.smithi012.stdout:9/833: truncate da/dd/d38/fe0 783785 0 2024-02-14T13:10:40.825 INFO:tasks.workunit.client.0.smithi012.stdout:0/791: sync 2024-02-14T13:10:40.827 INFO:tasks.workunit.client.0.smithi012.stdout:7/681: write df/f23 [3200572,32972] 0 2024-02-14T13:10:40.829 INFO:tasks.workunit.client.0.smithi012.stdout:7/682: creat df/d27/d4b/d6b/d6d/d85/db8/fef x:0 0 0 2024-02-14T13:10:40.830 INFO:tasks.workunit.client.0.smithi012.stdout:1/775: dread d6/ff [4194304,4194304] 0 2024-02-14T13:10:40.830 INFO:tasks.workunit.client.0.smithi012.stdout:1/776: write d6/d10/d22/d31/d5b/d5d/f6e [1097172,101914] 0 2024-02-14T13:10:40.831 INFO:tasks.workunit.client.0.smithi012.stdout:7/683: truncate df/d36/f5e 346409 0 2024-02-14T13:10:40.831 INFO:tasks.workunit.client.0.smithi012.stdout:1/777: dread d6/d10/d22/d31/d3e/fc4 [0,4194304] 0 2024-02-14T13:10:40.832 INFO:tasks.workunit.client.0.smithi012.stdout:5/831: sync 2024-02-14T13:10:40.832 INFO:tasks.workunit.client.0.smithi012.stdout:7/684: mkdir df/d24/d9e/df0 0 2024-02-14T13:10:40.832 INFO:tasks.workunit.client.0.smithi012.stdout:9/834: write da/faa [2194279,35499] 0 2024-02-14T13:10:40.833 INFO:tasks.workunit.client.0.smithi012.stdout:1/778: mkdir d6/d10/d22/d31/d5b/d5e/d65/df4 0 2024-02-14T13:10:40.834 INFO:tasks.workunit.client.0.smithi012.stdout:8/737: dwrite d9/dc/d14/d23/f41 [0,4194304] 0 2024-02-14T13:10:40.835 INFO:tasks.workunit.client.0.smithi012.stdout:9/835: creat da/dd/d38/d7e/d91/da6/f117 x:0 0 0 2024-02-14T13:10:40.836 INFO:tasks.workunit.client.0.smithi012.stdout:1/779: chown d6/d10/l60 30564 1 2024-02-14T13:10:40.837 INFO:tasks.workunit.client.0.smithi012.stdout:5/832: dread dc/d17/d20/d4c/f51 [0,4194304] 0 2024-02-14T13:10:40.838 INFO:tasks.workunit.client.0.smithi012.stdout:0/792: dread d10/d14/d1b/d54/d96/fdf [0,4194304] 0 2024-02-14T13:10:40.838 INFO:tasks.workunit.client.0.smithi012.stdout:4/722: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fe9 [0,4194304] 0 2024-02-14T13:10:40.841 INFO:tasks.workunit.client.0.smithi012.stdout:8/738: mknod d9/dc/d38/cf9 0 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:6/733: dwrite d1/d1e/d1b/da8/f68 [0,4194304] 0 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:6/734: chown d1/f9f 81 1 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:1/780: dread d6/d10/d22/d31/d3e/f4f [0,4194304] 0 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:1/781: write d6/d10/df0/fca [509702,96655] 0 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:6/735: write d1/df/d24/fe7 [617367,108644] 0 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:9/836: creat da/d33/d63/d106/f118 x:0 0 0 2024-02-14T13:10:40.842 INFO:tasks.workunit.client.0.smithi012.stdout:6/736: write d1/d1e/d1b/f57 [124385,33157] 0 2024-02-14T13:10:40.843 INFO:tasks.workunit.client.0.smithi012.stdout:6/737: chown d1/fb3 2 1 2024-02-14T13:10:40.847 INFO:tasks.workunit.client.0.smithi012.stdout:9/837: dread da/d33/d63/f76 [0,4194304] 0 2024-02-14T13:10:40.847 INFO:tasks.workunit.client.0.smithi012.stdout:9/838: chown da/dd/d18/dfc 7851929 1 2024-02-14T13:10:40.847 INFO:tasks.workunit.client.0.smithi012.stdout:4/723: getdents d0/d10/d28/d4f/d6b/d83/d99 0 2024-02-14T13:10:40.849 INFO:tasks.workunit.client.0.smithi012.stdout:9/839: dread da/d33/d63/d106/fe5 [0,4194304] 0 2024-02-14T13:10:40.849 INFO:tasks.workunit.client.0.smithi012.stdout:9/840: chown da/dd/d19/df3/d85/c50 1 1 2024-02-14T13:10:40.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/793: rmdir d10/d14/d1b 39 2024-02-14T13:10:40.849 INFO:tasks.workunit.client.0.smithi012.stdout:0/794: readlink d10/d14/d2b/l2d 0 2024-02-14T13:10:40.849 INFO:tasks.workunit.client.0.smithi012.stdout:7/685: dread df/d27/f2b [0,4194304] 0 2024-02-14T13:10:40.849 INFO:tasks.workunit.client.0.smithi012.stdout:5/833: read dc/d17/d20/f36 [1333959,106241] 0 2024-02-14T13:10:40.850 INFO:tasks.workunit.client.0.smithi012.stdout:8/739: mknod d9/dc/d14/d2e/dde/d56/d57/d7c/cfa 0 2024-02-14T13:10:40.852 INFO:tasks.workunit.client.0.smithi012.stdout:1/782: getdents d6/d10/d22/d31/d5b/d5e/d65/db4 0 2024-02-14T13:10:40.854 INFO:tasks.workunit.client.0.smithi012.stdout:0/795: unlink d10/d14/d41/d61/d74/fb3 0 2024-02-14T13:10:40.855 INFO:tasks.workunit.client.0.smithi012.stdout:7/686: dread df/d36/f5e [0,4194304] 0 2024-02-14T13:10:40.856 INFO:tasks.workunit.client.0.smithi012.stdout:4/724: write d0/f95 [5555644,121833] 0 2024-02-14T13:10:40.857 INFO:tasks.workunit.client.0.smithi012.stdout:5/834: write dc/d17/f43 [135082,21921] 0 2024-02-14T13:10:40.858 INFO:tasks.workunit.client.0.smithi012.stdout:8/740: readlink d9/dc/d14/d2e/l8d 0 2024-02-14T13:10:40.858 INFO:tasks.workunit.client.0.smithi012.stdout:8/741: fsync d9/dc/d14/d23/f41 0 2024-02-14T13:10:40.858 INFO:tasks.workunit.client.0.smithi012.stdout:1/783: mknod d6/d10/d22/d31/dd9/cf5 0 2024-02-14T13:10:40.858 INFO:tasks.workunit.client.0.smithi012.stdout:7/687: getdents df/d27/d4b/d8d/dd4 0 2024-02-14T13:10:40.858 INFO:tasks.workunit.client.0.smithi012.stdout:7/688: write df/d2d/d82/f97 [1445874,20528] 0 2024-02-14T13:10:40.859 INFO:tasks.workunit.client.0.smithi012.stdout:4/725: creat d0/d10/d28/f109 x:0 0 0 2024-02-14T13:10:40.861 INFO:tasks.workunit.client.0.smithi012.stdout:4/726: write d0/d10/d1f/fa7 [60889,28161] 0 2024-02-14T13:10:40.861 INFO:tasks.workunit.client.0.smithi012.stdout:5/835: rename dc/d2f/d40/d53/cce to dc/d2f/d89/c103 0 2024-02-14T13:10:40.861 INFO:tasks.workunit.client.0.smithi012.stdout:4/727: read - d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fb2 zero size 2024-02-14T13:10:40.861 INFO:tasks.workunit.client.0.smithi012.stdout:3/689: sync 2024-02-14T13:10:40.861 INFO:tasks.workunit.client.0.smithi012.stdout:2/801: sync 2024-02-14T13:10:40.862 INFO:tasks.workunit.client.0.smithi012.stdout:8/742: getdents d9/dc/d38 0 2024-02-14T13:10:40.862 INFO:tasks.workunit.client.0.smithi012.stdout:8/743: write d9/dc/d14/d23/f85 [590413,690] 0 2024-02-14T13:10:40.863 INFO:tasks.workunit.client.0.smithi012.stdout:9/841: dwrite da/dd/d19/fad [0,4194304] 0 2024-02-14T13:10:40.864 INFO:tasks.workunit.client.0.smithi012.stdout:1/784: unlink d6/d10/d22/d44/f52 0 2024-02-14T13:10:40.865 INFO:tasks.workunit.client.0.smithi012.stdout:5/836: mknod dc/d2f/d40/c104 0 2024-02-14T13:10:40.865 INFO:tasks.workunit.client.0.smithi012.stdout:3/690: creat d9/d68/ff2 x:0 0 0 2024-02-14T13:10:40.866 INFO:tasks.workunit.client.0.smithi012.stdout:2/802: rename d0/d20/l96 to d0/d6/d37/d84/d51/d113/l116 0 2024-02-14T13:10:40.866 INFO:tasks.workunit.client.0.smithi012.stdout:2/803: read d0/d6/d37/fdd [600340,51526] 0 2024-02-14T13:10:40.867 INFO:tasks.workunit.client.0.smithi012.stdout:8/744: creat d9/dc/d14/d2e/dde/da1/ffb x:0 0 0 2024-02-14T13:10:40.870 INFO:tasks.workunit.client.0.smithi012.stdout:5/837: rmdir dc/d17/d20/d4c/d7b/dfa/de7 39 2024-02-14T13:10:40.870 INFO:tasks.workunit.client.0.smithi012.stdout:3/691: rmdir d9/dd/d30/d44 39 2024-02-14T13:10:40.870 INFO:tasks.workunit.client.0.smithi012.stdout:3/692: chown d9/dd/d30/d44/d66 0 1 2024-02-14T13:10:40.872 INFO:tasks.workunit.client.0.smithi012.stdout:8/745: mkdir d9/dc/d38/dfc 0 2024-02-14T13:10:40.872 INFO:tasks.workunit.client.0.smithi012.stdout:1/785: read d6/d10/d22/d31/d5b/d5d/f1a [1433747,76084] 0 2024-02-14T13:10:40.872 INFO:tasks.workunit.client.0.smithi012.stdout:5/838: symlink dc/d2f/d70/dbc/l105 0 2024-02-14T13:10:40.873 INFO:tasks.workunit.client.0.smithi012.stdout:3/693: mkdir d9/d18/d39/df3 0 2024-02-14T13:10:40.874 INFO:tasks.workunit.client.0.smithi012.stdout:2/804: link d0/d1a/de4/fce d0/d1a/de4/f117 0 2024-02-14T13:10:40.874 INFO:tasks.workunit.client.0.smithi012.stdout:9/842: dread da/dd/d19/d30/f43 [0,4194304] 0 2024-02-14T13:10:40.874 INFO:tasks.workunit.client.0.smithi012.stdout:8/746: write d9/dc/d14/d2e/f3f [5049611,102225] 0 2024-02-14T13:10:40.874 INFO:tasks.workunit.client.0.smithi012.stdout:8/747: fdatasync d9/dc/d14/d23/f39 0 2024-02-14T13:10:40.875 INFO:tasks.workunit.client.0.smithi012.stdout:5/839: creat dc/d2f/f106 x:0 0 0 2024-02-14T13:10:40.876 INFO:tasks.workunit.client.0.smithi012.stdout:2/805: mkdir d0/d8/d11/d33/dc3/dd5/d118 0 2024-02-14T13:10:40.877 INFO:tasks.workunit.client.0.smithi012.stdout:9/843: link da/dd/d57/d59/d73/db6/cf8 da/dd/d19/d30/c119 0 2024-02-14T13:10:40.881 INFO:tasks.workunit.client.0.smithi012.stdout:9/844: rename f2 to da/dd/d38/d7e/d91/da6/f11a 0 2024-02-14T13:10:40.881 INFO:tasks.workunit.client.0.smithi012.stdout:2/806: dread d0/d8/d11/f17 [0,4194304] 0 2024-02-14T13:10:40.882 INFO:tasks.workunit.client.0.smithi012.stdout:9/845: symlink da/dd/d38/d7e/d91/l11b 0 2024-02-14T13:10:40.882 INFO:tasks.workunit.client.0.smithi012.stdout:9/846: truncate da/dd/d19/d30/d45/f7d 574854 0 2024-02-14T13:10:40.882 INFO:tasks.workunit.client.0.smithi012.stdout:9/847: fdatasync da/dd/d38/d7e/d91/f10b 0 2024-02-14T13:10:40.883 INFO:tasks.workunit.client.0.smithi012.stdout:9/848: creat da/dd/d38/d7e/f11c x:0 0 0 2024-02-14T13:10:40.885 INFO:tasks.workunit.client.0.smithi012.stdout:9/849: creat da/dd/d57/d59/d73/f11d x:0 0 0 2024-02-14T13:10:40.885 INFO:tasks.workunit.client.0.smithi012.stdout:9/850: write da/dd/d38/fe0 [1443174,54740] 0 2024-02-14T13:10:40.885 INFO:tasks.workunit.client.0.smithi012.stdout:3/694: write d9/dd/de/d58/d65/d6c/f7c [2283487,90339] 0 2024-02-14T13:10:40.889 INFO:tasks.workunit.client.0.smithi012.stdout:3/695: dread d9/dd/de/d58/d65/df0/fb2 [0,4194304] 0 2024-02-14T13:10:40.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/851: rename da/dd/d57/d59/d73/f107 to da/dd/d19/df3/d85/d48/f11e 0 2024-02-14T13:10:40.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/852: chown da/dd/d38/d7e/d91/da6 39 1 2024-02-14T13:10:40.889 INFO:tasks.workunit.client.0.smithi012.stdout:9/853: stat da/dd/d57/d59/f10e 0 2024-02-14T13:10:40.890 INFO:tasks.workunit.client.0.smithi012.stdout:3/696: mknod d9/d68/cf4 0 2024-02-14T13:10:40.891 INFO:tasks.workunit.client.0.smithi012.stdout:9/854: link da/dd/d57/d59/d73/db6/df1/f52 da/d4f/f11f 0 2024-02-14T13:10:40.891 INFO:tasks.workunit.client.0.smithi012.stdout:2/807: dread d0/d6/d37/fad [4194304,4194304] 0 2024-02-14T13:10:40.892 INFO:tasks.workunit.client.0.smithi012.stdout:9/855: read - da/dd/d57/db2/fd3 zero size 2024-02-14T13:10:40.892 INFO:tasks.workunit.client.0.smithi012.stdout:9/856: stat da/dd/d38/d7e/fb9 0 2024-02-14T13:10:40.892 INFO:tasks.workunit.client.0.smithi012.stdout:3/697: truncate d9/dd/d30/d44/d3d/f67 1694676 0 2024-02-14T13:10:40.892 INFO:tasks.workunit.client.0.smithi012.stdout:3/698: fsync d9/dd/d30/d34/d78/f96 0 2024-02-14T13:10:40.893 INFO:tasks.workunit.client.0.smithi012.stdout:2/808: dread d0/d8/d11/d35/dd0/d70/fd9 [0,4194304] 0 2024-02-14T13:10:40.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/857: rename da/dd/la4 to da/d33/l120 0 2024-02-14T13:10:40.895 INFO:tasks.workunit.client.0.smithi012.stdout:9/858: stat da/dd/d19/df3/d85/c10c 0 2024-02-14T13:10:40.896 INFO:tasks.workunit.client.0.smithi012.stdout:2/809: rename d0/d6/d37/d84/c8f to d0/d8/d9/c119 0 2024-02-14T13:10:40.897 INFO:tasks.workunit.client.0.smithi012.stdout:2/810: chown d0/d6/de/d7d 166 1 2024-02-14T13:10:40.897 INFO:tasks.workunit.client.0.smithi012.stdout:2/811: truncate d0/d8/d10c/f10b 6862925 0 2024-02-14T13:10:40.897 INFO:tasks.workunit.client.0.smithi012.stdout:8/748: rmdir d9/dc/d14/d2e 39 2024-02-14T13:10:40.899 INFO:tasks.workunit.client.0.smithi012.stdout:9/859: symlink da/dd/d19/d30/d9d/dce/l121 0 2024-02-14T13:10:40.899 INFO:tasks.workunit.client.0.smithi012.stdout:9/860: write da/d33/d63/d106/fe5 [1054260,109214] 0 2024-02-14T13:10:40.899 INFO:tasks.workunit.client.0.smithi012.stdout:9/861: readlink da/d33/d63/lfe 0 2024-02-14T13:10:40.899 INFO:tasks.workunit.client.0.smithi012.stdout:9/862: readlink da/dd/d57/d59/d73/l84 0 2024-02-14T13:10:40.900 INFO:tasks.workunit.client.0.smithi012.stdout:8/749: rename d9/dc/d14/d2e/dde/d56/d57/fd6 to d9/dc/d14/d2e/dde/da3/ded/da5/ffd 0 2024-02-14T13:10:40.901 INFO:tasks.workunit.client.0.smithi012.stdout:8/750: write d9/dc/d1b/f27 [4174835,104815] 0 2024-02-14T13:10:40.901 INFO:tasks.workunit.client.0.smithi012.stdout:9/863: truncate da/d4f/f11f 3050417 0 2024-02-14T13:10:40.903 INFO:tasks.workunit.client.0.smithi012.stdout:3/699: dread d9/d18/f5e [0,4194304] 0 2024-02-14T13:10:40.905 INFO:tasks.workunit.client.0.smithi012.stdout:3/700: mknod d9/dd/d30/d34/cf5 0 2024-02-14T13:10:40.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/701: fdatasync d9/dd/d30/d44/d66/db3/db9/fda 0 2024-02-14T13:10:40.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/702: write d9/d18/f23 [382090,36875] 0 2024-02-14T13:10:40.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/703: stat d9/dd/de/d58/lbd 0 2024-02-14T13:10:40.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/704: chown d9/dd/de/f1a 365 1 2024-02-14T13:10:40.906 INFO:tasks.workunit.client.0.smithi012.stdout:3/705: fdatasync d9/d3f/d4e/f5a 0 2024-02-14T13:10:40.906 INFO:tasks.workunit.client.0.smithi012.stdout:9/864: dread da/dd/d19/df3/f75 [0,4194304] 0 2024-02-14T13:10:40.907 INFO:tasks.workunit.client.0.smithi012.stdout:3/706: rename d9/dd/d30/l76 to d9/dd/d30/d44/d66/dd0/lf6 0 2024-02-14T13:10:40.909 INFO:tasks.workunit.client.0.smithi012.stdout:9/865: link da/d33/d63/f76 da/dd/d57/d59/d73/db6/f122 0 2024-02-14T13:10:40.909 INFO:tasks.workunit.client.0.smithi012.stdout:8/751: write d9/dc/d14/d2e/dde/d56/fb5 [3213435,38287] 0 2024-02-14T13:10:40.910 INFO:tasks.workunit.client.0.smithi012.stdout:8/752: stat d9/dc/d14/d2e/dde/d56/d57/d5c/laa 0 2024-02-14T13:10:40.910 INFO:tasks.workunit.client.0.smithi012.stdout:8/753: chown d9/dc/d14/fd4 1746 1 2024-02-14T13:10:40.911 INFO:tasks.workunit.client.0.smithi012.stdout:3/707: mkdir d9/d18/d39/df7 0 2024-02-14T13:10:40.913 INFO:tasks.workunit.client.0.smithi012.stdout:8/754: mkdir d9/dc/d1b/d6b/dfe 0 2024-02-14T13:10:40.913 INFO:tasks.workunit.client.0.smithi012.stdout:8/755: dread - d9/dc/d14/d23/d62/fdd zero size 2024-02-14T13:10:40.913 INFO:tasks.workunit.client.0.smithi012.stdout:3/708: mkdir d9/d13/daa/df8 0 2024-02-14T13:10:40.914 INFO:tasks.workunit.client.0.smithi012.stdout:8/756: symlink d9/dc/d14/d2e/dde/lff 0 2024-02-14T13:10:40.915 INFO:tasks.workunit.client.0.smithi012.stdout:3/709: symlink d9/d3f/d73/d5d/lf9 0 2024-02-14T13:10:40.916 INFO:tasks.workunit.client.0.smithi012.stdout:8/757: creat d9/dc/d14/f100 x:0 0 0 2024-02-14T13:10:40.916 INFO:tasks.workunit.client.0.smithi012.stdout:8/758: fdatasync d9/dc/d14/d2e/dde/d56/d57/d7c/f69 0 2024-02-14T13:10:40.916 INFO:tasks.workunit.client.0.smithi012.stdout:8/759: stat d9/dc/d14/d2e/dde/da3/ded/da5/fb0 0 2024-02-14T13:10:40.918 INFO:tasks.workunit.client.0.smithi012.stdout:3/710: rename d9/dd/de/f1a to d9/dd/d30/d44/d66/dd0/ffa 0 2024-02-14T13:10:40.918 INFO:tasks.workunit.client.0.smithi012.stdout:3/711: chown d9/dd/de/cd9 249502 1 2024-02-14T13:10:40.918 INFO:tasks.workunit.client.0.smithi012.stdout:9/866: write da/dd/d19/f4d [1481023,79373] 0 2024-02-14T13:10:40.920 INFO:tasks.workunit.client.0.smithi012.stdout:9/867: rename da/dd/d57/d59/d73/db6/df1/fbb to da/dd/d19/d30/d9d/f123 0 2024-02-14T13:10:40.923 INFO:tasks.workunit.client.0.smithi012.stdout:9/868: dread da/dd/d19/d30/f29 [0,4194304] 0 2024-02-14T13:10:40.925 INFO:tasks.workunit.client.0.smithi012.stdout:9/869: unlink da/dd/d19/df3/d85/c10c 0 2024-02-14T13:10:40.933 INFO:tasks.workunit.client.0.smithi012.stdout:9/870: dread da/f3f [0,4194304] 0 2024-02-14T13:10:40.933 INFO:tasks.workunit.client.0.smithi012.stdout:9/871: chown da/dd/d57/d59/d73/db6/df1/fa3 1948153 1 2024-02-14T13:10:40.934 INFO:tasks.workunit.client.0.smithi012.stdout:9/872: creat da/d33/d63/d106/f124 x:0 0 0 2024-02-14T13:10:40.945 INFO:tasks.workunit.client.0.smithi012.stdout:0/796: dwrite d10/f104 [0,4194304] 0 2024-02-14T13:10:40.945 INFO:tasks.workunit.client.0.smithi012.stdout:0/797: truncate d10/d14/d41/d61/f103 418479 0 2024-02-14T13:10:40.946 INFO:tasks.workunit.client.0.smithi012.stdout:3/712: dwrite d9/d3f/fa2 [0,4194304] 0 2024-02-14T13:10:40.948 INFO:tasks.workunit.client.0.smithi012.stdout:8/760: dwrite d9/dc/d14/d2e/dde/da3/ded/da5/fb0 [0,4194304] 0 2024-02-14T13:10:40.948 INFO:tasks.workunit.client.0.smithi012.stdout:8/761: write f4 [1587357,50040] 0 2024-02-14T13:10:40.949 INFO:tasks.workunit.client.0.smithi012.stdout:8/762: chown d9/dc/d14/d23 461560 1 2024-02-14T13:10:40.949 INFO:tasks.workunit.client.0.smithi012.stdout:0/798: creat d10/d14/d41/d52/d78/d8c/d7f/df8/f105 x:0 0 0 2024-02-14T13:10:40.950 INFO:tasks.workunit.client.0.smithi012.stdout:3/713: mkdir d9/d3f/dac/dfb 0 2024-02-14T13:10:40.953 INFO:tasks.workunit.client.0.smithi012.stdout:0/799: mkdir d10/d14/d1b/d54/d106 0 2024-02-14T13:10:40.953 INFO:tasks.workunit.client.0.smithi012.stdout:0/800: dread - d10/d14/d1b/d30/f83 zero size 2024-02-14T13:10:40.954 INFO:tasks.workunit.client.0.smithi012.stdout:3/714: truncate d9/d13/dea/f9b 400771 0 2024-02-14T13:10:40.955 INFO:tasks.workunit.client.0.smithi012.stdout:8/763: rename d9/dc/d14/d2e/dde/lc6 to d9/dc/d14/d2e/l101 0 2024-02-14T13:10:40.955 INFO:tasks.workunit.client.0.smithi012.stdout:0/801: creat d10/d14/d41/f107 x:0 0 0 2024-02-14T13:10:40.956 INFO:tasks.workunit.client.0.smithi012.stdout:3/715: getdents d9/d68 0 2024-02-14T13:10:40.958 INFO:tasks.workunit.client.0.smithi012.stdout:8/764: symlink d9/dc/d14/d2e/dde/d56/d57/d7c/l102 0 2024-02-14T13:10:40.958 INFO:tasks.workunit.client.0.smithi012.stdout:8/765: stat d9/c1a 0 2024-02-14T13:10:40.958 INFO:tasks.workunit.client.0.smithi012.stdout:0/802: getdents d10/d14/d20/d49 0 2024-02-14T13:10:40.958 INFO:tasks.workunit.client.0.smithi012.stdout:0/803: dread - d10/d14/d41/f82 zero size 2024-02-14T13:10:40.960 INFO:tasks.workunit.client.0.smithi012.stdout:8/766: unlink d9/dc/d14/d2e/fa6 0 2024-02-14T13:10:40.964 INFO:tasks.workunit.client.0.smithi012.stdout:4/728: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa [0,4194304] 0 2024-02-14T13:10:40.964 INFO:tasks.workunit.client.0.smithi012.stdout:4/729: truncate d0/d10/d1f/fa7 639421 0 2024-02-14T13:10:40.964 INFO:tasks.workunit.client.0.smithi012.stdout:9/873: dwrite da/dd/d38/d7e/ddc/fe2 [0,4194304] 0 2024-02-14T13:10:40.964 INFO:tasks.workunit.client.0.smithi012.stdout:9/874: chown da/dd/d19/d30/d45/cbf 28 1 2024-02-14T13:10:40.965 INFO:tasks.workunit.client.0.smithi012.stdout:4/730: creat d0/d10/d28/da9/d86/db5/f10a x:0 0 0 2024-02-14T13:10:40.968 INFO:tasks.workunit.client.0.smithi012.stdout:9/875: creat da/dd/d19/d30/f125 x:0 0 0 2024-02-14T13:10:40.969 INFO:tasks.workunit.client.0.smithi012.stdout:9/876: fdatasync da/dd/d19/f4d 0 2024-02-14T13:10:40.969 INFO:tasks.workunit.client.0.smithi012.stdout:4/731: symlink d0/d10/d28/da9/d86/l10b 0 2024-02-14T13:10:40.970 INFO:tasks.workunit.client.0.smithi012.stdout:9/877: creat da/dd/d38/d7e/d91/da6/f126 x:0 0 0 2024-02-14T13:10:40.972 INFO:tasks.workunit.client.0.smithi012.stdout:4/732: rename d0/d10/d28/d4f/d6b/d8f/d56/f5d to d0/df0/f10c 0 2024-02-14T13:10:40.973 INFO:tasks.workunit.client.0.smithi012.stdout:2/812: dwrite d0/d6/de/fa7 [0,4194304] 0 2024-02-14T13:10:40.973 INFO:tasks.workunit.client.0.smithi012.stdout:2/813: chown d0/d8/d11/d33 341404446 1 2024-02-14T13:10:40.973 INFO:tasks.workunit.client.0.smithi012.stdout:2/814: chown d0/d1a/de4/l98 5 1 2024-02-14T13:10:40.973 INFO:tasks.workunit.client.0.smithi012.stdout:2/815: chown d0/d8/d10c/f10b 1080906 1 2024-02-14T13:10:40.973 INFO:tasks.workunit.client.0.smithi012.stdout:9/878: rmdir da/d4f 39 2024-02-14T13:10:40.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/840: dwrite dc/d2f/d70/dbc/dd8/ff1 [0,4194304] 0 2024-02-14T13:10:40.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/841: write dc/f15 [5681431,62669] 0 2024-02-14T13:10:40.974 INFO:tasks.workunit.client.0.smithi012.stdout:5/842: readlink dc/d2f/d89/lc5 0 2024-02-14T13:10:40.974 INFO:tasks.workunit.client.0.smithi012.stdout:4/733: mknod d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/c10d 0 2024-02-14T13:10:40.977 INFO:tasks.workunit.client.0.smithi012.stdout:5/843: dread dc/d17/f3f [0,4194304] 0 2024-02-14T13:10:40.981 INFO:tasks.workunit.client.0.smithi012.stdout:2/816: creat d0/d8/d11/d35/dd0/d70/db0/f11a x:0 0 0 2024-02-14T13:10:40.982 INFO:tasks.workunit.client.0.smithi012.stdout:2/817: chown d0/d8/d11/d35/dd0/c10f 11 1 2024-02-14T13:10:40.982 INFO:tasks.workunit.client.0.smithi012.stdout:2/818: truncate d0/d8/d11/d33/d53/d110/d57/d6d/fe1 1046697 0 2024-02-14T13:10:40.982 INFO:tasks.workunit.client.0.smithi012.stdout:2/819: fdatasync d0/d8/d9/d90/dab/f59 0 2024-02-14T13:10:40.983 INFO:tasks.workunit.client.0.smithi012.stdout:9/879: creat da/dd/d57/d59/f127 x:0 0 0 2024-02-14T13:10:40.988 INFO:tasks.workunit.client.0.smithi012.stdout:2/820: read d0/d1a/de4/d39/f91 [3390761,71246] 0 2024-02-14T13:10:40.992 INFO:tasks.workunit.client.0.smithi012.stdout:5/844: mknod dc/d2f/d70/dbc/dd8/c107 0 2024-02-14T13:10:40.992 INFO:tasks.workunit.client.0.smithi012.stdout:5/845: stat dc/d47/d69 0 2024-02-14T13:10:40.993 INFO:tasks.workunit.client.0.smithi012.stdout:9/880: symlink da/d4f/l128 0 2024-02-14T13:10:40.995 INFO:tasks.workunit.client.0.smithi012.stdout:9/881: creat da/d4f/f129 x:0 0 0 2024-02-14T13:10:41.000 INFO:tasks.workunit.client.0.smithi012.stdout:5/846: dread dc/d47/d6e/f77 [0,4194304] 0 2024-02-14T13:10:41.000 INFO:tasks.workunit.client.0.smithi012.stdout:5/847: stat dc/d17/ded 0 2024-02-14T13:10:41.003 INFO:tasks.workunit.client.0.smithi012.stdout:5/848: creat dc/d17/d20/d4c/d63/d81/f108 x:0 0 0 2024-02-14T13:10:41.003 INFO:tasks.workunit.client.0.smithi012.stdout:5/849: write dc/d2f/d40/d53/d97/fbe [217623,85845] 0 2024-02-14T13:10:41.004 INFO:tasks.workunit.client.0.smithi012.stdout:5/850: creat dc/d17/d20/f109 x:0 0 0 2024-02-14T13:10:41.004 INFO:tasks.workunit.client.0.smithi012.stdout:5/851: write dc/d2f/d40/f48 [1122293,20139] 0 2024-02-14T13:10:41.005 INFO:tasks.workunit.client.0.smithi012.stdout:5/852: write dc/d2f/d3e/fdf [652873,10523] 0 2024-02-14T13:10:41.006 INFO:tasks.workunit.client.0.smithi012.stdout:5/853: creat dc/d47/f10a x:0 0 0 2024-02-14T13:10:41.007 INFO:tasks.workunit.client.0.smithi012.stdout:5/854: creat dc/d2f/d70/d78/dc4/f10b x:0 0 0 2024-02-14T13:10:41.010 INFO:tasks.workunit.client.0.smithi012.stdout:8/767: dwrite d9/dc/d38/fb8 [0,4194304] 0 2024-02-14T13:10:41.012 INFO:tasks.workunit.client.0.smithi012.stdout:0/804: dwrite d10/f13 [0,4194304] 0 2024-02-14T13:10:41.013 INFO:tasks.workunit.client.0.smithi012.stdout:2/821: dwrite d0/d8/d11/d35/dd0/d70/fd9 [0,4194304] 0 2024-02-14T13:10:41.013 INFO:tasks.workunit.client.0.smithi012.stdout:3/716: dwrite d9/d3f/d88/fe5 [0,4194304] 0 2024-02-14T13:10:41.014 INFO:tasks.workunit.client.0.smithi012.stdout:0/805: rmdir d10/d14/d41/d52/d78/dea 39 2024-02-14T13:10:41.016 INFO:tasks.workunit.client.0.smithi012.stdout:8/768: symlink d9/dc/d14/d23/l103 0 2024-02-14T13:10:41.020 INFO:tasks.workunit.client.0.smithi012.stdout:0/806: creat d10/d14/d1b/d54/f108 x:0 0 0 2024-02-14T13:10:41.020 INFO:tasks.workunit.client.0.smithi012.stdout:6/738: sync 2024-02-14T13:10:41.021 INFO:tasks.workunit.client.0.smithi012.stdout:3/717: write d9/dd/de/d58/f99 [3842241,41361] 0 2024-02-14T13:10:41.022 INFO:tasks.workunit.client.0.smithi012.stdout:0/807: creat d10/d14/d41/df2/f109 x:0 0 0 2024-02-14T13:10:41.023 INFO:tasks.workunit.client.0.smithi012.stdout:0/808: chown d10/d14/d20 9793112 1 2024-02-14T13:10:41.025 INFO:tasks.workunit.client.0.smithi012.stdout:6/739: rename d1/df/d24/l6e to d1/d1e/dc/d28/lec 0 2024-02-14T13:10:41.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/809: creat d10/d14/d1b/d30/dfa/f10a x:0 0 0 2024-02-14T13:10:41.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/810: stat d10/dad/fb2 0 2024-02-14T13:10:41.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/811: truncate d10/d14/d1b/f68 665910 0 2024-02-14T13:10:41.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/812: write d10/d14/d1b/d30/f3f [1105529,28438] 0 2024-02-14T13:10:41.028 INFO:tasks.workunit.client.0.smithi012.stdout:6/740: getdents d1/df/d16/d7c/d97/d82/da5 0 2024-02-14T13:10:41.028 INFO:tasks.workunit.client.0.smithi012.stdout:2/822: dread d0/d6/de/f4e [0,4194304] 0 2024-02-14T13:10:41.030 INFO:tasks.workunit.client.0.smithi012.stdout:0/813: creat d10/d14/d2b/f10b x:0 0 0 2024-02-14T13:10:41.032 INFO:tasks.workunit.client.0.smithi012.stdout:6/741: unlink d1/df/d24/d3f/d56/da3/fb5 0 2024-02-14T13:10:41.032 INFO:tasks.workunit.client.0.smithi012.stdout:3/718: read d9/d13/f20 [6941285,60508] 0 2024-02-14T13:10:41.032 INFO:tasks.workunit.client.0.smithi012.stdout:6/742: write d1/df/d24/daf/fd8 [1140524,18803] 0 2024-02-14T13:10:41.032 INFO:tasks.workunit.client.0.smithi012.stdout:8/769: dwrite d9/dc/d1b/d6b/fad [0,4194304] 0 2024-02-14T13:10:41.035 INFO:tasks.workunit.client.0.smithi012.stdout:0/814: symlink d10/d14/d20/daa/l10c 0 2024-02-14T13:10:41.035 INFO:tasks.workunit.client.0.smithi012.stdout:0/815: fsync d10/d14/d1b/d30/f6f 0 2024-02-14T13:10:41.035 INFO:tasks.workunit.client.0.smithi012.stdout:6/743: link d1/d1e/d1b/lca d1/d1e/d1b/d21/d78/ddf/led 0 2024-02-14T13:10:41.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/816: creat d10/d14/d41/d52/d99/ddc/f10d x:0 0 0 2024-02-14T13:10:41.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/817: chown d10/d14/d41/d52/d78/dea 179236 1 2024-02-14T13:10:41.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/818: dread - d10/d14/d41/d52/d78/d8c/d7f/ffd zero size 2024-02-14T13:10:41.036 INFO:tasks.workunit.client.0.smithi012.stdout:0/819: fsync d10/d14/d1b/f3a 0 2024-02-14T13:10:41.038 INFO:tasks.workunit.client.0.smithi012.stdout:6/744: getdents d1/d1e/dc/d43/d75 0 2024-02-14T13:10:41.039 INFO:tasks.workunit.client.0.smithi012.stdout:6/745: chown d1/f9f 2 1 2024-02-14T13:10:41.041 INFO:tasks.workunit.client.0.smithi012.stdout:0/820: mknod d10/d14/d41/d52/d78/d8c/c10e 0 2024-02-14T13:10:41.043 INFO:tasks.workunit.client.0.smithi012.stdout:6/746: dread d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:41.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/821: dread d10/d14/d41/d52/d78/d8c/f35 [0,4194304] 0 2024-02-14T13:10:41.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/822: write d10/d14/d20/f64 [3047194,77105] 0 2024-02-14T13:10:41.044 INFO:tasks.workunit.client.0.smithi012.stdout:0/823: fdatasync d10/d14/d41/d61/d74/dfc/f63 0 2024-02-14T13:10:41.058 INFO:tasks.workunit.client.0.smithi012.stdout:3/719: dwrite d9/dd/d30/d44/d66/dd0/ffa [0,4194304] 0 2024-02-14T13:10:41.059 INFO:tasks.workunit.client.0.smithi012.stdout:2/823: dwrite d0/d20/feb [0,4194304] 0 2024-02-14T13:10:41.074 INFO:tasks.workunit.client.0.smithi012.stdout:3/720: dwrite d9/d18/f55 [0,4194304] 0 2024-02-14T13:10:41.098 INFO:tasks.workunit.client.0.smithi012.stdout:6/747: creat d1/df/d24/d3f/d56/da3/fee x:0 0 0 2024-02-14T13:10:41.099 INFO:tasks.workunit.client.0.smithi012.stdout:0/824: unlink d10/d14/d41/d52/d99/ddc/f10d 0 2024-02-14T13:10:41.102 INFO:tasks.workunit.client.0.smithi012.stdout:2/824: symlink d0/d6/d37/d84/l11b 0 2024-02-14T13:10:41.107 INFO:tasks.workunit.client.0.smithi012.stdout:3/721: mknod d9/d13/dea/cfc 0 2024-02-14T13:10:41.107 INFO:tasks.workunit.client.0.smithi012.stdout:3/722: chown d9/d13/d28 0 1 2024-02-14T13:10:41.110 INFO:tasks.workunit.client.0.smithi012.stdout:6/748: rename d1/df/d24/d3f/d56/da3/fee to d1/d1e/dc/d43/dd4/fef 0 2024-02-14T13:10:41.110 INFO:tasks.workunit.client.0.smithi012.stdout:6/749: chown d1/df/d16/d7c/d97/lc5 0 1 2024-02-14T13:10:41.115 INFO:tasks.workunit.client.0.smithi012.stdout:6/750: link d1/d1e/d1b/d21/f35 d1/df/d50/db4/ff0 0 2024-02-14T13:10:41.118 INFO:tasks.workunit.client.0.smithi012.stdout:2/825: dwrite d0/d6/fb6 [0,4194304] 0 2024-02-14T13:10:41.123 INFO:tasks.workunit.client.0.smithi012.stdout:2/826: rename d0/d8/d11/d33/l8e to d0/d6/de/d7b/l11c 0 2024-02-14T13:10:41.126 INFO:tasks.workunit.client.0.smithi012.stdout:2/827: dread d0/d8/f30 [4194304,4194304] 0 2024-02-14T13:10:41.146 INFO:tasks.workunit.client.0.smithi012.stdout:2/828: dwrite d0/d6/d37/fdd [0,4194304] 0 2024-02-14T13:10:41.146 INFO:tasks.workunit.client.0.smithi012.stdout:2/829: write d0/d8/d11/d33/d53/d110/d57/d6d/fe1 [2073463,120096] 0 2024-02-14T13:10:41.147 INFO:tasks.workunit.client.0.smithi012.stdout:2/830: creat d0/d8/d10c/f11d x:0 0 0 2024-02-14T13:10:41.155 INFO:tasks.workunit.client.0.smithi012.stdout:2/831: dread d0/d8/f6f [0,4194304] 0 2024-02-14T13:10:41.157 INFO:tasks.workunit.client.0.smithi012.stdout:2/832: truncate d0/d1a/f25 776834 0 2024-02-14T13:10:41.163 INFO:tasks.workunit.client.0.smithi012.stdout:6/751: creat d1/d1e/dc/ff1 x:0 0 0 2024-02-14T13:10:41.164 INFO:tasks.workunit.client.0.smithi012.stdout:6/752: mkdir d1/dc0/df2 0 2024-02-14T13:10:41.164 INFO:tasks.workunit.client.0.smithi012.stdout:6/753: read d1/d1e/dc/d28/f4d [1803734,124222] 0 2024-02-14T13:10:41.164 INFO:tasks.workunit.client.0.smithi012.stdout:2/833: dread d0/d1a/de4/d50/d68/d9c/f9f [0,4194304] 0 2024-02-14T13:10:41.164 INFO:tasks.workunit.client.0.smithi012.stdout:2/834: write d0/d6/de/d7b/f5e [1561347,42087] 0 2024-02-14T13:10:41.165 INFO:tasks.workunit.client.0.smithi012.stdout:6/754: mkdir d1/df/d50/db4/dea/df3 0 2024-02-14T13:10:41.167 INFO:tasks.workunit.client.0.smithi012.stdout:2/835: rename d0/d8/d9/c119 to d0/d8/d11/d33/c11e 0 2024-02-14T13:10:41.169 INFO:tasks.workunit.client.0.smithi012.stdout:2/836: creat d0/d6/f11f x:0 0 0 2024-02-14T13:10:41.170 INFO:tasks.workunit.client.0.smithi012.stdout:0/825: unlink d10/d14/d1b/cec 0 2024-02-14T13:10:41.171 INFO:tasks.workunit.client.0.smithi012.stdout:0/826: symlink d10/d14/d41/d52/d78/df9/l10f 0 2024-02-14T13:10:41.171 INFO:tasks.workunit.client.0.smithi012.stdout:2/837: dread d0/d8/d11/d33/d53/d110/d57/f78 [0,4194304] 0 2024-02-14T13:10:41.171 INFO:tasks.workunit.client.0.smithi012.stdout:0/827: write d10/d14/d1b/d30/f3f [1969066,46674] 0 2024-02-14T13:10:41.173 INFO:tasks.workunit.client.0.smithi012.stdout:0/828: getdents d10/d14/d2b/da4 0 2024-02-14T13:10:41.173 INFO:tasks.workunit.client.0.smithi012.stdout:0/829: chown d10/d14/d41/d52/d78/d8c/f35 438 1 2024-02-14T13:10:41.178 INFO:tasks.workunit.client.0.smithi012.stdout:6/755: unlink d1/df/d24/daf/f53 0 2024-02-14T13:10:41.178 INFO:tasks.workunit.client.0.smithi012.stdout:6/756: readlink d1/d1e/dc/d28/lb6 0 2024-02-14T13:10:41.178 INFO:tasks.workunit.client.0.smithi012.stdout:6/757: truncate d1/df/d50/db4/fdb 1022127 0 2024-02-14T13:10:41.179 INFO:tasks.workunit.client.0.smithi012.stdout:6/758: unlink d1/df/d24/d5f/da0/fcf 0 2024-02-14T13:10:41.180 INFO:tasks.workunit.client.0.smithi012.stdout:6/759: symlink d1/df/d24/d3f/d56/d93/lf4 0 2024-02-14T13:10:41.181 INFO:tasks.workunit.client.0.smithi012.stdout:6/760: mknod d1/d1e/d1b/d21/cf5 0 2024-02-14T13:10:41.189 INFO:tasks.workunit.client.0.smithi012.stdout:2/838: dwrite d0/d6/de/d7b/da8/f10e [0,4194304] 0 2024-02-14T13:10:41.196 INFO:tasks.workunit.client.0.smithi012.stdout:3/723: rmdir d9/dd/d30/d44 39 2024-02-14T13:10:41.196 INFO:tasks.workunit.client.0.smithi012.stdout:3/724: fdatasync d9/dd/f17 0 2024-02-14T13:10:41.197 INFO:tasks.workunit.client.0.smithi012.stdout:3/725: creat d9/d18/d39/df7/ffd x:0 0 0 2024-02-14T13:10:41.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/726: chown d9/d13 2112 1 2024-02-14T13:10:41.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/727: fsync d9/dd/fbc 0 2024-02-14T13:10:41.200 INFO:tasks.workunit.client.0.smithi012.stdout:3/728: unlink d9/dd/d30/d34/l49 0 2024-02-14T13:10:41.201 INFO:tasks.workunit.client.0.smithi012.stdout:3/729: mkdir d9/dd/dfe 0 2024-02-14T13:10:41.201 INFO:tasks.workunit.client.0.smithi012.stdout:3/730: mkdir d9/d3f/d73/d5d/d91/dff 0 2024-02-14T13:10:41.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/830: unlink d10/d14/f2e 0 2024-02-14T13:10:41.206 INFO:tasks.workunit.client.0.smithi012.stdout:0/831: read d10/d84/fda [144186,69809] 0 2024-02-14T13:10:41.206 INFO:tasks.workunit.client.0.smithi012.stdout:2/839: dwrite d0/d8/d9/d90/fe6 [0,4194304] 0 2024-02-14T13:10:41.207 INFO:tasks.workunit.client.0.smithi012.stdout:6/761: creat d1/d1e/ff6 x:0 0 0 2024-02-14T13:10:41.218 INFO:tasks.workunit.client.0.smithi012.stdout:2/840: dread d0/d8/d11/d33/d53/d110/d57/f66 [0,4194304] 0 2024-02-14T13:10:41.220 INFO:tasks.workunit.client.0.smithi012.stdout:6/762: write d1/df/d24/d3f/d56/d93/d95/fd0 [668571,12630] 0 2024-02-14T13:10:41.220 INFO:tasks.workunit.client.0.smithi012.stdout:0/832: mknod d10/d14/d1b/d7e/c110 0 2024-02-14T13:10:41.220 INFO:tasks.workunit.client.0.smithi012.stdout:0/833: fsync fd 0 2024-02-14T13:10:41.221 INFO:tasks.workunit.client.0.smithi012.stdout:3/731: dwrite d9/d3f/d73/d5d/f8b [0,4194304] 0 2024-02-14T13:10:41.221 INFO:tasks.workunit.client.0.smithi012.stdout:3/732: write d9/d13/daa/de2/fe9 [501545,17702] 0 2024-02-14T13:10:41.223 INFO:tasks.workunit.client.0.smithi012.stdout:0/834: link d10/dad/fb2 d10/d14/d41/d52/d56/f111 0 2024-02-14T13:10:41.226 INFO:tasks.workunit.client.0.smithi012.stdout:0/835: truncate d10/d14/d20/f37 6906288 0 2024-02-14T13:10:41.229 INFO:tasks.workunit.client.0.smithi012.stdout:0/836: creat d10/d14/d1b/d8e/f112 x:0 0 0 2024-02-14T13:10:41.229 INFO:tasks.workunit.client.0.smithi012.stdout:0/837: dread - d10/d14/d41/df2/f109 zero size 2024-02-14T13:10:41.230 INFO:tasks.workunit.client.0.smithi012.stdout:1/786: sync 2024-02-14T13:10:41.230 INFO:tasks.workunit.client.0.smithi012.stdout:7/689: sync 2024-02-14T13:10:41.231 INFO:tasks.workunit.client.0.smithi012.stdout:7/690: chown df/d2d/lc5 1 1 2024-02-14T13:10:41.232 INFO:tasks.workunit.client.0.smithi012.stdout:1/787: creat d6/d10/d22/d31/d5b/d5e/d65/df4/ff6 x:0 0 0 2024-02-14T13:10:41.232 INFO:tasks.workunit.client.0.smithi012.stdout:1/788: write d6/d10/d22/d31/d5b/d5e/d65/f75 [134490,14742] 0 2024-02-14T13:10:41.233 INFO:tasks.workunit.client.0.smithi012.stdout:7/691: creat df/d27/d4b/ff1 x:0 0 0 2024-02-14T13:10:41.235 INFO:tasks.workunit.client.0.smithi012.stdout:1/789: link d6/d10/d22/d31/d5b/d5d/f86 d6/d10/d22/ff7 0 2024-02-14T13:10:41.237 INFO:tasks.workunit.client.0.smithi012.stdout:1/790: mkdir d6/d10/d22/d31/d34/df8 0 2024-02-14T13:10:41.238 INFO:tasks.workunit.client.0.smithi012.stdout:1/791: write d6/d10/d22/d31/d34/d58/f9a [526813,85838] 0 2024-02-14T13:10:41.240 INFO:tasks.workunit.client.0.smithi012.stdout:0/838: write d10/d14/d1b/f22 [6950757,4454] 0 2024-02-14T13:10:41.240 INFO:tasks.workunit.client.0.smithi012.stdout:2/841: dwrite d0/d6/de/d7d/f83 [4194304,4194304] 0 2024-02-14T13:10:41.240 INFO:tasks.workunit.client.0.smithi012.stdout:0/839: write d10/dad/fb8 [1568399,115939] 0 2024-02-14T13:10:41.240 INFO:tasks.workunit.client.0.smithi012.stdout:0/840: write d10/d14/d1b/f8a [1363055,25088] 0 2024-02-14T13:10:41.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/763: dwrite d1/df/d24/d3f/d56/da3/fc8 [0,4194304] 0 2024-02-14T13:10:41.244 INFO:tasks.workunit.client.0.smithi012.stdout:6/764: chown d1/df/d50/db4/cc4 4229159 1 2024-02-14T13:10:41.247 INFO:tasks.workunit.client.0.smithi012.stdout:3/733: dwrite d9/dd/de/fe3 [0,4194304] 0 2024-02-14T13:10:41.247 INFO:tasks.workunit.client.0.smithi012.stdout:3/734: chown d9/dd/d30/d44/d66/ced 7165590 1 2024-02-14T13:10:41.247 INFO:tasks.workunit.client.0.smithi012.stdout:3/735: readlink d9/dd/de/d58/lbd 0 2024-02-14T13:10:41.247 INFO:tasks.workunit.client.0.smithi012.stdout:3/736: readlink d9/d3f/d73/d5d/d82/lae 0 2024-02-14T13:10:41.251 INFO:tasks.workunit.client.0.smithi012.stdout:6/765: creat d1/d1e/dc/d43/dd4/ff7 x:0 0 0 2024-02-14T13:10:41.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/737: dread d9/d13/f2b [0,4194304] 0 2024-02-14T13:10:41.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/738: fdatasync d9/dd/de/d58/d65/d6c/f94 0 2024-02-14T13:10:41.259 INFO:tasks.workunit.client.0.smithi012.stdout:3/739: link d9/dc4/lc5 d9/dd/de/d58/d65/df0/l100 0 2024-02-14T13:10:41.259 INFO:tasks.workunit.client.0.smithi012.stdout:0/841: dread d10/d14/d41/d61/d74/f91 [0,4194304] 0 2024-02-14T13:10:41.259 INFO:tasks.workunit.client.0.smithi012.stdout:0/842: truncate d10/d14/d1b/f68 1134873 0 2024-02-14T13:10:41.260 INFO:tasks.workunit.client.0.smithi012.stdout:3/740: mknod d9/d13/daa/df8/c101 0 2024-02-14T13:10:41.260 INFO:tasks.workunit.client.0.smithi012.stdout:0/843: write d10/d14/d20/d49/fb1 [854184,107164] 0 2024-02-14T13:10:41.260 INFO:tasks.workunit.client.0.smithi012.stdout:0/844: write d10/d14/d41/d52/d78/d8c/d7f/fa5 [500864,59812] 0 2024-02-14T13:10:41.261 INFO:tasks.workunit.client.0.smithi012.stdout:0/845: truncate d10/f62 808473 0 2024-02-14T13:10:41.261 INFO:tasks.workunit.client.0.smithi012.stdout:0/846: fsync d10/d14/d20/f37 0 2024-02-14T13:10:41.261 INFO:tasks.workunit.client.0.smithi012.stdout:3/741: mknod d9/d3f/c102 0 2024-02-14T13:10:41.261 INFO:tasks.workunit.client.0.smithi012.stdout:2/842: dwrite d0/d1a/f25 [0,4194304] 0 2024-02-14T13:10:41.261 INFO:tasks.workunit.client.0.smithi012.stdout:0/847: mkdir d10/d14/d2b/d113 0 2024-02-14T13:10:41.263 INFO:tasks.workunit.client.0.smithi012.stdout:2/843: rmdir d0/d8/d11/d35/dd0/d7a 39 2024-02-14T13:10:41.272 INFO:tasks.workunit.client.0.smithi012.stdout:0/848: read d10/d14/d51/fa1 [490515,54725] 0 2024-02-14T13:10:41.272 INFO:tasks.workunit.client.0.smithi012.stdout:0/849: write d10/dad/fde [139843,46134] 0 2024-02-14T13:10:41.273 INFO:tasks.workunit.client.0.smithi012.stdout:0/850: link d10/d14/d1b/d7e/c110 d10/d14/d20/c114 0 2024-02-14T13:10:41.274 INFO:tasks.workunit.client.0.smithi012.stdout:1/792: dwrite d6/d10/d22/d31/d5b/d5d/d80/fd7 [0,4194304] 0 2024-02-14T13:10:41.274 INFO:tasks.workunit.client.0.smithi012.stdout:1/793: write d6/d10/d22/d44/dbb/fc2 [114097,106376] 0 2024-02-14T13:10:41.274 INFO:tasks.workunit.client.0.smithi012.stdout:1/794: chown d6/d10/d22/d31/d34/df8 370753064 1 2024-02-14T13:10:41.274 INFO:tasks.workunit.client.0.smithi012.stdout:0/851: creat d10/dad/f115 x:0 0 0 2024-02-14T13:10:41.276 INFO:tasks.workunit.client.0.smithi012.stdout:0/852: rmdir d10/d84 39 2024-02-14T13:10:41.276 INFO:tasks.workunit.client.0.smithi012.stdout:0/853: mknod d10/d14/d41/d52/d72/c116 0 2024-02-14T13:10:41.277 INFO:tasks.workunit.client.0.smithi012.stdout:0/854: chown d10/d14/d41/d52/d78/d8c/d7f 943132788 1 2024-02-14T13:10:41.277 INFO:tasks.workunit.client.0.smithi012.stdout:0/855: write d10/d14/d20/daa/fc8 [327637,7004] 0 2024-02-14T13:10:41.277 INFO:tasks.workunit.client.0.smithi012.stdout:0/856: chown d10/d14/d20/d49/l8d 840 1 2024-02-14T13:10:41.277 INFO:tasks.workunit.client.0.smithi012.stdout:0/857: getdents d10/d14/d41/d52/d99/d9b 0 2024-02-14T13:10:41.278 INFO:tasks.workunit.client.0.smithi012.stdout:0/858: symlink d10/d14/d41/d52/d78/d8c/l117 0 2024-02-14T13:10:41.278 INFO:tasks.workunit.client.0.smithi012.stdout:0/859: dread d10/d14/d41/d61/f103 [0,4194304] 0 2024-02-14T13:10:41.285 INFO:tasks.workunit.client.0.smithi012.stdout:1/795: dread d6/d10/d22/d31/d5b/d5e/d65/fa6 [0,4194304] 0 2024-02-14T13:10:41.285 INFO:tasks.workunit.client.0.smithi012.stdout:1/796: getdents d6/d10/d22/d31/d5b/d5e/d65/dec 0 2024-02-14T13:10:41.287 INFO:tasks.workunit.client.0.smithi012.stdout:1/797: symlink d6/d10/d22/d31/d5b/d5e/lf9 0 2024-02-14T13:10:41.287 INFO:tasks.workunit.client.0.smithi012.stdout:7/692: dwrite df/f30 [0,4194304] 0 2024-02-14T13:10:41.287 INFO:tasks.workunit.client.0.smithi012.stdout:6/766: dwrite d1/df/d24/fe0 [0,4194304] 0 2024-02-14T13:10:41.287 INFO:tasks.workunit.client.0.smithi012.stdout:7/693: stat df/d27/l7f 0 2024-02-14T13:10:41.287 INFO:tasks.workunit.client.0.smithi012.stdout:7/694: chown df/d2d/d82/d88/db2/fb5 0 1 2024-02-14T13:10:41.288 INFO:tasks.workunit.client.0.smithi012.stdout:2/844: dwrite d0/d1a/f49 [4194304,4194304] 0 2024-02-14T13:10:41.289 INFO:tasks.workunit.client.0.smithi012.stdout:3/742: dwrite d9/d3f/d88/dc0/ff1 [0,4194304] 0 2024-02-14T13:10:41.290 INFO:tasks.workunit.client.0.smithi012.stdout:6/767: mknod d1/df/d16/d7c/d97/cf8 0 2024-02-14T13:10:41.290 INFO:tasks.workunit.client.0.smithi012.stdout:6/768: fdatasync d1/d1e/d1b/d3e/f4c 0 2024-02-14T13:10:41.292 INFO:tasks.workunit.client.0.smithi012.stdout:2/845: link d0/f2f d0/d6/d37/d84/f120 0 2024-02-14T13:10:41.293 INFO:tasks.workunit.client.0.smithi012.stdout:0/860: write d10/f13 [260725,47071] 0 2024-02-14T13:10:41.293 INFO:tasks.workunit.client.0.smithi012.stdout:0/861: write d10/d14/d1b/d30/f6d [507608,92655] 0 2024-02-14T13:10:41.293 INFO:tasks.workunit.client.0.smithi012.stdout:0/862: chown d10/d14/d1b/d30/f7b 1985411359 1 2024-02-14T13:10:41.297 INFO:tasks.workunit.client.0.smithi012.stdout:1/798: write d6/d10/d22/d31/d5b/d5d/d6d/f7d [1390312,76527] 0 2024-02-14T13:10:41.297 INFO:tasks.workunit.client.0.smithi012.stdout:1/799: chown d6/d10/d22/d31/d5b/d5e/d65/db4/fed 9044127 1 2024-02-14T13:10:41.301 INFO:tasks.workunit.client.0.smithi012.stdout:3/743: getdents d9/d18/d39 0 2024-02-14T13:10:41.302 INFO:tasks.workunit.client.0.smithi012.stdout:6/769: unlink d1/d1e/d1b/d6d/fbc 0 2024-02-14T13:10:41.303 INFO:tasks.workunit.client.0.smithi012.stdout:2/846: mknod d0/d6/de/d7b/da8/c121 0 2024-02-14T13:10:41.305 INFO:tasks.workunit.client.0.smithi012.stdout:0/863: creat d10/d14/d1b/f118 x:0 0 0 2024-02-14T13:10:41.308 INFO:tasks.workunit.client.0.smithi012.stdout:1/800: mknod d6/d10/d22/d31/d5b/d5e/d65/cfa 0 2024-02-14T13:10:41.308 INFO:tasks.workunit.client.0.smithi012.stdout:1/801: dread - d6/d10/d22/d31/d3e/fb1 zero size 2024-02-14T13:10:41.309 INFO:tasks.workunit.client.0.smithi012.stdout:3/744: rename d9/d68 to d9/d13/dea/d103 0 2024-02-14T13:10:41.310 INFO:tasks.workunit.client.0.smithi012.stdout:0/864: creat d10/d14/d1b/f119 x:0 0 0 2024-02-14T13:10:41.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/847: rename d0/d2d/f77 to d0/d6/f122 0 2024-02-14T13:10:41.312 INFO:tasks.workunit.client.0.smithi012.stdout:4/734: sync 2024-02-14T13:10:41.312 INFO:tasks.workunit.client.0.smithi012.stdout:3/745: dread d9/d13/daa/de2/fe9 [0,4194304] 0 2024-02-14T13:10:41.314 INFO:tasks.workunit.client.0.smithi012.stdout:2/848: rmdir d0/d6/d37/d84/d51/d113 39 2024-02-14T13:10:41.315 INFO:tasks.workunit.client.0.smithi012.stdout:3/746: mkdir d9/d13/daa/de2/d104 0 2024-02-14T13:10:41.316 INFO:tasks.workunit.client.0.smithi012.stdout:0/865: mkdir d10/d14/d11a 0 2024-02-14T13:10:41.318 INFO:tasks.workunit.client.0.smithi012.stdout:0/866: unlink d10/d14/d41/d52/cb5 0 2024-02-14T13:10:41.319 INFO:tasks.workunit.client.0.smithi012.stdout:0/867: creat d10/d84/dbd/f11b x:0 0 0 2024-02-14T13:10:41.320 INFO:tasks.workunit.client.0.smithi012.stdout:6/770: dwrite d1/df/d24/d5f/da0/fc1 [0,4194304] 0 2024-02-14T13:10:41.321 INFO:tasks.workunit.client.0.smithi012.stdout:6/771: write d1/d1e/d1b/d3e/f4c [33081,91497] 0 2024-02-14T13:10:41.321 INFO:tasks.workunit.client.0.smithi012.stdout:6/772: chown d1/d1e/d1b/f87 54272458 1 2024-02-14T13:10:41.321 INFO:tasks.workunit.client.0.smithi012.stdout:6/773: chown d1/df/d50/db4/ff0 0 1 2024-02-14T13:10:41.322 INFO:tasks.workunit.client.0.smithi012.stdout:6/774: link d1/d1e/ff6 d1/d1e/d1b/d6d/ff9 0 2024-02-14T13:10:41.324 INFO:tasks.workunit.client.0.smithi012.stdout:6/775: unlink d1/df/d16/c45 0 2024-02-14T13:10:41.326 INFO:tasks.workunit.client.0.smithi012.stdout:6/776: link d1/d1e/c4e d1/d1e/d1b/d21/d78/ddf/cfa 0 2024-02-14T13:10:41.329 INFO:tasks.workunit.client.0.smithi012.stdout:6/777: creat d1/df/d16/d7c/d97/d82/ffb x:0 0 0 2024-02-14T13:10:41.330 INFO:tasks.workunit.client.0.smithi012.stdout:6/778: write d1/d1e/ff6 [904421,41557] 0 2024-02-14T13:10:41.334 INFO:tasks.workunit.client.0.smithi012.stdout:1/802: dwrite d6/d10/d22/d31/d3e/d71/fe8 [0,4194304] 0 2024-02-14T13:10:41.334 INFO:tasks.workunit.client.0.smithi012.stdout:1/803: write d6/d10/d22/d31/d5b/d5d/f17 [1907472,80399] 0 2024-02-14T13:10:41.335 INFO:tasks.workunit.client.0.smithi012.stdout:1/804: fdatasync d6/d10/d22/d31/d5b/d5e/d65/fa6 0 2024-02-14T13:10:41.338 INFO:tasks.workunit.client.0.smithi012.stdout:1/805: rmdir d6/d10/d22/d31/d5b/d5d/d80/da4 39 2024-02-14T13:10:41.340 INFO:tasks.workunit.client.0.smithi012.stdout:1/806: mknod d6/d10/d22/d31/d5b/d5e/d3d/cfb 0 2024-02-14T13:10:41.340 INFO:tasks.workunit.client.0.smithi012.stdout:1/807: read - d6/d10/d22/d31/d3e/fb1 zero size 2024-02-14T13:10:41.342 INFO:tasks.workunit.client.0.smithi012.stdout:1/808: creat d6/d10/df0/ffc x:0 0 0 2024-02-14T13:10:41.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/809: rename d6/d10/f3a to d6/d10/d22/d31/d5b/d5e/d65/ffd 0 2024-02-14T13:10:41.346 INFO:tasks.workunit.client.0.smithi012.stdout:1/810: fdatasync d6/d10/d22/d31/d34/d58/feb 0 2024-02-14T13:10:41.356 INFO:tasks.workunit.client.0.smithi012.stdout:4/735: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/fa0 [0,4194304] 0 2024-02-14T13:10:41.367 INFO:tasks.workunit.client.0.smithi012.stdout:0/868: dwrite d10/d14/d41/f6a [0,4194304] 0 2024-02-14T13:10:41.368 INFO:tasks.workunit.client.0.smithi012.stdout:0/869: link d10/d84/dbd/c27 d10/d14/d1b/d30/c11c 0 2024-02-14T13:10:41.368 INFO:tasks.workunit.client.0.smithi012.stdout:0/870: stat d10/d14/d41/d61/d74/l9e 0 2024-02-14T13:10:41.370 INFO:tasks.workunit.client.0.smithi012.stdout:2/849: dwrite d0/d1a/de4/d50/d68/d9c/f9f [4194304,4194304] 0 2024-02-14T13:10:41.370 INFO:tasks.workunit.client.0.smithi012.stdout:2/850: stat d0/d8/f30 0 2024-02-14T13:10:41.370 INFO:tasks.workunit.client.0.smithi012.stdout:3/747: dwrite d9/d3f/fa2 [0,4194304] 0 2024-02-14T13:10:41.370 INFO:tasks.workunit.client.0.smithi012.stdout:6/779: dwrite d1/d1e/d66/f88 [0,4194304] 0 2024-02-14T13:10:41.373 INFO:tasks.workunit.client.0.smithi012.stdout:2/851: unlink d0/d1a/de4/f42 0 2024-02-14T13:10:41.374 INFO:tasks.workunit.client.0.smithi012.stdout:4/736: dwrite d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 [0,4194304] 0 2024-02-14T13:10:41.374 INFO:tasks.workunit.client.0.smithi012.stdout:4/737: readlink d0/d10/d28/d4f/d6b/d8f/d56/d98/lb4 0 2024-02-14T13:10:41.375 INFO:tasks.workunit.client.0.smithi012.stdout:3/748: creat d9/d13/dea/dc9/f105 x:0 0 0 2024-02-14T13:10:41.381 INFO:tasks.workunit.client.0.smithi012.stdout:6/780: rmdir d1/d1e/d1b/d3e 39 2024-02-14T13:10:41.381 INFO:tasks.workunit.client.0.smithi012.stdout:6/781: readlink d1/df/d16/d7c/d97/lc5 0 2024-02-14T13:10:41.381 INFO:tasks.workunit.client.0.smithi012.stdout:6/782: chown d1/df/d24/d3f/d56/da3/cce 6 1 2024-02-14T13:10:41.381 INFO:tasks.workunit.client.0.smithi012.stdout:6/783: chown d1/df/d24/d3f/l58 7 1 2024-02-14T13:10:41.381 INFO:tasks.workunit.client.0.smithi012.stdout:6/784: dread - d1/df/d24/d3f/d56/d93/feb zero size 2024-02-14T13:10:41.382 INFO:tasks.workunit.client.0.smithi012.stdout:2/852: mkdir d0/d8/d11/d33/d53/d6b/d123 0 2024-02-14T13:10:41.384 INFO:tasks.workunit.client.0.smithi012.stdout:4/738: rename d0/d10/d28/d4f/f40 to d0/d10/d28/d4f/d6b/d83/d17/d5f/dcc/f10e 0 2024-02-14T13:10:41.385 INFO:tasks.workunit.client.0.smithi012.stdout:3/749: link d9/dd/d30/d34/c8d d9/d3f/d73/c106 0 2024-02-14T13:10:41.385 INFO:tasks.workunit.client.0.smithi012.stdout:3/750: stat d9/d18 0 2024-02-14T13:10:41.385 INFO:tasks.workunit.client.0.smithi012.stdout:3/751: fdatasync d9/d13/daa/de2/fe9 0 2024-02-14T13:10:41.386 INFO:tasks.workunit.client.0.smithi012.stdout:6/785: creat d1/df/d16/d7c/d97/d82/da5/ffc x:0 0 0 2024-02-14T13:10:41.386 INFO:tasks.workunit.client.0.smithi012.stdout:6/786: readlink d1/d1e/d1b/l99 0 2024-02-14T13:10:41.386 INFO:tasks.workunit.client.0.smithi012.stdout:6/787: chown d1/df/d24/f40 4695656 1 2024-02-14T13:10:41.388 INFO:tasks.workunit.client.0.smithi012.stdout:3/752: rename d9/d13/cb7 to d9/d3f/d4e/c107 0 2024-02-14T13:10:41.388 INFO:tasks.workunit.client.0.smithi012.stdout:5/855: sync 2024-02-14T13:10:41.388 INFO:tasks.workunit.client.0.smithi012.stdout:9/882: sync 2024-02-14T13:10:41.388 INFO:tasks.workunit.client.0.smithi012.stdout:8/770: sync 2024-02-14T13:10:41.390 INFO:tasks.workunit.client.0.smithi012.stdout:6/788: creat d1/df/d50/db4/ffd x:0 0 0 2024-02-14T13:10:41.390 INFO:tasks.workunit.client.0.smithi012.stdout:6/789: read d1/d1e/d1b/d21/d78/fde [564636,68970] 0 2024-02-14T13:10:41.391 INFO:tasks.workunit.client.0.smithi012.stdout:0/871: dwrite d10/d14/d2b/f10b [0,4194304] 0 2024-02-14T13:10:41.391 INFO:tasks.workunit.client.0.smithi012.stdout:0/872: write d10/d14/d41/d61/d74/fef [3304095,34743] 0 2024-02-14T13:10:41.391 INFO:tasks.workunit.client.0.smithi012.stdout:3/753: mknod d9/d13/daa/df8/c108 0 2024-02-14T13:10:41.391 INFO:tasks.workunit.client.0.smithi012.stdout:3/754: truncate d9/d3f/dac/fdc 1004149 0 2024-02-14T13:10:41.392 INFO:tasks.workunit.client.0.smithi012.stdout:5/856: mkdir dc/d47/d59/d10c 0 2024-02-14T13:10:41.394 INFO:tasks.workunit.client.0.smithi012.stdout:8/771: rename d9/dc/d14/d2e/dde/d56/cce to d9/dc/d14/d23/d62/c104 0 2024-02-14T13:10:41.396 INFO:tasks.workunit.client.0.smithi012.stdout:6/790: mkdir d1/df/d16/d7c/dfe 0 2024-02-14T13:10:41.396 INFO:tasks.workunit.client.0.smithi012.stdout:6/791: chown d1/d1e/ff6 225 1 2024-02-14T13:10:41.396 INFO:tasks.workunit.client.0.smithi012.stdout:6/792: readlink d1/df/d24/d3f/d56/ldd 0 2024-02-14T13:10:41.396 INFO:tasks.workunit.client.0.smithi012.stdout:2/853: dwrite d0/d8/d9/d90/fbc [0,4194304] 0 2024-02-14T13:10:41.397 INFO:tasks.workunit.client.0.smithi012.stdout:3/755: truncate d9/d13/f2b 1844051 0 2024-02-14T13:10:41.397 INFO:tasks.workunit.client.0.smithi012.stdout:3/756: chown d9/d3f/l9d 1045180 1 2024-02-14T13:10:41.397 INFO:tasks.workunit.client.0.smithi012.stdout:3/757: chown d9/d3f/d4e/c107 23288 1 2024-02-14T13:10:41.398 INFO:tasks.workunit.client.0.smithi012.stdout:5/857: symlink dc/d17/ded/l10d 0 2024-02-14T13:10:41.399 INFO:tasks.workunit.client.0.smithi012.stdout:0/873: rename d10/d14/d20/d49/lc1 to d10/d14/d41/d52/d72/l11d 0 2024-02-14T13:10:41.401 INFO:tasks.workunit.client.0.smithi012.stdout:3/758: creat d9/d3f/d88/f109 x:0 0 0 2024-02-14T13:10:41.402 INFO:tasks.workunit.client.0.smithi012.stdout:0/874: mkdir d10/d11e 0 2024-02-14T13:10:41.402 INFO:tasks.workunit.client.0.smithi012.stdout:4/739: dread d0/d10/d1f/d71/fd5 [0,4194304] 0 2024-02-14T13:10:41.404 INFO:tasks.workunit.client.0.smithi012.stdout:3/759: link d9/dd/d30/d44/d66/db3/lc6 d9/d18/d39/df7/l10a 0 2024-02-14T13:10:41.407 INFO:tasks.workunit.client.0.smithi012.stdout:5/858: dread f5 [0,4194304] 0 2024-02-14T13:10:41.409 INFO:tasks.workunit.client.0.smithi012.stdout:4/740: rename d0/d10/d28/d4f/d6b/fde to d0/d10/d28/d4f/d6b/d8f/d56/df7/f10f 0 2024-02-14T13:10:41.411 INFO:tasks.workunit.client.0.smithi012.stdout:5/859: dread dc/d17/d4b/f7c [0,4194304] 0 2024-02-14T13:10:41.412 INFO:tasks.workunit.client.0.smithi012.stdout:4/741: chown d0/c19 1 1 2024-02-14T13:10:41.423 INFO:tasks.workunit.client.0.smithi012.stdout:0/875: dread d10/d14/d41/f89 [0,4194304] 0 2024-02-14T13:10:41.425 INFO:tasks.workunit.client.0.smithi012.stdout:0/876: mkdir d10/d14/d41/d52/d99/d9b/dd0/d11f 0 2024-02-14T13:10:41.425 INFO:tasks.workunit.client.0.smithi012.stdout:8/772: dwrite d9/dc/d14/d2e/dde/f9b [0,4194304] 0 2024-02-14T13:10:41.425 INFO:tasks.workunit.client.0.smithi012.stdout:8/773: write d9/dc/d14/d2e/dde/f88 [229583,84686] 0 2024-02-14T13:10:41.425 INFO:tasks.workunit.client.0.smithi012.stdout:6/793: dwrite d1/d1e/d1b/d6d/fe8 [0,4194304] 0 2024-02-14T13:10:41.427 INFO:tasks.workunit.client.0.smithi012.stdout:0/877: dread d10/f62 [0,4194304] 0 2024-02-14T13:10:41.429 INFO:tasks.workunit.client.0.smithi012.stdout:8/774: truncate d9/dc/d1b/f9f 290927 0 2024-02-14T13:10:41.429 INFO:tasks.workunit.client.0.smithi012.stdout:8/775: fsync d9/fe3 0 2024-02-14T13:10:41.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/742: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/fe2 [0,4194304] 0 2024-02-14T13:10:41.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/743: chown d0/d10/c6e 356121243 1 2024-02-14T13:10:41.429 INFO:tasks.workunit.client.0.smithi012.stdout:9/883: dwrite da/dd/d57/db2/fd0 [0,4194304] 0 2024-02-14T13:10:41.429 INFO:tasks.workunit.client.0.smithi012.stdout:6/794: getdents d1/d1e/dc/d43/dd4 0 2024-02-14T13:10:41.430 INFO:tasks.workunit.client.0.smithi012.stdout:0/878: write d10/dad/fb8 [429239,18787] 0 2024-02-14T13:10:41.430 INFO:tasks.workunit.client.0.smithi012.stdout:6/795: link d1/df/fcc d1/d1e/d1b/db8/fff 0 2024-02-14T13:10:41.430 INFO:tasks.workunit.client.0.smithi012.stdout:6/796: truncate d1/d1e/d1b/db8/fff 1017946 0 2024-02-14T13:10:41.432 INFO:tasks.workunit.client.0.smithi012.stdout:0/879: getdents d10/d14/d41/d52/d99 0 2024-02-14T13:10:41.434 INFO:tasks.workunit.client.0.smithi012.stdout:0/880: mknod d10/d14/d20/daa/dca/c120 0 2024-02-14T13:10:41.436 INFO:tasks.workunit.client.0.smithi012.stdout:0/881: rename d10/d84/d93/cbf to d10/d14/d41/d52/d67/c121 0 2024-02-14T13:10:41.437 INFO:tasks.workunit.client.0.smithi012.stdout:0/882: mkdir d10/d14/d1b/d8e/d122 0 2024-02-14T13:10:41.438 INFO:tasks.workunit.client.0.smithi012.stdout:0/883: creat d10/d14/d41/d52/d78/df9/dff/f123 x:0 0 0 2024-02-14T13:10:41.439 INFO:tasks.workunit.client.0.smithi012.stdout:3/760: dwrite d9/dd/de/d58/f64 [0,4194304] 0 2024-02-14T13:10:41.439 INFO:tasks.workunit.client.0.smithi012.stdout:3/761: read - d9/d13/fa1 zero size 2024-02-14T13:10:41.442 INFO:tasks.workunit.client.0.smithi012.stdout:5/860: dwrite dc/d47/d6e/f77 [0,4194304] 0 2024-02-14T13:10:41.442 INFO:tasks.workunit.client.0.smithi012.stdout:8/776: write d9/dc/d14/d2e/dde/f9b [3836986,111553] 0 2024-02-14T13:10:41.444 INFO:tasks.workunit.client.0.smithi012.stdout:9/884: dread da/dd/d19/df3/d85/f51 [0,4194304] 0 2024-02-14T13:10:41.444 INFO:tasks.workunit.client.0.smithi012.stdout:9/885: chown da/dd/d57/d59/d73/db6/df1/fa3 6075 1 2024-02-14T13:10:41.444 INFO:tasks.workunit.client.0.smithi012.stdout:9/886: write da/dd/faf [438240,126619] 0 2024-02-14T13:10:41.448 INFO:tasks.workunit.client.0.smithi012.stdout:3/762: symlink d9/dd/d30/d44/d66/db3/dee/l10b 0 2024-02-14T13:10:41.449 INFO:tasks.workunit.client.0.smithi012.stdout:5/861: rename dc/d17/d20/c23 to dc/d17/d4b/c10e 0 2024-02-14T13:10:41.450 INFO:tasks.workunit.client.0.smithi012.stdout:4/744: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fe6 [0,4194304] 0 2024-02-14T13:10:41.451 INFO:tasks.workunit.client.0.smithi012.stdout:8/777: creat d9/dc/d14/d2e/dde/da1/dba/f105 x:0 0 0 2024-02-14T13:10:41.452 INFO:tasks.workunit.client.0.smithi012.stdout:5/862: dread dc/d17/f3f [0,4194304] 0 2024-02-14T13:10:41.452 INFO:tasks.workunit.client.0.smithi012.stdout:9/887: unlink da/d4f/f60 0 2024-02-14T13:10:41.452 INFO:tasks.workunit.client.0.smithi012.stdout:9/888: write da/dd/d57/d59/f10a [667397,89866] 0 2024-02-14T13:10:41.453 INFO:tasks.workunit.client.0.smithi012.stdout:8/778: dread d9/dc/d14/d2e/dde/da3/de9/fd9 [0,4194304] 0 2024-02-14T13:10:41.456 INFO:tasks.workunit.client.0.smithi012.stdout:5/863: unlink dc/d47/d69/lae 0 2024-02-14T13:10:41.458 INFO:tasks.workunit.client.0.smithi012.stdout:8/779: rename d9/dc/d14/d2e/dde/da3/ded/da5/fb6 to d9/dc/d1b/d6b/f106 0 2024-02-14T13:10:41.458 INFO:tasks.workunit.client.0.smithi012.stdout:8/780: write d9/dc/d14/fbc [922599,16692] 0 2024-02-14T13:10:41.459 INFO:tasks.workunit.client.0.smithi012.stdout:0/884: dwrite d10/dad/fb2 [0,4194304] 0 2024-02-14T13:10:41.460 INFO:tasks.workunit.client.0.smithi012.stdout:7/695: sync 2024-02-14T13:10:41.460 INFO:tasks.workunit.client.0.smithi012.stdout:7/696: chown df/d36/d67/cae 479 1 2024-02-14T13:10:41.460 INFO:tasks.workunit.client.0.smithi012.stdout:0/885: write d10/d14/d41/d52/d78/d8c/f35 [333339,81237] 0 2024-02-14T13:10:41.462 INFO:tasks.workunit.client.0.smithi012.stdout:7/697: creat df/d2d/ff2 x:0 0 0 2024-02-14T13:10:41.462 INFO:tasks.workunit.client.0.smithi012.stdout:5/864: dread dc/d17/f24 [0,4194304] 0 2024-02-14T13:10:41.462 INFO:tasks.workunit.client.0.smithi012.stdout:5/865: dread - dc/d47/d69/feb zero size 2024-02-14T13:10:41.463 INFO:tasks.workunit.client.0.smithi012.stdout:0/886: creat d10/d14/d41/d52/d78/df9/dff/f124 x:0 0 0 2024-02-14T13:10:41.464 INFO:tasks.workunit.client.0.smithi012.stdout:8/781: mkdir d9/dc/d14/d2e/dde/d56/d57/d92/de1/d107 0 2024-02-14T13:10:41.464 INFO:tasks.workunit.client.0.smithi012.stdout:8/782: fsync d9/dc/d1b/f9f 0 2024-02-14T13:10:41.465 INFO:tasks.workunit.client.0.smithi012.stdout:9/889: dread da/dd/d19/df3/d85/d48/fde [0,4194304] 0 2024-02-14T13:10:41.468 INFO:tasks.workunit.client.0.smithi012.stdout:7/698: rename df/d2d/d5d/d72/d8a/f9a to df/d27/d4b/d6b/d6d/d85/ff3 0 2024-02-14T13:10:41.468 INFO:tasks.workunit.client.0.smithi012.stdout:0/887: mkdir d10/d14/d20/daa/de0/d125 0 2024-02-14T13:10:41.468 INFO:tasks.workunit.client.0.smithi012.stdout:7/699: chown df/d27/d4b/d6b/fa5 9759521 1 2024-02-14T13:10:41.468 INFO:tasks.workunit.client.0.smithi012.stdout:3/763: dwrite d9/dd/de/d58/d65/f6e [0,4194304] 0 2024-02-14T13:10:41.472 INFO:tasks.workunit.client.0.smithi012.stdout:0/888: rename d10/d14/d1b to d10/d14/d41/d52/d67/d126 0 2024-02-14T13:10:41.474 INFO:tasks.workunit.client.0.smithi012.stdout:0/889: fsync d10/d14/d41/d61/d74/dfc/f4b 0 2024-02-14T13:10:41.474 INFO:tasks.workunit.client.0.smithi012.stdout:4/745: dwrite d0/de1/de8/f73 [0,4194304] 0 2024-02-14T13:10:41.474 INFO:tasks.workunit.client.0.smithi012.stdout:4/746: chown d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/fab 35 1 2024-02-14T13:10:41.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/700: symlink df/d36/lf4 0 2024-02-14T13:10:41.474 INFO:tasks.workunit.client.0.smithi012.stdout:7/701: read df/f59 [1594526,63714] 0 2024-02-14T13:10:41.479 INFO:tasks.workunit.client.0.smithi012.stdout:3/764: rmdir d9/dd/d30/d34/d78/de1 0 2024-02-14T13:10:41.479 INFO:tasks.workunit.client.0.smithi012.stdout:3/765: fdatasync d9/dd/d30/d44/f4b 0 2024-02-14T13:10:41.480 INFO:tasks.workunit.client.0.smithi012.stdout:0/890: mknod d10/db6/c127 0 2024-02-14T13:10:41.481 INFO:tasks.workunit.client.0.smithi012.stdout:7/702: creat df/d24/d9e/df0/ff5 x:0 0 0 2024-02-14T13:10:41.482 INFO:tasks.workunit.client.0.smithi012.stdout:3/766: symlink d9/d18/d39/df7/l10c 0 2024-02-14T13:10:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:7/703: mknod df/d2d/d5d/d72/cf6 0 2024-02-14T13:10:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/767: mkdir d9/dd/d10d 0 2024-02-14T13:10:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/768: write d9/f61 [696095,110733] 0 2024-02-14T13:10:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/769: chown d9/d13/dea/d103/f90 24929962 1 2024-02-14T13:10:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:3/770: truncate d9/d18/d39/df7/ffd 376068 0 2024-02-14T13:10:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:7/704: creat df/d2d/d5d/d72/ff7 x:0 0 0 2024-02-14T13:10:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:7/705: chown df/d2d/d57 30186905 1 2024-02-14T13:10:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:7/706: chown df/d24/d9e/df0/ff5 762 1 2024-02-14T13:10:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:3/771: rename d9/d13/daa/de2 to d9/d13/daa/df8/d10e 0 2024-02-14T13:10:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:5/866: dwrite dc/f33 [0,4194304] 0 2024-02-14T13:10:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:5/867: getdents dc/d2f/d40/d53/d97/d98 0 2024-02-14T13:10:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:9/890: dwrite da/dd/d19/df3/d85/d48/f11e [0,4194304] 0 2024-02-14T13:10:41.502 INFO:tasks.workunit.client.0.smithi012.stdout:3/772: dread d9/d3f/d88/dc0/ff1 [0,4194304] 0 2024-02-14T13:10:41.502 INFO:tasks.workunit.client.0.smithi012.stdout:3/773: fsync d9/dd/d30/d44/d66/db3/fe8 0 2024-02-14T13:10:41.503 INFO:tasks.workunit.client.0.smithi012.stdout:9/891: mknod da/dd/c12a 0 2024-02-14T13:10:41.503 INFO:tasks.workunit.client.0.smithi012.stdout:9/892: fdatasync da/dd/d19/d30/f1f 0 2024-02-14T13:10:41.504 INFO:tasks.workunit.client.0.smithi012.stdout:3/774: truncate d9/dd/de/d58/d65/df0/fb2 676863 0 2024-02-14T13:10:41.505 INFO:tasks.workunit.client.0.smithi012.stdout:9/893: link da/dd/d19/d30/d9d/dce/cfa da/dd/c12b 0 2024-02-14T13:10:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:8/783: dwrite d9/dc/d14/d2e/dde/d56/d57/d5c/f61 [4194304,4194304] 0 2024-02-14T13:10:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:4/747: dwrite d0/d10/d1f/f9b [0,4194304] 0 2024-02-14T13:10:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/775: mknod d9/d3f/d73/d5d/d91/c10f 0 2024-02-14T13:10:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/776: truncate d9/d7b/d95/fab 112090 0 2024-02-14T13:10:41.508 INFO:tasks.workunit.client.0.smithi012.stdout:9/894: rmdir da/dd/d57/d59/dc4 39 2024-02-14T13:10:41.508 INFO:tasks.workunit.client.0.smithi012.stdout:9/895: chown da/d33/d63/d106/f124 185645077 1 2024-02-14T13:10:41.510 INFO:tasks.workunit.client.0.smithi012.stdout:4/748: getdents d0/d10/d28/d4f/d6b/d8f 0 2024-02-14T13:10:41.511 INFO:tasks.workunit.client.0.smithi012.stdout:3/777: creat d9/dd/d30/d44/d66/db3/f110 x:0 0 0 2024-02-14T13:10:41.511 INFO:tasks.workunit.client.0.smithi012.stdout:3/778: fsync d9/d3f/d88/fe5 0 2024-02-14T13:10:41.511 INFO:tasks.workunit.client.0.smithi012.stdout:3/779: stat d9/dd/d30/d44/d66/db3/cd7 0 2024-02-14T13:10:41.512 INFO:tasks.workunit.client.0.smithi012.stdout:9/896: creat da/dd/d38/d7e/f12c x:0 0 0 2024-02-14T13:10:41.513 INFO:tasks.workunit.client.0.smithi012.stdout:4/749: mkdir d0/d10/d28/d4f/d6b/d8f/d56/d98/d110 0 2024-02-14T13:10:41.514 INFO:tasks.workunit.client.0.smithi012.stdout:3/780: mknod d9/d7b/c111 0 2024-02-14T13:10:41.514 INFO:tasks.workunit.client.0.smithi012.stdout:3/781: write d9/f61 [694301,8388] 0 2024-02-14T13:10:41.514 INFO:tasks.workunit.client.0.smithi012.stdout:3/782: write d9/dd/d30/d34/d78/fb1 [171281,15573] 0 2024-02-14T13:10:41.516 INFO:tasks.workunit.client.0.smithi012.stdout:9/897: rename da/d4f/f11f to da/dd/d38/d7e/ddc/f12d 0 2024-02-14T13:10:41.518 INFO:tasks.workunit.client.0.smithi012.stdout:4/750: rmdir d0/d10/d28/da9/d86 39 2024-02-14T13:10:41.523 INFO:tasks.workunit.client.0.smithi012.stdout:5/868: dwrite dc/d17/f3f [0,4194304] 0 2024-02-14T13:10:41.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/869: stat f6 0 2024-02-14T13:10:41.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/870: write dc/d17/d20/d8e/f9e [644018,19040] 0 2024-02-14T13:10:41.524 INFO:tasks.workunit.client.0.smithi012.stdout:0/891: dwrite d10/d14/fba [0,4194304] 0 2024-02-14T13:10:41.524 INFO:tasks.workunit.client.0.smithi012.stdout:5/871: stat dc/d17/fd9 0 2024-02-14T13:10:41.524 INFO:tasks.workunit.client.0.smithi012.stdout:0/892: write d10/d14/d41/df2/f109 [990718,1820] 0 2024-02-14T13:10:41.524 INFO:tasks.workunit.client.0.smithi012.stdout:0/893: fsync d10/d14/d20/d49/fc9 0 2024-02-14T13:10:41.529 INFO:tasks.workunit.client.0.smithi012.stdout:9/898: rmdir da/d4f 39 2024-02-14T13:10:41.532 INFO:tasks.workunit.client.0.smithi012.stdout:0/894: truncate d10/d14/d41/d52/d72/fa7 237281 0 2024-02-14T13:10:41.533 INFO:tasks.workunit.client.0.smithi012.stdout:9/899: getdents da/dd/d38/d7e/d91 0 2024-02-14T13:10:41.534 INFO:tasks.workunit.client.0.smithi012.stdout:5/872: write dc/d17/d20/d4c/d63/d81/fcd [1615037,114347] 0 2024-02-14T13:10:41.535 INFO:tasks.workunit.client.0.smithi012.stdout:9/900: rename da/dd/d19/d30/d45/c77 to da/d33/d63/d106/c12e 0 2024-02-14T13:10:41.535 INFO:tasks.workunit.client.0.smithi012.stdout:8/784: dwrite d9/dc/d14/d2e/dde/d56/d57/d7c/f99 [0,4194304] 0 2024-02-14T13:10:41.535 INFO:tasks.workunit.client.0.smithi012.stdout:5/873: symlink dc/d2f/d70/d78/dc4/l10f 0 2024-02-14T13:10:41.535 INFO:tasks.workunit.client.0.smithi012.stdout:5/874: chown dc/d17/d20/d4c/d63/d81/fd4 630 1 2024-02-14T13:10:41.536 INFO:tasks.workunit.client.0.smithi012.stdout:9/901: creat da/dd/d19/d30/d9d/dce/f12f x:0 0 0 2024-02-14T13:10:41.539 INFO:tasks.workunit.client.0.smithi012.stdout:5/875: creat dc/d2f/d89/f110 x:0 0 0 2024-02-14T13:10:41.539 INFO:tasks.workunit.client.0.smithi012.stdout:5/876: write dc/d2f/f74 [111520,72645] 0 2024-02-14T13:10:41.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/783: dwrite d9/d3f/d4e/f6d [0,4194304] 0 2024-02-14T13:10:41.539 INFO:tasks.workunit.client.0.smithi012.stdout:4/751: dwrite d0/d10/f3b [0,4194304] 0 2024-02-14T13:10:41.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/784: dread d9/dd/d30/d44/f9e [0,4194304] 0 2024-02-14T13:10:41.540 INFO:tasks.workunit.client.0.smithi012.stdout:9/902: write da/dd/d57/f41 [1589055,120881] 0 2024-02-14T13:10:41.540 INFO:tasks.workunit.client.0.smithi012.stdout:9/903: truncate da/dd/d57/d59/f10a 1473255 0 2024-02-14T13:10:41.542 INFO:tasks.workunit.client.0.smithi012.stdout:8/785: mknod d9/dc/d14/d2e/c108 0 2024-02-14T13:10:41.543 INFO:tasks.workunit.client.0.smithi012.stdout:5/877: symlink dc/d47/l111 0 2024-02-14T13:10:41.544 INFO:tasks.workunit.client.0.smithi012.stdout:4/752: creat d0/d10/f111 x:0 0 0 2024-02-14T13:10:41.544 INFO:tasks.workunit.client.0.smithi012.stdout:0/895: dread d10/d14/d2b/f10b [0,4194304] 0 2024-02-14T13:10:41.545 INFO:tasks.workunit.client.0.smithi012.stdout:3/785: dread d9/dd/de/d58/d65/d6c/f7c [0,4194304] 0 2024-02-14T13:10:41.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/753: rename d0/d10/f3b to d0/d10/d28/da9/d86/db5/f112 0 2024-02-14T13:10:41.550 INFO:tasks.workunit.client.0.smithi012.stdout:5/878: dread dc/d17/d20/d4c/d63/d81/fcd [0,4194304] 0 2024-02-14T13:10:41.550 INFO:tasks.workunit.client.0.smithi012.stdout:5/879: chown dc/d17/l1f 0 1 2024-02-14T13:10:41.550 INFO:tasks.workunit.client.0.smithi012.stdout:3/786: creat d9/d3f/dac/dfb/f112 x:0 0 0 2024-02-14T13:10:41.550 INFO:tasks.workunit.client.0.smithi012.stdout:3/787: chown d9/dd/de/l74 617 1 2024-02-14T13:10:41.551 INFO:tasks.workunit.client.0.smithi012.stdout:4/754: creat d0/d10/d28/d4f/d6b/d83/d99/f113 x:0 0 0 2024-02-14T13:10:41.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/880: mkdir dc/d2f/d70/d78/d99/d112 0 2024-02-14T13:10:41.552 INFO:tasks.workunit.client.0.smithi012.stdout:5/881: chown dc/d17/ded/fa2 1 1 2024-02-14T13:10:41.552 INFO:tasks.workunit.client.0.smithi012.stdout:4/755: mknod d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/c114 0 2024-02-14T13:10:41.553 INFO:tasks.workunit.client.0.smithi012.stdout:4/756: creat d0/de1/de8/f115 x:0 0 0 2024-02-14T13:10:41.553 INFO:tasks.workunit.client.0.smithi012.stdout:0/896: write d10/d14/d41/d52/d67/d126/d7e/f97 [3048429,36999] 0 2024-02-14T13:10:41.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/786: dread d9/dc/d14/d23/f63 [0,4194304] 0 2024-02-14T13:10:41.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/787: truncate d9/dc/d38/d6a/f79 4717520 0 2024-02-14T13:10:41.554 INFO:tasks.workunit.client.0.smithi012.stdout:8/788: write d9/dc/d1b/f80 [1445960,59746] 0 2024-02-14T13:10:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:4/757: rename d0/d10/d28/l66 to d0/de1/de8/l116 0 2024-02-14T13:10:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/811: sync 2024-02-14T13:10:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/812: truncate d6/d10/d22/d31/d3e/fd0 236179 0 2024-02-14T13:10:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/813: fdatasync d6/d10/d22/d31/d5b/d5e/d65/fd2 0 2024-02-14T13:10:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/814: read d6/d10/d22/d31/d34/d58/d61/fda [230258,103059] 0 2024-02-14T13:10:41.555 INFO:tasks.workunit.client.0.smithi012.stdout:1/815: write d6/d10/d22/d31/d34/d3b/f53 [1621990,107763] 0 2024-02-14T13:10:41.556 INFO:tasks.workunit.client.0.smithi012.stdout:8/789: symlink d9/dc/d14/d2e/dde/da3/ded/dd5/l109 0 2024-02-14T13:10:41.556 INFO:tasks.workunit.client.0.smithi012.stdout:8/790: write d9/dc/d14/d2e/dde/d56/d57/d7c/fef [940711,39767] 0 2024-02-14T13:10:41.556 INFO:tasks.workunit.client.0.smithi012.stdout:1/816: read d6/d10/d22/d31/d5b/dcd/da2/fd5 [213042,87254] 0 2024-02-14T13:10:41.558 INFO:tasks.workunit.client.0.smithi012.stdout:0/897: rename d10/d14/d20/daa/de0/d125 to d10/d14/d41/d52/d99/d9b/d128 0 2024-02-14T13:10:41.558 INFO:tasks.workunit.client.0.smithi012.stdout:8/791: fdatasync d9/dc/d14/d2e/dde/d56/d57/f6c 0 2024-02-14T13:10:41.559 INFO:tasks.workunit.client.0.smithi012.stdout:1/817: creat d6/d10/d22/d31/d34/d58/ffe x:0 0 0 2024-02-14T13:10:41.559 INFO:tasks.workunit.client.0.smithi012.stdout:9/904: dwrite da/d33/d63/f86 [0,4194304] 0 2024-02-14T13:10:41.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/898: dread d10/f13 [0,4194304] 0 2024-02-14T13:10:41.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/899: stat d10/d14/d41/d61/d74/dfc/f4d 0 2024-02-14T13:10:41.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/900: write d10/d14/d41/d52/d78/d8c/f35 [796858,98045] 0 2024-02-14T13:10:41.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/901: readlink lb 0 2024-02-14T13:10:41.563 INFO:tasks.workunit.client.0.smithi012.stdout:0/902: readlink d10/d14/d41/le4 0 2024-02-14T13:10:41.564 INFO:tasks.workunit.client.0.smithi012.stdout:5/882: dread dc/d47/d6e/ff7 [0,4194304] 0 2024-02-14T13:10:41.568 INFO:tasks.workunit.client.0.smithi012.stdout:9/905: truncate da/dd/d19/df3/d85/f31 2699583 0 2024-02-14T13:10:41.569 INFO:tasks.workunit.client.0.smithi012.stdout:8/792: rmdir d9/dc/d14/d2e/dde/d56/d57/dca 39 2024-02-14T13:10:41.572 INFO:tasks.workunit.client.0.smithi012.stdout:3/788: dwrite d9/dd/fbc [0,4194304] 0 2024-02-14T13:10:41.572 INFO:tasks.workunit.client.0.smithi012.stdout:3/789: readlink d9/d3f/d73/d5d/lf9 0 2024-02-14T13:10:41.572 INFO:tasks.workunit.client.0.smithi012.stdout:0/903: unlink d10/d14/d41/d52/d67/d126/d30/l3d 0 2024-02-14T13:10:41.574 INFO:tasks.workunit.client.0.smithi012.stdout:5/883: creat dc/d17/ded/de5/f113 x:0 0 0 2024-02-14T13:10:41.576 INFO:tasks.workunit.client.0.smithi012.stdout:9/906: rename da/dd/d19/f4d to da/dd/d19/d30/d9d/f130 0 2024-02-14T13:10:41.577 INFO:tasks.workunit.client.0.smithi012.stdout:9/907: stat da/dd/d57/d59/d73/db6/df1/d8d/ldb 0 2024-02-14T13:10:41.577 INFO:tasks.workunit.client.0.smithi012.stdout:8/793: creat d9/dc/d14/d2e/dde/da3/ded/da5/f10a x:0 0 0 2024-02-14T13:10:41.581 INFO:tasks.workunit.client.0.smithi012.stdout:5/884: creat dc/d17/d20/d4c/d7b/dfa/de7/f114 x:0 0 0 2024-02-14T13:10:41.583 INFO:tasks.workunit.client.0.smithi012.stdout:9/908: mknod da/dd/d19/df3/d85/d48/c131 0 2024-02-14T13:10:41.585 INFO:tasks.workunit.client.0.smithi012.stdout:5/885: rename dc/d17/d20/d8e/f9e to dc/d17/f115 0 2024-02-14T13:10:41.587 INFO:tasks.workunit.client.0.smithi012.stdout:3/790: write d9/dd/f4a [648426,109478] 0 2024-02-14T13:10:41.587 INFO:tasks.workunit.client.0.smithi012.stdout:5/886: creat dc/d2f/d70/d78/f116 x:0 0 0 2024-02-14T13:10:41.587 INFO:tasks.workunit.client.0.smithi012.stdout:5/887: chown dc/d17/d20/d4c/d63/d81/cc8 96 1 2024-02-14T13:10:41.588 INFO:tasks.workunit.client.0.smithi012.stdout:4/758: dwrite d0/f6 [4194304,4194304] 0 2024-02-14T13:10:41.590 INFO:tasks.workunit.client.0.smithi012.stdout:1/818: dwrite d6/ff [4194304,4194304] 0 2024-02-14T13:10:41.590 INFO:tasks.workunit.client.0.smithi012.stdout:3/791: unlink d9/d13/dea/f9f 0 2024-02-14T13:10:41.590 INFO:tasks.workunit.client.0.smithi012.stdout:3/792: stat d9/d13/dea/f9b 0 2024-02-14T13:10:41.591 INFO:tasks.workunit.client.0.smithi012.stdout:5/888: rmdir dc/d17 39 2024-02-14T13:10:41.594 INFO:tasks.workunit.client.0.smithi012.stdout:4/759: unlink d0/d10/f60 0 2024-02-14T13:10:41.595 INFO:tasks.workunit.client.0.smithi012.stdout:1/819: creat d6/d10/df0/fff x:0 0 0 2024-02-14T13:10:41.595 INFO:tasks.workunit.client.0.smithi012.stdout:1/820: chown d6/d10/d22/d31/d5b/d5e/d65/d87/dcc 110837 1 2024-02-14T13:10:41.598 INFO:tasks.workunit.client.0.smithi012.stdout:3/793: unlink d9/dd/de/l74 0 2024-02-14T13:10:41.600 INFO:tasks.workunit.client.0.smithi012.stdout:5/889: link dc/d2f/d94/l102 dc/d2f/d70/dbc/l117 0 2024-02-14T13:10:41.600 INFO:tasks.workunit.client.0.smithi012.stdout:5/890: write dc/d17/ded/de5/f113 [776103,81476] 0 2024-02-14T13:10:41.600 INFO:tasks.workunit.client.0.smithi012.stdout:4/760: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/c117 0 2024-02-14T13:10:41.600 INFO:tasks.workunit.client.0.smithi012.stdout:4/761: chown d0/d10/d28/d62/l8b 4515057 1 2024-02-14T13:10:41.602 INFO:tasks.workunit.client.0.smithi012.stdout:1/821: rename d6/d10/d22/d31/d3e/fd0 to d6/d10/d22/d31/d5b/d5d/d6d/de9/f100 0 2024-02-14T13:10:41.603 INFO:tasks.workunit.client.0.smithi012.stdout:3/794: symlink d9/dd/d30/d44/d66/dd0/l113 0 2024-02-14T13:10:41.603 INFO:tasks.workunit.client.0.smithi012.stdout:3/795: dread - d9/d13/fa1 zero size 2024-02-14T13:10:41.603 INFO:tasks.workunit.client.0.smithi012.stdout:1/822: dread d6/d10/d22/fb5 [0,4194304] 0 2024-02-14T13:10:41.603 INFO:tasks.workunit.client.0.smithi012.stdout:5/891: getdents dc/d2f/d40/d53/d8a 0 2024-02-14T13:10:41.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/762: unlink d0/lf 0 2024-02-14T13:10:41.607 INFO:tasks.workunit.client.0.smithi012.stdout:0/904: dwrite d10/d14/d41/d52/d78/d8c/d7f/fa5 [0,4194304] 0 2024-02-14T13:10:41.607 INFO:tasks.workunit.client.0.smithi012.stdout:8/794: dwrite d9/dc/d14/d2e/dde/da3/ded/f78 [0,4194304] 0 2024-02-14T13:10:41.607 INFO:tasks.workunit.client.0.smithi012.stdout:2/854: sync 2024-02-14T13:10:41.608 INFO:tasks.workunit.client.0.smithi012.stdout:4/763: mkdir d0/d10/d28/d118 0 2024-02-14T13:10:41.608 INFO:tasks.workunit.client.0.smithi012.stdout:4/764: dread - d0/d10/d28/d4f/d6b/d8f/f88 zero size 2024-02-14T13:10:41.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/823: dread d6/d10/d22/d31/d5b/d5e/d65/fa6 [0,4194304] 0 2024-02-14T13:10:41.608 INFO:tasks.workunit.client.0.smithi012.stdout:1/824: write d6/d10/d22/d31/d5b/d5d/d6d/de9/f100 [862853,126070] 0 2024-02-14T13:10:41.612 INFO:tasks.workunit.client.0.smithi012.stdout:9/909: dwrite da/dd/d19/df3/f75 [0,4194304] 0 2024-02-14T13:10:41.619 INFO:tasks.workunit.client.0.smithi012.stdout:2/855: link d0/d6/f11f d0/d8/d10c/f124 0 2024-02-14T13:10:41.620 INFO:tasks.workunit.client.0.smithi012.stdout:4/765: mknod d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/c119 0 2024-02-14T13:10:41.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/905: rename d10/d14/d20/f5a to d10/d14/f129 0 2024-02-14T13:10:41.622 INFO:tasks.workunit.client.0.smithi012.stdout:0/906: write d10/dad/fb8 [2110215,46693] 0 2024-02-14T13:10:41.624 INFO:tasks.workunit.client.0.smithi012.stdout:9/910: creat da/dd/d19/df3/d85/d48/f132 x:0 0 0 2024-02-14T13:10:41.626 INFO:tasks.workunit.client.0.smithi012.stdout:4/766: mkdir d0/de1/de8/d11a 0 2024-02-14T13:10:41.626 INFO:tasks.workunit.client.0.smithi012.stdout:4/767: chown d0/de1/de8/l116 9686 1 2024-02-14T13:10:41.627 INFO:tasks.workunit.client.0.smithi012.stdout:0/907: creat d10/d14/d20/f12a x:0 0 0 2024-02-14T13:10:41.628 INFO:tasks.workunit.client.0.smithi012.stdout:0/908: chown d10/d14/d51/f7a 0 1 2024-02-14T13:10:41.628 INFO:tasks.workunit.client.0.smithi012.stdout:0/909: fsync d10/d84/fcd 0 2024-02-14T13:10:41.629 INFO:tasks.workunit.client.0.smithi012.stdout:9/911: mkdir da/dd/d133 0 2024-02-14T13:10:41.629 INFO:tasks.workunit.client.0.smithi012.stdout:9/912: fdatasync da/d33/d63/d106/f70 0 2024-02-14T13:10:41.629 INFO:tasks.workunit.client.0.smithi012.stdout:9/913: chown da/dd/d38/d7e/d91 17 1 2024-02-14T13:10:41.630 INFO:tasks.workunit.client.0.smithi012.stdout:2/856: write d0/d20/d54/f82 [479253,107921] 0 2024-02-14T13:10:41.630 INFO:tasks.workunit.client.0.smithi012.stdout:4/768: symlink d0/d10/d28/l11b 0 2024-02-14T13:10:41.630 INFO:tasks.workunit.client.0.smithi012.stdout:4/769: write d0/d10/d28/da9/f100 [902856,114020] 0 2024-02-14T13:10:41.630 INFO:tasks.workunit.client.0.smithi012.stdout:8/795: dwrite d9/dc/fe8 [0,4194304] 0 2024-02-14T13:10:41.632 INFO:tasks.workunit.client.0.smithi012.stdout:3/796: dwrite d9/d18/d39/df7/ffd [0,4194304] 0 2024-02-14T13:10:41.632 INFO:tasks.workunit.client.0.smithi012.stdout:0/910: rmdir d10/d14/d41/d52/d78/d8c 39 2024-02-14T13:10:41.634 INFO:tasks.workunit.client.0.smithi012.stdout:9/914: unlink da/dd/d57/d59/fb5 0 2024-02-14T13:10:41.634 INFO:tasks.workunit.client.0.smithi012.stdout:9/915: chown da/d33/l120 477 1 2024-02-14T13:10:41.635 INFO:tasks.workunit.client.0.smithi012.stdout:1/825: dwrite d6/d10/d22/d31/d3e/fbf [0,4194304] 0 2024-02-14T13:10:41.635 INFO:tasks.workunit.client.0.smithi012.stdout:1/826: fdatasync d6/fab 0 2024-02-14T13:10:41.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/857: rmdir d0/d8/d11/d33/d53/d6b 39 2024-02-14T13:10:41.636 INFO:tasks.workunit.client.0.smithi012.stdout:2/858: readlink d0/d20/d54/lde 0 2024-02-14T13:10:41.638 INFO:tasks.workunit.client.0.smithi012.stdout:4/770: write d0/f6 [6838037,49023] 0 2024-02-14T13:10:41.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/796: link d9/l29 d9/l10b 0 2024-02-14T13:10:41.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/797: write d9/dc/d38/d6a/fb4 [9213933,69073] 0 2024-02-14T13:10:41.639 INFO:tasks.workunit.client.0.smithi012.stdout:3/797: read d9/dd/d30/d44/d3d/f67 [539185,121020] 0 2024-02-14T13:10:41.639 INFO:tasks.workunit.client.0.smithi012.stdout:5/892: dwrite dc/d47/d69/f9b [0,4194304] 0 2024-02-14T13:10:41.641 INFO:tasks.workunit.client.0.smithi012.stdout:0/911: rename d10/d14/d41/d52/d67/d126/d30/c11c to d10/d14/d2b/da4/c12b 0 2024-02-14T13:10:41.641 INFO:tasks.workunit.client.0.smithi012.stdout:6/797: sync 2024-02-14T13:10:41.641 INFO:tasks.workunit.client.0.smithi012.stdout:7/707: sync 2024-02-14T13:10:41.643 INFO:tasks.workunit.client.0.smithi012.stdout:1/827: write d6/d10/d22/d31/d3e/d71/fe8 [1975364,10495] 0 2024-02-14T13:10:41.643 INFO:tasks.workunit.client.0.smithi012.stdout:1/828: truncate d6/d10/d22/d31/d34/d58/d61/f9d 933933 0 2024-02-14T13:10:41.644 INFO:tasks.workunit.client.0.smithi012.stdout:2/859: creat d0/d20/f125 x:0 0 0 2024-02-14T13:10:41.644 INFO:tasks.workunit.client.0.smithi012.stdout:1/829: dread d6/d10/d22/d44/dbb/fc2 [0,4194304] 0 2024-02-14T13:10:41.645 INFO:tasks.workunit.client.0.smithi012.stdout:4/771: link d0/d10/d28/d62/f108 d0/d10/d28/da9/f11c 0 2024-02-14T13:10:41.647 INFO:tasks.workunit.client.0.smithi012.stdout:8/798: truncate d9/dc/d14/d2e/dde/da3/ded/f7d 478202 0 2024-02-14T13:10:41.647 INFO:tasks.workunit.client.0.smithi012.stdout:8/799: chown d9/dc/d38/cf9 31250677 1 2024-02-14T13:10:41.648 INFO:tasks.workunit.client.0.smithi012.stdout:3/798: creat d9/d18/d39/f114 x:0 0 0 2024-02-14T13:10:41.652 INFO:tasks.workunit.client.0.smithi012.stdout:5/893: truncate dc/d17/d20/d4c/f51 1942578 0 2024-02-14T13:10:41.653 INFO:tasks.workunit.client.0.smithi012.stdout:0/912: symlink d10/d14/d41/d52/d67/l12c 0 2024-02-14T13:10:41.655 INFO:tasks.workunit.client.0.smithi012.stdout:7/708: unlink df/d27/d4b/d8d/fcb 0 2024-02-14T13:10:41.656 INFO:tasks.workunit.client.0.smithi012.stdout:6/798: creat d1/df/d24/daf/f100 x:0 0 0 2024-02-14T13:10:41.656 INFO:tasks.workunit.client.0.smithi012.stdout:6/799: fsync d1/df/d50/db4/fdb 0 2024-02-14T13:10:41.658 INFO:tasks.workunit.client.0.smithi012.stdout:2/860: symlink d0/d6/de/d7d/db7/l126 0 2024-02-14T13:10:41.660 INFO:tasks.workunit.client.0.smithi012.stdout:1/830: rename d6/d10/d22/d31/d5b/dcd/da2 to d6/d10/d22/d44/dbb/d101 0 2024-02-14T13:10:41.662 INFO:tasks.workunit.client.0.smithi012.stdout:4/772: unlink d0/d10/d1f/d71/fb3 0 2024-02-14T13:10:41.663 INFO:tasks.workunit.client.0.smithi012.stdout:8/800: mkdir d9/dc/d14/d23/ddf/d10c 0 2024-02-14T13:10:41.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/894: truncate dc/d17/d20/d4c/d63/d81/fd4 158807 0 2024-02-14T13:10:41.675 INFO:tasks.workunit.client.0.smithi012.stdout:7/709: mknod df/d2d/d5d/cf8 0 2024-02-14T13:10:41.676 INFO:tasks.workunit.client.0.smithi012.stdout:9/916: rmdir da/dd/d57/d59/ddf 0 2024-02-14T13:10:41.677 INFO:tasks.workunit.client.0.smithi012.stdout:9/917: write da/f23 [1673022,17064] 0 2024-02-14T13:10:41.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/861: creat d0/d6/de/d7d/f127 x:0 0 0 2024-02-14T13:10:41.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/862: dread - d0/d1a/de4/d50/d68/f107 zero size 2024-02-14T13:10:41.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/863: fsync d0/d8/d11/d33/d53/d110/de7/ff9 0 2024-02-14T13:10:41.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/864: dread - d0/d20/f125 zero size 2024-02-14T13:10:41.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/865: dread - d0/d1a/fcf zero size 2024-02-14T13:10:41.678 INFO:tasks.workunit.client.0.smithi012.stdout:2/866: chown d0/d8/d11/d35/dd0 3651 1 2024-02-14T13:10:41.679 INFO:tasks.workunit.client.0.smithi012.stdout:0/913: rename d10/d14/d41/d52/d78/d8c/d7f/df8 to d10/d14/d41/d52/d56/d12d 0 2024-02-14T13:10:41.680 INFO:tasks.workunit.client.0.smithi012.stdout:1/831: unlink d6/d10/d22/d31/d5b/d5d/d6d/l91 0 2024-02-14T13:10:41.682 INFO:tasks.workunit.client.0.smithi012.stdout:4/773: creat d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f11d x:0 0 0 2024-02-14T13:10:41.684 INFO:tasks.workunit.client.0.smithi012.stdout:8/801: creat d9/dc/d14/d2e/dde/d56/d57/d92/de1/f10d x:0 0 0 2024-02-14T13:10:41.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/895: truncate dc/d17/d20/f64 246934 0 2024-02-14T13:10:41.686 INFO:tasks.workunit.client.0.smithi012.stdout:4/774: dread d0/d10/d28/da9/f100 [0,4194304] 0 2024-02-14T13:10:41.686 INFO:tasks.workunit.client.0.smithi012.stdout:4/775: chown d0/de1/de8/dd9/ldb 209 1 2024-02-14T13:10:41.686 INFO:tasks.workunit.client.0.smithi012.stdout:7/710: mknod df/d2d/d82/d88/d90/cf9 0 2024-02-14T13:10:41.686 INFO:tasks.workunit.client.0.smithi012.stdout:7/711: fdatasync df/d27/f2b 0 2024-02-14T13:10:41.686 INFO:tasks.workunit.client.0.smithi012.stdout:7/712: chown df/d27/d4b/d6b/d6d/d85/fd5 2 1 2024-02-14T13:10:41.687 INFO:tasks.workunit.client.0.smithi012.stdout:7/713: write df/d24/f29 [2786235,65361] 0 2024-02-14T13:10:41.688 INFO:tasks.workunit.client.0.smithi012.stdout:9/918: symlink da/dd/d57/db2/l134 0 2024-02-14T13:10:41.688 INFO:tasks.workunit.client.0.smithi012.stdout:9/919: truncate da/dd/d19/d30/d9d/dce/f12f 186644 0 2024-02-14T13:10:41.688 INFO:tasks.workunit.client.0.smithi012.stdout:9/920: write da/dd/d38/d7e/f101 [5078472,111284] 0 2024-02-14T13:10:41.688 INFO:tasks.workunit.client.0.smithi012.stdout:9/921: readlink da/dd/d57/db2/l134 0 2024-02-14T13:10:41.688 INFO:tasks.workunit.client.0.smithi012.stdout:2/867: dread d0/d6/de/fa7 [0,4194304] 0 2024-02-14T13:10:41.688 INFO:tasks.workunit.client.0.smithi012.stdout:0/914: rename d10/d14/d41/d61/d74/dfc to d10/d14/d41/d52/d12e 0 2024-02-14T13:10:41.690 INFO:tasks.workunit.client.0.smithi012.stdout:4/776: mkdir d0/d10/d28/d4f/d6b/d8f/d56/df7/d11e 0 2024-02-14T13:10:41.690 INFO:tasks.workunit.client.0.smithi012.stdout:4/777: truncate d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f11d 141427 0 2024-02-14T13:10:41.690 INFO:tasks.workunit.client.0.smithi012.stdout:4/778: write d0/df0/f10c [1880342,25608] 0 2024-02-14T13:10:41.691 INFO:tasks.workunit.client.0.smithi012.stdout:9/922: rmdir da/dd/d19/d30/d45 39 2024-02-14T13:10:41.693 INFO:tasks.workunit.client.0.smithi012.stdout:8/802: dread d9/dc/d14/d2e/dde/d56/faf [0,4194304] 0 2024-02-14T13:10:41.694 INFO:tasks.workunit.client.0.smithi012.stdout:2/868: mkdir d0/d8/d11/d33/d128 0 2024-02-14T13:10:41.696 INFO:tasks.workunit.client.0.smithi012.stdout:7/714: rename df/d27/d4b/d8d/fe5 to df/d27/d4b/d5a/ffa 0 2024-02-14T13:10:41.697 INFO:tasks.workunit.client.0.smithi012.stdout:0/915: truncate d10/fa9 13716 0 2024-02-14T13:10:41.697 INFO:tasks.workunit.client.0.smithi012.stdout:0/916: stat d10/dad 0 2024-02-14T13:10:41.697 INFO:tasks.workunit.client.0.smithi012.stdout:0/917: dread - d10/d84/ff6 zero size 2024-02-14T13:10:41.698 INFO:tasks.workunit.client.0.smithi012.stdout:1/832: dwrite d6/d10/d22/d44/dbb/d101/fd5 [0,4194304] 0 2024-02-14T13:10:41.698 INFO:tasks.workunit.client.0.smithi012.stdout:1/833: chown d6/d10/df0/fff 299198 1 2024-02-14T13:10:41.700 INFO:tasks.workunit.client.0.smithi012.stdout:8/803: mkdir d9/dc/d14/d2e/dde/da3/d10e 0 2024-02-14T13:10:41.700 INFO:tasks.workunit.client.0.smithi012.stdout:8/804: chown d9/dc/d14/d2e/dde/da3/d10e 1 1 2024-02-14T13:10:41.702 INFO:tasks.workunit.client.0.smithi012.stdout:2/869: dread d0/d8/d11/faf [0,4194304] 0 2024-02-14T13:10:41.702 INFO:tasks.workunit.client.0.smithi012.stdout:2/870: stat d0/d8/d9/d90/dab/f59 0 2024-02-14T13:10:41.705 INFO:tasks.workunit.client.0.smithi012.stdout:7/715: mknod df/cfb 0 2024-02-14T13:10:41.706 INFO:tasks.workunit.client.0.smithi012.stdout:7/716: fdatasync df/d2d/d57/fe7 0 2024-02-14T13:10:41.707 INFO:tasks.workunit.client.0.smithi012.stdout:0/918: unlink d10/d14/f15 0 2024-02-14T13:10:41.711 INFO:tasks.workunit.client.0.smithi012.stdout:4/779: dwrite d0/d10/d28/da9/f11c [0,4194304] 0 2024-02-14T13:10:41.711 INFO:tasks.workunit.client.0.smithi012.stdout:8/805: link d9/dc/d14/d2e/dde/da3/ded/f5e d9/dc/d14/d2e/dde/da3/de9/f10f 0 2024-02-14T13:10:41.713 INFO:tasks.workunit.client.0.smithi012.stdout:2/871: symlink d0/d1a/de4/d50/l129 0 2024-02-14T13:10:41.713 INFO:tasks.workunit.client.0.smithi012.stdout:2/872: write d0/d1a/f49 [2803297,24725] 0 2024-02-14T13:10:41.713 INFO:tasks.workunit.client.0.smithi012.stdout:2/873: chown d0/d6/de/cf 96 1 2024-02-14T13:10:41.714 INFO:tasks.workunit.client.0.smithi012.stdout:7/717: dread df/d24/f29 [0,4194304] 0 2024-02-14T13:10:41.716 INFO:tasks.workunit.client.0.smithi012.stdout:4/780: symlink d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/l11f 0 2024-02-14T13:10:41.716 INFO:tasks.workunit.client.0.smithi012.stdout:1/834: dwrite d6/d10/d22/d44/f7c [0,4194304] 0 2024-02-14T13:10:41.716 INFO:tasks.workunit.client.0.smithi012.stdout:1/835: write d6/d10/d22/d31/d34/f88 [295080,45137] 0 2024-02-14T13:10:41.716 INFO:tasks.workunit.client.0.smithi012.stdout:8/806: creat d9/f110 x:0 0 0 2024-02-14T13:10:41.716 INFO:tasks.workunit.client.0.smithi012.stdout:8/807: dread - d9/dc/d14/d2e/dde/da1/ffb zero size 2024-02-14T13:10:41.718 INFO:tasks.workunit.client.0.smithi012.stdout:4/781: creat d0/de1/de8/dd9/ddc/f120 x:0 0 0 2024-02-14T13:10:41.719 INFO:tasks.workunit.client.0.smithi012.stdout:2/874: dread d0/d6/d37/fff [0,4194304] 0 2024-02-14T13:10:41.721 INFO:tasks.workunit.client.0.smithi012.stdout:8/808: creat d9/db9/f111 x:0 0 0 2024-02-14T13:10:41.722 INFO:tasks.workunit.client.0.smithi012.stdout:4/782: creat d0/d10/d28/d4f/d6b/d83/d99/f121 x:0 0 0 2024-02-14T13:10:41.722 INFO:tasks.workunit.client.0.smithi012.stdout:4/783: write d0/f6 [1817407,99792] 0 2024-02-14T13:10:41.723 INFO:tasks.workunit.client.0.smithi012.stdout:8/809: mkdir d9/dc/d14/d2e/dde/d56/d57/d7c/d112 0 2024-02-14T13:10:41.723 INFO:tasks.workunit.client.0.smithi012.stdout:8/810: write d9/dc/d14/d23/f67 [883992,111115] 0 2024-02-14T13:10:41.724 INFO:tasks.workunit.client.0.smithi012.stdout:0/919: dwrite d10/d14/d41/d52/d78/d8c/f4e [0,4194304] 0 2024-02-14T13:10:41.725 INFO:tasks.workunit.client.0.smithi012.stdout:0/920: dread d10/fa9 [0,4194304] 0 2024-02-14T13:10:41.725 INFO:tasks.workunit.client.0.smithi012.stdout:8/811: creat d9/dc/d38/d6a/f113 x:0 0 0 2024-02-14T13:10:41.727 INFO:tasks.workunit.client.0.smithi012.stdout:8/812: getdents d9/dc/d14/d2e/dde/d56/d57/d92 0 2024-02-14T13:10:41.728 INFO:tasks.workunit.client.0.smithi012.stdout:1/836: dread d6/fe [0,4194304] 0 2024-02-14T13:10:41.731 INFO:tasks.workunit.client.0.smithi012.stdout:1/837: truncate d6/d10/d22/d31/d5b/d5e/d65/fa6 2192968 0 2024-02-14T13:10:41.734 INFO:tasks.workunit.client.0.smithi012.stdout:1/838: mknod d6/d10/df0/c102 0 2024-02-14T13:10:41.735 INFO:tasks.workunit.client.0.smithi012.stdout:4/784: write d0/d10/d28/d4f/d6b/d83/d17/f5e [179187,30066] 0 2024-02-14T13:10:41.736 INFO:tasks.workunit.client.0.smithi012.stdout:1/839: symlink d6/d10/d22/d31/d3e/l103 0 2024-02-14T13:10:41.737 INFO:tasks.workunit.client.0.smithi012.stdout:1/840: getdents d6/d10/d22/d31/d5b/dcd 0 2024-02-14T13:10:41.737 INFO:tasks.workunit.client.0.smithi012.stdout:1/841: chown d6/d10/d22/d31/d34/df8 258276 1 2024-02-14T13:10:41.738 INFO:tasks.workunit.client.0.smithi012.stdout:0/921: dread d10/d14/d41/d52/d78/d8c/d7f/fa5 [0,4194304] 0 2024-02-14T13:10:41.739 INFO:tasks.workunit.client.0.smithi012.stdout:0/922: truncate d10/d14/d41/d52/d67/d126/d54/f108 230546 0 2024-02-14T13:10:41.739 INFO:tasks.workunit.client.0.smithi012.stdout:4/785: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/fdf [0,4194304] 0 2024-02-14T13:10:41.739 INFO:tasks.workunit.client.0.smithi012.stdout:2/875: dwrite d0/d8/d11/d35/dd0/d7a/f8d [0,4194304] 0 2024-02-14T13:10:41.739 INFO:tasks.workunit.client.0.smithi012.stdout:4/786: write d0/d10/d28/da9/d86/ffa [6066739,37338] 0 2024-02-14T13:10:41.739 INFO:tasks.workunit.client.0.smithi012.stdout:2/876: readlink d0/d20/d54/lde 0 2024-02-14T13:10:41.740 INFO:tasks.workunit.client.0.smithi012.stdout:0/923: creat d10/d14/d2b/d113/f12f x:0 0 0 2024-02-14T13:10:41.745 INFO:tasks.workunit.client.0.smithi012.stdout:4/787: mknod d0/d10/d28/d4f/d6b/d83/d99/c122 0 2024-02-14T13:10:41.747 INFO:tasks.workunit.client.0.smithi012.stdout:2/877: mkdir d0/d8/d11/d33/dc3/d111/d12a 0 2024-02-14T13:10:41.747 INFO:tasks.workunit.client.0.smithi012.stdout:2/878: write d0/d8/d11/d33/d63/f102 [424915,30989] 0 2024-02-14T13:10:41.747 INFO:tasks.workunit.client.0.smithi012.stdout:8/813: dwrite d9/dc/d14/d2e/dde/f88 [0,4194304] 0 2024-02-14T13:10:41.748 INFO:tasks.workunit.client.0.smithi012.stdout:0/924: symlink d10/d14/d41/d52/d12e/dd5/l130 0 2024-02-14T13:10:41.750 INFO:tasks.workunit.client.0.smithi012.stdout:2/879: rename d0/d6/de/fa7 to d0/d8/d11/d33/d128/f12b 0 2024-02-14T13:10:41.751 INFO:tasks.workunit.client.0.smithi012.stdout:1/842: write d6/d10/d22/d31/d34/fbe [4669910,39144] 0 2024-02-14T13:10:41.753 INFO:tasks.workunit.client.0.smithi012.stdout:8/814: mknod d9/dc/d14/d2e/dde/c114 0 2024-02-14T13:10:41.754 INFO:tasks.workunit.client.0.smithi012.stdout:8/815: write d9/dc/f9d [729225,11435] 0 2024-02-14T13:10:41.754 INFO:tasks.workunit.client.0.smithi012.stdout:0/925: truncate d10/d14/d20/f69 3083949 0 2024-02-14T13:10:41.757 INFO:tasks.workunit.client.0.smithi012.stdout:1/843: rmdir d6/d10/d22/d31/d5b/d5d/d6d 39 2024-02-14T13:10:41.757 INFO:tasks.workunit.client.0.smithi012.stdout:1/844: fdatasync d6/d10/df0/fca 0 2024-02-14T13:10:41.757 INFO:tasks.workunit.client.0.smithi012.stdout:1/845: write d6/d10/d22/d31/d5b/d5e/fb3 [709755,74780] 0 2024-02-14T13:10:41.757 INFO:tasks.workunit.client.0.smithi012.stdout:1/846: stat d6/d10/df0/f8c 0 2024-02-14T13:10:41.759 INFO:tasks.workunit.client.0.smithi012.stdout:8/816: mknod d9/dc/d38/dfc/c115 0 2024-02-14T13:10:41.759 INFO:tasks.workunit.client.0.smithi012.stdout:3/799: sync 2024-02-14T13:10:41.761 INFO:tasks.workunit.client.0.smithi012.stdout:0/926: getdents d10/d14/d41/d52/d78/df9/dff 0 2024-02-14T13:10:41.761 INFO:tasks.workunit.client.0.smithi012.stdout:0/927: write d10/d14/d41/d52/d12e/f4f [830373,130307] 0 2024-02-14T13:10:41.764 INFO:tasks.workunit.client.0.smithi012.stdout:1/847: rename d6/d10/d22/d31/d34/d3b/ff1 to d6/d10/d22/d31/d34/f104 0 2024-02-14T13:10:41.764 INFO:tasks.workunit.client.0.smithi012.stdout:1/848: chown d6/d10/d22/d31/d5b/dcd/fd8 0 1 2024-02-14T13:10:41.769 INFO:tasks.workunit.client.0.smithi012.stdout:4/788: dwrite d0/d10/d28/d4f/d6b/d83/d17/f38 [0,4194304] 0 2024-02-14T13:10:41.770 INFO:tasks.workunit.client.0.smithi012.stdout:1/849: creat d6/d10/d22/d31/d5b/d5e/d65/f105 x:0 0 0 2024-02-14T13:10:41.777 INFO:tasks.workunit.client.0.smithi012.stdout:4/789: symlink d0/de1/de8/dd9/l123 0 2024-02-14T13:10:41.777 INFO:tasks.workunit.client.0.smithi012.stdout:4/790: truncate d0/d10/d28/d4f/d6b/d8f/f103 383637 0 2024-02-14T13:10:41.777 INFO:tasks.workunit.client.0.smithi012.stdout:4/791: chown d0/l5 7768618 1 2024-02-14T13:10:41.782 INFO:tasks.workunit.client.0.smithi012.stdout:1/850: rename d6/d10/d22/d31/d5b/dcd/cb9 to d6/d10/d22/d31/d5b/d5e/d65/db4/c106 0 2024-02-14T13:10:41.783 INFO:tasks.workunit.client.0.smithi012.stdout:4/792: getdents d0/d10/d28/d4f 0 2024-02-14T13:10:41.784 INFO:tasks.workunit.client.0.smithi012.stdout:1/851: creat d6/d10/d22/d44/dbb/d101/f107 x:0 0 0 2024-02-14T13:10:41.785 INFO:tasks.workunit.client.0.smithi012.stdout:1/852: write d6/d10/d22/d31/d34/d58/d61/f9d [605456,88793] 0 2024-02-14T13:10:41.786 INFO:tasks.workunit.client.0.smithi012.stdout:4/793: creat d0/d10/d1f/f124 x:0 0 0 2024-02-14T13:10:41.789 INFO:tasks.workunit.client.0.smithi012.stdout:4/794: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 [0,4194304] 0 2024-02-14T13:10:41.792 INFO:tasks.workunit.client.0.smithi012.stdout:2/880: dwrite d0/d8/d11/d35/fd1 [0,4194304] 0 2024-02-14T13:10:41.792 INFO:tasks.workunit.client.0.smithi012.stdout:2/881: chown d0/d20/c29 10024 1 2024-02-14T13:10:41.793 INFO:tasks.workunit.client.0.smithi012.stdout:0/928: dread d10/d14/d41/d61/d74/fef [0,4194304] 0 2024-02-14T13:10:41.793 INFO:tasks.workunit.client.0.smithi012.stdout:0/929: dread - d10/d14/d41/d52/d78/df9/dff/f123 zero size 2024-02-14T13:10:41.793 INFO:tasks.workunit.client.0.smithi012.stdout:0/930: chown d10/d14/d41/d52/d56/d12d/f105 107941 1 2024-02-14T13:10:41.793 INFO:tasks.workunit.client.0.smithi012.stdout:0/931: chown d10/d84/dbd/fc7 15567593 1 2024-02-14T13:10:41.794 INFO:tasks.workunit.client.0.smithi012.stdout:8/817: dwrite d9/dc/d14/d2e/dde/da3/de9/fe2 [0,4194304] 0 2024-02-14T13:10:41.795 INFO:tasks.workunit.client.0.smithi012.stdout:3/800: dwrite d9/dd/d30/d44/d66/db3/f110 [0,4194304] 0 2024-02-14T13:10:41.797 INFO:tasks.workunit.client.0.smithi012.stdout:3/801: dread d9/d13/dea/f9b [0,4194304] 0 2024-02-14T13:10:41.799 INFO:tasks.workunit.client.0.smithi012.stdout:8/818: rename d9/dc/d14/d2e/dde/d56/d57/d92/de1 to d9/dc/d14/d2e/dde/da3/ded/d116 0 2024-02-14T13:10:41.802 INFO:tasks.workunit.client.0.smithi012.stdout:1/853: dwrite d6/d10/d22/d31/d5b/d5d/d80/fd4 [0,4194304] 0 2024-02-14T13:10:41.802 INFO:tasks.workunit.client.0.smithi012.stdout:3/802: rename d9/dd/d30/lb4 to d9/dd/d30/d34/dc1/l115 0 2024-02-14T13:10:41.802 INFO:tasks.workunit.client.0.smithi012.stdout:8/819: mknod d9/dc/d14/d2e/dde/d56/d57/d7c/c117 0 2024-02-14T13:10:41.807 INFO:tasks.workunit.client.0.smithi012.stdout:1/854: mknod d6/d10/d22/d31/d5b/d5e/d65/d87/dcc/c108 0 2024-02-14T13:10:41.808 INFO:tasks.workunit.client.0.smithi012.stdout:0/932: dread d10/dad/fb2 [0,4194304] 0 2024-02-14T13:10:41.808 INFO:tasks.workunit.client.0.smithi012.stdout:0/933: dread - d10/d14/d20/d49/fc9 zero size 2024-02-14T13:10:41.808 INFO:tasks.workunit.client.0.smithi012.stdout:0/934: write d10/d84/dbd/fc7 [228786,12109] 0 2024-02-14T13:10:41.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/803: rename d9/d18/d39/df7/l10c to d9/dd/d30/d44/d66/db3/db9/l116 0 2024-02-14T13:10:41.809 INFO:tasks.workunit.client.0.smithi012.stdout:3/804: chown d9/d3f/d73/d5d/d91 111 1 2024-02-14T13:10:41.811 INFO:tasks.workunit.client.0.smithi012.stdout:0/935: mkdir d10/d11e/d131 0 2024-02-14T13:10:41.811 INFO:tasks.workunit.client.0.smithi012.stdout:0/936: fdatasync d10/d14/d2b/f6e 0 2024-02-14T13:10:41.811 INFO:tasks.workunit.client.0.smithi012.stdout:3/805: creat d9/d13/d28/f117 x:0 0 0 2024-02-14T13:10:41.813 INFO:tasks.workunit.client.0.smithi012.stdout:1/855: dread d6/d10/d22/d31/d34/fb0 [0,4194304] 0 2024-02-14T13:10:41.813 INFO:tasks.workunit.client.0.smithi012.stdout:1/856: readlink d6/d10/d22/d31/d5b/d5d/d80/da4/lf2 0 2024-02-14T13:10:41.814 INFO:tasks.workunit.client.0.smithi012.stdout:0/937: rename d10/d14/d41/d52/d99/ddc to d10/d14/d41/d52/d67/d132 0 2024-02-14T13:10:41.815 INFO:tasks.workunit.client.0.smithi012.stdout:1/857: dread d6/d10/d22/d31/d34/d3b/f43 [0,4194304] 0 2024-02-14T13:10:41.815 INFO:tasks.workunit.client.0.smithi012.stdout:3/806: mknod d9/d3f/d88/c118 0 2024-02-14T13:10:41.817 INFO:tasks.workunit.client.0.smithi012.stdout:8/820: dread d9/dc/d38/f51 [0,4194304] 0 2024-02-14T13:10:41.817 INFO:tasks.workunit.client.0.smithi012.stdout:4/795: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/fdf [0,4194304] 0 2024-02-14T13:10:41.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/858: rename d6/d10/d22/d31/d34/d58/d61/f9d to d6/d10/d22/d31/d5b/d5e/d65/dec/f109 0 2024-02-14T13:10:41.819 INFO:tasks.workunit.client.0.smithi012.stdout:3/807: unlink d9/d13/c37 0 2024-02-14T13:10:41.819 INFO:tasks.workunit.client.0.smithi012.stdout:2/882: dwrite d0/d8/d11/d33/d53/d110/faa [0,4194304] 0 2024-02-14T13:10:41.819 INFO:tasks.workunit.client.0.smithi012.stdout:2/883: chown d0/d8/d11 1611494176 1 2024-02-14T13:10:41.821 INFO:tasks.workunit.client.0.smithi012.stdout:2/884: dread d0/d1a/de4/d50/fac [0,4194304] 0 2024-02-14T13:10:41.823 INFO:tasks.workunit.client.0.smithi012.stdout:4/796: truncate d0/d10/d1f/fb7 3878538 0 2024-02-14T13:10:41.823 INFO:tasks.workunit.client.0.smithi012.stdout:4/797: chown d0/d10/d28/c65 1011 1 2024-02-14T13:10:41.824 INFO:tasks.workunit.client.0.smithi012.stdout:8/821: symlink d9/dc/l118 0 2024-02-14T13:10:41.830 INFO:tasks.workunit.client.0.smithi012.stdout:1/859: dread d6/d10/d22/f54 [0,4194304] 0 2024-02-14T13:10:41.830 INFO:tasks.workunit.client.0.smithi012.stdout:3/808: creat d9/dd/d10d/f119 x:0 0 0 2024-02-14T13:10:41.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/938: dwrite d10/d14/d41/d61/f103 [0,4194304] 0 2024-02-14T13:10:41.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/939: chown d10/d14/d41/d52/d78/df9/dff/f124 614 1 2024-02-14T13:10:41.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/940: fsync d10/d14/d41/d52/d67/d126/d54/fe3 0 2024-02-14T13:10:41.832 INFO:tasks.workunit.client.0.smithi012.stdout:0/941: stat d10/d14/d41/d52/d56/l8f 0 2024-02-14T13:10:41.834 INFO:tasks.workunit.client.0.smithi012.stdout:2/885: symlink d0/d20/d75/d8a/d105/l12c 0 2024-02-14T13:10:41.837 INFO:tasks.workunit.client.0.smithi012.stdout:1/860: rmdir d6/d10/d22/d31/d5b/d5e/d3d 39 2024-02-14T13:10:41.837 INFO:tasks.workunit.client.0.smithi012.stdout:1/861: write d6/fab [708263,57274] 0 2024-02-14T13:10:41.837 INFO:tasks.workunit.client.0.smithi012.stdout:1/862: chown d6/d10/d22/d31/d5b/d5d/d80/da4/lf2 688054 1 2024-02-14T13:10:41.837 INFO:tasks.workunit.client.0.smithi012.stdout:1/863: read - d6/d10/d22/d31/d5b/d5d/f86 zero size 2024-02-14T13:10:41.839 INFO:tasks.workunit.client.0.smithi012.stdout:3/809: creat d9/dd/d30/d44/f11a x:0 0 0 2024-02-14T13:10:41.840 INFO:tasks.workunit.client.0.smithi012.stdout:4/798: dwrite d0/d10/d1f/d71/fd5 [4194304,4194304] 0 2024-02-14T13:10:41.840 INFO:tasks.workunit.client.0.smithi012.stdout:6/800: sync 2024-02-14T13:10:41.842 INFO:tasks.workunit.client.0.smithi012.stdout:1/864: read d6/d10/d22/d31/fdd [3636502,10942] 0 2024-02-14T13:10:41.842 INFO:tasks.workunit.client.0.smithi012.stdout:1/865: readlink d6/d10/d22/l26 0 2024-02-14T13:10:41.842 INFO:tasks.workunit.client.0.smithi012.stdout:0/942: mkdir d10/d14/d41/d133 0 2024-02-14T13:10:41.843 INFO:tasks.workunit.client.0.smithi012.stdout:2/886: creat d0/d8/d11/d35/dd0/d7a/f12d x:0 0 0 2024-02-14T13:10:41.845 INFO:tasks.workunit.client.0.smithi012.stdout:8/822: rename d9/dc/d14/d2e/cb3 to d9/dc/d38/dfc/c119 0 2024-02-14T13:10:41.847 INFO:tasks.workunit.client.0.smithi012.stdout:7/718: sync 2024-02-14T13:10:41.848 INFO:tasks.workunit.client.0.smithi012.stdout:5/896: sync 2024-02-14T13:10:41.848 INFO:tasks.workunit.client.0.smithi012.stdout:9/923: sync 2024-02-14T13:10:41.848 INFO:tasks.workunit.client.0.smithi012.stdout:7/719: write df/d24/f29 [3375484,42961] 0 2024-02-14T13:10:41.848 INFO:tasks.workunit.client.0.smithi012.stdout:3/810: truncate d9/dd/d30/d44/d66/dd0/ffa 3382355 0 2024-02-14T13:10:41.850 INFO:tasks.workunit.client.0.smithi012.stdout:4/799: mknod d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/c125 0 2024-02-14T13:10:41.851 INFO:tasks.workunit.client.0.smithi012.stdout:2/887: read d0/d6/d37/d84/d51/f73 [2115612,61233] 0 2024-02-14T13:10:41.851 INFO:tasks.workunit.client.0.smithi012.stdout:6/801: symlink d1/df/d16/d7c/d97/d82/da5/dc9/l101 0 2024-02-14T13:10:41.852 INFO:tasks.workunit.client.0.smithi012.stdout:1/866: creat d6/d10/d22/d31/d5b/d5e/d65/d87/dcc/f10a x:0 0 0 2024-02-14T13:10:41.853 INFO:tasks.workunit.client.0.smithi012.stdout:0/943: creat d10/d14/d41/d52/d78/f134 x:0 0 0 2024-02-14T13:10:41.854 INFO:tasks.workunit.client.0.smithi012.stdout:8/823: mknod d9/dc/d14/d2e/dde/da3/d10e/c11a 0 2024-02-14T13:10:41.856 INFO:tasks.workunit.client.0.smithi012.stdout:5/897: rename dc/d2f/f106 to dc/d2f/d70/d78/f118 0 2024-02-14T13:10:41.857 INFO:tasks.workunit.client.0.smithi012.stdout:7/720: creat df/d27/ffc x:0 0 0 2024-02-14T13:10:41.858 INFO:tasks.workunit.client.0.smithi012.stdout:3/811: mknod d9/dd/d30/c11b 0 2024-02-14T13:10:41.859 INFO:tasks.workunit.client.0.smithi012.stdout:4/800: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/f126 x:0 0 0 2024-02-14T13:10:41.861 INFO:tasks.workunit.client.0.smithi012.stdout:2/888: mknod d0/d6/de/de8/c12e 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/802: mkdir d1/df/d24/d3f/d56/d102 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/803: truncate d1/d1e/dc/d38/fb7 857553 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/804: write d1/d1e/d1b/d21/d78/fc3 [2032261,24705] 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/805: readlink d1/df/d24/d3f/d56/l8a 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/806: truncate d1/df/f48 3311187 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/807: fsync d1/df/d24/fe0 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/808: readlink d1/df/d24/daf/ld5 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:6/809: write d1/d1e/dc/fe5 [81869,67674] 0 2024-02-14T13:10:41.863 INFO:tasks.workunit.client.0.smithi012.stdout:0/944: rmdir d10 39 2024-02-14T13:10:41.864 INFO:tasks.workunit.client.0.smithi012.stdout:8/824: rename d9/dc/d14/d2e/dde/d56/d57/d7c/f99 to d9/dc/d14/d2e/dde/da3/f11b 0 2024-02-14T13:10:41.865 INFO:tasks.workunit.client.0.smithi012.stdout:5/898: truncate dc/d17/ded/fa2 1266 0 2024-02-14T13:10:41.866 INFO:tasks.workunit.client.0.smithi012.stdout:2/889: creat d0/d8/d11/d33/d53/d6b/d123/f12f x:0 0 0 2024-02-14T13:10:41.866 INFO:tasks.workunit.client.0.smithi012.stdout:2/890: fsync d0/d20/f23 0 2024-02-14T13:10:41.867 INFO:tasks.workunit.client.0.smithi012.stdout:3/812: dread d9/d3f/d88/fe5 [0,4194304] 0 2024-02-14T13:10:41.867 INFO:tasks.workunit.client.0.smithi012.stdout:3/813: read - d9/d18/d39/f114 zero size 2024-02-14T13:10:41.868 INFO:tasks.workunit.client.0.smithi012.stdout:2/891: dread d0/d1a/fd7 [0,4194304] 0 2024-02-14T13:10:41.868 INFO:tasks.workunit.client.0.smithi012.stdout:0/945: creat d10/f135 x:0 0 0 2024-02-14T13:10:41.869 INFO:tasks.workunit.client.0.smithi012.stdout:6/810: dread d1/d1e/d1b/f85 [0,4194304] 0 2024-02-14T13:10:41.869 INFO:tasks.workunit.client.0.smithi012.stdout:6/811: read d1/df/f48 [2143201,3492] 0 2024-02-14T13:10:41.869 INFO:tasks.workunit.client.0.smithi012.stdout:6/812: truncate d1/d1e/d1b/d21/d69/fa9 4708137 0 2024-02-14T13:10:41.870 INFO:tasks.workunit.client.0.smithi012.stdout:6/813: read d1/df/d24/d5f/fcd [619484,80764] 0 2024-02-14T13:10:41.870 INFO:tasks.workunit.client.0.smithi012.stdout:6/814: write d1/df/d16/d7c/d97/d82/ffb [758941,95889] 0 2024-02-14T13:10:41.870 INFO:tasks.workunit.client.0.smithi012.stdout:6/815: chown d1/d1e/d1b/f2f 14317698 1 2024-02-14T13:10:41.870 INFO:tasks.workunit.client.0.smithi012.stdout:7/721: rename df/d2d/d57 to df/d24/dfd 0 2024-02-14T13:10:41.870 INFO:tasks.workunit.client.0.smithi012.stdout:7/722: chown df/d27/ffc 9066 1 2024-02-14T13:10:41.871 INFO:tasks.workunit.client.0.smithi012.stdout:8/825: link d9/dc/d14/d2e/dde/c68 d9/dc/d14/d23/ddf/d10c/c11c 0 2024-02-14T13:10:41.871 INFO:tasks.workunit.client.0.smithi012.stdout:8/826: chown d9/dc/l118 393 1 2024-02-14T13:10:41.873 INFO:tasks.workunit.client.0.smithi012.stdout:5/899: mknod dc/d17/d20/d4c/d7b/dfa/de7/c119 0 2024-02-14T13:10:41.873 INFO:tasks.workunit.client.0.smithi012.stdout:0/946: rmdir d10/d14/d41/d52/d67 39 2024-02-14T13:10:41.876 INFO:tasks.workunit.client.0.smithi012.stdout:3/814: write d9/d18/d39/df7/ffd [2415447,90212] 0 2024-02-14T13:10:41.877 INFO:tasks.workunit.client.0.smithi012.stdout:7/723: dread df/d27/d4b/d6b/d6d/f81 [0,4194304] 0 2024-02-14T13:10:41.877 INFO:tasks.workunit.client.0.smithi012.stdout:7/724: dread - df/d27/d4b/d6b/d6d/d85/db8/fd7 zero size 2024-02-14T13:10:41.878 INFO:tasks.workunit.client.0.smithi012.stdout:4/801: rename d0/d10/d28/da9/d86/db5/f10a to d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/f127 0 2024-02-14T13:10:41.878 INFO:tasks.workunit.client.0.smithi012.stdout:4/802: chown d0/d10/d28/d62/cd7 6 1 2024-02-14T13:10:41.879 INFO:tasks.workunit.client.0.smithi012.stdout:6/816: getdents d1/df/d24/d3f/d56 0 2024-02-14T13:10:41.880 INFO:tasks.workunit.client.0.smithi012.stdout:8/827: symlink d9/dc/d14/d2e/dde/d56/l11d 0 2024-02-14T13:10:41.881 INFO:tasks.workunit.client.0.smithi012.stdout:5/900: creat dc/d17/d20/f11a x:0 0 0 2024-02-14T13:10:41.881 INFO:tasks.workunit.client.0.smithi012.stdout:7/725: dread df/d27/f2b [0,4194304] 0 2024-02-14T13:10:41.882 INFO:tasks.workunit.client.0.smithi012.stdout:0/947: creat d10/d14/d41/d133/f136 x:0 0 0 2024-02-14T13:10:41.884 INFO:tasks.workunit.client.0.smithi012.stdout:5/901: dread dc/d17/ded/de5/f113 [0,4194304] 0 2024-02-14T13:10:41.885 INFO:tasks.workunit.client.0.smithi012.stdout:3/815: creat d9/d13/dea/d103/f11c x:0 0 0 2024-02-14T13:10:41.885 INFO:tasks.workunit.client.0.smithi012.stdout:3/816: readlink d9/d18/l1d 0 2024-02-14T13:10:41.887 INFO:tasks.workunit.client.0.smithi012.stdout:4/803: read d0/d10/d28/d4f/d6b/d83/f2d [3701505,117500] 0 2024-02-14T13:10:41.887 INFO:tasks.workunit.client.0.smithi012.stdout:4/804: fsync d0/d10/d28/d4f/d6b/d83/f106 0 2024-02-14T13:10:41.887 INFO:tasks.workunit.client.0.smithi012.stdout:4/805: chown d0/d10 36392076 1 2024-02-14T13:10:41.887 INFO:tasks.workunit.client.0.smithi012.stdout:6/817: creat d1/d1e/dc/d28/f103 x:0 0 0 2024-02-14T13:10:41.887 INFO:tasks.workunit.client.0.smithi012.stdout:6/818: chown d1/d1e/d1b/d21/d78 3522308 1 2024-02-14T13:10:41.891 INFO:tasks.workunit.client.0.smithi012.stdout:7/726: dread df/d27/f66 [0,4194304] 0 2024-02-14T13:10:41.891 INFO:tasks.workunit.client.0.smithi012.stdout:0/948: symlink d10/d14/d41/d52/d67/d126/d7e/l137 0 2024-02-14T13:10:41.891 INFO:tasks.workunit.client.0.smithi012.stdout:8/828: creat d9/dc/d38/d6a/df2/f11e x:0 0 0 2024-02-14T13:10:41.891 INFO:tasks.workunit.client.0.smithi012.stdout:8/829: chown d9/fe3 7 1 2024-02-14T13:10:41.891 INFO:tasks.workunit.client.0.smithi012.stdout:8/830: write d9/dc/d14/d2e/dde/da1/ffb [534003,59173] 0 2024-02-14T13:10:41.892 INFO:tasks.workunit.client.0.smithi012.stdout:5/902: link dc/d17/d20/d4c/d63/d81/l8f dc/d47/d59/d10c/l11b 0 2024-02-14T13:10:41.895 INFO:tasks.workunit.client.0.smithi012.stdout:6/819: mkdir d1/df/d16/d7c/dfe/d104 0 2024-02-14T13:10:41.896 INFO:tasks.workunit.client.0.smithi012.stdout:0/949: creat d10/d14/d41/d61/f138 x:0 0 0 2024-02-14T13:10:41.897 INFO:tasks.workunit.client.0.smithi012.stdout:7/727: truncate df/f30 700440 0 2024-02-14T13:10:41.900 INFO:tasks.workunit.client.0.smithi012.stdout:5/903: mknod dc/d17/d20/d4c/d58/dda/c11c 0 2024-02-14T13:10:41.901 INFO:tasks.workunit.client.0.smithi012.stdout:3/817: symlink d9/dd/d30/d34/l11d 0 2024-02-14T13:10:41.904 INFO:tasks.workunit.client.0.smithi012.stdout:6/820: rename d1/df/d24/d3f/d56/d93/d95/fd0 to d1/d1e/dc/d28/d7b/f105 0 2024-02-14T13:10:41.906 INFO:tasks.workunit.client.0.smithi012.stdout:7/728: rename df/d36/f63 to df/d36/ffe 0 2024-02-14T13:10:41.907 INFO:tasks.workunit.client.0.smithi012.stdout:5/904: getdents dc/d2f/d40/d53 0 2024-02-14T13:10:41.908 INFO:tasks.workunit.client.0.smithi012.stdout:3/818: fdatasync d9/dd/d30/d34/f51 0 2024-02-14T13:10:41.910 INFO:tasks.workunit.client.0.smithi012.stdout:6/821: mkdir d1/d1e/d1b/d21/d69/d106 0 2024-02-14T13:10:41.911 INFO:tasks.workunit.client.0.smithi012.stdout:5/905: write dc/d2f/d3e/fde [1059677,130142] 0 2024-02-14T13:10:41.911 INFO:tasks.workunit.client.0.smithi012.stdout:5/906: truncate dc/dc2/fd0 614032 0 2024-02-14T13:10:41.913 INFO:tasks.workunit.client.0.smithi012.stdout:3/819: dread d9/dd/d30/d34/d78/f96 [0,4194304] 0 2024-02-14T13:10:41.914 INFO:tasks.workunit.client.0.smithi012.stdout:5/907: mkdir dc/d2f/d70/d11d 0 2024-02-14T13:10:41.914 INFO:tasks.workunit.client.0.smithi012.stdout:5/908: chown dc/d2f/d70/d78/d99/d112 446 1 2024-02-14T13:10:41.915 INFO:tasks.workunit.client.0.smithi012.stdout:4/806: dwrite d0/d10/d28/d4f/d6b/d83/d17/faf [0,4194304] 0 2024-02-14T13:10:41.916 INFO:tasks.workunit.client.0.smithi012.stdout:5/909: write dc/d17/f41 [1336554,78098] 0 2024-02-14T13:10:41.916 INFO:tasks.workunit.client.0.smithi012.stdout:3/820: creat d9/d13/daa/f11e x:0 0 0 2024-02-14T13:10:41.919 INFO:tasks.workunit.client.0.smithi012.stdout:8/831: dwrite d9/dc/d14/d2e/dde/f59 [0,4194304] 0 2024-02-14T13:10:41.919 INFO:tasks.workunit.client.0.smithi012.stdout:8/832: write d9/dc/d14/d2e/dde/d56/d57/d7c/fea [4386528,40063] 0 2024-02-14T13:10:41.919 INFO:tasks.workunit.client.0.smithi012.stdout:8/833: chown d9/dc/d1b/f80 57855987 1 2024-02-14T13:10:41.919 INFO:tasks.workunit.client.0.smithi012.stdout:8/834: chown d9/dc/d14/d2e/dde/da1/ld2 1706980 1 2024-02-14T13:10:41.922 INFO:tasks.workunit.client.0.smithi012.stdout:4/807: creat d0/d10/d1f/d71/f128 x:0 0 0 2024-02-14T13:10:41.923 INFO:tasks.workunit.client.0.smithi012.stdout:5/910: mkdir dc/d2f/d70/d78/dc4/ddc/d11e 0 2024-02-14T13:10:41.923 INFO:tasks.workunit.client.0.smithi012.stdout:4/808: chown d0/d10/d1f/c102 2 1 2024-02-14T13:10:41.923 INFO:tasks.workunit.client.0.smithi012.stdout:5/911: read - dc/d2f/d70/d78/dc4/f10b zero size 2024-02-14T13:10:41.923 INFO:tasks.workunit.client.0.smithi012.stdout:5/912: write dc/d17/d20/d4c/d63/d81/ddd/ffc [992811,65983] 0 2024-02-14T13:10:41.923 INFO:tasks.workunit.client.0.smithi012.stdout:5/913: chown dc/d17/d20/d4c/f51 627591 1 2024-02-14T13:10:41.924 INFO:tasks.workunit.client.0.smithi012.stdout:8/835: getdents d9/dc/d14/d2e/dde 0 2024-02-14T13:10:41.929 INFO:tasks.workunit.client.0.smithi012.stdout:4/809: truncate d0/d10/feb 1765484 0 2024-02-14T13:10:41.929 INFO:tasks.workunit.client.0.smithi012.stdout:5/914: creat dc/d17/d20/d4c/d7b/dfa/de7/f11f x:0 0 0 2024-02-14T13:10:41.930 INFO:tasks.workunit.client.0.smithi012.stdout:0/950: dwrite d10/f62 [0,4194304] 0 2024-02-14T13:10:41.930 INFO:tasks.workunit.client.0.smithi012.stdout:0/951: truncate d10/d14/d41/d52/d12e/f4f 1481397 0 2024-02-14T13:10:41.931 INFO:tasks.workunit.client.0.smithi012.stdout:8/836: rename d9/dc/d14/d2e/dde/d56/d57/d92 to d9/dc/d14/d11f 0 2024-02-14T13:10:41.936 INFO:tasks.workunit.client.0.smithi012.stdout:5/915: rename dc/d2f/fa3 to dc/d2f/d70/d78/f120 0 2024-02-14T13:10:41.938 INFO:tasks.workunit.client.0.smithi012.stdout:8/837: creat d9/dc/d14/d2e/dde/d56/d57/d7c/f120 x:0 0 0 2024-02-14T13:10:41.939 INFO:tasks.workunit.client.0.smithi012.stdout:0/952: symlink d10/d14/l139 0 2024-02-14T13:10:41.941 INFO:tasks.workunit.client.0.smithi012.stdout:8/838: truncate d9/dc/f2c 5093576 0 2024-02-14T13:10:41.942 INFO:tasks.workunit.client.0.smithi012.stdout:0/953: mkdir d10/d14/d41/d52/d78/df9/dff/d13a 0 2024-02-14T13:10:41.942 INFO:tasks.workunit.client.0.smithi012.stdout:0/954: write d10/d14/d41/d52/d78/fe5 [830068,59328] 0 2024-02-14T13:10:41.944 INFO:tasks.workunit.client.0.smithi012.stdout:8/839: creat d9/dc/d14/d2e/dde/da3/de9/f121 x:0 0 0 2024-02-14T13:10:41.944 INFO:tasks.workunit.client.0.smithi012.stdout:8/840: write d9/dc/d14/d2e/dde/d56/d57/d5c/fc3 [1289777,18517] 0 2024-02-14T13:10:41.949 INFO:tasks.workunit.client.0.smithi012.stdout:0/955: mkdir d10/d14/d41/d52/d56/d13b 0 2024-02-14T13:10:41.950 INFO:tasks.workunit.client.0.smithi012.stdout:7/729: dwrite df/d24/d9e/faa [0,4194304] 0 2024-02-14T13:10:41.950 INFO:tasks.workunit.client.0.smithi012.stdout:0/956: mkdir d10/d14/d2b/da4/d13c 0 2024-02-14T13:10:41.953 INFO:tasks.workunit.client.0.smithi012.stdout:7/730: getdents df/d27/d4b/d6b/d6d/d85 0 2024-02-14T13:10:41.953 INFO:tasks.workunit.client.0.smithi012.stdout:7/731: fsync df/d24/d9e/df0/ff5 0 2024-02-14T13:10:41.954 INFO:tasks.workunit.client.0.smithi012.stdout:7/732: creat df/d36/d67/fff x:0 0 0 2024-02-14T13:10:41.954 INFO:tasks.workunit.client.0.smithi012.stdout:7/733: chown df/d36/f39 1797052764 1 2024-02-14T13:10:41.954 INFO:tasks.workunit.client.0.smithi012.stdout:8/841: write d9/dc/d14/d2e/dde/da3/de9/fe2 [4086842,102811] 0 2024-02-14T13:10:41.955 INFO:tasks.workunit.client.0.smithi012.stdout:7/734: mkdir df/d27/d100 0 2024-02-14T13:10:41.955 INFO:tasks.workunit.client.0.smithi012.stdout:8/842: symlink d9/l122 0 2024-02-14T13:10:41.956 INFO:tasks.workunit.client.0.smithi012.stdout:7/735: dread df/d36/f39 [0,4194304] 0 2024-02-14T13:10:41.957 INFO:tasks.workunit.client.0.smithi012.stdout:8/843: dread d9/dc/d14/d2e/dde/da3/fa8 [0,4194304] 0 2024-02-14T13:10:41.958 INFO:tasks.workunit.client.0.smithi012.stdout:7/736: unlink df/d36/f46 0 2024-02-14T13:10:41.959 INFO:tasks.workunit.client.0.smithi012.stdout:8/844: symlink d9/dc/l123 0 2024-02-14T13:10:41.959 INFO:tasks.workunit.client.0.smithi012.stdout:8/845: truncate d9/dc/d14/d2e/dde/da3/ded/da5/f10a 384321 0 2024-02-14T13:10:41.960 INFO:tasks.workunit.client.0.smithi012.stdout:7/737: symlink df/d2d/d82/d88/l101 0 2024-02-14T13:10:41.962 INFO:tasks.workunit.client.0.smithi012.stdout:7/738: unlink df/d2d/d82/d88/db2/lcf 0 2024-02-14T13:10:41.963 INFO:tasks.workunit.client.0.smithi012.stdout:4/810: dwrite d0/d10/d1f/f20 [0,4194304] 0 2024-02-14T13:10:41.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/916: dwrite dc/d47/fa8 [0,4194304] 0 2024-02-14T13:10:41.963 INFO:tasks.workunit.client.0.smithi012.stdout:6/822: dwrite d1/d1e/d1b/d21/d69/f9d [0,4194304] 0 2024-02-14T13:10:41.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/917: chown dc/d47/l111 1572688233 1 2024-02-14T13:10:41.963 INFO:tasks.workunit.client.0.smithi012.stdout:5/918: truncate dc/d2f/d94/fb5 1317508 0 2024-02-14T13:10:41.964 INFO:tasks.workunit.client.0.smithi012.stdout:4/811: symlink d0/d10/d28/da9/d86/l129 0 2024-02-14T13:10:41.964 INFO:tasks.workunit.client.0.smithi012.stdout:4/812: stat d0/d10/d28/d4f/cfe 0 2024-02-14T13:10:41.964 INFO:tasks.workunit.client.0.smithi012.stdout:3/821: dwrite d9/dd/d30/d44/f9e [0,4194304] 0 2024-02-14T13:10:41.966 INFO:tasks.workunit.client.0.smithi012.stdout:4/813: dread d0/d10/d28/d4f/d6b/d83/d17/f47 [0,4194304] 0 2024-02-14T13:10:41.970 INFO:tasks.workunit.client.0.smithi012.stdout:3/822: mkdir d9/d13/dea/d11f 0 2024-02-14T13:10:41.971 INFO:tasks.workunit.client.0.smithi012.stdout:4/814: rename d0/d10/f107 to d0/df0/f12a 0 2024-02-14T13:10:41.972 INFO:tasks.workunit.client.0.smithi012.stdout:4/815: write d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f11d [558424,30069] 0 2024-02-14T13:10:41.973 INFO:tasks.workunit.client.0.smithi012.stdout:3/823: dread d9/dd/de/d58/d65/d6c/f94 [0,4194304] 0 2024-02-14T13:10:41.975 INFO:tasks.workunit.client.0.smithi012.stdout:7/739: dread df/d27/fed [0,4194304] 0 2024-02-14T13:10:41.975 INFO:tasks.workunit.client.0.smithi012.stdout:7/740: stat df/lc7 0 2024-02-14T13:10:41.976 INFO:tasks.workunit.client.0.smithi012.stdout:7/741: chown df/d2d/d82 14124 1 2024-02-14T13:10:41.977 INFO:tasks.workunit.client.0.smithi012.stdout:4/816: mkdir d0/de1/d12b 0 2024-02-14T13:10:41.978 INFO:tasks.workunit.client.0.smithi012.stdout:0/957: dwrite d10/d14/d41/d52/f92 [0,4194304] 0 2024-02-14T13:10:41.978 INFO:tasks.workunit.client.0.smithi012.stdout:8/846: dwrite d9/dc/d14/d2e/dde/d56/d57/d7c/f69 [0,4194304] 0 2024-02-14T13:10:41.978 INFO:tasks.workunit.client.0.smithi012.stdout:7/742: mknod df/d27/d4b/d8d/dd4/c102 0 2024-02-14T13:10:41.980 INFO:tasks.workunit.client.0.smithi012.stdout:4/817: symlink d0/d10/d28/d4f/d6b/d83/d99/l12c 0 2024-02-14T13:10:41.982 INFO:tasks.workunit.client.0.smithi012.stdout:3/824: dread d9/f35 [0,4194304] 0 2024-02-14T13:10:41.982 INFO:tasks.workunit.client.0.smithi012.stdout:3/825: fdatasync d9/d7b/d95/fab 0 2024-02-14T13:10:41.983 INFO:tasks.workunit.client.0.smithi012.stdout:0/958: symlink d10/db6/l13d 0 2024-02-14T13:10:41.983 INFO:tasks.workunit.client.0.smithi012.stdout:0/959: chown f0 60 1 2024-02-14T13:10:41.985 INFO:tasks.workunit.client.0.smithi012.stdout:6/823: dwrite d1/d1e/d1b/d21/f32 [0,4194304] 0 2024-02-14T13:10:41.985 INFO:tasks.workunit.client.0.smithi012.stdout:6/824: write d1/d1e/dc/d43/d75/faa [658137,115747] 0 2024-02-14T13:10:41.985 INFO:tasks.workunit.client.0.smithi012.stdout:8/847: creat d9/dc/d14/d23/ddf/f124 x:0 0 0 2024-02-14T13:10:41.985 INFO:tasks.workunit.client.0.smithi012.stdout:8/848: stat d9/dc/d14/d2e/dde/f59 0 2024-02-14T13:10:41.988 INFO:tasks.workunit.client.0.smithi012.stdout:3/826: dread d9/dcd/fdb [0,4194304] 0 2024-02-14T13:10:41.995 INFO:tasks.workunit.client.0.smithi012.stdout:6/825: mknod d1/d1e/c107 0 2024-02-14T13:10:42.001 INFO:tasks.workunit.client.0.smithi012.stdout:6/826: creat d1/d1e/d1b/da8/f108 x:0 0 0 2024-02-14T13:10:42.002 INFO:tasks.workunit.client.0.smithi012.stdout:8/849: rename d9/dc/d14/d2e/dde/d56/d57/d7c/lbd to d9/dc/d14/d2e/dde/d56/d57/l125 0 2024-02-14T13:10:42.003 INFO:tasks.workunit.client.0.smithi012.stdout:3/827: mkdir d9/dd/d30/d34/d120 0 2024-02-14T13:10:42.004 INFO:tasks.workunit.client.0.smithi012.stdout:6/827: getdents d1/df/d24/d5f 0 2024-02-14T13:10:42.004 INFO:tasks.workunit.client.0.smithi012.stdout:6/828: dread - d1/d1e/d1b/d21/fe2 zero size 2024-02-14T13:10:42.007 INFO:tasks.workunit.client.0.smithi012.stdout:3/828: rename d9/ld2 to d9/d13/dea/d11f/l121 0 2024-02-14T13:10:42.008 INFO:tasks.workunit.client.0.smithi012.stdout:8/850: mkdir d9/dc/d14/d2e/d126 0 2024-02-14T13:10:42.009 INFO:tasks.workunit.client.0.smithi012.stdout:3/829: symlink d9/d13/daa/df8/d10e/d104/l122 0 2024-02-14T13:10:42.012 INFO:tasks.workunit.client.0.smithi012.stdout:4/818: dwrite d0/d10/d28/d4f/d6b/d83/d99/ff8 [0,4194304] 0 2024-02-14T13:10:42.016 INFO:tasks.workunit.client.0.smithi012.stdout:7/743: dwrite df/d24/d56/fa8 [0,4194304] 0 2024-02-14T13:10:42.016 INFO:tasks.workunit.client.0.smithi012.stdout:0/960: dwrite d10/d14/d41/d52/d67/d126/f68 [0,4194304] 0 2024-02-14T13:10:42.022 INFO:tasks.workunit.client.0.smithi012.stdout:6/829: dread d1/d1e/d1b/d21/d69/f9d [0,4194304] 0 2024-02-14T13:10:42.022 INFO:tasks.workunit.client.0.smithi012.stdout:9/924: sync 2024-02-14T13:10:42.023 INFO:tasks.workunit.client.0.smithi012.stdout:0/961: rename d10/d84/dbd/c95 to d10/d14/d11a/c13e 0 2024-02-14T13:10:42.025 INFO:tasks.workunit.client.0.smithi012.stdout:6/830: mkdir d1/d1e/dc/d43/d75/d109 0 2024-02-14T13:10:42.026 INFO:tasks.workunit.client.0.smithi012.stdout:9/925: mkdir da/dd/d19/d30/d45/d135 0 2024-02-14T13:10:42.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/962: truncate d10/d14/d41/fc0 1262496 0 2024-02-14T13:10:42.027 INFO:tasks.workunit.client.0.smithi012.stdout:0/963: stat d10/d14/d41/d52/d67/d126/c3e 0 2024-02-14T13:10:42.029 INFO:tasks.workunit.client.0.smithi012.stdout:9/926: mkdir da/dd/d57/d59/d73/d136 0 2024-02-14T13:10:42.030 INFO:tasks.workunit.client.0.smithi012.stdout:0/964: mknod d10/d14/d41/d52/d56/d12d/c13f 0 2024-02-14T13:10:42.030 INFO:tasks.workunit.client.0.smithi012.stdout:0/965: chown d10/dad/fe2 22 1 2024-02-14T13:10:42.030 INFO:tasks.workunit.client.0.smithi012.stdout:0/966: getdents d10/d14/d2b/da4/d13c 0 2024-02-14T13:10:42.032 INFO:tasks.workunit.client.0.smithi012.stdout:9/927: creat da/dd/f137 x:0 0 0 2024-02-14T13:10:42.032 INFO:tasks.workunit.client.0.smithi012.stdout:0/967: truncate d10/d14/d41/d52/d78/fe5 387123 0 2024-02-14T13:10:42.034 INFO:tasks.workunit.client.0.smithi012.stdout:9/928: truncate f4 1200639 0 2024-02-14T13:10:42.035 INFO:tasks.workunit.client.0.smithi012.stdout:0/968: symlink d10/d14/d41/d52/d99/d9b/dd0/l140 0 2024-02-14T13:10:42.036 INFO:tasks.workunit.client.0.smithi012.stdout:9/929: rmdir da/dd/d57 39 2024-02-14T13:10:42.037 INFO:tasks.workunit.client.0.smithi012.stdout:0/969: symlink d10/d14/d2b/da4/dbb/l141 0 2024-02-14T13:10:42.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/851: dwrite d9/dc/d38/fb8 [0,4194304] 0 2024-02-14T13:10:42.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/852: truncate d9/dc/d14/d23/ddf/f124 749625 0 2024-02-14T13:10:42.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/853: chown d9/dc/d14/d2e/dde/d56/d57/d7c/fc1 15028586 1 2024-02-14T13:10:42.039 INFO:tasks.workunit.client.0.smithi012.stdout:8/854: write d9/dc/d14/d2e/dde/d56/d57/d7c/f120 [579488,26326] 0 2024-02-14T13:10:42.039 INFO:tasks.workunit.client.0.smithi012.stdout:0/970: mkdir d10/d14/d2b/da4/d13c/d142 0 2024-02-14T13:10:42.039 INFO:tasks.workunit.client.0.smithi012.stdout:0/971: chown d10/d14/d41/d52/d67/d126/d30/f6d 1540971 1 2024-02-14T13:10:42.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/819: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/fb8 [0,4194304] 0 2024-02-14T13:10:42.040 INFO:tasks.workunit.client.0.smithi012.stdout:4/820: dread - d0/d10/d28/f109 zero size 2024-02-14T13:10:42.040 INFO:tasks.workunit.client.0.smithi012.stdout:7/744: dwrite df/d24/d56/fa8 [0,4194304] 0 2024-02-14T13:10:42.040 INFO:tasks.workunit.client.0.smithi012.stdout:8/855: creat d9/dc/d1b/d6b/f127 x:0 0 0 2024-02-14T13:10:42.042 INFO:tasks.workunit.client.0.smithi012.stdout:0/972: creat d10/d14/d41/d52/d78/df9/f143 x:0 0 0 2024-02-14T13:10:42.046 INFO:tasks.workunit.client.0.smithi012.stdout:7/745: symlink df/d27/d4b/d6b/d6d/d85/l103 0 2024-02-14T13:10:42.046 INFO:tasks.workunit.client.0.smithi012.stdout:8/856: mkdir d9/db9/d128 0 2024-02-14T13:10:42.048 INFO:tasks.workunit.client.0.smithi012.stdout:0/973: unlink d10/d14/d20/daa/l10c 0 2024-02-14T13:10:42.048 INFO:tasks.workunit.client.0.smithi012.stdout:0/974: dread - d10/d14/d41/d61/fed zero size 2024-02-14T13:10:42.049 INFO:tasks.workunit.client.0.smithi012.stdout:0/975: mkdir d10/d14/d41/d52/d78/df9/dff/d144 0 2024-02-14T13:10:42.050 INFO:tasks.workunit.client.0.smithi012.stdout:0/976: truncate d10/d14/d41/d61/d74/f90 1140668 0 2024-02-14T13:10:42.052 INFO:tasks.workunit.client.0.smithi012.stdout:1/867: sync 2024-02-14T13:10:42.052 INFO:tasks.workunit.client.0.smithi012.stdout:2/892: sync 2024-02-14T13:10:42.052 INFO:tasks.workunit.client.0.smithi012.stdout:1/868: dread - d6/d10/d22/d31/d5b/d5e/d65/f105 zero size 2024-02-14T13:10:42.053 INFO:tasks.workunit.client.0.smithi012.stdout:2/893: symlink d0/d1a/de4/d50/l130 0 2024-02-14T13:10:42.053 INFO:tasks.workunit.client.0.smithi012.stdout:2/894: write d0/d1a/fd7 [1095106,49057] 0 2024-02-14T13:10:42.054 INFO:tasks.workunit.client.0.smithi012.stdout:1/869: rmdir d6/d10/d22/d31/d5b/dcd 39 2024-02-14T13:10:42.056 INFO:tasks.workunit.client.0.smithi012.stdout:9/930: dwrite da/dd/d19/df3/d85/d48/f11e [4194304,4194304] 0 2024-02-14T13:10:42.056 INFO:tasks.workunit.client.0.smithi012.stdout:2/895: mknod d0/d6/c131 0 2024-02-14T13:10:42.056 INFO:tasks.workunit.client.0.smithi012.stdout:7/746: dread df/d27/f66 [0,4194304] 0 2024-02-14T13:10:42.056 INFO:tasks.workunit.client.0.smithi012.stdout:2/896: write d0/d8/d10c/f11d [927724,48153] 0 2024-02-14T13:10:42.056 INFO:tasks.workunit.client.0.smithi012.stdout:2/897: write d0/d8/d9/d90/fbc [4911925,105667] 0 2024-02-14T13:10:42.056 INFO:tasks.workunit.client.0.smithi012.stdout:2/898: chown d0/d8/d9/d90/dab/c5d 0 1 2024-02-14T13:10:42.059 INFO:tasks.workunit.client.0.smithi012.stdout:9/931: truncate da/dd/fb4 17131 0 2024-02-14T13:10:42.062 INFO:tasks.workunit.client.0.smithi012.stdout:2/899: symlink d0/d1a/de4/d50/d68/d9c/ddc/l132 0 2024-02-14T13:10:42.064 INFO:tasks.workunit.client.0.smithi012.stdout:9/932: rename da/dd/d19/ce9 to da/dd/d19/d30/d45/d135/c138 0 2024-02-14T13:10:42.066 INFO:tasks.workunit.client.0.smithi012.stdout:2/900: getdents d0/d8/d11/d33/d128 0 2024-02-14T13:10:42.066 INFO:tasks.workunit.client.0.smithi012.stdout:4/821: dwrite d0/d10/d28/d4f/d6b/d83/d17/f72 [4194304,4194304] 0 2024-02-14T13:10:42.068 INFO:tasks.workunit.client.0.smithi012.stdout:9/933: creat da/dd/d19/d30/d9d/dce/f139 x:0 0 0 2024-02-14T13:10:42.070 INFO:tasks.workunit.client.0.smithi012.stdout:2/901: creat d0/d1a/de4/d50/db1/f133 x:0 0 0 2024-02-14T13:10:42.072 INFO:tasks.workunit.client.0.smithi012.stdout:1/870: dread d6/d10/d22/d31/d5b/d5d/d80/da4/fe4 [0,4194304] 0 2024-02-14T13:10:42.072 INFO:tasks.workunit.client.0.smithi012.stdout:1/871: dread - d6/d10/d22/d31/d34/d58/ffe zero size 2024-02-14T13:10:42.073 INFO:tasks.workunit.client.0.smithi012.stdout:4/822: creat d0/d10/d28/d4f/d6b/d83/d17/f12d x:0 0 0 2024-02-14T13:10:42.073 INFO:tasks.workunit.client.0.smithi012.stdout:7/747: dread df/d27/d4b/d8d/fa0 [0,4194304] 0 2024-02-14T13:10:42.073 INFO:tasks.workunit.client.0.smithi012.stdout:2/902: creat d0/d8/f134 x:0 0 0 2024-02-14T13:10:42.073 INFO:tasks.workunit.client.0.smithi012.stdout:2/903: write d0/d1a/de4/d50/db1/f133 [360140,101532] 0 2024-02-14T13:10:42.074 INFO:tasks.workunit.client.0.smithi012.stdout:8/857: dwrite d9/dc/d38/d6a/fdc [0,4194304] 0 2024-02-14T13:10:42.074 INFO:tasks.workunit.client.0.smithi012.stdout:1/872: creat d6/d10/d22/f10b x:0 0 0 2024-02-14T13:10:42.075 INFO:tasks.workunit.client.0.smithi012.stdout:8/858: write d9/dc/d14/fbc [457707,100743] 0 2024-02-14T13:10:42.075 INFO:tasks.workunit.client.0.smithi012.stdout:8/859: write d9/dc/d1b/f21 [8946434,120730] 0 2024-02-14T13:10:42.075 INFO:tasks.workunit.client.0.smithi012.stdout:4/823: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/f12e x:0 0 0 2024-02-14T13:10:42.078 INFO:tasks.workunit.client.0.smithi012.stdout:2/904: getdents d0/d8/d9/d90 0 2024-02-14T13:10:42.080 INFO:tasks.workunit.client.0.smithi012.stdout:0/977: dwrite d10/d14/d41/d52/d78/df9/f143 [0,4194304] 0 2024-02-14T13:10:42.080 INFO:tasks.workunit.client.0.smithi012.stdout:2/905: read d0/d1a/fd7 [825843,63802] 0 2024-02-14T13:10:42.084 INFO:tasks.workunit.client.0.smithi012.stdout:1/873: link d6/d10/d22/d31/d5b/d5e/d65/f75 d6/d10/d22/d31/d34/d3b/f10c 0 2024-02-14T13:10:42.086 INFO:tasks.workunit.client.0.smithi012.stdout:4/824: rmdir d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89 39 2024-02-14T13:10:42.086 INFO:tasks.workunit.client.0.smithi012.stdout:4/825: stat d0/d10/d28/d62/c92 0 2024-02-14T13:10:42.086 INFO:tasks.workunit.client.0.smithi012.stdout:4/826: write d0/d10/d28/d4f/d6b/d83/d17/f47 [1816143,97178] 0 2024-02-14T13:10:42.086 INFO:tasks.workunit.client.0.smithi012.stdout:4/827: chown d0/d10/d28/d4f/cfe 10780 1 2024-02-14T13:10:42.087 INFO:tasks.workunit.client.0.smithi012.stdout:4/828: dread d0/d10/f7b [0,4194304] 0 2024-02-14T13:10:42.087 INFO:tasks.workunit.client.0.smithi012.stdout:9/934: dwrite da/dd/d18/f22 [0,4194304] 0 2024-02-14T13:10:42.087 INFO:tasks.workunit.client.0.smithi012.stdout:4/829: fdatasync d0/d10/d28/f45 0 2024-02-14T13:10:42.090 INFO:tasks.workunit.client.0.smithi012.stdout:0/978: creat d10/d14/d41/d52/d78/d8c/f145 x:0 0 0 2024-02-14T13:10:42.096 INFO:tasks.workunit.client.0.smithi012.stdout:2/906: unlink d0/d1a/de4/d39/f91 0 2024-02-14T13:10:42.099 INFO:tasks.workunit.client.0.smithi012.stdout:7/748: dwrite df/d24/f71 [0,4194304] 0 2024-02-14T13:10:42.099 INFO:tasks.workunit.client.0.smithi012.stdout:7/749: chown df/d24/f87 327827868 1 2024-02-14T13:10:42.099 INFO:tasks.workunit.client.0.smithi012.stdout:7/750: write df/f26 [1550057,2380] 0 2024-02-14T13:10:42.099 INFO:tasks.workunit.client.0.smithi012.stdout:7/751: stat df/d24/f38 0 2024-02-14T13:10:42.100 INFO:tasks.workunit.client.0.smithi012.stdout:4/830: getdents d0/de1/de8/dd9 0 2024-02-14T13:10:42.101 INFO:tasks.workunit.client.0.smithi012.stdout:9/935: symlink da/dd/d38/d7e/d91/l13a 0 2024-02-14T13:10:42.102 INFO:tasks.workunit.client.0.smithi012.stdout:9/936: readlink da/dd/l110 0 2024-02-14T13:10:42.102 INFO:tasks.workunit.client.0.smithi012.stdout:9/937: chown da/d33/d63/f86 78 1 2024-02-14T13:10:42.102 INFO:tasks.workunit.client.0.smithi012.stdout:0/979: mkdir d10/d14/d20/d146 0 2024-02-14T13:10:42.102 INFO:tasks.workunit.client.0.smithi012.stdout:0/980: read - d10/d14/d41/d52/d78/d8c/d7f/fe8 zero size 2024-02-14T13:10:42.103 INFO:tasks.workunit.client.0.smithi012.stdout:9/938: creat da/dd/d57/d59/da8/f13b x:0 0 0 2024-02-14T13:10:42.104 INFO:tasks.workunit.client.0.smithi012.stdout:0/981: link d10/d14/d41/c46 d10/d14/d41/d52/d67/c147 0 2024-02-14T13:10:42.104 INFO:tasks.workunit.client.0.smithi012.stdout:0/982: write d10/d84/fda [509411,85884] 0 2024-02-14T13:10:42.104 INFO:tasks.workunit.client.0.smithi012.stdout:0/983: write d10/d14/d41/d52/d78/df9/dff/f123 [403695,89257] 0 2024-02-14T13:10:42.124 INFO:tasks.workunit.client.0.smithi012.stdout:1/874: rename d6/d10/d22/d31/d34/d3b to d6/d10/d22/d31/d3e/d10d 0 2024-02-14T13:10:42.124 INFO:tasks.workunit.client.0.smithi012.stdout:1/875: write d6/d10/d22/d44/dbb/d101/fd5 [5236149,129850] 0 2024-02-14T13:10:42.127 INFO:tasks.workunit.client.0.smithi012.stdout:4/831: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/f12e [0,4194304] 0 2024-02-14T13:10:42.128 INFO:tasks.workunit.client.0.smithi012.stdout:2/907: rename d0/d8/d10c/f11d to d0/d20/d75/d8a/d105/f135 0 2024-02-14T13:10:42.130 INFO:tasks.workunit.client.0.smithi012.stdout:7/752: dwrite df/d27/d4b/f8e [0,4194304] 0 2024-02-14T13:10:42.137 INFO:tasks.workunit.client.0.smithi012.stdout:9/939: rename da/dd/lf7 to da/dd/d19/df3/l13c 0 2024-02-14T13:10:42.139 INFO:tasks.workunit.client.0.smithi012.stdout:2/908: mkdir d0/d6/d37/d84/d51/d113/d136 0 2024-02-14T13:10:42.139 INFO:tasks.workunit.client.0.smithi012.stdout:1/876: read d6/d10/d22/d44/f7c [2600899,40775] 0 2024-02-14T13:10:42.149 INFO:tasks.workunit.client.0.smithi012.stdout:0/984: rename d10/d14/d41/d61/d74/l9e to d10/d14/d41/d52/d78/dea/l148 0 2024-02-14T13:10:42.152 INFO:tasks.workunit.client.0.smithi012.stdout:2/909: unlink d0/d1a/de4/d50/d68/d9c/ddc/dec/lee 0 2024-02-14T13:10:42.154 INFO:tasks.workunit.client.0.smithi012.stdout:2/910: symlink d0/d20/d75/d8a/l137 0 2024-02-14T13:10:42.158 INFO:tasks.workunit.client.0.smithi012.stdout:2/911: creat d0/d8/d11/d33/d53/d110/d57/d6d/dcb/f138 x:0 0 0 2024-02-14T13:10:42.160 INFO:tasks.workunit.client.0.smithi012.stdout:2/912: mknod d0/d8/d11/d33/d128/c139 0 2024-02-14T13:10:42.160 INFO:tasks.workunit.client.0.smithi012.stdout:2/913: write d0/d8/d9/d90/fe6 [4432151,91144] 0 2024-02-14T13:10:42.160 INFO:tasks.workunit.client.0.smithi012.stdout:0/985: dread d10/d84/fda [0,4194304] 0 2024-02-14T13:10:42.164 INFO:tasks.workunit.client.0.smithi012.stdout:2/914: rename d0/d20/d54/l95 to d0/d8/d9/d90/l13a 0 2024-02-14T13:10:42.165 INFO:tasks.workunit.client.0.smithi012.stdout:0/986: truncate d10/d14/d41/df2/f109 203223 0 2024-02-14T13:10:42.166 INFO:tasks.workunit.client.0.smithi012.stdout:7/753: dwrite df/d2d/d82/d88/fb7 [0,4194304] 0 2024-02-14T13:10:42.166 INFO:tasks.workunit.client.0.smithi012.stdout:4/832: dwrite d0/d10/d1f/fb7 [0,4194304] 0 2024-02-14T13:10:42.166 INFO:tasks.workunit.client.0.smithi012.stdout:4/833: fsync d0/d10/d1f/f2f 0 2024-02-14T13:10:42.166 INFO:tasks.workunit.client.0.smithi012.stdout:2/915: creat d0/d6/d37/f13b x:0 0 0 2024-02-14T13:10:42.166 INFO:tasks.workunit.client.0.smithi012.stdout:2/916: stat d0/d6/de/de8/c12e 0 2024-02-14T13:10:42.167 INFO:tasks.workunit.client.0.smithi012.stdout:9/940: dwrite da/d33/d63/f8a [0,4194304] 0 2024-02-14T13:10:42.167 INFO:tasks.workunit.client.0.smithi012.stdout:9/941: read - da/dd/d57/d59/d73/db6/df1/f6b zero size 2024-02-14T13:10:42.167 INFO:tasks.workunit.client.0.smithi012.stdout:0/987: rmdir d10/d14/d2b/da4 39 2024-02-14T13:10:42.171 INFO:tasks.workunit.client.0.smithi012.stdout:1/877: dwrite d6/d10/d22/d31/d5b/d5e/d65/d87/dcc/f10a [0,4194304] 0 2024-02-14T13:10:42.172 INFO:tasks.workunit.client.0.smithi012.stdout:4/834: getdents d0/d10/d28/d4f/d6b/d83/d17 0 2024-02-14T13:10:42.172 INFO:tasks.workunit.client.0.smithi012.stdout:4/835: stat d0/d10/d28/da9/f100 0 2024-02-14T13:10:42.175 INFO:tasks.workunit.client.0.smithi012.stdout:0/988: creat d10/d14/d41/d52/d78/df9/dff/d144/f149 x:0 0 0 2024-02-14T13:10:42.175 INFO:tasks.workunit.client.0.smithi012.stdout:0/989: readlink d10/d14/d41/d52/d67/l12c 0 2024-02-14T13:10:42.178 INFO:tasks.workunit.client.0.smithi012.stdout:1/878: rmdir d6/d10/d22/d31/d5b/dcd/dc1 0 2024-02-14T13:10:42.179 INFO:tasks.workunit.client.0.smithi012.stdout:2/917: link d0/d1a/de4/d50/l129 d0/d1a/de4/l13c 0 2024-02-14T13:10:42.179 INFO:tasks.workunit.client.0.smithi012.stdout:2/918: chown d0/d1a/f47 5 1 2024-02-14T13:10:42.180 INFO:tasks.workunit.client.0.smithi012.stdout:0/990: mkdir d10/d14/d2b/d113/d14a 0 2024-02-14T13:10:42.182 INFO:tasks.workunit.client.0.smithi012.stdout:7/754: dwrite df/d2d/f96 [0,4194304] 0 2024-02-14T13:10:42.182 INFO:tasks.workunit.client.0.smithi012.stdout:9/942: dread da/d4f/fed [0,4194304] 0 2024-02-14T13:10:42.183 INFO:tasks.workunit.client.0.smithi012.stdout:1/879: rmdir d6/d10/d64 39 2024-02-14T13:10:42.185 INFO:tasks.workunit.client.0.smithi012.stdout:7/755: symlink df/d2d/d82/d88/d90/l104 0 2024-02-14T13:10:42.187 INFO:tasks.workunit.client.0.smithi012.stdout:9/943: creat da/dd/d38/d7e/d91/f13d x:0 0 0 2024-02-14T13:10:42.187 INFO:tasks.workunit.client.0.smithi012.stdout:4/836: dread d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 [0,4194304] 0 2024-02-14T13:10:42.187 INFO:tasks.workunit.client.0.smithi012.stdout:7/756: mknod df/d27/d4b/d6b/d6d/c105 0 2024-02-14T13:10:42.189 INFO:tasks.workunit.client.0.smithi012.stdout:0/991: dread d10/d14/d41/d52/d67/d126/d30/f3f [0,4194304] 0 2024-02-14T13:10:42.190 INFO:tasks.workunit.client.0.smithi012.stdout:0/992: chown d10/d14/d41/d61 0 1 2024-02-14T13:10:42.190 INFO:tasks.workunit.client.0.smithi012.stdout:4/837: dread d0/d10/d28/d4f/d6b/d83/f2d [4194304,4194304] 0 2024-02-14T13:10:42.190 INFO:tasks.workunit.client.0.smithi012.stdout:9/944: link da/d33/d63/f86 da/dd/f13e 0 2024-02-14T13:10:42.192 INFO:tasks.workunit.client.0.smithi012.stdout:7/757: rename df/d27/f66 to df/d27/d4b/d8d/dd4/f106 0 2024-02-14T13:10:42.192 INFO:tasks.workunit.client.0.smithi012.stdout:7/758: fdatasync df/f30 0 2024-02-14T13:10:42.193 INFO:tasks.workunit.client.0.smithi012.stdout:0/993: creat d10/d11e/f14b x:0 0 0 2024-02-14T13:10:42.193 INFO:tasks.workunit.client.0.smithi012.stdout:1/880: write d6/d10/d22/d31/d5b/d5e/d65/d87/f97 [4042284,117195] 0 2024-02-14T13:10:42.194 INFO:tasks.workunit.client.0.smithi012.stdout:4/838: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/dcc/c12f 0 2024-02-14T13:10:42.196 INFO:tasks.workunit.client.0.smithi012.stdout:7/759: symlink df/l107 0 2024-02-14T13:10:42.196 INFO:tasks.workunit.client.0.smithi012.stdout:7/760: readlink df/l16 0 2024-02-14T13:10:42.196 INFO:tasks.workunit.client.0.smithi012.stdout:7/761: write df/d2d/d5d/d72/d8a/fc6 [517575,41024] 0 2024-02-14T13:10:42.196 INFO:tasks.workunit.client.0.smithi012.stdout:5/919: sync 2024-02-14T13:10:42.196 INFO:tasks.workunit.client.0.smithi012.stdout:5/920: read dc/d17/ded/fa2 [282,120108] 0 2024-02-14T13:10:42.197 INFO:tasks.workunit.client.0.smithi012.stdout:0/994: creat d10/d14/d41/d52/d56/d12d/f14c x:0 0 0 2024-02-14T13:10:42.200 INFO:tasks.workunit.client.0.smithi012.stdout:1/881: rename d6/d10/d22/d31/d34/d58/feb to d6/d10/d22/d31/d34/d58/f10e 0 2024-02-14T13:10:42.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/919: dwrite d0/d8/d11/d35/dd0/d70/fd9 [0,4194304] 0 2024-02-14T13:10:42.200 INFO:tasks.workunit.client.0.smithi012.stdout:2/920: truncate d0/d1a/dfc/f104 280787 0 2024-02-14T13:10:42.201 INFO:tasks.workunit.client.0.smithi012.stdout:4/839: mknod d0/de1/de8/dd9/ddc/c130 0 2024-02-14T13:10:42.201 INFO:tasks.workunit.client.0.smithi012.stdout:4/840: chown d0/d10/d28/d4f/l9c 4 1 2024-02-14T13:10:42.202 INFO:tasks.workunit.client.0.smithi012.stdout:9/945: dread da/dd/d19/df3/fd1 [0,4194304] 0 2024-02-14T13:10:42.202 INFO:tasks.workunit.client.0.smithi012.stdout:9/946: chown da/dd/d19/d30/d45/feb 108061 1 2024-02-14T13:10:42.202 INFO:tasks.workunit.client.0.smithi012.stdout:9/947: truncate da/dd/d57/d59/f10e 525803 0 2024-02-14T13:10:42.202 INFO:tasks.workunit.client.0.smithi012.stdout:7/762: truncate df/d27/d4b/d6b/d6d/d85/ff3 1035455 0 2024-02-14T13:10:42.202 INFO:tasks.workunit.client.0.smithi012.stdout:7/763: chown df/d27/d4b/d6b/d6d/cd2 7 1 2024-02-14T13:10:42.203 INFO:tasks.workunit.client.0.smithi012.stdout:5/921: rmdir dc/d2f/d70/d78/dc4 39 2024-02-14T13:10:42.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/995: creat d10/d14/d20/d146/f14d x:0 0 0 2024-02-14T13:10:42.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/996: write d10/d14/d41/d52/d67/d126/f119 [21508,105962] 0 2024-02-14T13:10:42.205 INFO:tasks.workunit.client.0.smithi012.stdout:0/997: truncate d10/d14/d41/d52/d56/d12d/f105 450482 0 2024-02-14T13:10:42.206 INFO:tasks.workunit.client.0.smithi012.stdout:0/998: chown d10/d14/d41/d52/d67/d126/d30/f6d 62948 1 2024-02-14T13:10:42.206 INFO:tasks.workunit.client.0.smithi012.stdout:1/882: symlink d6/d10/d22/d31/d5b/d5d/d80/l10f 0 2024-02-14T13:10:42.207 INFO:tasks.workunit.client.0.smithi012.stdout:3/830: sync 2024-02-14T13:10:42.207 INFO:tasks.workunit.client.0.smithi012.stdout:8/860: sync 2024-02-14T13:10:42.207 INFO:tasks.workunit.client.0.smithi012.stdout:6/831: sync 2024-02-14T13:10:42.208 INFO:tasks.workunit.client.0.smithi012.stdout:2/921: symlink d0/l13d 0 2024-02-14T13:10:42.209 INFO:tasks.workunit.client.0.smithi012.stdout:4/841: creat d0/d10/d28/d4f/dc7/dfb/f131 x:0 0 0 2024-02-14T13:10:42.210 INFO:tasks.workunit.client.0.smithi012.stdout:9/948: mknod da/dd/d19/d30/c13f 0 2024-02-14T13:10:42.212 INFO:tasks.workunit.client.0.smithi012.stdout:5/922: symlink dc/d17/d20/d4c/d63/d81/ddd/l121 0 2024-02-14T13:10:42.213 INFO:tasks.workunit.client.0.smithi012.stdout:3/831: dread d9/dc4/fdd [0,4194304] 0 2024-02-14T13:10:42.214 INFO:tasks.workunit.client.0.smithi012.stdout:9/949: dread da/d33/d63/d106/fe5 [0,4194304] 0 2024-02-14T13:10:42.216 INFO:tasks.workunit.client.0.smithi012.stdout:0/999: creat d10/d14/d20/d49/f14e x:0 0 0 2024-02-14T13:10:42.217 INFO:tasks.workunit.client.0.smithi012.stdout:1/883: getdents d6 0 2024-02-14T13:10:42.218 INFO:tasks.workunit.client.0.smithi012.stdout:8/861: creat d9/dc/d14/d23/ddf/d10c/f129 x:0 0 0 2024-02-14T13:10:42.219 INFO:tasks.workunit.client.0.smithi012.stdout:8/862: readlink d9/dc/d14/lc0 0 2024-02-14T13:10:42.220 INFO:tasks.workunit.client.0.smithi012.stdout:2/922: getdents d0/d1a/de4/d50/d68/d9c/ddc 0 2024-02-14T13:10:42.221 INFO:tasks.workunit.client.0.smithi012.stdout:4/842: truncate d0/de1/de8/f64 651041 0 2024-02-14T13:10:42.224 INFO:tasks.workunit.client.0.smithi012.stdout:9/950: dread da/fc [0,4194304] 0 2024-02-14T13:10:42.229 INFO:tasks.workunit.client.0.smithi012.stdout:8/863: truncate d9/f84 3103852 0 2024-02-14T13:10:42.229 INFO:tasks.workunit.client.0.smithi012.stdout:8/864: chown d9/dc/d14/d2e/dde/f7a 4 1 2024-02-14T13:10:42.229 INFO:tasks.workunit.client.0.smithi012.stdout:8/865: chown d9/dc/d14/d2e/dde/da3/d10e/c11a 11 1 2024-02-14T13:10:42.230 INFO:tasks.workunit.client.0.smithi012.stdout:2/923: unlink d0/d8/d11/d33/d53/d110/faa 0 2024-02-14T13:10:42.232 INFO:tasks.workunit.client.0.smithi012.stdout:4/843: mkdir d0/de1/d12b/d132 0 2024-02-14T13:10:42.232 INFO:tasks.workunit.client.0.smithi012.stdout:4/844: readlink d0/d10/d28/d4f/d6b/lff 0 2024-02-14T13:10:42.233 INFO:tasks.workunit.client.0.smithi012.stdout:9/951: getdents da/dd/d57/d59/d73 0 2024-02-14T13:10:42.234 INFO:tasks.workunit.client.0.smithi012.stdout:9/952: read - da/dd/d57/db2/fd3 zero size 2024-02-14T13:10:42.234 INFO:tasks.workunit.client.0.smithi012.stdout:4/845: symlink d0/d10/d28/d4f/l133 0 2024-02-14T13:10:42.235 INFO:tasks.workunit.client.0.smithi012.stdout:9/953: creat da/dd/d57/d59/da8/f140 x:0 0 0 2024-02-14T13:10:42.237 INFO:tasks.workunit.client.0.smithi012.stdout:4/846: chown d0/d10/d28/d4f/d6b/d8f/d56/d8c/lbe 31792 1 2024-02-14T13:10:42.241 INFO:tasks.workunit.client.0.smithi012.stdout:4/847: symlink d0/d10/d28/d4f/d6b/d83/d17/l134 0 2024-02-14T13:10:42.243 INFO:tasks.workunit.client.0.smithi012.stdout:9/954: mknod da/dd/d57/c141 0 2024-02-14T13:10:42.244 INFO:tasks.workunit.client.0.smithi012.stdout:4/848: creat d0/d10/d28/d4f/d6b/d8f/d56/df7/f135 x:0 0 0 2024-02-14T13:10:42.246 INFO:tasks.workunit.client.0.smithi012.stdout:4/849: truncate d0/d10/d28/da9/f11c 1402257 0 2024-02-14T13:10:42.247 INFO:tasks.workunit.client.0.smithi012.stdout:9/955: mkdir da/dd/d38/d142 0 2024-02-14T13:10:42.248 INFO:tasks.workunit.client.0.smithi012.stdout:2/924: dread d0/d8/d11/d35/dd0/d70/fd9 [0,4194304] 0 2024-02-14T13:10:42.248 INFO:tasks.workunit.client.0.smithi012.stdout:4/850: symlink d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/dce/l136 0 2024-02-14T13:10:42.250 INFO:tasks.workunit.client.0.smithi012.stdout:9/956: rmdir da/d33/d63/d106 39 2024-02-14T13:10:42.250 INFO:tasks.workunit.client.0.smithi012.stdout:9/957: truncate da/dd/d57/d59/da8/f140 565310 0 2024-02-14T13:10:42.252 INFO:tasks.workunit.client.0.smithi012.stdout:4/851: symlink d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/l137 0 2024-02-14T13:10:42.252 INFO:tasks.workunit.client.0.smithi012.stdout:4/852: readlink d0/d10/d28/d4f/d6b/de7/led 0 2024-02-14T13:10:42.252 INFO:tasks.workunit.client.0.smithi012.stdout:9/958: getdents da/dd/d18 0 2024-02-14T13:10:42.253 INFO:tasks.workunit.client.0.smithi012.stdout:6/832: dwrite d1/df/d24/fe0 [4194304,4194304] 0 2024-02-14T13:10:42.253 INFO:tasks.workunit.client.0.smithi012.stdout:6/833: chown d1/df/d24/cbd 532589 1 2024-02-14T13:10:42.254 INFO:tasks.workunit.client.0.smithi012.stdout:9/959: rename da/dd/d38/fe0 to da/dd/d38/d7e/d91/d100/f143 0 2024-02-14T13:10:42.255 INFO:tasks.workunit.client.0.smithi012.stdout:9/960: truncate da/dd/d38/d7e/ddc/f113 515220 0 2024-02-14T13:10:42.255 INFO:tasks.workunit.client.0.smithi012.stdout:9/961: readlink da/dd/l110 0 2024-02-14T13:10:42.255 INFO:tasks.workunit.client.0.smithi012.stdout:5/923: dwrite f0 [0,4194304] 0 2024-02-14T13:10:42.255 INFO:tasks.workunit.client.0.smithi012.stdout:5/924: write dc/d17/d20/f36 [1408527,96021] 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/832: dwrite d9/dd/d30/fca [0,4194304] 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/833: fsync d9/d3f/d88/fe5 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:8/866: dwrite d9/dc/d14/d2e/dde/d56/d57/d7c/fef [0,4194304] 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:8/867: fdatasync d9/dc/d14/d2e/dde/da1/ffb 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/834: read d9/dc4/fc7 [165402,87835] 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/835: write d9/dd/fbc [4276914,43339] 0 2024-02-14T13:10:42.257 INFO:tasks.workunit.client.0.smithi012.stdout:6/834: creat d1/df/d50/f10a x:0 0 0 2024-02-14T13:10:42.262 INFO:tasks.workunit.client.0.smithi012.stdout:2/925: dread d0/d8/d9/d90/dab/f59 [0,4194304] 0 2024-02-14T13:10:42.262 INFO:tasks.workunit.client.0.smithi012.stdout:5/925: rename dc/d47/d6e/l88 to dc/d17/d20/d4c/l122 0 2024-02-14T13:10:42.262 INFO:tasks.workunit.client.0.smithi012.stdout:9/962: write da/dd/d57/d59/d73/db6/df1/f9a [1063271,110618] 0 2024-02-14T13:10:42.262 INFO:tasks.workunit.client.0.smithi012.stdout:9/963: write da/dd/d57/d59/d73/db6/df1/f9a [3341606,9849] 0 2024-02-14T13:10:42.265 INFO:tasks.workunit.client.0.smithi012.stdout:9/964: dread da/dd/d19/d30/f43 [0,4194304] 0 2024-02-14T13:10:42.266 INFO:tasks.workunit.client.0.smithi012.stdout:8/868: creat d9/dc/d38/d6a/f12a x:0 0 0 2024-02-14T13:10:42.268 INFO:tasks.workunit.client.0.smithi012.stdout:3/836: creat d9/d3f/da8/f123 x:0 0 0 2024-02-14T13:10:42.269 INFO:tasks.workunit.client.0.smithi012.stdout:6/835: truncate d1/df/d16/d7c/d97/d82/ffb 347903 0 2024-02-14T13:10:42.271 INFO:tasks.workunit.client.0.smithi012.stdout:2/926: rmdir d0/d8/d11/d33 39 2024-02-14T13:10:42.273 INFO:tasks.workunit.client.0.smithi012.stdout:5/926: rmdir dc/d2f/d89 39 2024-02-14T13:10:42.274 INFO:tasks.workunit.client.0.smithi012.stdout:5/927: fdatasync dc/d17/d20/f2b 0 2024-02-14T13:10:42.274 INFO:tasks.workunit.client.0.smithi012.stdout:5/928: fsync dc/d17/d20/f22 0 2024-02-14T13:10:42.274 INFO:tasks.workunit.client.0.smithi012.stdout:9/965: truncate da/dd/d19/d30/f81 3407502 0 2024-02-14T13:10:42.276 INFO:tasks.workunit.client.0.smithi012.stdout:8/869: write d9/dc/d14/d2e/dde/d56/fa7 [1541376,103826] 0 2024-02-14T13:10:42.276 INFO:tasks.workunit.client.0.smithi012.stdout:8/870: truncate d9/dc/d14/d2e/dde/da1/ffb 732187 0 2024-02-14T13:10:42.276 INFO:tasks.workunit.client.0.smithi012.stdout:3/837: rename d9/d3f/d88/dc0/le6 to d9/d3f/dac/dfb/l124 0 2024-02-14T13:10:42.278 INFO:tasks.workunit.client.0.smithi012.stdout:9/966: mknod da/dd/d57/d59/d73/c144 0 2024-02-14T13:10:42.280 INFO:tasks.workunit.client.0.smithi012.stdout:8/871: creat d9/dc/d14/d2e/dde/da1/f12b x:0 0 0 2024-02-14T13:10:42.280 INFO:tasks.workunit.client.0.smithi012.stdout:8/872: stat d9/dc/d14/d2e/dde/c6f 0 2024-02-14T13:10:42.280 INFO:tasks.workunit.client.0.smithi012.stdout:8/873: chown d9/dc/d38/lc2 8 1 2024-02-14T13:10:42.282 INFO:tasks.workunit.client.0.smithi012.stdout:2/927: rename d0/d6/de/de8/lf5 to d0/d8/d11/d33/dc3/d111/l13e 0 2024-02-14T13:10:42.282 INFO:tasks.workunit.client.0.smithi012.stdout:2/928: write d0/d1a/de4/d50/d68/d9c/f9f [9367301,25378] 0 2024-02-14T13:10:42.282 INFO:tasks.workunit.client.0.smithi012.stdout:2/929: chown d0/d1a/de4/d39/db8 1 1 2024-02-14T13:10:42.283 INFO:tasks.workunit.client.0.smithi012.stdout:2/930: write d0/d1a/de4/d50/db1/f133 [294876,40416] 0 2024-02-14T13:10:42.283 INFO:tasks.workunit.client.0.smithi012.stdout:2/931: chown d0/d8/f6f 9898 1 2024-02-14T13:10:42.283 INFO:tasks.workunit.client.0.smithi012.stdout:3/838: rmdir d9/dd/d30/d44/d66/db3/db9 39 2024-02-14T13:10:42.284 INFO:tasks.workunit.client.0.smithi012.stdout:8/874: symlink d9/dc/d1b/d6b/dfe/l12c 0 2024-02-14T13:10:42.285 INFO:tasks.workunit.client.0.smithi012.stdout:8/875: truncate d9/dc/d14/d2e/dde/da3/de9/f10f 4566357 0 2024-02-14T13:10:42.285 INFO:tasks.workunit.client.0.smithi012.stdout:8/876: truncate d9/dc/d14/d2e/dde/da1/f12b 632800 0 2024-02-14T13:10:42.289 INFO:tasks.workunit.client.0.smithi012.stdout:9/967: rename da/dd/d19/d30/f1f to da/dd/d38/f145 0 2024-02-14T13:10:42.289 INFO:tasks.workunit.client.0.smithi012.stdout:9/968: dread - da/dd/d38/d7e/fb9 zero size 2024-02-14T13:10:42.291 INFO:tasks.workunit.client.0.smithi012.stdout:2/932: rename d0/d20/d54/f82 to d0/d8/d11/d33/dc3/dd5/d118/f13f 0 2024-02-14T13:10:42.292 INFO:tasks.workunit.client.0.smithi012.stdout:9/969: rmdir da/d33/d63 39 2024-02-14T13:10:42.297 INFO:tasks.workunit.client.0.smithi012.stdout:2/933: unlink d0/l13d 0 2024-02-14T13:10:42.301 INFO:tasks.workunit.client.0.smithi012.stdout:2/934: truncate d0/d8/d11/d33/dc3/dd5/d118/f13f 1528574 0 2024-02-14T13:10:42.302 INFO:tasks.workunit.client.0.smithi012.stdout:2/935: mkdir d0/d8/d9/d90/dab/d140 0 2024-02-14T13:10:42.308 INFO:tasks.workunit.client.0.smithi012.stdout:3/839: dwrite d9/dd/d30/d34/f51 [0,4194304] 0 2024-02-14T13:10:42.308 INFO:tasks.workunit.client.0.smithi012.stdout:3/840: stat d9/d3f/dac/dfb 0 2024-02-14T13:10:42.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/936: symlink d0/d8/d11/d33/d53/d110/d57/d6d/dcb/l141 0 2024-02-14T13:10:42.309 INFO:tasks.workunit.client.0.smithi012.stdout:2/937: dread - d0/d1a/de4/d50/d68/d9c/f100 zero size 2024-02-14T13:10:42.309 INFO:tasks.workunit.client.0.smithi012.stdout:8/877: dwrite d9/dc/d1b/f80 [0,4194304] 0 2024-02-14T13:10:42.310 INFO:tasks.workunit.client.0.smithi012.stdout:3/841: mkdir d9/dc4/d125 0 2024-02-14T13:10:42.312 INFO:tasks.workunit.client.0.smithi012.stdout:3/842: dread d9/d13/d28/f9a [0,4194304] 0 2024-02-14T13:10:42.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/938: symlink d0/d6/de/de8/l142 0 2024-02-14T13:10:42.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/939: chown d0/d6/de/de8 125171 1 2024-02-14T13:10:42.312 INFO:tasks.workunit.client.0.smithi012.stdout:2/940: dread - d0/d1a/de4/d39/db8/fc9 zero size 2024-02-14T13:10:42.315 INFO:tasks.workunit.client.0.smithi012.stdout:8/878: mknod d9/dc/d14/d2e/dde/da1/dba/c12d 0 2024-02-14T13:10:42.317 INFO:tasks.workunit.client.0.smithi012.stdout:3/843: rename d9/dd/de/c25 to d9/d18/c126 0 2024-02-14T13:10:42.317 INFO:tasks.workunit.client.0.smithi012.stdout:3/844: truncate d9/d13/daa/f11e 915067 0 2024-02-14T13:10:42.319 INFO:tasks.workunit.client.0.smithi012.stdout:2/941: creat d0/d6/de/d7b/da8/f143 x:0 0 0 2024-02-14T13:10:42.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/879: creat d9/dc/d14/d23/d62/f12e x:0 0 0 2024-02-14T13:10:42.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/880: chown d9/fbf 35010 1 2024-02-14T13:10:42.320 INFO:tasks.workunit.client.0.smithi012.stdout:8/881: fdatasync d9/dc/d14/d2e/dde/da3/de9/fd9 0 2024-02-14T13:10:42.321 INFO:tasks.workunit.client.0.smithi012.stdout:8/882: truncate d9/dc/d14/d2e/dde/f59 1854289 0 2024-02-14T13:10:42.326 INFO:tasks.workunit.client.0.smithi012.stdout:3/845: dread d9/dd/d30/d34/f51 [0,4194304] 0 2024-02-14T13:10:42.330 INFO:tasks.workunit.client.0.smithi012.stdout:8/883: dread d9/dc/d38/d6a/fdc [0,4194304] 0 2024-02-14T13:10:42.335 INFO:tasks.workunit.client.0.smithi012.stdout:3/846: dread d9/dd/d30/d44/f4b [4194304,4194304] 0 2024-02-14T13:10:42.340 INFO:tasks.workunit.client.0.smithi012.stdout:8/884: dread d9/dc/d14/d2e/dde/d56/d57/d7c/fef [0,4194304] 0 2024-02-14T13:10:42.342 INFO:tasks.workunit.client.0.smithi012.stdout:8/885: creat d9/dc/d38/f12f x:0 0 0 2024-02-14T13:10:42.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/886: creat d9/dc/f130 x:0 0 0 2024-02-14T13:10:42.343 INFO:tasks.workunit.client.0.smithi012.stdout:8/887: stat d9/dc/d14/d2e/dde/d56/fbe 0 2024-02-14T13:10:42.344 INFO:tasks.workunit.client.0.smithi012.stdout:8/888: rmdir d9/dc/d14/d11f 39 2024-02-14T13:10:42.344 INFO:tasks.workunit.client.0.smithi012.stdout:8/889: fdatasync d9/dc/d38/f51 0 2024-02-14T13:10:42.344 INFO:tasks.workunit.client.0.smithi012.stdout:3/847: dread d9/d3f/d4e/f6d [0,4194304] 0 2024-02-14T13:10:42.345 INFO:tasks.workunit.client.0.smithi012.stdout:8/890: rename d9/dc/d1b/l33 to d9/dc/d14/d2e/dde/d56/d57/dca/l131 0 2024-02-14T13:10:42.346 INFO:tasks.workunit.client.0.smithi012.stdout:3/848: creat d9/dd/de/d58/d65/d6c/f127 x:0 0 0 2024-02-14T13:10:42.346 INFO:tasks.workunit.client.0.smithi012.stdout:2/942: dwrite d0/d1a/de4/d50/d68/d9c/f9f [0,4194304] 0 2024-02-14T13:10:42.346 INFO:tasks.workunit.client.0.smithi012.stdout:2/943: chown d0/d8/d11/d33/d5c/dc2/c10d 1832 1 2024-02-14T13:10:42.347 INFO:tasks.workunit.client.0.smithi012.stdout:3/849: rmdir d9/dd/d30/d34/d78/dd5 0 2024-02-14T13:10:42.347 INFO:tasks.workunit.client.0.smithi012.stdout:8/891: dread d9/dc/f9d [0,4194304] 0 2024-02-14T13:10:42.348 INFO:tasks.workunit.client.0.smithi012.stdout:2/944: symlink d0/l144 0 2024-02-14T13:10:42.348 INFO:tasks.workunit.client.0.smithi012.stdout:2/945: chown d0/d8/d11/d35/dd0/l46 1670863 1 2024-02-14T13:10:42.349 INFO:tasks.workunit.client.0.smithi012.stdout:3/850: unlink d9/d13/dea/d103/cf4 0 2024-02-14T13:10:42.349 INFO:tasks.workunit.client.0.smithi012.stdout:3/851: truncate d9/d13/dea/d103/f90 1538292 0 2024-02-14T13:10:42.349 INFO:tasks.workunit.client.0.smithi012.stdout:2/946: read d0/d8/d11/d33/d53/d6b/f6c [726032,86827] 0 2024-02-14T13:10:42.354 INFO:tasks.workunit.client.0.smithi012.stdout:3/852: link d9/dd/d30/d44/d66/db3/db9/lba d9/d13/l128 0 2024-02-14T13:10:42.354 INFO:tasks.workunit.client.0.smithi012.stdout:3/853: fdatasync d9/d3f/d4e/f5a 0 2024-02-14T13:10:42.355 INFO:tasks.workunit.client.0.smithi012.stdout:8/892: rmdir d9/dc 39 2024-02-14T13:10:42.356 INFO:tasks.workunit.client.0.smithi012.stdout:2/947: creat d0/d8/d11/d33/f145 x:0 0 0 2024-02-14T13:10:42.356 INFO:tasks.workunit.client.0.smithi012.stdout:2/948: write d0/d8/d11/f17 [3530531,106282] 0 2024-02-14T13:10:42.357 INFO:tasks.workunit.client.0.smithi012.stdout:3/854: rename d9/d3f/l48 to d9/d13/dea/d11f/l129 0 2024-02-14T13:10:42.358 INFO:tasks.workunit.client.0.smithi012.stdout:2/949: creat d0/d8/d11/d35/dd0/f146 x:0 0 0 2024-02-14T13:10:42.358 INFO:tasks.workunit.client.0.smithi012.stdout:2/950: chown d0/d20/d54/l64 746935 1 2024-02-14T13:10:42.359 INFO:tasks.workunit.client.0.smithi012.stdout:3/855: dread d9/dd/de/d58/d65/df0/fb2 [0,4194304] 0 2024-02-14T13:10:42.361 INFO:tasks.workunit.client.0.smithi012.stdout:3/856: symlink d9/d7b/d95/l12a 0 2024-02-14T13:10:42.361 INFO:tasks.workunit.client.0.smithi012.stdout:3/857: write d9/dd/d30/d44/f11a [467070,57184] 0 2024-02-14T13:10:42.361 INFO:tasks.workunit.client.0.smithi012.stdout:3/858: fsync d9/d13/dea/d103/f90 0 2024-02-14T13:10:42.363 INFO:tasks.workunit.client.0.smithi012.stdout:8/893: dread d9/dc/d14/d2e/dde/da3/ded/f78 [0,4194304] 0 2024-02-14T13:10:42.364 INFO:tasks.workunit.client.0.smithi012.stdout:8/894: dread - d9/dc/d14/d2e/ff8 zero size 2024-02-14T13:10:42.372 INFO:tasks.workunit.client.0.smithi012.stdout:8/895: dread d9/dc/d14/d2e/f54 [0,4194304] 0 2024-02-14T13:10:42.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/764: sync 2024-02-14T13:10:42.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/765: write df/d24/d56/f60 [1012325,100608] 0 2024-02-14T13:10:42.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/766: write df/d27/d4b/d6b/fc2 [739428,81673] 0 2024-02-14T13:10:42.389 INFO:tasks.workunit.client.0.smithi012.stdout:7/767: write df/d24/d9e/faa [3586143,67252] 0 2024-02-14T13:10:42.389 INFO:tasks.workunit.client.0.smithi012.stdout:2/951: dwrite d0/d8/d11/d35/dd0/d70/f115 [0,4194304] 0 2024-02-14T13:10:42.389 INFO:tasks.workunit.client.0.smithi012.stdout:2/952: write d0/d8/d11/d35/dd0/d70/db0/f11a [229247,107926] 0 2024-02-14T13:10:42.391 INFO:tasks.workunit.client.0.smithi012.stdout:2/953: creat d0/d6/de/de8/f147 x:0 0 0 2024-02-14T13:10:42.391 INFO:tasks.workunit.client.0.smithi012.stdout:2/954: readlink d0/d1a/de4/d50/d68/d9c/ddc/le0 0 2024-02-14T13:10:42.393 INFO:tasks.workunit.client.0.smithi012.stdout:7/768: truncate df/d24/d9e/faa 4070389 0 2024-02-14T13:10:42.394 INFO:tasks.workunit.client.0.smithi012.stdout:7/769: symlink df/d27/d100/l108 0 2024-02-14T13:10:42.395 INFO:tasks.workunit.client.0.smithi012.stdout:7/770: write df/d2d/f3f [1378807,58289] 0 2024-02-14T13:10:42.395 INFO:tasks.workunit.client.0.smithi012.stdout:3/859: dwrite d9/d18/d39/f114 [0,4194304] 0 2024-02-14T13:10:42.396 INFO:tasks.workunit.client.0.smithi012.stdout:8/896: dwrite d9/dc/d1b/f80 [0,4194304] 0 2024-02-14T13:10:42.397 INFO:tasks.workunit.client.0.smithi012.stdout:7/771: symlink df/d24/d56/l109 0 2024-02-14T13:10:42.398 INFO:tasks.workunit.client.0.smithi012.stdout:8/897: rmdir d9/dc/d14/d2e/dde/da1/dba 39 2024-02-14T13:10:42.401 INFO:tasks.workunit.client.0.smithi012.stdout:7/772: dread df/d2d/d5d/d72/d8a/dcd/fce [0,4194304] 0 2024-02-14T13:10:42.403 INFO:tasks.workunit.client.0.smithi012.stdout:7/773: creat df/d2d/d5d/d72/de8/f10a x:0 0 0 2024-02-14T13:10:42.403 INFO:tasks.workunit.client.0.smithi012.stdout:7/774: write df/d2d/d5d/d72/f99 [50713,35067] 0 2024-02-14T13:10:42.404 INFO:tasks.workunit.client.0.smithi012.stdout:3/860: dread d9/dd/de/fe3 [0,4194304] 0 2024-02-14T13:10:42.405 INFO:tasks.workunit.client.0.smithi012.stdout:7/775: rename df/d24/dfd to df/d27/d100/d10b 0 2024-02-14T13:10:42.405 INFO:tasks.workunit.client.0.smithi012.stdout:7/776: chown df/d27/d100/l108 7955 1 2024-02-14T13:10:42.405 INFO:tasks.workunit.client.0.smithi012.stdout:2/955: dwrite d0/d20/d75/d8a/d105/f135 [0,4194304] 0 2024-02-14T13:10:42.405 INFO:tasks.workunit.client.0.smithi012.stdout:2/956: dread - d0/d8/d11/d35/dd0/f146 zero size 2024-02-14T13:10:42.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/957: stat d0/d8/d11/d33/d53/d110/d57/la9 0 2024-02-14T13:10:42.406 INFO:tasks.workunit.client.0.smithi012.stdout:2/958: fsync d0/d6/fb6 0 2024-02-14T13:10:42.406 INFO:tasks.workunit.client.0.smithi012.stdout:3/861: rmdir d9/dc4/d125 0 2024-02-14T13:10:42.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/959: rename d0/d8/d9/dbe to d0/d8/d11/d35/dd0/df0/d148 0 2024-02-14T13:10:42.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/960: truncate d0/d8/d11/d33/f38 6382707 0 2024-02-14T13:10:42.410 INFO:tasks.workunit.client.0.smithi012.stdout:3/862: mknod d9/d18/d39/df7/c12b 0 2024-02-14T13:10:42.410 INFO:tasks.workunit.client.0.smithi012.stdout:2/961: creat d0/d6/d37/f149 x:0 0 0 2024-02-14T13:10:42.411 INFO:tasks.workunit.client.0.smithi012.stdout:3/863: creat d9/d18/d39/df7/f12c x:0 0 0 2024-02-14T13:10:42.411 INFO:tasks.workunit.client.0.smithi012.stdout:2/962: symlink d0/d8/d11/d33/d5c/l14a 0 2024-02-14T13:10:42.413 INFO:tasks.workunit.client.0.smithi012.stdout:2/963: creat d0/d8/d11/d35/dd0/f14b x:0 0 0 2024-02-14T13:10:42.414 INFO:tasks.workunit.client.0.smithi012.stdout:2/964: symlink d0/d1a/l14c 0 2024-02-14T13:10:42.422 INFO:tasks.workunit.client.0.smithi012.stdout:2/965: write d0/d1a/f25 [3933961,31198] 0 2024-02-14T13:10:42.422 INFO:tasks.workunit.client.0.smithi012.stdout:8/898: dwrite d9/dc/d14/fd4 [0,4194304] 0 2024-02-14T13:10:42.432 INFO:tasks.workunit.client.0.smithi012.stdout:7/777: dwrite df/d27/d100/d10b/f75 [0,4194304] 0 2024-02-14T13:10:42.432 INFO:tasks.workunit.client.0.smithi012.stdout:7/778: readlink df/d2d/d82/d88/db2/lb3 0 2024-02-14T13:10:42.432 INFO:tasks.workunit.client.0.smithi012.stdout:3/864: dwrite d9/f61 [0,4194304] 0 2024-02-14T13:10:42.435 INFO:tasks.workunit.client.0.smithi012.stdout:7/779: mknod df/d24/d9e/c10c 0 2024-02-14T13:10:42.437 INFO:tasks.workunit.client.0.smithi012.stdout:3/865: rename d9/d3f/d4e/f6d to d9/d18/f12d 0 2024-02-14T13:10:42.437 INFO:tasks.workunit.client.0.smithi012.stdout:8/899: write d9/dc/d38/d6a/f7e [4632037,79223] 0 2024-02-14T13:10:42.438 INFO:tasks.workunit.client.0.smithi012.stdout:7/780: getdents df/d2d/d5d/d72 0 2024-02-14T13:10:42.438 INFO:tasks.workunit.client.0.smithi012.stdout:7/781: chown df/d2d 1444762 1 2024-02-14T13:10:42.440 INFO:tasks.workunit.client.0.smithi012.stdout:8/900: creat d9/dc/d14/d2e/dde/f132 x:0 0 0 2024-02-14T13:10:42.440 INFO:tasks.workunit.client.0.smithi012.stdout:7/782: mkdir df/d27/d4b/d10d 0 2024-02-14T13:10:42.443 INFO:tasks.workunit.client.0.smithi012.stdout:8/901: rename d9/dc/d14/d23/c74 to d9/dc/d14/d2e/c133 0 2024-02-14T13:10:42.445 INFO:tasks.workunit.client.0.smithi012.stdout:8/902: mkdir d9/dc/d14/d23/ddf/d134 0 2024-02-14T13:10:42.446 INFO:tasks.workunit.client.0.smithi012.stdout:8/903: write d9/dc/d14/d2e/dde/da1/ffb [605148,40510] 0 2024-02-14T13:10:42.448 INFO:tasks.workunit.client.0.smithi012.stdout:8/904: stat d9/dc/d14/d23/l2a 0 2024-02-14T13:10:42.451 INFO:tasks.workunit.client.0.smithi012.stdout:2/966: dwrite d0/d6/d37/fad [4194304,4194304] 0 2024-02-14T13:10:42.452 INFO:tasks.workunit.client.0.smithi012.stdout:2/967: rmdir d0/d8/d9/d90/dab 39 2024-02-14T13:10:42.453 INFO:tasks.workunit.client.0.smithi012.stdout:2/968: chown d0/d8/d11/d35/l108 0 1 2024-02-14T13:10:42.454 INFO:tasks.workunit.client.0.smithi012.stdout:2/969: mknod d0/d1a/de4/d50/d68/d9c/ddc/dfd/c14d 0 2024-02-14T13:10:42.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/884: sync 2024-02-14T13:10:42.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/885: fsync d6/d10/d22/d31/f74 0 2024-02-14T13:10:42.458 INFO:tasks.workunit.client.0.smithi012.stdout:1/886: stat d6/d10/d22/d31/d34 0 2024-02-14T13:10:42.463 INFO:tasks.workunit.client.0.smithi012.stdout:7/783: dwrite df/d36/f3a [8388608,4194304] 0 2024-02-14T13:10:42.463 INFO:tasks.workunit.client.0.smithi012.stdout:3/866: dwrite d9/dd/de/d58/d65/df0/fb2 [0,4194304] 0 2024-02-14T13:10:42.466 INFO:tasks.workunit.client.0.smithi012.stdout:8/905: dwrite d9/dc/d14/d2e/dde/d56/d57/d7c/f120 [0,4194304] 0 2024-02-14T13:10:42.467 INFO:tasks.workunit.client.0.smithi012.stdout:3/867: symlink d9/dd/d30/d44/d66/db3/dee/l12e 0 2024-02-14T13:10:42.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:42 smithi012 ceph-mon[32370]: pgmap v407: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 164 MiB/s wr, 1.28k op/s 2024-02-14T13:10:42.471 INFO:tasks.workunit.client.0.smithi012.stdout:8/906: mknod d9/dc/d14/d2e/dde/da1/c135 0 2024-02-14T13:10:42.473 INFO:tasks.workunit.client.0.smithi012.stdout:2/970: dwrite d0/d6/d37/fdd [4194304,4194304] 0 2024-02-14T13:10:42.473 INFO:tasks.workunit.client.0.smithi012.stdout:2/971: truncate d0/d6/de/d7d/f127 594407 0 2024-02-14T13:10:42.473 INFO:tasks.workunit.client.0.smithi012.stdout:2/972: chown d0/d6/de/d7d/cdf 20 1 2024-02-14T13:10:42.474 INFO:tasks.workunit.client.0.smithi012.stdout:3/868: rename d9/d18/d39/cbf to d9/dcd/c12f 0 2024-02-14T13:10:42.475 INFO:tasks.workunit.client.0.smithi012.stdout:8/907: getdents d9/dc/d14/d2e/dde/da1/dba 0 2024-02-14T13:10:42.481 INFO:tasks.workunit.client.0.smithi012.stdout:2/973: link d0/d6/de/de8/c12e d0/d1a/de4/d50/d68/c14e 0 2024-02-14T13:10:42.481 INFO:tasks.workunit.client.0.smithi012.stdout:2/974: fdatasync d0/d8/d10c/f10b 0 2024-02-14T13:10:42.482 INFO:tasks.workunit.client.0.smithi012.stdout:8/908: creat d9/db9/d128/f136 x:0 0 0 2024-02-14T13:10:42.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/909: symlink d9/dc/d14/d23/ddf/d10c/l137 0 2024-02-14T13:10:42.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/910: dread - d9/dc/d14/d23/ddf/fe7 zero size 2024-02-14T13:10:42.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/911: readlink d9/dc/d14/lf0 0 2024-02-14T13:10:42.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/912: readlink d9/dc/d14/d23/ddf/d10c/l137 0 2024-02-14T13:10:42.483 INFO:tasks.workunit.client.0.smithi012.stdout:8/913: readlink d9/dc/d1b/l45 0 2024-02-14T13:10:42.485 INFO:tasks.workunit.client.0.smithi012.stdout:8/914: mkdir d9/d138 0 2024-02-14T13:10:42.485 INFO:tasks.workunit.client.0.smithi012.stdout:8/915: chown d9/dc/d14/d2e/dde/da3/ded/da5/f10a 659 1 2024-02-14T13:10:42.485 INFO:tasks.workunit.client.0.smithi012.stdout:8/916: mknod d9/dc/d14/d2e/dde/d56/c139 0 2024-02-14T13:10:42.486 INFO:tasks.workunit.client.0.smithi012.stdout:8/917: read - d9/dc/d38/d6a/f12a zero size 2024-02-14T13:10:42.487 INFO:tasks.workunit.client.0.smithi012.stdout:8/918: symlink d9/dc/d38/l13a 0 2024-02-14T13:10:42.487 INFO:tasks.workunit.client.0.smithi012.stdout:8/919: creat d9/db9/d128/f13b x:0 0 0 2024-02-14T13:10:42.487 INFO:tasks.workunit.client.0.smithi012.stdout:8/920: fsync d9/dc/d14/d2e/dde/da3/de9/f10f 0 2024-02-14T13:10:42.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:42 smithi103 ceph-mon[36921]: pgmap v407: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 164 MiB/s wr, 1.28k op/s 2024-02-14T13:10:42.491 INFO:tasks.workunit.client.0.smithi012.stdout:4/853: sync 2024-02-14T13:10:42.493 INFO:tasks.workunit.client.0.smithi012.stdout:4/854: mkdir d0/de1/de8/dd9/ddc/d138 0 2024-02-14T13:10:42.495 INFO:tasks.workunit.client.0.smithi012.stdout:4/855: creat d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/f139 x:0 0 0 2024-02-14T13:10:42.495 INFO:tasks.workunit.client.0.smithi012.stdout:4/856: chown d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fb2 662898 1 2024-02-14T13:10:42.496 INFO:tasks.workunit.client.0.smithi012.stdout:4/857: rename d0/d10/d28/d4f/d6b/d8f/d56/df7/f135 to d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f13a 0 2024-02-14T13:10:42.497 INFO:tasks.workunit.client.0.smithi012.stdout:4/858: chown d0/d10/d28/d4f/d6b/d8f/d56/ff4 38 1 2024-02-14T13:10:42.497 INFO:tasks.workunit.client.0.smithi012.stdout:4/859: dread - d0/d10/d1f/f124 zero size 2024-02-14T13:10:42.498 INFO:tasks.workunit.client.0.smithi012.stdout:1/887: dwrite d6/d10/d22/d44/dbb/d101/f107 [0,4194304] 0 2024-02-14T13:10:42.500 INFO:tasks.workunit.client.0.smithi012.stdout:1/888: write d6/d10/df0/f67 [1259534,115273] 0 2024-02-14T13:10:42.501 INFO:tasks.workunit.client.0.smithi012.stdout:1/889: mknod d6/d10/d22/d31/d34/da0/c110 0 2024-02-14T13:10:42.506 INFO:tasks.workunit.client.0.smithi012.stdout:4/860: write d0/f5c [35333,62008] 0 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:7/784: dwrite df/d2d/d5d/d72/f77 [0,4194304] 0 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/869: dwrite d9/d13/dea/d103/f90 [0,4194304] 0 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/870: chown d9/d3f/dac/cd3 31 1 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/871: fsync d9/dd/d30/d44/f4b 0 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/872: write d9/d13/f20 [3427155,116168] 0 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:3/873: fdatasync d9/dd/d10d/f119 0 2024-02-14T13:10:42.507 INFO:tasks.workunit.client.0.smithi012.stdout:2/975: dwrite d0/d8/d11/d33/d53/d110/d57/d6d/fe1 [0,4194304] 0 2024-02-14T13:10:42.508 INFO:tasks.workunit.client.0.smithi012.stdout:2/976: read d0/d1a/de4/d39/fda [2792872,88281] 0 2024-02-14T13:10:42.510 INFO:tasks.workunit.client.0.smithi012.stdout:4/861: write d0/d10/feb [1510634,57774] 0 2024-02-14T13:10:42.510 INFO:tasks.workunit.client.0.smithi012.stdout:3/874: symlink d9/d18/d39/df7/l130 0 2024-02-14T13:10:42.510 INFO:tasks.workunit.client.0.smithi012.stdout:3/875: chown d9/dd/lad 1888397 1 2024-02-14T13:10:42.511 INFO:tasks.workunit.client.0.smithi012.stdout:2/977: mknod d0/d8/d11/d35/dd0/d70/c14f 0 2024-02-14T13:10:42.511 INFO:tasks.workunit.client.0.smithi012.stdout:2/978: fdatasync d0/d6/d37/fff 0 2024-02-14T13:10:42.511 INFO:tasks.workunit.client.0.smithi012.stdout:4/862: creat d0/de1/d12b/f13b x:0 0 0 2024-02-14T13:10:42.513 INFO:tasks.workunit.client.0.smithi012.stdout:4/863: dread d0/d10/d28/d4f/d6b/d8f/d56/d8c/f9d [0,4194304] 0 2024-02-14T13:10:42.513 INFO:tasks.workunit.client.0.smithi012.stdout:2/979: mkdir d0/d6/de/d7b/da8/d150 0 2024-02-14T13:10:42.514 INFO:tasks.workunit.client.0.smithi012.stdout:4/864: mkdir d0/de1/de8/dd9/ddc/d138/d13c 0 2024-02-14T13:10:42.515 INFO:tasks.workunit.client.0.smithi012.stdout:8/921: dwrite d9/fbf [4194304,4194304] 0 2024-02-14T13:10:42.515 INFO:tasks.workunit.client.0.smithi012.stdout:2/980: creat d0/f151 x:0 0 0 2024-02-14T13:10:42.515 INFO:tasks.workunit.client.0.smithi012.stdout:2/981: chown d0/d8/d11/d33/d53/d110/d57/f78 240 1 2024-02-14T13:10:42.520 INFO:tasks.workunit.client.0.smithi012.stdout:1/890: dwrite d6/d10/d22/d31/d5b/d5d/f1a [0,4194304] 0 2024-02-14T13:10:42.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/891: write d6/d10/d22/d31/d34/fbe [3835205,75200] 0 2024-02-14T13:10:42.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/892: write d6/d10/d22/d31/d3e/d71/fe8 [3940649,42460] 0 2024-02-14T13:10:42.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/893: write d6/d10/f99 [4640433,25014] 0 2024-02-14T13:10:42.521 INFO:tasks.workunit.client.0.smithi012.stdout:1/894: chown d6/d10/d22/d31/d5b/d5e/d65/db4/fed 10188202 1 2024-02-14T13:10:42.524 INFO:tasks.workunit.client.0.smithi012.stdout:4/865: read d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/fe9 [1334950,76211] 0 2024-02-14T13:10:42.525 INFO:tasks.workunit.client.0.smithi012.stdout:8/922: creat d9/dc/d14/d2e/dde/da3/ded/dd5/f13c x:0 0 0 2024-02-14T13:10:42.525 INFO:tasks.workunit.client.0.smithi012.stdout:8/923: readlink d9/dc/d14/d23/l2a 0 2024-02-14T13:10:42.526 INFO:tasks.workunit.client.0.smithi012.stdout:2/982: creat d0/d8/d11/d35/dd0/f152 x:0 0 0 2024-02-14T13:10:42.526 INFO:tasks.workunit.client.0.smithi012.stdout:2/983: fsync d0/d6/d37/d84/d51/f73 0 2024-02-14T13:10:42.530 INFO:tasks.workunit.client.0.smithi012.stdout:7/785: dwrite df/f30 [0,4194304] 0 2024-02-14T13:10:42.532 INFO:tasks.workunit.client.0.smithi012.stdout:8/924: creat d9/dc/d38/d6a/df2/f13d x:0 0 0 2024-02-14T13:10:42.534 INFO:tasks.workunit.client.0.smithi012.stdout:3/876: dwrite d9/dd/d30/fca [0,4194304] 0 2024-02-14T13:10:42.535 INFO:tasks.workunit.client.0.smithi012.stdout:2/984: truncate d0/d8/d11/d33/d53/d110/d57/f66 981416 0 2024-02-14T13:10:42.535 INFO:tasks.workunit.client.0.smithi012.stdout:2/985: write d0/d8/d11/f17 [2277273,41731] 0 2024-02-14T13:10:42.535 INFO:tasks.workunit.client.0.smithi012.stdout:2/986: rename d0/d8/d11/d33 to d0/d8/d11/d33/d5c/d153 22 2024-02-14T13:10:42.536 INFO:tasks.workunit.client.0.smithi012.stdout:8/925: mkdir d9/dc/d14/d2e/dde/da1/d13e 0 2024-02-14T13:10:42.538 INFO:tasks.workunit.client.0.smithi012.stdout:6/836: sync 2024-02-14T13:10:42.539 INFO:tasks.workunit.client.0.smithi012.stdout:5/929: sync 2024-02-14T13:10:42.539 INFO:tasks.workunit.client.0.smithi012.stdout:9/970: sync 2024-02-14T13:10:42.539 INFO:tasks.workunit.client.0.smithi012.stdout:5/930: write dc/d47/d69/feb [480809,64846] 0 2024-02-14T13:10:42.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/877: mkdir d9/dc4/d131 0 2024-02-14T13:10:42.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/878: fdatasync d9/dcd/fdb 0 2024-02-14T13:10:42.539 INFO:tasks.workunit.client.0.smithi012.stdout:3/879: write d9/d3f/f4c [2027332,94103] 0 2024-02-14T13:10:42.540 INFO:tasks.workunit.client.0.smithi012.stdout:6/837: link d1/d1e/d1b/f87 d1/df/d24/d5f/f10b 0 2024-02-14T13:10:42.540 INFO:tasks.workunit.client.0.smithi012.stdout:6/838: stat d1/d1e/dc/d43 0 2024-02-14T13:10:42.540 INFO:tasks.workunit.client.0.smithi012.stdout:6/839: dread - d1/df/d50/f10a zero size 2024-02-14T13:10:42.541 INFO:tasks.workunit.client.0.smithi012.stdout:9/971: truncate da/d33/d63/f8a 1735231 0 2024-02-14T13:10:42.542 INFO:tasks.workunit.client.0.smithi012.stdout:5/931: creat dc/d17/d20/d4c/d7b/dfa/de7/f123 x:0 0 0 2024-02-14T13:10:42.544 INFO:tasks.workunit.client.0.smithi012.stdout:3/880: truncate d9/d18/d39/f114 1626935 0 2024-02-14T13:10:42.545 INFO:tasks.workunit.client.0.smithi012.stdout:5/932: creat dc/d2f/d40/f124 x:0 0 0 2024-02-14T13:10:42.547 INFO:tasks.workunit.client.0.smithi012.stdout:1/895: dwrite d6/d10/d22/d31/d5b/d5e/d3d/f51 [0,4194304] 0 2024-02-14T13:10:42.547 INFO:tasks.workunit.client.0.smithi012.stdout:4/866: dwrite d0/d10/d28/da9/fd3 [0,4194304] 0 2024-02-14T13:10:42.547 INFO:tasks.workunit.client.0.smithi012.stdout:1/896: write d6/d10/d22/d44/dbb/d101/faa [722827,103068] 0 2024-02-14T13:10:42.547 INFO:tasks.workunit.client.0.smithi012.stdout:3/881: creat d9/d3f/dac/dfb/f132 x:0 0 0 2024-02-14T13:10:42.549 INFO:tasks.workunit.client.0.smithi012.stdout:5/933: mknod dc/d17/d20/d4c/d63/dab/c125 0 2024-02-14T13:10:42.553 INFO:tasks.workunit.client.0.smithi012.stdout:9/972: dread da/dd/d19/df3/d85/d48/fde [0,4194304] 0 2024-02-14T13:10:42.553 INFO:tasks.workunit.client.0.smithi012.stdout:9/973: chown da/dd/d19/fad 0 1 2024-02-14T13:10:42.555 INFO:tasks.workunit.client.0.smithi012.stdout:4/867: unlink d0/d10/d28/fd4 0 2024-02-14T13:10:42.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:42 smithi055 ceph-mon[36853]: pgmap v407: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 164 MiB/s wr, 1.28k op/s 2024-02-14T13:10:42.560 INFO:tasks.workunit.client.0.smithi012.stdout:6/840: dread d1/df/d24/f40 [0,4194304] 0 2024-02-14T13:10:42.564 INFO:tasks.workunit.client.0.smithi012.stdout:2/987: dwrite d0/d1a/de4/d50/fac [0,4194304] 0 2024-02-14T13:10:42.564 INFO:tasks.workunit.client.0.smithi012.stdout:2/988: fdatasync d0/d6/d37/f13b 0 2024-02-14T13:10:42.564 INFO:tasks.workunit.client.0.smithi012.stdout:5/934: creat dc/d2f/d40/d53/f126 x:0 0 0 2024-02-14T13:10:42.566 INFO:tasks.workunit.client.0.smithi012.stdout:6/841: creat d1/d1e/d1b/d21/f10c x:0 0 0 2024-02-14T13:10:42.567 INFO:tasks.workunit.client.0.smithi012.stdout:8/926: dwrite d9/dc/d14/d2e/dde/da3/de9/fd9 [0,4194304] 0 2024-02-14T13:10:42.570 INFO:tasks.workunit.client.0.smithi012.stdout:2/989: creat d0/d8/d11/d33/d63/f154 x:0 0 0 2024-02-14T13:10:42.570 INFO:tasks.workunit.client.0.smithi012.stdout:2/990: readlink d0/d8/d11/d33/d53/d110/la6 0 2024-02-14T13:10:42.570 INFO:tasks.workunit.client.0.smithi012.stdout:2/991: dread - d0/d8/d11/d35/dd0/f146 zero size 2024-02-14T13:10:42.572 INFO:tasks.workunit.client.0.smithi012.stdout:5/935: creat dc/d2f/d40/d53/f127 x:0 0 0 2024-02-14T13:10:42.572 INFO:tasks.workunit.client.0.smithi012.stdout:5/936: fdatasync dc/d2f/d40/d53/f127 0 2024-02-14T13:10:42.572 INFO:tasks.workunit.client.0.smithi012.stdout:6/842: rmdir d1/df/d16/d7c/dfe 39 2024-02-14T13:10:42.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/927: creat d9/dc/d14/d2e/dde/da3/de9/f13f x:0 0 0 2024-02-14T13:10:42.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/928: dread - d9/dc/d14/d2e/dde/fd1 zero size 2024-02-14T13:10:42.575 INFO:tasks.workunit.client.0.smithi012.stdout:8/929: fdatasync d9/dc/d14/d2e/ff8 0 2024-02-14T13:10:42.576 INFO:tasks.workunit.client.0.smithi012.stdout:2/992: mkdir d0/d6/d37/da5/d155 0 2024-02-14T13:10:42.578 INFO:tasks.workunit.client.0.smithi012.stdout:5/937: symlink dc/d2f/d40/d53/d97/d98/l128 0 2024-02-14T13:10:42.581 INFO:tasks.workunit.client.0.smithi012.stdout:2/993: mkdir d0/d8/d11/d35/dd0/df0/d156 0 2024-02-14T13:10:42.582 INFO:tasks.workunit.client.0.smithi012.stdout:3/882: dwrite d9/d3f/d73/f86 [0,4194304] 0 2024-02-14T13:10:42.582 INFO:tasks.workunit.client.0.smithi012.stdout:5/938: creat dc/d17/d20/d4c/d7b/dfa/de7/f129 x:0 0 0 2024-02-14T13:10:42.584 INFO:tasks.workunit.client.0.smithi012.stdout:2/994: creat d0/d8/d9/d90/dab/f157 x:0 0 0 2024-02-14T13:10:42.584 INFO:tasks.workunit.client.0.smithi012.stdout:2/995: stat d0/d2d/f99 0 2024-02-14T13:10:42.586 INFO:tasks.workunit.client.0.smithi012.stdout:3/883: stat d9/d3f/d73/c106 0 2024-02-14T13:10:42.587 INFO:tasks.workunit.client.0.smithi012.stdout:9/974: dwrite da/faa [0,4194304] 0 2024-02-14T13:10:42.587 INFO:tasks.workunit.client.0.smithi012.stdout:1/897: dwrite d6/fd [0,4194304] 0 2024-02-14T13:10:42.587 INFO:tasks.workunit.client.0.smithi012.stdout:1/898: write d6/d10/f99 [1471639,115533] 0 2024-02-14T13:10:42.587 INFO:tasks.workunit.client.0.smithi012.stdout:1/899: write d6/d10/d22/d31/d3e/d71/fd6 [695167,104447] 0 2024-02-14T13:10:42.588 INFO:tasks.workunit.client.0.smithi012.stdout:4/868: dwrite d0/d10/d28/d4f/d6b/d8f/d56/fad [0,4194304] 0 2024-02-14T13:10:42.589 INFO:tasks.workunit.client.0.smithi012.stdout:5/939: truncate dc/d2f/d70/d78/f120 3735402 0 2024-02-14T13:10:42.590 INFO:tasks.workunit.client.0.smithi012.stdout:2/996: creat d0/d1a/de4/d50/d68/d9c/dfa/f158 x:0 0 0 2024-02-14T13:10:42.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/884: mkdir d9/dd/d30/d44/d66/db3/dee/d133 0 2024-02-14T13:10:42.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/885: truncate d9/dd/d30/d44/d66/db3/f110 4997031 0 2024-02-14T13:10:42.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/886: fsync d9/d18/d39/df7/ffd 0 2024-02-14T13:10:42.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/887: stat d9/dd/f17 0 2024-02-14T13:10:42.592 INFO:tasks.workunit.client.0.smithi012.stdout:3/888: write d9/d3f/dac/dfb/f132 [960263,55671] 0 2024-02-14T13:10:42.594 INFO:tasks.workunit.client.0.smithi012.stdout:1/900: dread d6/d10/d22/d31/fdd [0,4194304] 0 2024-02-14T13:10:42.594 INFO:tasks.workunit.client.0.smithi012.stdout:1/901: fdatasync d6/fd 0 2024-02-14T13:10:42.595 INFO:tasks.workunit.client.0.smithi012.stdout:5/940: truncate f6 2235337 0 2024-02-14T13:10:42.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/843: dwrite d1/df/fd6 [0,4194304] 0 2024-02-14T13:10:42.597 INFO:tasks.workunit.client.0.smithi012.stdout:6/844: chown d1/d1e 2517 1 2024-02-14T13:10:42.597 INFO:tasks.workunit.client.0.smithi012.stdout:2/997: mkdir d0/d8/d11/d33/dc3/d111/d159 0 2024-02-14T13:10:42.599 INFO:tasks.workunit.client.0.smithi012.stdout:3/889: creat d9/dd/de/d58/d65/f134 x:0 0 0 2024-02-14T13:10:42.599 INFO:tasks.workunit.client.0.smithi012.stdout:3/890: fdatasync d9/d3f/d4e/f5a 0 2024-02-14T13:10:42.599 INFO:tasks.workunit.client.0.smithi012.stdout:8/930: rmdir d9/dc/d14/d2e/dde 39 2024-02-14T13:10:42.600 INFO:tasks.workunit.client.0.smithi012.stdout:5/941: dread dc/d17/d20/d4c/f51 [0,4194304] 0 2024-02-14T13:10:42.600 INFO:tasks.workunit.client.0.smithi012.stdout:5/942: read dc/d2f/d3e/fde [1752438,124805] 0 2024-02-14T13:10:42.601 INFO:tasks.workunit.client.0.smithi012.stdout:1/902: symlink d6/d10/d22/d31/d5b/d5e/d65/dec/l111 0 2024-02-14T13:10:42.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/869: dwrite d0/d10/d28/d4f/d6b/d83/d99/fa3 [0,4194304] 0 2024-02-14T13:10:42.606 INFO:tasks.workunit.client.0.smithi012.stdout:4/870: chown d0/d10/d28/d4f/d6b/d83/f16 1458337846 1 2024-02-14T13:10:42.607 INFO:tasks.workunit.client.0.smithi012.stdout:6/845: rmdir d1/dc0 39 2024-02-14T13:10:42.609 INFO:tasks.workunit.client.0.smithi012.stdout:2/998: link d0/d8/d11/d33/d53/d6b/d123/f12f d0/d8/d9/d90/f15a 0 2024-02-14T13:10:42.609 INFO:tasks.workunit.client.0.smithi012.stdout:2/999: truncate d0/d8/d11/d35/dd0/df0/d148/fca 357528 0 2024-02-14T13:10:42.610 INFO:tasks.workunit.client.0.smithi012.stdout:8/931: symlink d9/dc/d14/d2e/dde/da1/l140 0 2024-02-14T13:10:42.610 INFO:tasks.workunit.client.0.smithi012.stdout:8/932: write d9/db9/fcd [843887,65827] 0 2024-02-14T13:10:42.611 INFO:tasks.workunit.client.0.smithi012.stdout:8/933: stat d9/dc/d14/d2e/dde/da3/ded/f8a 0 2024-02-14T13:10:42.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/871: truncate d0/f68 1378433 0 2024-02-14T13:10:42.615 INFO:tasks.workunit.client.0.smithi012.stdout:4/872: fdatasync d0/d10/d28/d4f/d6b/d8f/f48 0 2024-02-14T13:10:42.616 INFO:tasks.workunit.client.0.smithi012.stdout:6/846: link d1/d1e/dc/ff1 d1/d1e/d1b/d21/d78/f10d 0 2024-02-14T13:10:42.618 INFO:tasks.workunit.client.0.smithi012.stdout:8/934: creat d9/dc/d14/d2e/dde/da1/d13e/f141 x:0 0 0 2024-02-14T13:10:42.618 INFO:tasks.workunit.client.0.smithi012.stdout:8/935: fdatasync d9/dc/d1b/f27 0 2024-02-14T13:10:42.620 INFO:tasks.workunit.client.0.smithi012.stdout:3/891: dwrite d9/dd/d30/d44/d66/dd0/ffa [0,4194304] 0 2024-02-14T13:10:42.620 INFO:tasks.workunit.client.0.smithi012.stdout:3/892: fsync d9/d3f/fa2 0 2024-02-14T13:10:42.620 INFO:tasks.workunit.client.0.smithi012.stdout:3/893: fdatasync d9/d3f/dac/dfb/f112 0 2024-02-14T13:10:42.621 INFO:tasks.workunit.client.0.smithi012.stdout:6/847: rename d1/df/d50/ld7 to d1/d1e/d1b/db8/l10e 0 2024-02-14T13:10:42.622 INFO:tasks.workunit.client.0.smithi012.stdout:8/936: mknod d9/dc/d14/d23/ddf/d10c/c142 0 2024-02-14T13:10:42.622 INFO:tasks.workunit.client.0.smithi012.stdout:1/903: truncate d6/fd 1702663 0 2024-02-14T13:10:42.623 INFO:tasks.workunit.client.0.smithi012.stdout:1/904: write d6/d10/d22/d31/d34/d58/ffe [863153,103265] 0 2024-02-14T13:10:42.623 INFO:tasks.workunit.client.0.smithi012.stdout:1/905: dread d6/d10/d22/d31/d5b/d5d/fa1 [0,4194304] 0 2024-02-14T13:10:42.623 INFO:tasks.workunit.client.0.smithi012.stdout:3/894: creat d9/dd/d30/d44/d66/dd0/f135 x:0 0 0 2024-02-14T13:10:42.624 INFO:tasks.workunit.client.0.smithi012.stdout:3/895: truncate d9/d13/dea/d103/fcf 1025388 0 2024-02-14T13:10:42.625 INFO:tasks.workunit.client.0.smithi012.stdout:6/848: rename d1/d1e/d1b/d21/f32 to d1/d1e/dc/f10f 0 2024-02-14T13:10:42.626 INFO:tasks.workunit.client.0.smithi012.stdout:4/873: dread d0/de1/fef [0,4194304] 0 2024-02-14T13:10:42.626 INFO:tasks.workunit.client.0.smithi012.stdout:8/937: creat d9/dc/d14/d23/ddf/d134/f143 x:0 0 0 2024-02-14T13:10:42.626 INFO:tasks.workunit.client.0.smithi012.stdout:8/938: fsync d9/dc/d14/fbc 0 2024-02-14T13:10:42.628 INFO:tasks.workunit.client.0.smithi012.stdout:6/849: rename d1/df/d24/d3f/d56/d102 to d1/d110 0 2024-02-14T13:10:42.629 INFO:tasks.workunit.client.0.smithi012.stdout:5/943: dwrite dc/d17/d20/d4c/d58/dda/ff4 [0,4194304] 0 2024-02-14T13:10:42.629 INFO:tasks.workunit.client.0.smithi012.stdout:5/944: read dc/d17/d20/d4c/f51 [233191,130880] 0 2024-02-14T13:10:42.630 INFO:tasks.workunit.client.0.smithi012.stdout:8/939: creat d9/dc/d14/f144 x:0 0 0 2024-02-14T13:10:42.634 INFO:tasks.workunit.client.0.smithi012.stdout:6/850: dread d1/d1e/d1b/d21/f35 [0,4194304] 0 2024-02-14T13:10:42.634 INFO:tasks.workunit.client.0.smithi012.stdout:6/851: fdatasync d1/df/d24/d3f/d56/d93/fc6 0 2024-02-14T13:10:42.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/940: mkdir d9/dc/d14/d11f/d145 0 2024-02-14T13:10:42.638 INFO:tasks.workunit.client.0.smithi012.stdout:8/941: chown d9/dc/d38/d6a 1 1 2024-02-14T13:10:42.639 INFO:tasks.workunit.client.0.smithi012.stdout:8/942: dread - d9/dc/d14/d2e/dde/da1/dba/f105 zero size 2024-02-14T13:10:42.639 INFO:tasks.workunit.client.0.smithi012.stdout:7/786: sync 2024-02-14T13:10:42.639 INFO:tasks.workunit.client.0.smithi012.stdout:7/787: write df/d27/d4b/f8f [4948605,31398] 0 2024-02-14T13:10:42.641 INFO:tasks.workunit.client.0.smithi012.stdout:6/852: rename d1/df/d24/daf to d1/d1e/d1b/d111 0 2024-02-14T13:10:42.641 INFO:tasks.workunit.client.0.smithi012.stdout:5/945: write dc/d17/d20/f64 [1105865,116973] 0 2024-02-14T13:10:42.642 INFO:tasks.workunit.client.0.smithi012.stdout:6/853: rmdir d1/dc0 39 2024-02-14T13:10:42.647 INFO:tasks.workunit.client.0.smithi012.stdout:6/854: dread d1/d1e/dc/d43/d75/f92 [0,4194304] 0 2024-02-14T13:10:42.649 INFO:tasks.workunit.client.0.smithi012.stdout:6/855: mkdir d1/df/d16/d7c/d112 0 2024-02-14T13:10:42.649 INFO:tasks.workunit.client.0.smithi012.stdout:1/906: dwrite d6/d10/d22/d31/d5b/d5d/f1a [0,4194304] 0 2024-02-14T13:10:42.651 INFO:tasks.workunit.client.0.smithi012.stdout:6/856: rmdir d1/df/d50 39 2024-02-14T13:10:42.653 INFO:tasks.workunit.client.0.smithi012.stdout:7/788: write df/f20 [4738300,18286] 0 2024-02-14T13:10:42.654 INFO:tasks.workunit.client.0.smithi012.stdout:1/907: creat d6/d10/d22/d31/d3e/d71/f112 x:0 0 0 2024-02-14T13:10:42.654 INFO:tasks.workunit.client.0.smithi012.stdout:1/908: chown d6/d10/d22/d44/dbb/lcb 12868937 1 2024-02-14T13:10:42.654 INFO:tasks.workunit.client.0.smithi012.stdout:6/857: truncate d1/fb3 3896060 0 2024-02-14T13:10:42.654 INFO:tasks.workunit.client.0.smithi012.stdout:6/858: stat d1/d1e/d1b/f57 0 2024-02-14T13:10:42.655 INFO:tasks.workunit.client.0.smithi012.stdout:4/874: dwrite d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/f127 [0,4194304] 0 2024-02-14T13:10:42.656 INFO:tasks.workunit.client.0.smithi012.stdout:6/859: getdents d1/df/d16/d7c/d97 0 2024-02-14T13:10:42.658 INFO:tasks.workunit.client.0.smithi012.stdout:8/943: write d9/dc/d14/d2e/dde/d56/d57/f6e [4776827,29976] 0 2024-02-14T13:10:42.658 INFO:tasks.workunit.client.0.smithi012.stdout:1/909: dread d6/d10/d22/d31/d5b/d5e/d65/d87/f97 [0,4194304] 0 2024-02-14T13:10:42.659 INFO:tasks.workunit.client.0.smithi012.stdout:4/875: creat d0/d10/d28/d4f/dc7/f13d x:0 0 0 2024-02-14T13:10:42.659 INFO:tasks.workunit.client.0.smithi012.stdout:4/876: write d0/f68 [1690540,11561] 0 2024-02-14T13:10:42.660 INFO:tasks.workunit.client.0.smithi012.stdout:8/944: dread d9/db9/fcd [0,4194304] 0 2024-02-14T13:10:42.662 INFO:tasks.workunit.client.0.smithi012.stdout:6/860: link d1/df/d24/d3f/d56/le6 d1/d1e/dc/d43/l113 0 2024-02-14T13:10:42.662 INFO:tasks.workunit.client.0.smithi012.stdout:5/946: dwrite dc/d2f/d89/f110 [0,4194304] 0 2024-02-14T13:10:42.664 INFO:tasks.workunit.client.0.smithi012.stdout:1/910: mknod d6/d10/d22/d31/d5b/d5d/d6d/c113 0 2024-02-14T13:10:42.664 INFO:tasks.workunit.client.0.smithi012.stdout:1/911: read - d6/d10/d22/d31/d3e/d10d/fee zero size 2024-02-14T13:10:42.665 INFO:tasks.workunit.client.0.smithi012.stdout:4/877: mknod d0/d10/d28/d4f/dc7/dfb/c13e 0 2024-02-14T13:10:42.666 INFO:tasks.workunit.client.0.smithi012.stdout:6/861: getdents d1/d1e 0 2024-02-14T13:10:42.668 INFO:tasks.workunit.client.0.smithi012.stdout:5/947: creat dc/d47/d6e/f12a x:0 0 0 2024-02-14T13:10:42.669 INFO:tasks.workunit.client.0.smithi012.stdout:6/862: dread d1/df/d24/f8f [0,4194304] 0 2024-02-14T13:10:42.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/948: write f5 [2027940,102647] 0 2024-02-14T13:10:42.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/949: chown dc/d17/f67 144592492 1 2024-02-14T13:10:42.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/950: write dc/d17/d20/f35 [746888,106625] 0 2024-02-14T13:10:42.670 INFO:tasks.workunit.client.0.smithi012.stdout:5/951: dread - dc/d47/d6e/f12a zero size 2024-02-14T13:10:42.670 INFO:tasks.workunit.client.0.smithi012.stdout:1/912: mknod d6/d10/d22/d31/d5b/d5d/d80/c114 0 2024-02-14T13:10:42.670 INFO:tasks.workunit.client.0.smithi012.stdout:4/878: creat d0/d10/d28/d4f/d6b/d8f/f13f x:0 0 0 2024-02-14T13:10:42.671 INFO:tasks.workunit.client.0.smithi012.stdout:4/879: truncate d0/d10/d28/d4f/d6b/d8f/f88 544693 0 2024-02-14T13:10:42.672 INFO:tasks.workunit.client.0.smithi012.stdout:5/952: rename dc/d17/d20/f37 to dc/d2f/d40/d53/d97/d98/f12b 0 2024-02-14T13:10:42.673 INFO:tasks.workunit.client.0.smithi012.stdout:5/953: mknod dc/d17/d20/d4c/c12c 0 2024-02-14T13:10:42.674 INFO:tasks.workunit.client.0.smithi012.stdout:5/954: symlink dc/d17/ded/de5/l12d 0 2024-02-14T13:10:42.674 INFO:tasks.workunit.client.0.smithi012.stdout:5/955: truncate dc/d17/d20/d4c/fef 881025 0 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/956: creat dc/d2f/d70/d11d/f12e x:0 0 0 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/957: fdatasync dc/d2f/d40/d53/f126 0 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/958: fsync dc/d17/d20/d4c/ff3 0 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/959: readlink dc/l18 0 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/960: chown dc/d17/d20/d4c/d7b/dfa/de7/le8 0 1 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/961: dread - dc/d2f/d70/d78/dc4/f10b zero size 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/962: write dc/d47/d6e/f12a [210133,62684] 0 2024-02-14T13:10:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:5/963: fsync dc/d2f/d40/f45 0 2024-02-14T13:10:42.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/964: creat dc/d17/ded/f12f x:0 0 0 2024-02-14T13:10:42.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/965: fdatasync dc/d17/d20/d4c/d63/d81/f108 0 2024-02-14T13:10:42.677 INFO:tasks.workunit.client.0.smithi012.stdout:5/966: chown dc/d47/fa8 0 1 2024-02-14T13:10:42.678 INFO:tasks.workunit.client.0.smithi012.stdout:7/789: dwrite df/d36/d67/fa7 [4194304,4194304] 0 2024-02-14T13:10:42.678 INFO:tasks.workunit.client.0.smithi012.stdout:7/790: readlink df/d2d/d82/d88/d90/l104 0 2024-02-14T13:10:42.678 INFO:tasks.workunit.client.0.smithi012.stdout:8/945: dwrite d9/dc/d38/d6a/f79 [4194304,4194304] 0 2024-02-14T13:10:42.678 INFO:tasks.workunit.client.0.smithi012.stdout:5/967: symlink dc/d2f/d70/d78/l130 0 2024-02-14T13:10:42.679 INFO:tasks.workunit.client.0.smithi012.stdout:8/946: creat d9/db9/f146 x:0 0 0 2024-02-14T13:10:42.679 INFO:tasks.workunit.client.0.smithi012.stdout:4/880: dread d0/d10/d28/da9/d86/db5/fc9 [0,4194304] 0 2024-02-14T13:10:42.679 INFO:tasks.workunit.client.0.smithi012.stdout:4/881: fsync d0/d10/d28/d4f/d6b/d83/d99/f113 0 2024-02-14T13:10:42.680 INFO:tasks.workunit.client.0.smithi012.stdout:5/968: truncate dc/d17/d20/d4c/d58/dda/ff4 3513747 0 2024-02-14T13:10:42.680 INFO:tasks.workunit.client.0.smithi012.stdout:5/969: read - dc/d17/d20/d4c/d7b/dfa/de7/f11f zero size 2024-02-14T13:10:42.681 INFO:tasks.workunit.client.0.smithi012.stdout:5/970: symlink dc/d17/d4b/l131 0 2024-02-14T13:10:42.683 INFO:tasks.workunit.client.0.smithi012.stdout:5/971: creat dc/d2f/d70/d78/f132 x:0 0 0 2024-02-14T13:10:42.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/972: getdents dc/d2f/d40/d53 0 2024-02-14T13:10:42.685 INFO:tasks.workunit.client.0.smithi012.stdout:5/973: dread - dc/d2f/d3e/fb9 zero size 2024-02-14T13:10:42.687 INFO:tasks.workunit.client.0.smithi012.stdout:5/974: mknod dc/d17/d20/c133 0 2024-02-14T13:10:42.688 INFO:tasks.workunit.client.0.smithi012.stdout:6/863: dwrite d1/df/d16/d7c/d97/d82/f9c [0,4194304] 0 2024-02-14T13:10:42.688 INFO:tasks.workunit.client.0.smithi012.stdout:6/864: truncate d1/d1e/d1b/d6d/ff9 1567497 0 2024-02-14T13:10:42.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/791: write df/f40 [1642955,41801] 0 2024-02-14T13:10:42.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/792: read df/d2d/f3e [457143,105989] 0 2024-02-14T13:10:42.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/793: truncate df/d27/d4b/d6b/fa5 990612 0 2024-02-14T13:10:42.691 INFO:tasks.workunit.client.0.smithi012.stdout:7/794: rmdir df/d24/d9e/df0 39 2024-02-14T13:10:42.694 INFO:tasks.workunit.client.0.smithi012.stdout:1/913: dwrite d6/fd [0,4194304] 0 2024-02-14T13:10:42.694 INFO:tasks.workunit.client.0.smithi012.stdout:1/914: fdatasync d6/d10/d22/d31/d34/fb0 0 2024-02-14T13:10:42.694 INFO:tasks.workunit.client.0.smithi012.stdout:7/795: rename df/l13 to df/d27/d4b/d6b/d6d/l10e 0 2024-02-14T13:10:42.698 INFO:tasks.workunit.client.0.smithi012.stdout:6/865: dread d1/df/d24/d5f/da0/fc1 [0,4194304] 0 2024-02-14T13:10:42.703 INFO:tasks.workunit.client.0.smithi012.stdout:5/975: write dc/d17/d20/f3a [1575529,39506] 0 2024-02-14T13:10:42.705 INFO:tasks.workunit.client.0.smithi012.stdout:5/976: mknod dc/d2f/d40/d53/c134 0 2024-02-14T13:10:42.705 INFO:tasks.workunit.client.0.smithi012.stdout:5/977: fdatasync dc/d2f/d70/d78/f120 0 2024-02-14T13:10:42.705 INFO:tasks.workunit.client.0.smithi012.stdout:5/978: chown dc/d2f/d40/d53/c5b 282 1 2024-02-14T13:10:42.706 INFO:tasks.workunit.client.0.smithi012.stdout:6/866: dread d1/d1e/dc/d28/f4d [0,4194304] 0 2024-02-14T13:10:42.706 INFO:tasks.workunit.client.0.smithi012.stdout:6/867: chown d1/df/d24/d5f/da0 1415 1 2024-02-14T13:10:42.707 INFO:tasks.workunit.client.0.smithi012.stdout:5/979: rename dc/d17/d20/d4c/d7b/dfa/de7/c119 to dc/d2f/d40/d53/d97/c135 0 2024-02-14T13:10:42.707 INFO:tasks.workunit.client.0.smithi012.stdout:5/980: write dc/d2f/d70/d78/f116 [630564,72394] 0 2024-02-14T13:10:42.708 INFO:tasks.workunit.client.0.smithi012.stdout:6/868: creat d1/d1e/dc/d43/f114 x:0 0 0 2024-02-14T13:10:42.710 INFO:tasks.workunit.client.0.smithi012.stdout:1/915: write d6/d10/d22/d31/d34/f57 [1596965,77865] 0 2024-02-14T13:10:42.710 INFO:tasks.workunit.client.0.smithi012.stdout:8/947: dwrite d9/dc/d38/d6a/f113 [0,4194304] 0 2024-02-14T13:10:42.712 INFO:tasks.workunit.client.0.smithi012.stdout:1/916: symlink d6/d10/df0/l115 0 2024-02-14T13:10:42.713 INFO:tasks.workunit.client.0.smithi012.stdout:1/917: creat d6/d10/d22/d31/d34/d58/f116 x:0 0 0 2024-02-14T13:10:42.713 INFO:tasks.workunit.client.0.smithi012.stdout:1/918: write d6/d10/d22/d31/d3e/fb1 [896061,17852] 0 2024-02-14T13:10:42.715 INFO:tasks.workunit.client.0.smithi012.stdout:4/882: dwrite d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f11d [0,4194304] 0 2024-02-14T13:10:42.715 INFO:tasks.workunit.client.0.smithi012.stdout:1/919: unlink d6/d10/d22/d31/d5b/d5e/d65/f105 0 2024-02-14T13:10:42.715 INFO:tasks.workunit.client.0.smithi012.stdout:1/920: chown d6/d10/d22/d31/d3e/d71 1 1 2024-02-14T13:10:42.716 INFO:tasks.workunit.client.0.smithi012.stdout:7/796: dwrite df/d27/d4b/d6b/d6d/d85/db8/fd7 [0,4194304] 0 2024-02-14T13:10:42.717 INFO:tasks.workunit.client.0.smithi012.stdout:8/948: dread d9/dc/f2c [4194304,4194304] 0 2024-02-14T13:10:42.717 INFO:tasks.workunit.client.0.smithi012.stdout:8/949: truncate d9/dc/d1b/f9f 1016811 0 2024-02-14T13:10:42.717 INFO:tasks.workunit.client.0.smithi012.stdout:8/950: chown d9/dc/d14/d23/ddf/fee 41 1 2024-02-14T13:10:42.717 INFO:tasks.workunit.client.0.smithi012.stdout:8/951: read - d9/dc/d14/d2e/dde/d56/d57/dca/feb zero size 2024-02-14T13:10:42.719 INFO:tasks.workunit.client.0.smithi012.stdout:5/981: dread dc/d2f/d89/f8b [4194304,4194304] 0 2024-02-14T13:10:42.726 INFO:tasks.workunit.client.0.smithi012.stdout:7/797: dread df/d2d/d82/d88/fb7 [0,4194304] 0 2024-02-14T13:10:42.727 INFO:tasks.workunit.client.0.smithi012.stdout:4/883: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/dce/c140 0 2024-02-14T13:10:42.727 INFO:tasks.workunit.client.0.smithi012.stdout:5/982: write dc/d17/d20/f2b [2759018,113651] 0 2024-02-14T13:10:42.728 INFO:tasks.workunit.client.0.smithi012.stdout:1/921: unlink d6/d10/d22/d31/d5b/d5e/d3d/f45 0 2024-02-14T13:10:42.731 INFO:tasks.workunit.client.0.smithi012.stdout:7/798: dread df/d27/d4b/d8d/fa0 [0,4194304] 0 2024-02-14T13:10:42.733 INFO:tasks.workunit.client.0.smithi012.stdout:5/983: mknod dc/d17/d20/d4c/d58/c136 0 2024-02-14T13:10:42.735 INFO:tasks.workunit.client.0.smithi012.stdout:1/922: unlink d6/d10/d22/d31/d34/d89/cdb 0 2024-02-14T13:10:42.735 INFO:tasks.workunit.client.0.smithi012.stdout:1/923: fdatasync d6/d10/d22/d31/d34/d58/f10e 0 2024-02-14T13:10:42.735 INFO:tasks.workunit.client.0.smithi012.stdout:4/884: mknod d0/c141 0 2024-02-14T13:10:42.735 INFO:tasks.workunit.client.0.smithi012.stdout:6/869: dwrite d1/df/d50/db4/fdb [0,4194304] 0 2024-02-14T13:10:42.736 INFO:tasks.workunit.client.0.smithi012.stdout:8/952: dwrite d9/dc/d14/d2e/dde/da1/ffb [0,4194304] 0 2024-02-14T13:10:42.736 INFO:tasks.workunit.client.0.smithi012.stdout:8/953: truncate d9/dc/d14/d2e/dde/da1/dba/f105 686199 0 2024-02-14T13:10:42.737 INFO:tasks.workunit.client.0.smithi012.stdout:5/984: unlink dc/d2f/d89/f8b 0 2024-02-14T13:10:42.738 INFO:tasks.workunit.client.0.smithi012.stdout:5/985: dread dc/d17/d20/d4c/fef [0,4194304] 0 2024-02-14T13:10:42.738 INFO:tasks.workunit.client.0.smithi012.stdout:5/986: fdatasync dc/d17/d20/d4c/d58/f83 0 2024-02-14T13:10:42.738 INFO:tasks.workunit.client.0.smithi012.stdout:1/924: creat d6/d10/d22/d31/d34/da0/f117 x:0 0 0 2024-02-14T13:10:42.740 INFO:tasks.workunit.client.0.smithi012.stdout:4/885: creat d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f142 x:0 0 0 2024-02-14T13:10:42.741 INFO:tasks.workunit.client.0.smithi012.stdout:6/870: link d1/d1e/l39 d1/df/d16/d7c/d97/l115 0 2024-02-14T13:10:42.745 INFO:tasks.workunit.client.0.smithi012.stdout:8/954: creat d9/dc/d14/d2e/dde/da1/d13e/f147 x:0 0 0 2024-02-14T13:10:42.746 INFO:tasks.workunit.client.0.smithi012.stdout:9/975: sync 2024-02-14T13:10:42.747 INFO:tasks.workunit.client.0.smithi012.stdout:5/987: rmdir dc/d2f/d70/d78/dc4/ddc/d11e 0 2024-02-14T13:10:42.749 INFO:tasks.workunit.client.0.smithi012.stdout:1/925: truncate d6/d10/d22/d31/d34/d58/f92 1250357 0 2024-02-14T13:10:42.749 INFO:tasks.workunit.client.0.smithi012.stdout:3/896: sync 2024-02-14T13:10:42.749 INFO:tasks.workunit.client.0.smithi012.stdout:3/897: write d9/dd/de/d58/d65/f134 [620924,114475] 0 2024-02-14T13:10:42.750 INFO:tasks.workunit.client.0.smithi012.stdout:4/886: mknod d0/d10/d28/d4f/d6b/d8f/c143 0 2024-02-14T13:10:42.750 INFO:tasks.workunit.client.0.smithi012.stdout:9/976: creat da/dd/d57/d59/f146 x:0 0 0 2024-02-14T13:10:42.752 INFO:tasks.workunit.client.0.smithi012.stdout:5/988: unlink dc/d17/d20/d4c/d63/d81/ddd/ffc 0 2024-02-14T13:10:42.752 INFO:tasks.workunit.client.0.smithi012.stdout:7/799: dwrite df/d24/f87 [0,4194304] 0 2024-02-14T13:10:42.752 INFO:tasks.workunit.client.0.smithi012.stdout:5/989: write dc/f33 [4702082,64360] 0 2024-02-14T13:10:42.752 INFO:tasks.workunit.client.0.smithi012.stdout:5/990: fsync dc/d2f/d40/fc3 0 2024-02-14T13:10:42.752 INFO:tasks.workunit.client.0.smithi012.stdout:5/991: chown dc/d17/d20/l44 1914041 1 2024-02-14T13:10:42.753 INFO:tasks.workunit.client.0.smithi012.stdout:3/898: symlink d9/dd/d10d/l136 0 2024-02-14T13:10:42.754 INFO:tasks.workunit.client.0.smithi012.stdout:4/887: link d0/c141 d0/d10/d28/da9/d86/c144 0 2024-02-14T13:10:42.757 INFO:tasks.workunit.client.0.smithi012.stdout:9/977: symlink da/dd/d19/l147 0 2024-02-14T13:10:42.758 INFO:tasks.workunit.client.0.smithi012.stdout:9/978: write da/dd/d19/d30/f125 [796689,9295] 0 2024-02-14T13:10:42.758 INFO:tasks.workunit.client.0.smithi012.stdout:7/800: truncate df/d2d/f3e 1178136 0 2024-02-14T13:10:42.758 INFO:tasks.workunit.client.0.smithi012.stdout:7/801: dread - df/d2d/d5d/d72/de8/f10a zero size 2024-02-14T13:10:42.759 INFO:tasks.workunit.client.0.smithi012.stdout:9/979: dread da/dd/f5d [0,4194304] 0 2024-02-14T13:10:42.759 INFO:tasks.workunit.client.0.smithi012.stdout:5/992: link dc/d17/d20/f22 dc/d17/d20/d4c/d63/d81/ddd/f137 0 2024-02-14T13:10:42.761 INFO:tasks.workunit.client.0.smithi012.stdout:3/899: creat d9/dc4/d131/f137 x:0 0 0 2024-02-14T13:10:42.762 INFO:tasks.workunit.client.0.smithi012.stdout:8/955: dwrite d9/dc/d14/d2e/dde/d56/d57/d7c/fc1 [0,4194304] 0 2024-02-14T13:10:42.762 INFO:tasks.workunit.client.0.smithi012.stdout:4/888: symlink d0/de1/de8/l145 0 2024-02-14T13:10:42.763 INFO:tasks.workunit.client.0.smithi012.stdout:7/802: creat df/d2d/d5d/d72/de8/f10f x:0 0 0 2024-02-14T13:10:42.764 INFO:tasks.workunit.client.0.smithi012.stdout:9/980: creat da/dd/d18/dfc/f148 x:0 0 0 2024-02-14T13:10:42.766 INFO:tasks.workunit.client.0.smithi012.stdout:5/993: rename dc/d17/c46 to dc/d2f/d40/c138 0 2024-02-14T13:10:42.767 INFO:tasks.workunit.client.0.smithi012.stdout:8/956: dread d9/fbf [0,4194304] 0 2024-02-14T13:10:42.767 INFO:tasks.workunit.client.0.smithi012.stdout:3/900: mknod d9/d13/dea/dc9/c138 0 2024-02-14T13:10:42.768 INFO:tasks.workunit.client.0.smithi012.stdout:3/901: write d9/d13/daa/df8/d10e/fe9 [929803,112101] 0 2024-02-14T13:10:42.768 INFO:tasks.workunit.client.0.smithi012.stdout:3/902: write d9/d13/dea/d103/fcf [1543613,96422] 0 2024-02-14T13:10:42.769 INFO:tasks.workunit.client.0.smithi012.stdout:1/926: dwrite d6/d10/d22/d31/d5b/d5e/d65/fd2 [0,4194304] 0 2024-02-14T13:10:42.771 INFO:tasks.workunit.client.0.smithi012.stdout:7/803: rmdir df/d2d/d5d/d72 39 2024-02-14T13:10:42.771 INFO:tasks.workunit.client.0.smithi012.stdout:7/804: fdatasync df/d2d/d5d/d72/d8a/dcd/fce 0 2024-02-14T13:10:42.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/981: mkdir da/dd/d57/d59/d149 0 2024-02-14T13:10:42.774 INFO:tasks.workunit.client.0.smithi012.stdout:9/982: read - da/dd/d38/d7e/d91/f13d zero size 2024-02-14T13:10:42.775 INFO:tasks.workunit.client.0.smithi012.stdout:5/994: mkdir dc/d47/d6e/d139 0 2024-02-14T13:10:42.775 INFO:tasks.workunit.client.0.smithi012.stdout:4/889: write d0/d10/d28/d4f/d6b/d83/d99/fa3 [2969863,71577] 0 2024-02-14T13:10:42.777 INFO:tasks.workunit.client.0.smithi012.stdout:3/903: creat d9/dd/de/d58/d65/df0/f139 x:0 0 0 2024-02-14T13:10:42.777 INFO:tasks.workunit.client.0.smithi012.stdout:3/904: readlink l8 0 2024-02-14T13:10:42.777 INFO:tasks.workunit.client.0.smithi012.stdout:3/905: chown d9/l2c 106591 1 2024-02-14T13:10:42.784 INFO:tasks.workunit.client.0.smithi012.stdout:9/983: symlink da/dd/d57/d59/d73/l14a 0 2024-02-14T13:10:42.784 INFO:tasks.workunit.client.0.smithi012.stdout:8/957: dwrite d9/dc/d14/d2e/dde/da1/dba/f105 [0,4194304] 0 2024-02-14T13:10:42.786 INFO:tasks.workunit.client.0.smithi012.stdout:5/995: creat dc/d47/d6e/df0/f13a x:0 0 0 2024-02-14T13:10:42.786 INFO:tasks.workunit.client.0.smithi012.stdout:5/996: readlink dc/d47/d69/lcb 0 2024-02-14T13:10:42.786 INFO:tasks.workunit.client.0.smithi012.stdout:5/997: fsync dc/d2f/d3e/fb9 0 2024-02-14T13:10:42.786 INFO:tasks.workunit.client.0.smithi012.stdout:3/906: dread d9/d18/d39/f59 [4194304,4194304] 0 2024-02-14T13:10:42.787 INFO:tasks.workunit.client.0.smithi012.stdout:4/890: truncate d0/d10/d28/da9/d86/ffa 1797464 0 2024-02-14T13:10:42.787 INFO:tasks.workunit.client.0.smithi012.stdout:1/927: symlink d6/d10/l118 0 2024-02-14T13:10:42.788 INFO:tasks.workunit.client.0.smithi012.stdout:9/984: creat da/dd/d38/d7e/d91/f14b x:0 0 0 2024-02-14T13:10:42.788 INFO:tasks.workunit.client.0.smithi012.stdout:9/985: fsync da/dd/d19/df3/d85/fb3 0 2024-02-14T13:10:42.792 INFO:tasks.workunit.client.0.smithi012.stdout:5/998: rename dc/d17/ded/f95 to dc/d17/d20/d4c/d63/d81/f13b 0 2024-02-14T13:10:42.793 INFO:tasks.workunit.client.0.smithi012.stdout:3/907: creat d9/dd/d30/d44/d3d/f13a x:0 0 0 2024-02-14T13:10:42.793 INFO:tasks.workunit.client.0.smithi012.stdout:3/908: fdatasync d9/dd/de/d58/f64 0 2024-02-14T13:10:42.793 INFO:tasks.workunit.client.0.smithi012.stdout:3/909: truncate d9/dd/d30/d44/f9e 4639385 0 2024-02-14T13:10:42.794 INFO:tasks.workunit.client.0.smithi012.stdout:4/891: getdents d0/d10/d28/d4f/d6b/d8f/d56/d98/d110 0 2024-02-14T13:10:42.795 INFO:tasks.workunit.client.0.smithi012.stdout:9/986: creat da/dd/d57/f14c x:0 0 0 2024-02-14T13:10:42.796 INFO:tasks.workunit.client.0.smithi012.stdout:8/958: mknod d9/dc/d1b/c148 0 2024-02-14T13:10:42.798 INFO:tasks.workunit.client.0.smithi012.stdout:1/928: rename d6/d10/d22/d31/d34/d58/d61 to d6/d119 0 2024-02-14T13:10:42.799 INFO:tasks.workunit.client.0.smithi012.stdout:5/999: symlink dc/dec/l13c 0 2024-02-14T13:10:42.799 INFO:tasks.workunit.client.0.smithi012.stdout:3/910: symlink d9/dd/d30/d34/d78/l13b 0 2024-02-14T13:10:42.800 INFO:tasks.workunit.client.0.smithi012.stdout:4/892: symlink d0/d10/d28/d4f/l146 0 2024-02-14T13:10:42.801 INFO:tasks.workunit.client.0.smithi012.stdout:9/987: truncate da/f3f 2042915 0 2024-02-14T13:10:42.804 INFO:tasks.workunit.client.0.smithi012.stdout:3/911: rename d9/d3f/dac/dfb to d9/dd/de/d58/d13c 0 2024-02-14T13:10:42.805 INFO:tasks.workunit.client.0.smithi012.stdout:1/929: dread d6/d10/d22/d31/d5b/d5e/d65/d87/f97 [0,4194304] 0 2024-02-14T13:10:42.805 INFO:tasks.workunit.client.0.smithi012.stdout:4/893: mknod d0/de1/de8/c147 0 2024-02-14T13:10:42.806 INFO:tasks.workunit.client.0.smithi012.stdout:9/988: creat da/dd/f14d x:0 0 0 2024-02-14T13:10:42.806 INFO:tasks.workunit.client.0.smithi012.stdout:9/989: chown da/d4f/l128 26141 1 2024-02-14T13:10:42.807 INFO:tasks.workunit.client.0.smithi012.stdout:8/959: mkdir d9/dc/d14/d2e/dde/d56/d57/d149 0 2024-02-14T13:10:42.812 INFO:tasks.workunit.client.0.smithi012.stdout:9/990: unlink da/dd/fb4 0 2024-02-14T13:10:42.813 INFO:tasks.workunit.client.0.smithi012.stdout:4/894: rename d0/d10/d28/d4f/d6b/d8f/d56/d8c/cac to d0/d10/d28/d4f/d6b/d83/d17/d5f/da2/c148 0 2024-02-14T13:10:42.815 INFO:tasks.workunit.client.0.smithi012.stdout:8/960: dread d9/dc/d14/f95 [0,4194304] 0 2024-02-14T13:10:42.816 INFO:tasks.workunit.client.0.smithi012.stdout:8/961: symlink d9/dc/d38/dfc/l14a 0 2024-02-14T13:10:42.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/930: write d6/d10/d22/d31/d3e/fbf [2466531,81464] 0 2024-02-14T13:10:42.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/931: chown d6/d10/d22/d31/d5b/d5e/d3d/cd1 971079 1 2024-02-14T13:10:42.817 INFO:tasks.workunit.client.0.smithi012.stdout:1/932: write d6/d10/d22/d31/d5b/d5e/d65/d87/f97 [3029258,21093] 0 2024-02-14T13:10:42.821 INFO:tasks.workunit.client.0.smithi012.stdout:3/912: dwrite d9/d13/dea/d103/f11c [0,4194304] 0 2024-02-14T13:10:42.822 INFO:tasks.workunit.client.0.smithi012.stdout:1/933: rmdir d6/d10/d22/d31/d5b/d5d/de3 0 2024-02-14T13:10:42.825 INFO:tasks.workunit.client.0.smithi012.stdout:3/913: creat d9/d13/dea/dc9/f13d x:0 0 0 2024-02-14T13:10:42.826 INFO:tasks.workunit.client.0.smithi012.stdout:1/934: getdents d6/d10/d22/d31/d5b/d5e/d65/dec 0 2024-02-14T13:10:42.826 INFO:tasks.workunit.client.0.smithi012.stdout:1/935: dread - d6/d10/d22/d31/d3e/d71/f112 zero size 2024-02-14T13:10:42.827 INFO:tasks.workunit.client.0.smithi012.stdout:4/895: dread d0/f95 [0,4194304] 0 2024-02-14T13:10:42.827 INFO:tasks.workunit.client.0.smithi012.stdout:3/914: creat d9/dd/d30/d44/f13e x:0 0 0 2024-02-14T13:10:42.828 INFO:tasks.workunit.client.0.smithi012.stdout:8/962: dread d9/fbf [4194304,4194304] 0 2024-02-14T13:10:42.828 INFO:tasks.workunit.client.0.smithi012.stdout:1/936: unlink d6/d10/d22/d31/d34/f57 0 2024-02-14T13:10:42.829 INFO:tasks.workunit.client.0.smithi012.stdout:4/896: symlink d0/de1/de8/d11a/l149 0 2024-02-14T13:10:42.830 INFO:tasks.workunit.client.0.smithi012.stdout:3/915: unlink d9/dc4/fdd 0 2024-02-14T13:10:42.832 INFO:tasks.workunit.client.0.smithi012.stdout:8/963: symlink d9/dc/d14/d2e/dde/da3/d10e/l14b 0 2024-02-14T13:10:42.833 INFO:tasks.workunit.client.0.smithi012.stdout:4/897: mkdir d0/d10/d28/d4f/d6b/d83/d17/d14a 0 2024-02-14T13:10:42.845 INFO:tasks.workunit.client.0.smithi012.stdout:4/898: read d0/d10/d28/d4f/d6b/d8f/f48 [523340,112871] 0 2024-02-14T13:10:42.846 INFO:tasks.workunit.client.0.smithi012.stdout:4/899: symlink d0/d10/d28/d4f/dc7/dfb/l14b 0 2024-02-14T13:10:42.846 INFO:tasks.workunit.client.0.smithi012.stdout:4/900: stat d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/cf1 0 2024-02-14T13:10:42.848 INFO:tasks.workunit.client.0.smithi012.stdout:4/901: mkdir d0/d14c 0 2024-02-14T13:10:42.848 INFO:tasks.workunit.client.0.smithi012.stdout:4/902: chown d0/de1/d12b 717982 1 2024-02-14T13:10:42.848 INFO:tasks.workunit.client.0.smithi012.stdout:9/991: dwrite da/d33/d63/f8a [0,4194304] 0 2024-02-14T13:10:42.848 INFO:tasks.workunit.client.0.smithi012.stdout:4/903: mknod d0/d10/d28/da9/c14d 0 2024-02-14T13:10:42.850 INFO:tasks.workunit.client.0.smithi012.stdout:4/904: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 [0,4194304] 0 2024-02-14T13:10:42.850 INFO:tasks.workunit.client.0.smithi012.stdout:9/992: rename da/dd/d57/d59/d73/db6/df1/d8d to da/dd/d57/d14e 0 2024-02-14T13:10:42.851 INFO:tasks.workunit.client.0.smithi012.stdout:4/905: mknod d0/d10/d28/da9/c14e 0 2024-02-14T13:10:42.851 INFO:tasks.workunit.client.0.smithi012.stdout:4/906: truncate d0/d10/d28/da9/d86/ffa 1099212 0 2024-02-14T13:10:42.852 INFO:tasks.workunit.client.0.smithi012.stdout:4/907: dread - d0/de1/de8/dd9/ddc/f120 zero size 2024-02-14T13:10:42.852 INFO:tasks.workunit.client.0.smithi012.stdout:4/908: symlink d0/d10/d28/d4f/d6b/d83/d99/l14f 0 2024-02-14T13:10:42.856 INFO:tasks.workunit.client.0.smithi012.stdout:1/937: dwrite d6/d10/d22/d31/d5b/d5e/d65/dec/f109 [0,4194304] 0 2024-02-14T13:10:42.857 INFO:tasks.workunit.client.0.smithi012.stdout:8/964: dwrite d9/f84 [0,4194304] 0 2024-02-14T13:10:42.857 INFO:tasks.workunit.client.0.smithi012.stdout:8/965: dread - d9/db9/d128/f136 zero size 2024-02-14T13:10:42.857 INFO:tasks.workunit.client.0.smithi012.stdout:3/916: dwrite d9/d13/daa/df8/d10e/fe9 [0,4194304] 0 2024-02-14T13:10:42.859 INFO:tasks.workunit.client.0.smithi012.stdout:1/938: creat d6/d10/d64/f11a x:0 0 0 2024-02-14T13:10:42.859 INFO:tasks.workunit.client.0.smithi012.stdout:1/939: chown d6/d10/d22/fb5 460798131 1 2024-02-14T13:10:42.862 INFO:tasks.workunit.client.0.smithi012.stdout:9/993: dread da/d4f/fed [0,4194304] 0 2024-02-14T13:10:42.866 INFO:tasks.workunit.client.0.smithi012.stdout:9/994: creat da/d33/f14f x:0 0 0 2024-02-14T13:10:42.869 INFO:tasks.workunit.client.0.smithi012.stdout:8/966: dread d9/dc/d1b/f27 [4194304,4194304] 0 2024-02-14T13:10:42.872 INFO:tasks.workunit.client.0.smithi012.stdout:6/871: sync 2024-02-14T13:10:42.872 INFO:tasks.workunit.client.0.smithi012.stdout:6/872: truncate d1/df/d16/d7c/d97/d82/da5/ffc 367589 0 2024-02-14T13:10:42.874 INFO:tasks.workunit.client.0.smithi012.stdout:9/995: creat da/dd/d19/d30/d45/f150 x:0 0 0 2024-02-14T13:10:42.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/967: rmdir d9/dc/d14/d11f/df1 39 2024-02-14T13:10:42.876 INFO:tasks.workunit.client.0.smithi012.stdout:8/968: stat d9/l36 0 2024-02-14T13:10:42.879 INFO:tasks.workunit.client.0.smithi012.stdout:9/996: rename da/d33/d63/c88 to da/dd/d19/c151 0 2024-02-14T13:10:42.881 INFO:tasks.workunit.client.0.smithi012.stdout:8/969: rename d9/dc/d14/d2e/dde/da3/ded/da5/ff3 to d9/dc/d14/d11f/df1/f14c 0 2024-02-14T13:10:42.881 INFO:tasks.workunit.client.0.smithi012.stdout:8/970: fsync d9/dc/d14/d23/ddf/d134/f143 0 2024-02-14T13:10:42.883 INFO:tasks.workunit.client.0.smithi012.stdout:9/997: rmdir da/d4f 39 2024-02-14T13:10:42.883 INFO:tasks.workunit.client.0.smithi012.stdout:8/971: dread d9/dc/d14/d2e/dde/da1/f12b [0,4194304] 0 2024-02-14T13:10:42.883 INFO:tasks.workunit.client.0.smithi012.stdout:8/972: chown d9/dc 5 1 2024-02-14T13:10:42.884 INFO:tasks.workunit.client.0.smithi012.stdout:9/998: creat da/dd/d57/d59/d73/d136/f152 x:0 0 0 2024-02-14T13:10:42.885 INFO:tasks.workunit.client.0.smithi012.stdout:9/999: write da/dd/d38/d7e/ddc/f12d [1098698,6275] 0 2024-02-14T13:10:42.885 INFO:tasks.workunit.client.0.smithi012.stdout:7/805: sync 2024-02-14T13:10:42.887 INFO:tasks.workunit.client.0.smithi012.stdout:7/806: creat df/d24/d9e/df0/f110 x:0 0 0 2024-02-14T13:10:42.888 INFO:tasks.workunit.client.0.smithi012.stdout:7/807: dread df/d2d/d5d/d72/d8a/dcd/fce [0,4194304] 0 2024-02-14T13:10:42.889 INFO:tasks.workunit.client.0.smithi012.stdout:7/808: stat df/d27/d100/d10b 0 2024-02-14T13:10:42.891 INFO:tasks.workunit.client.0.smithi012.stdout:4/909: dwrite d0/de1/d12b/f13b [0,4194304] 0 2024-02-14T13:10:42.891 INFO:tasks.workunit.client.0.smithi012.stdout:4/910: chown d0/de1/de8/dd9/lda 863 1 2024-02-14T13:10:42.892 INFO:tasks.workunit.client.0.smithi012.stdout:8/973: dread d9/dc/d1b/f21 [0,4194304] 0 2024-02-14T13:10:42.892 INFO:tasks.workunit.client.0.smithi012.stdout:4/911: rmdir d0/d10/d28/da9/d86 39 2024-02-14T13:10:42.894 INFO:tasks.workunit.client.0.smithi012.stdout:8/974: link d9/dc/d14/d11f/df1/cf6 d9/dc/d14/c14d 0 2024-02-14T13:10:42.894 INFO:tasks.workunit.client.0.smithi012.stdout:4/912: truncate d0/d10/d28/d62/f108 825720 0 2024-02-14T13:10:42.895 INFO:tasks.workunit.client.0.smithi012.stdout:8/975: getdents d9/dc/d38/d6a/df2 0 2024-02-14T13:10:42.896 INFO:tasks.workunit.client.0.smithi012.stdout:4/913: mkdir d0/d10/d28/d4f/d6b/d83/d150 0 2024-02-14T13:10:42.896 INFO:tasks.workunit.client.0.smithi012.stdout:6/873: dwrite d1/f9f [0,4194304] 0 2024-02-14T13:10:42.897 INFO:tasks.workunit.client.0.smithi012.stdout:4/914: truncate d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f9e 3739521 0 2024-02-14T13:10:42.898 INFO:tasks.workunit.client.0.smithi012.stdout:6/874: creat d1/df/d24/d5f/f116 x:0 0 0 2024-02-14T13:10:42.899 INFO:tasks.workunit.client.0.smithi012.stdout:4/915: mknod d0/d10/d28/d4f/d6b/c151 0 2024-02-14T13:10:42.900 INFO:tasks.workunit.client.0.smithi012.stdout:4/916: creat d0/d10/d28/d4f/d6b/d83/d99/f152 x:0 0 0 2024-02-14T13:10:42.900 INFO:tasks.workunit.client.0.smithi012.stdout:4/917: stat d0/df0/f12a 0 2024-02-14T13:10:42.900 INFO:tasks.workunit.client.0.smithi012.stdout:1/940: dwrite d6/d10/d22/d44/dbb/fc2 [0,4194304] 0 2024-02-14T13:10:42.901 INFO:tasks.workunit.client.0.smithi012.stdout:4/918: mknod d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/c153 0 2024-02-14T13:10:42.902 INFO:tasks.workunit.client.0.smithi012.stdout:7/809: write df/d36/f3c [715659,110033] 0 2024-02-14T13:10:42.904 INFO:tasks.workunit.client.0.smithi012.stdout:4/919: unlink d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/fc2 0 2024-02-14T13:10:42.904 INFO:tasks.workunit.client.0.smithi012.stdout:3/917: dwrite d9/d13/d28/f40 [0,4194304] 0 2024-02-14T13:10:42.905 INFO:tasks.workunit.client.0.smithi012.stdout:7/810: mknod df/d24/c111 0 2024-02-14T13:10:42.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/920: mknod d0/d10/d28/d62/c154 0 2024-02-14T13:10:42.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/921: fsync d0/f6 0 2024-02-14T13:10:42.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/922: dread - d0/de1/de8/dd9/ff2 zero size 2024-02-14T13:10:42.906 INFO:tasks.workunit.client.0.smithi012.stdout:4/923: chown d0/d10/d28/da9/d86/l10b 1046194 1 2024-02-14T13:10:42.909 INFO:tasks.workunit.client.0.smithi012.stdout:3/918: creat d9/dcd/f13f x:0 0 0 2024-02-14T13:10:42.912 INFO:tasks.workunit.client.0.smithi012.stdout:7/811: creat df/d2d/d82/d88/f112 x:0 0 0 2024-02-14T13:10:42.914 INFO:tasks.workunit.client.0.smithi012.stdout:7/812: unlink df/d2d/d5d/cf8 0 2024-02-14T13:10:42.915 INFO:tasks.workunit.client.0.smithi012.stdout:3/919: dread d9/d3f/f41 [0,4194304] 0 2024-02-14T13:10:42.916 INFO:tasks.workunit.client.0.smithi012.stdout:7/813: mkdir df/d27/d4b/d6b/d6d/d85/d113 0 2024-02-14T13:10:42.916 INFO:tasks.workunit.client.0.smithi012.stdout:6/875: dwrite d1/df/d24/d3f/f47 [4194304,4194304] 0 2024-02-14T13:10:42.917 INFO:tasks.workunit.client.0.smithi012.stdout:6/876: readlink d1/d1e/d1b/d111/l84 0 2024-02-14T13:10:42.919 INFO:tasks.workunit.client.0.smithi012.stdout:3/920: mkdir d9/d13/daa/d140 0 2024-02-14T13:10:42.919 INFO:tasks.workunit.client.0.smithi012.stdout:3/921: chown d9/d18/d39/df3 13758 1 2024-02-14T13:10:42.919 INFO:tasks.workunit.client.0.smithi012.stdout:3/922: fdatasync d9/d13/dea/d103/f11c 0 2024-02-14T13:10:42.921 INFO:tasks.workunit.client.0.smithi012.stdout:3/923: dread d9/d13/dea/f9b [0,4194304] 0 2024-02-14T13:10:42.921 INFO:tasks.workunit.client.0.smithi012.stdout:1/941: dwrite d6/d10/d22/d31/d3e/d71/fe8 [0,4194304] 0 2024-02-14T13:10:42.922 INFO:tasks.workunit.client.0.smithi012.stdout:3/924: creat d9/dcd/f141 x:0 0 0 2024-02-14T13:10:42.926 INFO:tasks.workunit.client.0.smithi012.stdout:1/942: truncate d6/d10/d22/d44/dbb/d101/f107 583241 0 2024-02-14T13:10:42.927 INFO:tasks.workunit.client.0.smithi012.stdout:3/925: dread - d9/d3f/d88/f109 zero size 2024-02-14T13:10:42.932 INFO:tasks.workunit.client.0.smithi012.stdout:3/926: rename d9/dd/d30/d34/l3a to d9/l142 0 2024-02-14T13:10:42.932 INFO:tasks.workunit.client.0.smithi012.stdout:3/927: write d9/d3f/dac/fdc [1430157,59921] 0 2024-02-14T13:10:42.932 INFO:tasks.workunit.client.0.smithi012.stdout:3/928: write d9/dd/de/d58/d13c/f132 [1543698,38290] 0 2024-02-14T13:10:42.933 INFO:tasks.workunit.client.0.smithi012.stdout:3/929: readlink d9/dd/d30/d34/dc1/l115 0 2024-02-14T13:10:42.933 INFO:tasks.workunit.client.0.smithi012.stdout:3/930: read d9/d3f/f41 [1179388,76240] 0 2024-02-14T13:10:42.934 INFO:tasks.workunit.client.0.smithi012.stdout:3/931: read d9/d7b/d95/fab [30049,43504] 0 2024-02-14T13:10:42.935 INFO:tasks.workunit.client.0.smithi012.stdout:3/932: symlink d9/dd/d30/d44/d66/db3/dee/d133/l143 0 2024-02-14T13:10:42.936 INFO:tasks.workunit.client.0.smithi012.stdout:3/933: mknod d9/d13/dea/d103/d6a/c144 0 2024-02-14T13:10:42.937 INFO:tasks.workunit.client.0.smithi012.stdout:3/934: getdents d9/d13/dea/d11f 0 2024-02-14T13:10:42.940 INFO:tasks.workunit.client.0.smithi012.stdout:1/943: dread d6/d10/d22/d31/d5b/d5e/d3d/f51 [0,4194304] 0 2024-02-14T13:10:42.940 INFO:tasks.workunit.client.0.smithi012.stdout:1/944: chown d6/d10/d22/d31/d5b/d5d/c27 2 1 2024-02-14T13:10:42.947 INFO:tasks.workunit.client.0.smithi012.stdout:4/924: dwrite d0/d10/d28/da9/fd3 [0,4194304] 0 2024-02-14T13:10:42.948 INFO:tasks.workunit.client.0.smithi012.stdout:4/925: dread - d0/d10/d28/d4f/d6b/d83/f106 zero size 2024-02-14T13:10:42.948 INFO:tasks.workunit.client.0.smithi012.stdout:6/877: dwrite d1/d1e/dc/d28/d7b/fbf [0,4194304] 0 2024-02-14T13:10:42.948 INFO:tasks.workunit.client.0.smithi012.stdout:6/878: chown d1/df/d16/d7c/d112 203983466 1 2024-02-14T13:10:42.949 INFO:tasks.workunit.client.0.smithi012.stdout:4/926: getdents d0/d10/d28/d4f/d6b/d8f/d56/d98 0 2024-02-14T13:10:42.949 INFO:tasks.workunit.client.0.smithi012.stdout:4/927: chown d0/df0/f12a 4734805 1 2024-02-14T13:10:42.952 INFO:tasks.workunit.client.0.smithi012.stdout:7/814: dwrite df/d2d/d5d/d72/de8/f10a [0,4194304] 0 2024-02-14T13:10:42.954 INFO:tasks.workunit.client.0.smithi012.stdout:4/928: creat d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/f155 x:0 0 0 2024-02-14T13:10:42.958 INFO:tasks.workunit.client.0.smithi012.stdout:7/815: rmdir df/d36 39 2024-02-14T13:10:42.960 INFO:tasks.workunit.client.0.smithi012.stdout:7/816: creat df/d2d/d5d/f114 x:0 0 0 2024-02-14T13:10:42.961 INFO:tasks.workunit.client.0.smithi012.stdout:4/929: getdents d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6 0 2024-02-14T13:10:42.962 INFO:tasks.workunit.client.0.smithi012.stdout:4/930: symlink d0/de1/l156 0 2024-02-14T13:10:42.963 INFO:tasks.workunit.client.0.smithi012.stdout:4/931: write d0/d10/d28/d4f/d6b/d8f/d56/d8c/f9d [769616,4907] 0 2024-02-14T13:10:42.965 INFO:tasks.workunit.client.0.smithi012.stdout:4/932: creat d0/d10/d28/d4f/d6b/d8f/d56/f157 x:0 0 0 2024-02-14T13:10:42.967 INFO:tasks.workunit.client.0.smithi012.stdout:1/945: dwrite d6/d10/d22/d44/dbb/fc2 [0,4194304] 0 2024-02-14T13:10:42.972 INFO:tasks.workunit.client.0.smithi012.stdout:7/817: dread df/d36/d67/fa7 [4194304,4194304] 0 2024-02-14T13:10:42.974 INFO:tasks.workunit.client.0.smithi012.stdout:3/935: dwrite d9/dd/d30/d44/f29 [4194304,4194304] 0 2024-02-14T13:10:42.974 INFO:tasks.workunit.client.0.smithi012.stdout:7/818: truncate df/d2d/f52 5822880 0 2024-02-14T13:10:42.974 INFO:tasks.workunit.client.0.smithi012.stdout:6/879: dwrite d1/d1e/d66/f88 [0,4194304] 0 2024-02-14T13:10:42.975 INFO:tasks.workunit.client.0.smithi012.stdout:3/936: symlink d9/dd/l145 0 2024-02-14T13:10:42.976 INFO:tasks.workunit.client.0.smithi012.stdout:7/819: dread df/d27/d4b/d6b/d6d/d85/ff3 [0,4194304] 0 2024-02-14T13:10:42.976 INFO:tasks.workunit.client.0.smithi012.stdout:3/937: mknod d9/d13/dea/c146 0 2024-02-14T13:10:42.978 INFO:tasks.workunit.client.0.smithi012.stdout:7/820: unlink df/d27/d100/d10b/f75 0 2024-02-14T13:10:42.979 INFO:tasks.workunit.client.0.smithi012.stdout:7/821: mknod df/db1/c115 0 2024-02-14T13:10:42.979 INFO:tasks.workunit.client.0.smithi012.stdout:7/822: chown df/d2d/d5d/d72/de8/f10f 19929 1 2024-02-14T13:10:42.980 INFO:tasks.workunit.client.0.smithi012.stdout:7/823: readlink df/d27/d100/d10b/l5f 0 2024-02-14T13:10:42.981 INFO:tasks.workunit.client.0.smithi012.stdout:7/824: getdents df/d2d/d82/d88 0 2024-02-14T13:10:42.981 INFO:tasks.workunit.client.0.smithi012.stdout:7/825: fdatasync df/d2d/d82/d88/fb7 0 2024-02-14T13:10:42.982 INFO:tasks.workunit.client.0.smithi012.stdout:7/826: mkdir df/d27/d4b/d10d/d116 0 2024-02-14T13:10:42.982 INFO:tasks.workunit.client.0.smithi012.stdout:7/827: truncate df/d27/d4b/d6b/d6d/d85/db8/fef 468277 0 2024-02-14T13:10:42.982 INFO:tasks.workunit.client.0.smithi012.stdout:1/946: dread d6/d10/d22/d31/d3e/d10d/f53 [0,4194304] 0 2024-02-14T13:10:42.983 INFO:tasks.workunit.client.0.smithi012.stdout:1/947: creat d6/d10/d22/d31/d5b/d5e/d65/d87/f11b x:0 0 0 2024-02-14T13:10:42.984 INFO:tasks.workunit.client.0.smithi012.stdout:1/948: creat d6/d10/d22/d31/d5b/d5d/d6d/de9/f11c x:0 0 0 2024-02-14T13:10:42.985 INFO:tasks.workunit.client.0.smithi012.stdout:1/949: truncate d6/d10/d22/d31/d3e/d10d/f56 2174084 0 2024-02-14T13:10:42.985 INFO:tasks.workunit.client.0.smithi012.stdout:1/950: chown d6/d10/d22/d31/d34 923344681 1 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/951: rename d6/d10/df0/cc7 to d6/d10/d22/d31/d5b/d5e/d65/c11d 0 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/952: write d6/d10/d22/d44/dbb/d101/faa [1421680,43918] 0 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:3/938: dread d9/d13/dea/d103/f90 [0,4194304] 0 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:3/939: dread - d9/d13/d28/f117 zero size 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:3/940: chown d9/d3f/f41 57467 1 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:3/941: stat d9/d13/dea/dc9/fe7 0 2024-02-14T13:10:42.987 INFO:tasks.workunit.client.0.smithi012.stdout:1/953: creat d6/f11e x:0 0 0 2024-02-14T13:10:42.988 INFO:tasks.workunit.client.0.smithi012.stdout:1/954: mkdir d6/d10/d22/d31/d34/da0/d11f 0 2024-02-14T13:10:42.995 INFO:tasks.workunit.client.0.smithi012.stdout:3/942: dread d9/d18/f55 [0,4194304] 0 2024-02-14T13:10:42.999 INFO:tasks.workunit.client.0.smithi012.stdout:6/880: dwrite d1/df/d24/d5f/fcd [0,4194304] 0 2024-02-14T13:10:42.999 INFO:tasks.workunit.client.0.smithi012.stdout:4/933: dwrite d0/d10/d28/d4f/d6b/d8f/d56/df7/ffd [0,4194304] 0 2024-02-14T13:10:43.005 INFO:tasks.workunit.client.0.smithi012.stdout:1/955: dwrite d6/d10/d22/d31/d5b/d5e/d65/fd2 [0,4194304] 0 2024-02-14T13:10:43.006 INFO:tasks.workunit.client.0.smithi012.stdout:3/943: dread d9/dd/d30/d44/d66/dd0/ffa [0,4194304] 0 2024-02-14T13:10:43.008 INFO:tasks.workunit.client.0.smithi012.stdout:6/881: creat d1/d1e/d1b/d3e/f117 x:0 0 0 2024-02-14T13:10:43.011 INFO:tasks.workunit.client.0.smithi012.stdout:4/934: creat d0/d10/d28/f158 x:0 0 0 2024-02-14T13:10:43.012 INFO:tasks.workunit.client.0.smithi012.stdout:4/935: stat d0/d10/d28/cb0 0 2024-02-14T13:10:43.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/956: creat d6/d10/d22/d31/d5b/d5e/f120 x:0 0 0 2024-02-14T13:10:43.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/957: write d6/d10/d22/d44/dbb/d101/faa [2098923,35056] 0 2024-02-14T13:10:43.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/958: dread - d6/d10/d22/d31/d34/fe6 zero size 2024-02-14T13:10:43.013 INFO:tasks.workunit.client.0.smithi012.stdout:1/959: chown d6/d10/f99 143749175 1 2024-02-14T13:10:43.014 INFO:tasks.workunit.client.0.smithi012.stdout:3/944: symlink d9/d3f/d73/d5d/d82/l147 0 2024-02-14T13:10:43.017 INFO:tasks.workunit.client.0.smithi012.stdout:4/936: mkdir d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d159 0 2024-02-14T13:10:43.018 INFO:tasks.workunit.client.0.smithi012.stdout:1/960: rename d6/d10/d22/d44/dbb/d101/cce to d6/d10/d22/d31/d34/d58/c121 0 2024-02-14T13:10:43.019 INFO:tasks.workunit.client.0.smithi012.stdout:3/945: mkdir d9/dd/d10d/d148 0 2024-02-14T13:10:43.020 INFO:tasks.workunit.client.0.smithi012.stdout:1/961: mkdir d6/d10/d22/d31/d5b/dcd/d122 0 2024-02-14T13:10:43.022 INFO:tasks.workunit.client.0.smithi012.stdout:1/962: mkdir d6/d10/d22/d31/d34/d58/d123 0 2024-02-14T13:10:43.022 INFO:tasks.workunit.client.0.smithi012.stdout:8/976: sync 2024-02-14T13:10:43.023 INFO:tasks.workunit.client.0.smithi012.stdout:8/977: rmdir d9/dc/d14/d23/ddf/d10c 39 2024-02-14T13:10:43.024 INFO:tasks.workunit.client.0.smithi012.stdout:8/978: rmdir d9/dc/d38/dfc 39 2024-02-14T13:10:43.025 INFO:tasks.workunit.client.0.smithi012.stdout:8/979: truncate d9/dc/d14/d2e/dde/d56/d57/f6e 6440948 0 2024-02-14T13:10:43.026 INFO:tasks.workunit.client.0.smithi012.stdout:4/937: write d0/d10/d28/d4f/d6b/fdd [566626,98860] 0 2024-02-14T13:10:43.027 INFO:tasks.workunit.client.0.smithi012.stdout:4/938: write d0/d10/f7b [546754,69595] 0 2024-02-14T13:10:43.029 INFO:tasks.workunit.client.0.smithi012.stdout:4/939: link d0/d10/d28/d4f/d6b/d8f/d56/d8c/fe0 d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f15a 0 2024-02-14T13:10:43.032 INFO:tasks.workunit.client.0.smithi012.stdout:6/882: dwrite d1/d1e/dc/d43/f89 [0,4194304] 0 2024-02-14T13:10:43.033 INFO:tasks.workunit.client.0.smithi012.stdout:6/883: stat d1/df/d24/d3f/d56/da3/ld3 0 2024-02-14T13:10:43.033 INFO:tasks.workunit.client.0.smithi012.stdout:6/884: write d1/df/d24/d5f/f116 [851725,35440] 0 2024-02-14T13:10:43.033 INFO:tasks.workunit.client.0.smithi012.stdout:6/885: dread - d1/d1e/d1b/da8/d9b/fe4 zero size 2024-02-14T13:10:43.034 INFO:tasks.workunit.client.0.smithi012.stdout:6/886: symlink d1/df/d16/d7c/dfe/d104/l118 0 2024-02-14T13:10:43.035 INFO:tasks.workunit.client.0.smithi012.stdout:6/887: fsync d1/d1e/dc/d43/f63 0 2024-02-14T13:10:43.035 INFO:tasks.workunit.client.0.smithi012.stdout:6/888: write d1/d1e/dc/d43/d75/fe3 [936455,100774] 0 2024-02-14T13:10:43.036 INFO:tasks.workunit.client.0.smithi012.stdout:6/889: truncate d1/df/d16/d7c/d97/d82/da5/ffc 172366 0 2024-02-14T13:10:43.036 INFO:tasks.workunit.client.0.smithi012.stdout:6/890: write d1/d1e/d1b/d21/f10c [907130,30882] 0 2024-02-14T13:10:43.036 INFO:tasks.workunit.client.0.smithi012.stdout:6/891: write d1/d1e/dc/d43/d75/fe3 [700276,117237] 0 2024-02-14T13:10:43.072 INFO:tasks.workunit.client.0.smithi012.stdout:1/963: dwrite d6/d10/d22/d31/d5b/d5d/d6d/de9/f100 [0,4194304] 0 2024-02-14T13:10:43.072 INFO:tasks.workunit.client.0.smithi012.stdout:6/892: dwrite d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:43.073 INFO:tasks.workunit.client.0.smithi012.stdout:4/940: dwrite d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/f142 [0,4194304] 0 2024-02-14T13:10:43.073 INFO:tasks.workunit.client.0.smithi012.stdout:3/946: dwrite d9/d3f/d88/fe5 [0,4194304] 0 2024-02-14T13:10:43.075 INFO:tasks.workunit.client.0.smithi012.stdout:6/893: creat d1/df/d24/d3f/d56/d93/d95/dc7/f119 x:0 0 0 2024-02-14T13:10:43.076 INFO:tasks.workunit.client.0.smithi012.stdout:1/964: mknod d6/d10/d22/d31/d5b/d5d/d80/da4/c124 0 2024-02-14T13:10:43.079 INFO:tasks.workunit.client.0.smithi012.stdout:1/965: dread d6/d10/d22/d31/d5b/d5e/d65/db4/fb8 [0,4194304] 0 2024-02-14T13:10:43.079 INFO:tasks.workunit.client.0.smithi012.stdout:1/966: write d6/d10/d22/d31/d34/d58/ffe [1548745,86998] 0 2024-02-14T13:10:43.079 INFO:tasks.workunit.client.0.smithi012.stdout:1/967: chown d6/d10/d22/d31/d5b/d5e/d65/fd2 877866630 1 2024-02-14T13:10:43.079 INFO:tasks.workunit.client.0.smithi012.stdout:1/968: chown d6/d10/d22/d31/d5b/d5d/d80/c90 237466 1 2024-02-14T13:10:43.079 INFO:tasks.workunit.client.0.smithi012.stdout:4/941: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/dce/c15b 0 2024-02-14T13:10:43.081 INFO:tasks.workunit.client.0.smithi012.stdout:3/947: dread d9/d18/f56 [0,4194304] 0 2024-02-14T13:10:43.082 INFO:tasks.workunit.client.0.smithi012.stdout:4/942: dread d0/d10/d28/da9/d86/ffa [0,4194304] 0 2024-02-14T13:10:43.085 INFO:tasks.workunit.client.0.smithi012.stdout:6/894: mknod d1/df/d24/d3f/d56/d93/d95/c11a 0 2024-02-14T13:10:43.085 INFO:tasks.workunit.client.0.smithi012.stdout:6/895: dread - d1/d1e/d1b/d21/fe1 zero size 2024-02-14T13:10:43.089 INFO:tasks.workunit.client.0.smithi012.stdout:3/948: rename d9/d3f/da8/fa9 to d9/dd/d30/d44/d66/db3/dee/d133/f149 0 2024-02-14T13:10:43.090 INFO:tasks.workunit.client.0.smithi012.stdout:4/943: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/fa0 [0,4194304] 0 2024-02-14T13:10:43.091 INFO:tasks.workunit.client.0.smithi012.stdout:6/896: unlink d1/df/d24/d3f/d56/d93/fc6 0 2024-02-14T13:10:43.093 INFO:tasks.workunit.client.0.smithi012.stdout:1/969: mknod d6/d10/d22/d31/d5b/d5d/d80/da4/c125 0 2024-02-14T13:10:43.095 INFO:tasks.workunit.client.0.smithi012.stdout:4/944: mknod d0/de1/de8/d11a/c15c 0 2024-02-14T13:10:43.096 INFO:tasks.workunit.client.0.smithi012.stdout:6/897: mknod d1/d1e/d1b/da8/d9b/c11b 0 2024-02-14T13:10:43.097 INFO:tasks.workunit.client.0.smithi012.stdout:1/970: creat d6/d10/d22/d31/d34/df8/f126 x:0 0 0 2024-02-14T13:10:43.098 INFO:tasks.workunit.client.0.smithi012.stdout:6/898: creat d1/d1e/d1b/d3e/f11c x:0 0 0 2024-02-14T13:10:43.098 INFO:tasks.workunit.client.0.smithi012.stdout:6/899: write d1/d1e/d1b/d111/f100 [306866,18546] 0 2024-02-14T13:10:43.099 INFO:tasks.workunit.client.0.smithi012.stdout:1/971: creat d6/d10/f127 x:0 0 0 2024-02-14T13:10:43.099 INFO:tasks.workunit.client.0.smithi012.stdout:1/972: chown l5 13235161 1 2024-02-14T13:10:43.099 INFO:tasks.workunit.client.0.smithi012.stdout:6/900: creat d1/df/f11d x:0 0 0 2024-02-14T13:10:43.100 INFO:tasks.workunit.client.0.smithi012.stdout:1/973: mkdir d6/d10/d22/d31/d34/d58/d128 0 2024-02-14T13:10:43.100 INFO:tasks.workunit.client.0.smithi012.stdout:1/974: truncate d6/d10/d22/d31/d34/fb0 5437940 0 2024-02-14T13:10:43.111 INFO:tasks.workunit.client.0.smithi012.stdout:6/901: dread d1/df/fd6 [0,4194304] 0 2024-02-14T13:10:43.122 INFO:tasks.workunit.client.0.smithi012.stdout:4/945: dwrite d0/df0/f12a [0,4194304] 0 2024-02-14T13:10:43.123 INFO:tasks.workunit.client.0.smithi012.stdout:4/946: readlink d0/d10/d28/d62/l8b 0 2024-02-14T13:10:43.123 INFO:tasks.workunit.client.0.smithi012.stdout:4/947: fdatasync d0/d10/d28/d4f/d6b/fdd 0 2024-02-14T13:10:43.123 INFO:tasks.workunit.client.0.smithi012.stdout:1/975: dwrite d6/d10/d22/d31/d5b/d5d/f6e [0,4194304] 0 2024-02-14T13:10:43.123 INFO:tasks.workunit.client.0.smithi012.stdout:1/976: chown d6/d10/d22/f54 6689 1 2024-02-14T13:10:43.123 INFO:tasks.workunit.client.0.smithi012.stdout:6/902: dwrite d1/d1e/ff6 [0,4194304] 0 2024-02-14T13:10:43.124 INFO:tasks.workunit.client.0.smithi012.stdout:3/949: dwrite d9/d18/d39/df7/ffd [0,4194304] 0 2024-02-14T13:10:43.124 INFO:tasks.workunit.client.0.smithi012.stdout:3/950: read - d9/dcd/f13f zero size 2024-02-14T13:10:43.126 INFO:tasks.workunit.client.0.smithi012.stdout:4/948: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/f61 [0,4194304] 0 2024-02-14T13:10:43.128 INFO:tasks.workunit.client.0.smithi012.stdout:6/903: getdents d1/df/d16 0 2024-02-14T13:10:43.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/904: getdents d1/df/d24/d3f/d56 0 2024-02-14T13:10:43.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/905: fdatasync d1/d1e/d1b/d21/d69/fa9 0 2024-02-14T13:10:43.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/906: chown d1/d1e/d66 10250485 1 2024-02-14T13:10:43.132 INFO:tasks.workunit.client.0.smithi012.stdout:6/907: rename d1/df/d16/d7c/d97/d82 to d1/df/d24/d5f/d11e 0 2024-02-14T13:10:43.134 INFO:tasks.workunit.client.0.smithi012.stdout:1/977: dread d6/d10/d22/d31/d3e/f4f [0,4194304] 0 2024-02-14T13:10:43.135 INFO:tasks.workunit.client.0.smithi012.stdout:1/978: creat d6/d10/d22/d31/d5b/d5e/d65/d87/dcc/f129 x:0 0 0 2024-02-14T13:10:43.142 INFO:tasks.workunit.client.0.smithi012.stdout:7/828: sync 2024-02-14T13:10:43.142 INFO:tasks.workunit.client.0.smithi012.stdout:8/980: sync 2024-02-14T13:10:43.142 INFO:tasks.workunit.client.0.smithi012.stdout:7/829: fdatasync df/d2d/d5d/d72/ff7 0 2024-02-14T13:10:43.145 INFO:tasks.workunit.client.0.smithi012.stdout:8/981: rename d9/dc/d14/d2e/dde/d56/d57/d7c/fc5 to d9/dc/f14e 0 2024-02-14T13:10:43.156 INFO:tasks.workunit.client.0.smithi012.stdout:8/982: dread d9/dc/d14/d2e/dde/da3/f11b [0,4194304] 0 2024-02-14T13:10:43.156 INFO:tasks.workunit.client.0.smithi012.stdout:6/908: dwrite d1/d1e/dc/d28/f2d [0,4194304] 0 2024-02-14T13:10:43.156 INFO:tasks.workunit.client.0.smithi012.stdout:3/951: dwrite d9/d13/d28/f117 [0,4194304] 0 2024-02-14T13:10:43.156 INFO:tasks.workunit.client.0.smithi012.stdout:3/952: chown d9/dd/c62 59841 1 2024-02-14T13:10:43.156 INFO:tasks.workunit.client.0.smithi012.stdout:4/949: dwrite d0/d10/d28/d4f/d6b/d83/f2d [0,4194304] 0 2024-02-14T13:10:43.156 INFO:tasks.workunit.client.0.smithi012.stdout:4/950: truncate d0/d10/d28/d4f/d6b/d83/f106 1007260 0 2024-02-14T13:10:43.157 INFO:tasks.workunit.client.0.smithi012.stdout:3/953: creat d9/dcd/f14a x:0 0 0 2024-02-14T13:10:43.158 INFO:tasks.workunit.client.0.smithi012.stdout:3/954: chown d9/dd/d30/d44/d66/db3/db9/fda 297 1 2024-02-14T13:10:43.158 INFO:tasks.workunit.client.0.smithi012.stdout:3/955: fsync d9/dd/de/d58/d65/f134 0 2024-02-14T13:10:43.158 INFO:tasks.workunit.client.0.smithi012.stdout:3/956: creat d9/dd/d30/d34/dc1/f14b x:0 0 0 2024-02-14T13:10:43.159 INFO:tasks.workunit.client.0.smithi012.stdout:3/957: mknod d9/dd/d30/d44/c14c 0 2024-02-14T13:10:43.160 INFO:tasks.workunit.client.0.smithi012.stdout:3/958: rmdir d9/d13/daa/df8 39 2024-02-14T13:10:43.166 INFO:tasks.workunit.client.0.smithi012.stdout:1/979: dwrite d6/d10/d22/d31/d5b/d5d/f6e [0,4194304] 0 2024-02-14T13:10:43.167 INFO:tasks.workunit.client.0.smithi012.stdout:4/951: dread d0/d10/d28/d4f/d6b/d83/d17/fcb [0,4194304] 0 2024-02-14T13:10:43.167 INFO:tasks.workunit.client.0.smithi012.stdout:4/952: fdatasync d0/d10/d28/d4f/d6b/d83/d17/d5f/fdf 0 2024-02-14T13:10:43.167 INFO:tasks.workunit.client.0.smithi012.stdout:4/953: readlink d0/de1/de8/l145 0 2024-02-14T13:10:43.167 INFO:tasks.workunit.client.0.smithi012.stdout:1/980: mkdir d6/d10/d22/d31/d34/df3/d12a 0 2024-02-14T13:10:43.167 INFO:tasks.workunit.client.0.smithi012.stdout:1/981: chown d6/d10/d22/d31/d5b/d5d/d6d/de9/f100 6163712 1 2024-02-14T13:10:43.167 INFO:tasks.workunit.client.0.smithi012.stdout:1/982: chown d6/d10/d22/d31/d3e/fc4 30 1 2024-02-14T13:10:43.168 INFO:tasks.workunit.client.0.smithi012.stdout:4/954: dread d0/d10/d28/d4f/d6b/d83/f106 [0,4194304] 0 2024-02-14T13:10:43.170 INFO:tasks.workunit.client.0.smithi012.stdout:4/955: creat d0/d10/d28/d4f/d6b/d8f/d56/d98/f15d x:0 0 0 2024-02-14T13:10:43.170 INFO:tasks.workunit.client.0.smithi012.stdout:4/956: dread - d0/d10/d28/ffc zero size 2024-02-14T13:10:43.171 INFO:tasks.workunit.client.0.smithi012.stdout:4/957: link d0/d10/d28/d4f/d6b/d83/ld2 d0/d10/d28/d118/l15e 0 2024-02-14T13:10:43.173 INFO:tasks.workunit.client.0.smithi012.stdout:8/983: read d9/dc/d38/d6a/f113 [2098866,26163] 0 2024-02-14T13:10:43.174 INFO:tasks.workunit.client.0.smithi012.stdout:7/830: dwrite df/d27/d4b/d8d/fa0 [0,4194304] 0 2024-02-14T13:10:43.174 INFO:tasks.workunit.client.0.smithi012.stdout:7/831: chown df/d36/d67/fa7 17 1 2024-02-14T13:10:43.175 INFO:tasks.workunit.client.0.smithi012.stdout:3/959: dread d9/dd/de/d58/d13c/f132 [0,4194304] 0 2024-02-14T13:10:43.175 INFO:tasks.workunit.client.0.smithi012.stdout:8/984: symlink d9/dc/d14/d2e/dde/l14f 0 2024-02-14T13:10:43.175 INFO:tasks.workunit.client.0.smithi012.stdout:8/985: write d9/dc/d14/d23/ddf/d134/f143 [585161,11662] 0 2024-02-14T13:10:43.176 INFO:tasks.workunit.client.0.smithi012.stdout:7/832: mkdir df/d36/d117 0 2024-02-14T13:10:43.176 INFO:tasks.workunit.client.0.smithi012.stdout:7/833: write df/d27/d4b/d6b/d6d/d85/fad [1032856,53767] 0 2024-02-14T13:10:43.177 INFO:tasks.workunit.client.0.smithi012.stdout:8/986: symlink d9/dc/d14/d23/ddf/d134/l150 0 2024-02-14T13:10:43.179 INFO:tasks.workunit.client.0.smithi012.stdout:7/834: mknod df/d27/d4b/d5a/c118 0 2024-02-14T13:10:43.180 INFO:tasks.workunit.client.0.smithi012.stdout:3/960: dread d9/dd/de/d58/d65/d6c/f94 [0,4194304] 0 2024-02-14T13:10:43.181 INFO:tasks.workunit.client.0.smithi012.stdout:8/987: unlink d9/dc/d14/d2e/dde/c52 0 2024-02-14T13:10:43.182 INFO:tasks.workunit.client.0.smithi012.stdout:3/961: getdents d9/d13/dea/d103/d6a 0 2024-02-14T13:10:43.182 INFO:tasks.workunit.client.0.smithi012.stdout:3/962: chown d9/dd/d30/d34/f51 15650638 1 2024-02-14T13:10:43.182 INFO:tasks.workunit.client.0.smithi012.stdout:3/963: write d9/d13/dea/d103/ff2 [146087,75202] 0 2024-02-14T13:10:43.185 INFO:tasks.workunit.client.0.smithi012.stdout:8/988: write d9/fbf [4535788,130990] 0 2024-02-14T13:10:43.187 INFO:tasks.workunit.client.0.smithi012.stdout:8/989: creat d9/dc/d14/d2e/dde/d56/d57/dda/f151 x:0 0 0 2024-02-14T13:10:43.188 INFO:tasks.workunit.client.0.smithi012.stdout:8/990: mkdir d9/dc/d14/d2e/dde/d152 0 2024-02-14T13:10:43.189 INFO:tasks.workunit.client.0.smithi012.stdout:8/991: rename d9/cf to d9/dc/d14/d23/d62/c153 0 2024-02-14T13:10:43.191 INFO:tasks.workunit.client.0.smithi012.stdout:8/992: rmdir d9/dc/d14/d2e/dde/d56/d57/d7c/d112 0 2024-02-14T13:10:43.194 INFO:tasks.workunit.client.0.smithi012.stdout:3/964: dread d9/dd/d30/d44/d66/db3/db9/fda [0,4194304] 0 2024-02-14T13:10:43.195 INFO:tasks.workunit.client.0.smithi012.stdout:3/965: rmdir d9/dd/d30/d44/d66/db3/dee 39 2024-02-14T13:10:43.195 INFO:tasks.workunit.client.0.smithi012.stdout:8/993: dread d9/dc/d14/f95 [0,4194304] 0 2024-02-14T13:10:43.195 INFO:tasks.workunit.client.0.smithi012.stdout:6/909: dwrite d1/d1e/dc/f15 [4194304,4194304] 0 2024-02-14T13:10:43.195 INFO:tasks.workunit.client.0.smithi012.stdout:8/994: stat d9/dc/d14/d2e/dde/d56/d57/dda/f151 0 2024-02-14T13:10:43.195 INFO:tasks.workunit.client.0.smithi012.stdout:6/910: getdents d1/d1e/d1b/d21/d69/d106 0 2024-02-14T13:10:43.196 INFO:tasks.workunit.client.0.smithi012.stdout:3/966: mkdir d9/d3f/d14d 0 2024-02-14T13:10:43.196 INFO:tasks.workunit.client.0.smithi012.stdout:3/967: stat d9/dd/c5f 0 2024-02-14T13:10:43.196 INFO:tasks.workunit.client.0.smithi012.stdout:1/983: dwrite d6/f1b [0,4194304] 0 2024-02-14T13:10:43.196 INFO:tasks.workunit.client.0.smithi012.stdout:1/984: readlink d6/d10/d22/d31/d5b/d5e/d65/d87/ld3 0 2024-02-14T13:10:43.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/968: truncate d9/d13/f20 763948 0 2024-02-14T13:10:43.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/969: chown d9/d3f 1466286 1 2024-02-14T13:10:43.198 INFO:tasks.workunit.client.0.smithi012.stdout:3/970: stat d9/d13/dea/d103/d6a/cd6 0 2024-02-14T13:10:43.199 INFO:tasks.workunit.client.0.smithi012.stdout:1/985: dread d6/d10/d22/d44/dbb/d101/faa [0,4194304] 0 2024-02-14T13:10:43.206 INFO:tasks.workunit.client.0.smithi012.stdout:6/911: dread d1/d1e/d1b/d21/d69/fa9 [0,4194304] 0 2024-02-14T13:10:43.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/958: dwrite d0/d10/d28/d4f/d6b/d8f/f8d [0,4194304] 0 2024-02-14T13:10:43.206 INFO:tasks.workunit.client.0.smithi012.stdout:4/959: getdents d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d159 0 2024-02-14T13:10:43.208 INFO:tasks.workunit.client.0.smithi012.stdout:3/971: creat d9/d18/d39/df3/f14e x:0 0 0 2024-02-14T13:10:43.208 INFO:tasks.workunit.client.0.smithi012.stdout:3/972: write d9/dd/d30/d34/d78/f96 [1599213,129179] 0 2024-02-14T13:10:43.210 INFO:tasks.workunit.client.0.smithi012.stdout:1/986: rename d6/d10/d22/d31/d5b/d5d/d80/ce1 to d6/d10/d22/d31/d5b/d5e/d65/d87/dcc/c12b 0 2024-02-14T13:10:43.211 INFO:tasks.workunit.client.0.smithi012.stdout:1/987: dread - d6/d10/d22/d31/d34/da0/f117 zero size 2024-02-14T13:10:43.214 INFO:tasks.workunit.client.0.smithi012.stdout:6/912: truncate d1/d1e/d1b/d21/d78/fc3 1969236 0 2024-02-14T13:10:43.214 INFO:tasks.workunit.client.0.smithi012.stdout:6/913: readlink d1/d1e/dc/d43/dd4/ldc 0 2024-02-14T13:10:43.217 INFO:tasks.workunit.client.0.smithi012.stdout:8/995: dwrite d9/dc/d14/d2e/dde/d56/fa7 [0,4194304] 0 2024-02-14T13:10:43.217 INFO:tasks.workunit.client.0.smithi012.stdout:6/914: write d1/df/d24/d5f/f116 [152090,20878] 0 2024-02-14T13:10:43.220 INFO:tasks.workunit.client.0.smithi012.stdout:6/915: mknod d1/df/d24/d5f/da0/c11f 0 2024-02-14T13:10:43.221 INFO:tasks.workunit.client.0.smithi012.stdout:6/916: read d1/d1e/d1b/f87 [267658,86659] 0 2024-02-14T13:10:43.221 INFO:tasks.workunit.client.0.smithi012.stdout:6/917: truncate d1/d1e/dc/d43/d75/faa 1611729 0 2024-02-14T13:10:43.222 INFO:tasks.workunit.client.0.smithi012.stdout:6/918: readlink d1/d1e/d1b/db8/l10e 0 2024-02-14T13:10:43.223 INFO:tasks.workunit.client.0.smithi012.stdout:6/919: symlink d1/df/d16/d7c/d112/l120 0 2024-02-14T13:10:43.225 INFO:tasks.workunit.client.0.smithi012.stdout:6/920: dread d1/d1e/dc/d43/d75/fe3 [0,4194304] 0 2024-02-14T13:10:43.228 INFO:tasks.workunit.client.0.smithi012.stdout:3/973: dwrite d9/dd/de/d58/d65/d6c/f94 [0,4194304] 0 2024-02-14T13:10:43.228 INFO:tasks.workunit.client.0.smithi012.stdout:6/921: unlink d1/d1e/ca 0 2024-02-14T13:10:43.228 INFO:tasks.workunit.client.0.smithi012.stdout:6/922: chown d1/df/d50/f10a 0 1 2024-02-14T13:10:43.256 INFO:tasks.workunit.client.0.smithi012.stdout:8/996: dwrite d9/dc/d14/d2e/f5d [0,4194304] 0 2024-02-14T13:10:43.256 INFO:tasks.workunit.client.0.smithi012.stdout:3/974: dwrite d9/dd/de/d58/d65/d6c/f127 [0,4194304] 0 2024-02-14T13:10:43.256 INFO:tasks.workunit.client.0.smithi012.stdout:6/923: dwrite d1/d1e/d1b/da8/f68 [4194304,4194304] 0 2024-02-14T13:10:43.257 INFO:tasks.workunit.client.0.smithi012.stdout:3/975: rmdir d9/dd/d30 39 2024-02-14T13:10:43.259 INFO:tasks.workunit.client.0.smithi012.stdout:6/924: rename d1/f9f to d1/df/f121 0 2024-02-14T13:10:43.259 INFO:tasks.workunit.client.0.smithi012.stdout:3/976: chown d9/dd/d30/d34/ld1 868049 1 2024-02-14T13:10:43.259 INFO:tasks.workunit.client.0.smithi012.stdout:3/977: write d9/d13/d28/f9a [115098,83629] 0 2024-02-14T13:10:43.260 INFO:tasks.workunit.client.0.smithi012.stdout:8/997: write d9/dc/d14/d2e/dde/da3/f11b [1468095,27682] 0 2024-02-14T13:10:43.262 INFO:tasks.workunit.client.0.smithi012.stdout:6/925: creat d1/d1e/f122 x:0 0 0 2024-02-14T13:10:43.263 INFO:tasks.workunit.client.0.smithi012.stdout:3/978: rename d9/d3f/da8/cde to d9/d13/dea/d103/d6a/c14f 0 2024-02-14T13:10:43.264 INFO:tasks.workunit.client.0.smithi012.stdout:8/998: getdents d9/dc/d14/d2e/dde 0 2024-02-14T13:10:43.266 INFO:tasks.workunit.client.0.smithi012.stdout:6/926: creat d1/df/d24/d3f/f123 x:0 0 0 2024-02-14T13:10:43.266 INFO:tasks.workunit.client.0.smithi012.stdout:7/835: sync 2024-02-14T13:10:43.266 INFO:tasks.workunit.client.0.smithi012.stdout:7/836: chown df/c1a 117 1 2024-02-14T13:10:43.266 INFO:tasks.workunit.client.0.smithi012.stdout:7/837: chown df/d2d/c4a 28 1 2024-02-14T13:10:43.266 INFO:tasks.workunit.client.0.smithi012.stdout:3/979: mkdir d9/dcd/d150 0 2024-02-14T13:10:43.267 INFO:tasks.workunit.client.0.smithi012.stdout:8/999: rmdir d9/dc/d1b/d6b/dfe 39 2024-02-14T13:10:43.267 INFO:tasks.workunit.client.0.smithi012.stdout:6/927: dread d1/d1e/dc/d43/d75/faa [0,4194304] 0 2024-02-14T13:10:43.267 INFO:tasks.workunit.client.0.smithi012.stdout:6/928: chown d1/c79 1947 1 2024-02-14T13:10:43.268 INFO:tasks.workunit.client.0.smithi012.stdout:6/929: write d1/d1e/d1b/d21/f35 [2672814,83161] 0 2024-02-14T13:10:43.268 INFO:tasks.workunit.client.0.smithi012.stdout:6/930: chown d1/d1e/d1b/f2f 73804739 1 2024-02-14T13:10:43.268 INFO:tasks.workunit.client.0.smithi012.stdout:3/980: link d9/d3f/d4e/c107 d9/dd/d30/d44/d3d/c151 0 2024-02-14T13:10:43.268 INFO:tasks.workunit.client.0.smithi012.stdout:3/981: chown d9/d18/d39/l8a 446369981 1 2024-02-14T13:10:43.269 INFO:tasks.workunit.client.0.smithi012.stdout:6/931: mkdir d1/d1e/d1b/d21/d78/ddf/d124 0 2024-02-14T13:10:43.270 INFO:tasks.workunit.client.0.smithi012.stdout:3/982: mknod d9/d3f/d73/c152 0 2024-02-14T13:10:43.270 INFO:tasks.workunit.client.0.smithi012.stdout:6/932: truncate d1/d1e/ff6 1094118 0 2024-02-14T13:10:43.271 INFO:tasks.workunit.client.0.smithi012.stdout:6/933: creat d1/d1e/d1b/d3e/f125 x:0 0 0 2024-02-14T13:10:43.271 INFO:tasks.workunit.client.0.smithi012.stdout:6/934: creat d1/d1e/dc/f126 x:0 0 0 2024-02-14T13:10:43.272 INFO:tasks.workunit.client.0.smithi012.stdout:6/935: mkdir d1/df/d16/d7c/d127 0 2024-02-14T13:10:43.276 INFO:tasks.workunit.client.0.smithi012.stdout:3/983: write d9/dd/d30/d44/d66/db3/dee/d133/f149 [2540609,91106] 0 2024-02-14T13:10:43.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/936: dread d1/d1e/d1b/d3e/fb1 [0,4194304] 0 2024-02-14T13:10:43.280 INFO:tasks.workunit.client.0.smithi012.stdout:6/937: getdents d1/d1e/d66 0 2024-02-14T13:10:43.281 INFO:tasks.workunit.client.0.smithi012.stdout:6/938: mknod d1/d110/c128 0 2024-02-14T13:10:43.290 INFO:tasks.workunit.client.0.smithi012.stdout:7/838: dwrite df/d27/d4b/f8e [0,4194304] 0 2024-02-14T13:10:43.293 INFO:tasks.workunit.client.0.smithi012.stdout:7/839: symlink df/d2d/d82/d88/l119 0 2024-02-14T13:10:43.295 INFO:tasks.workunit.client.0.smithi012.stdout:7/840: mkdir df/d36/d67/d11a 0 2024-02-14T13:10:43.304 INFO:tasks.workunit.client.0.smithi012.stdout:3/984: dwrite d9/d13/dea/f9b [0,4194304] 0 2024-02-14T13:10:43.304 INFO:tasks.workunit.client.0.smithi012.stdout:3/985: chown d9/d13/d28/la0 207 1 2024-02-14T13:10:43.305 INFO:tasks.workunit.client.0.smithi012.stdout:6/939: dwrite d1/df/d24/d3f/d56/d93/feb [0,4194304] 0 2024-02-14T13:10:43.310 INFO:tasks.workunit.client.0.smithi012.stdout:6/940: mkdir d1/d1e/d129 0 2024-02-14T13:10:43.311 INFO:tasks.workunit.client.0.smithi012.stdout:6/941: link d1/df/d24/f8f d1/d1e/dc/d43/dd4/f12a 0 2024-02-14T13:10:43.311 INFO:tasks.workunit.client.0.smithi012.stdout:6/942: chown d1/d1e/d1b/da8/d9b 43 1 2024-02-14T13:10:43.313 INFO:tasks.workunit.client.0.smithi012.stdout:7/841: dwrite df/fb0 [0,4194304] 0 2024-02-14T13:10:43.313 INFO:tasks.workunit.client.0.smithi012.stdout:3/986: write d9/d13/dea/d103/f11c [1810361,82490] 0 2024-02-14T13:10:43.313 INFO:tasks.workunit.client.0.smithi012.stdout:6/943: rename d1/df/d24/d3f/d56/d93/d95/c11a to d1/d1e/d1b/c12b 0 2024-02-14T13:10:43.315 INFO:tasks.workunit.client.0.smithi012.stdout:3/987: creat d9/d3f/d73/f153 x:0 0 0 2024-02-14T13:10:43.315 INFO:tasks.workunit.client.0.smithi012.stdout:3/988: fdatasync d9/d7b/d95/fab 0 2024-02-14T13:10:43.315 INFO:tasks.workunit.client.0.smithi012.stdout:1/988: sync 2024-02-14T13:10:43.316 INFO:tasks.workunit.client.0.smithi012.stdout:4/960: sync 2024-02-14T13:10:43.317 INFO:tasks.workunit.client.0.smithi012.stdout:4/961: creat d0/d10/f15f x:0 0 0 2024-02-14T13:10:43.318 INFO:tasks.workunit.client.0.smithi012.stdout:4/962: mkdir d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/d160 0 2024-02-14T13:10:43.319 INFO:tasks.workunit.client.0.smithi012.stdout:4/963: creat d0/d10/d28/d4f/d6b/d8f/d56/d8c/df6/d160/f161 x:0 0 0 2024-02-14T13:10:43.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/989: write d6/d10/d22/d31/d5b/d5d/d6d/de9/f100 [812425,91732] 0 2024-02-14T13:10:43.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/990: truncate d6/d10/d22/d31/d5b/d5e/d65/dec/fde 744925 0 2024-02-14T13:10:43.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/991: stat d6/d10/d22/d31/d5b/d5d/d6d/de9/f100 0 2024-02-14T13:10:43.323 INFO:tasks.workunit.client.0.smithi012.stdout:1/992: creat d6/d10/d22/d31/d34/da0/d11f/f12c x:0 0 0 2024-02-14T13:10:43.324 INFO:tasks.workunit.client.0.smithi012.stdout:1/993: write d6/d10/d22/d31/d5b/d5d/fa1 [276190,36227] 0 2024-02-14T13:10:43.333 INFO:tasks.workunit.client.0.smithi012.stdout:6/944: dwrite d1/d1e/dc/d28/fd9 [0,4194304] 0 2024-02-14T13:10:43.335 INFO:tasks.workunit.client.0.smithi012.stdout:6/945: creat d1/d1e/dc/d28/d7b/f12c x:0 0 0 2024-02-14T13:10:43.335 INFO:tasks.workunit.client.0.smithi012.stdout:6/946: fsync d1/d1e/ff6 0 2024-02-14T13:10:43.335 INFO:tasks.workunit.client.0.smithi012.stdout:3/989: dwrite d9/d13/daa/df8/d10e/fe9 [0,4194304] 0 2024-02-14T13:10:43.336 INFO:tasks.workunit.client.0.smithi012.stdout:6/947: creat d1/df/d24/d5f/da0/f12d x:0 0 0 2024-02-14T13:10:43.336 INFO:tasks.workunit.client.0.smithi012.stdout:3/990: mknod d9/d18/d39/df7/c154 0 2024-02-14T13:10:43.336 INFO:tasks.workunit.client.0.smithi012.stdout:3/991: fsync d9/dd/de/d58/d13c/f132 0 2024-02-14T13:10:43.336 INFO:tasks.workunit.client.0.smithi012.stdout:3/992: fdatasync d9/dd/fb8 0 2024-02-14T13:10:43.336 INFO:tasks.workunit.client.0.smithi012.stdout:6/948: symlink d1/df/d16/l12e 0 2024-02-14T13:10:43.337 INFO:tasks.workunit.client.0.smithi012.stdout:3/993: creat d9/d3f/da8/f155 x:0 0 0 2024-02-14T13:10:43.337 INFO:tasks.workunit.client.0.smithi012.stdout:6/949: creat d1/df/d24/d5f/da0/f12f x:0 0 0 2024-02-14T13:10:43.343 INFO:tasks.workunit.client.0.smithi012.stdout:1/994: dwrite d6/d10/d64/f11a [0,4194304] 0 2024-02-14T13:10:43.350 INFO:tasks.workunit.client.0.smithi012.stdout:3/994: dread d9/d13/d28/f117 [0,4194304] 0 2024-02-14T13:10:43.351 INFO:tasks.workunit.client.0.smithi012.stdout:3/995: truncate d9/d7b/d95/fab 80207 0 2024-02-14T13:10:43.351 INFO:tasks.workunit.client.0.smithi012.stdout:3/996: dread - d9/dc4/d131/f137 zero size 2024-02-14T13:10:43.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/995: write d6/d10/d22/d31/d5b/d5e/d65/fd2 [3200549,117815] 0 2024-02-14T13:10:43.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/996: chown d6/d10/d22/d31/d34/d58/d128 55386 1 2024-02-14T13:10:43.352 INFO:tasks.workunit.client.0.smithi012.stdout:1/997: fsync d6/d10/d22/d31/d5b/d5e/f36 0 2024-02-14T13:10:43.352 INFO:tasks.workunit.client.0.smithi012.stdout:3/997: symlink d9/l156 0 2024-02-14T13:10:43.353 INFO:tasks.workunit.client.0.smithi012.stdout:6/950: dwrite d1/df/fcc [0,4194304] 0 2024-02-14T13:10:43.354 INFO:tasks.workunit.client.0.smithi012.stdout:3/998: rename d9/d18/d39/l8a to d9/d13/dea/d103/l157 0 2024-02-14T13:10:43.354 INFO:tasks.workunit.client.0.smithi012.stdout:3/999: chown d9/d3f/d73/d5d/c63 1970090 1 2024-02-14T13:10:43.356 INFO:tasks.workunit.client.0.smithi012.stdout:6/951: symlink d1/df/d16/l130 0 2024-02-14T13:10:43.358 INFO:tasks.workunit.client.0.smithi012.stdout:6/952: link d1/df/d24/d5f/da0/f12f d1/d1e/d1b/d21/d69/de9/f131 0 2024-02-14T13:10:43.358 INFO:tasks.workunit.client.0.smithi012.stdout:6/953: write d1/d1e/dc/d43/f63 [4730274,64418] 0 2024-02-14T13:10:43.375 INFO:tasks.workunit.client.0.smithi012.stdout:1/998: dwrite d6/d10/d22/d31/d5b/d5d/d80/fd7 [0,4194304] 0 2024-02-14T13:10:43.376 INFO:tasks.workunit.client.0.smithi012.stdout:1/999: rename d6/d10/d22/d31/d5b/d5d/d80/da4/c124 to d6/d10/d22/d31/d34/c12d 0 2024-02-14T13:10:43.418 INFO:tasks.workunit.client.0.smithi012.stdout:7/842: sync 2024-02-14T13:10:43.436 INFO:tasks.workunit.client.0.smithi012.stdout:7/843: dwrite df/d27/d4b/d6b/d6d/d85/fdd [0,4194304] 0 2024-02-14T13:10:44.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:44 smithi012 ceph-mon[32370]: pgmap v408: 97 pgs: 97 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 186 MiB/s rd, 236 MiB/s wr, 1.35k op/s 2024-02-14T13:10:44.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:44 smithi103 ceph-mon[36921]: pgmap v408: 97 pgs: 97 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 186 MiB/s rd, 236 MiB/s wr, 1.35k op/s 2024-02-14T13:10:44.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:44 smithi055 ceph-mon[36853]: pgmap v408: 97 pgs: 97 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 186 MiB/s rd, 236 MiB/s wr, 1.35k op/s 2024-02-14T13:10:46.129 INFO:tasks.workunit.client.0.smithi012.stdout:4/964: sync 2024-02-14T13:10:46.129 INFO:tasks.workunit.client.0.smithi012.stdout:7/844: sync 2024-02-14T13:10:46.129 INFO:tasks.workunit.client.0.smithi012.stdout:6/954: sync 2024-02-14T13:10:46.129 INFO:tasks.workunit.client.0.smithi012.stdout:7/845: chown df/d27/d100/d10b/ld3 38101550 1 2024-02-14T13:10:46.131 INFO:tasks.workunit.client.0.smithi012.stdout:6/955: symlink d1/df/d24/d5f/d11e/da5/dc9/l132 0 2024-02-14T13:10:46.132 INFO:tasks.workunit.client.0.smithi012.stdout:6/956: mkdir d1/d1e/d1b/d21/d78/ddf/d133 0 2024-02-14T13:10:46.142 INFO:tasks.workunit.client.0.smithi012.stdout:7/846: read df/d24/f87 [4079019,79233] 0 2024-02-14T13:10:46.142 INFO:tasks.workunit.client.0.smithi012.stdout:7/847: chown df/d2d 11009 1 2024-02-14T13:10:46.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/848: dread df/d36/f3a [0,4194304] 0 2024-02-14T13:10:46.153 INFO:tasks.workunit.client.0.smithi012.stdout:7/849: getdents df/d2d/d5d/d72/d8a/dcd 0 2024-02-14T13:10:46.156 INFO:tasks.workunit.client.0.smithi012.stdout:7/850: rename df/d2d/d82/d88/d90/fe3 to df/d27/d4b/d8d/dd4/f11b 0 2024-02-14T13:10:46.156 INFO:tasks.workunit.client.0.smithi012.stdout:7/851: write df/d27/d4b/d8d/dd4/f106 [4366959,101808] 0 2024-02-14T13:10:46.156 INFO:tasks.workunit.client.0.smithi012.stdout:6/957: dwrite d1/d1e/d1b/d3e/f11c [0,4194304] 0 2024-02-14T13:10:46.156 INFO:tasks.workunit.client.0.smithi012.stdout:7/852: link df/d2d/f83 df/d2d/d82/d88/f11c 0 2024-02-14T13:10:46.194 INFO:tasks.workunit.client.0.smithi012.stdout:6/958: mkdir d1/d1e/d1b/d21/d134 0 2024-02-14T13:10:46.194 INFO:tasks.workunit.client.0.smithi012.stdout:6/959: dread - d1/d1e/dc/d28/d7b/f12c zero size 2024-02-14T13:10:46.194 INFO:tasks.workunit.client.0.smithi012.stdout:6/960: readlink d1/d1e/d1b/d21/d78/l7f 0 2024-02-14T13:10:46.195 INFO:tasks.workunit.client.0.smithi012.stdout:6/961: rename d1/d1e/d1b/d21/d69/f9d to d1/d110/f135 0 2024-02-14T13:10:46.196 INFO:tasks.workunit.client.0.smithi012.stdout:6/962: mkdir d1/d1e/dc/d43/d75/d136 0 2024-02-14T13:10:46.198 INFO:tasks.workunit.client.0.smithi012.stdout:6/963: creat d1/df/d24/d3f/d56/d93/f137 x:0 0 0 2024-02-14T13:10:46.198 INFO:tasks.workunit.client.0.smithi012.stdout:6/964: stat d1/d1e/dc/d43/d75/fe3 0 2024-02-14T13:10:46.199 INFO:tasks.workunit.client.0.smithi012.stdout:6/965: rename d1/df/d24/fe0 to d1/df/d16/d7c/d127/f138 0 2024-02-14T13:10:46.199 INFO:tasks.workunit.client.0.smithi012.stdout:6/966: truncate d1/d1e/d1b/d6d/ff9 1619173 0 2024-02-14T13:10:46.201 INFO:tasks.workunit.client.0.smithi012.stdout:7/853: mkdir df/d27/d4b/d8d/d11d 0 2024-02-14T13:10:46.202 INFO:tasks.workunit.client.0.smithi012.stdout:7/854: mknod df/d27/d4b/d10d/c11e 0 2024-02-14T13:10:46.210 INFO:tasks.workunit.client.0.smithi012.stdout:7/855: write df/d27/d4b/d8d/fe2 [3076568,3823] 0 2024-02-14T13:10:46.230 INFO:tasks.workunit.client.0.smithi012.stdout:7/856: dwrite df/d27/d100/d10b/fb6 [0,4194304] 0 2024-02-14T13:10:46.232 INFO:tasks.workunit.client.0.smithi012.stdout:7/857: mkdir df/d2d/d82/d11f 0 2024-02-14T13:10:46.233 INFO:tasks.workunit.client.0.smithi012.stdout:7/858: rename df/d2d/d5d/d72/de8/f10a to df/d27/d4b/d10d/d116/f120 0 2024-02-14T13:10:46.235 INFO:tasks.workunit.client.0.smithi012.stdout:7/859: rename df/cfb to df/d27/d4b/d5a/c121 0 2024-02-14T13:10:46.244 INFO:tasks.workunit.client.0.smithi012.stdout:7/860: dread df/d27/d4b/d6b/d6d/d85/db8/fd7 [0,4194304] 0 2024-02-14T13:10:46.244 INFO:tasks.workunit.client.0.smithi012.stdout:7/861: stat df/c14 0 2024-02-14T13:10:46.245 INFO:tasks.workunit.client.0.smithi012.stdout:7/862: unlink df/l1c 0 2024-02-14T13:10:46.246 INFO:tasks.workunit.client.0.smithi012.stdout:7/863: creat df/d27/d4b/d8d/d11d/f122 x:0 0 0 2024-02-14T13:10:46.247 INFO:tasks.workunit.client.0.smithi012.stdout:7/864: write df/d24/f38 [86870,21163] 0 2024-02-14T13:10:46.247 INFO:tasks.workunit.client.0.smithi012.stdout:7/865: creat df/d2d/d5d/d72/de8/f123 x:0 0 0 2024-02-14T13:10:46.248 INFO:tasks.workunit.client.0.smithi012.stdout:7/866: creat df/f124 x:0 0 0 2024-02-14T13:10:46.249 INFO:tasks.workunit.client.0.smithi012.stdout:7/867: creat df/d2d/d5d/d72/d8a/f125 x:0 0 0 2024-02-14T13:10:46.249 INFO:tasks.workunit.client.0.smithi012.stdout:7/868: stat df/d27/fa2 0 2024-02-14T13:10:46.267 INFO:tasks.workunit.client.0.smithi012.stdout:7/869: dwrite df/d2d/d82/d88/fb7 [0,4194304] 0 2024-02-14T13:10:46.273 INFO:tasks.workunit.client.0.smithi012.stdout:7/870: write df/d27/d4b/d5a/f9d [1088802,97095] 0 2024-02-14T13:10:46.273 INFO:tasks.workunit.client.0.smithi012.stdout:7/871: fdatasync df/d2d/d5d/f114 0 2024-02-14T13:10:46.274 INFO:tasks.workunit.client.0.smithi012.stdout:7/872: readlink df/d2d/d5d/l80 0 2024-02-14T13:10:46.274 INFO:tasks.workunit.client.0.smithi012.stdout:7/873: readlink df/d36/d67/l9b 0 2024-02-14T13:10:46.275 INFO:tasks.workunit.client.0.smithi012.stdout:7/874: creat df/d24/d9e/f126 x:0 0 0 2024-02-14T13:10:46.277 INFO:tasks.workunit.client.0.smithi012.stdout:4/965: sync 2024-02-14T13:10:46.277 INFO:tasks.workunit.client.0.smithi012.stdout:6/967: sync 2024-02-14T13:10:46.277 INFO:tasks.workunit.client.0.smithi012.stdout:6/968: truncate d1/d1e/d1b/d21/f10c 1001466 0 2024-02-14T13:10:46.278 INFO:tasks.workunit.client.0.smithi012.stdout:4/966: symlink d0/d10/d1f/d71/l162 0 2024-02-14T13:10:46.279 INFO:tasks.workunit.client.0.smithi012.stdout:4/967: write d0/d10/d1f/fa7 [1505140,9619] 0 2024-02-14T13:10:46.279 INFO:tasks.workunit.client.0.smithi012.stdout:6/969: mknod d1/d1e/d1b/d21/d78/c139 0 2024-02-14T13:10:46.283 INFO:tasks.workunit.client.0.smithi012.stdout:4/968: rmdir d0/d10/d1f 39 2024-02-14T13:10:46.284 INFO:tasks.workunit.client.0.smithi012.stdout:7/875: write df/d27/d100/d10b/fb6 [119293,99795] 0 2024-02-14T13:10:46.286 INFO:tasks.workunit.client.0.smithi012.stdout:7/876: unlink df/d24/d9e/c10c 0 2024-02-14T13:10:46.287 INFO:tasks.workunit.client.0.smithi012.stdout:4/969: rename d0/d10/d1f to d0/d10/d28/d4f/d6b/d8f/d56/d163 0 2024-02-14T13:10:46.288 INFO:tasks.workunit.client.0.smithi012.stdout:7/877: symlink df/d27/d4b/d8d/l127 0 2024-02-14T13:10:46.289 INFO:tasks.workunit.client.0.smithi012.stdout:4/970: mkdir d0/d10/d28/d4f/d6b/d83/d164 0 2024-02-14T13:10:46.290 INFO:tasks.workunit.client.0.smithi012.stdout:7/878: creat df/d27/d4b/d6b/d6d/d85/db8/f128 x:0 0 0 2024-02-14T13:10:46.290 INFO:tasks.workunit.client.0.smithi012.stdout:7/879: write df/f20 [4357094,41962] 0 2024-02-14T13:10:46.290 INFO:tasks.workunit.client.0.smithi012.stdout:4/971: stat d0/d10/d28/d4f/d6b/d83/d17/d5f/dcc/c105 0 2024-02-14T13:10:46.291 INFO:tasks.workunit.client.0.smithi012.stdout:7/880: symlink df/l129 0 2024-02-14T13:10:46.293 INFO:tasks.workunit.client.0.smithi012.stdout:4/972: link d0/d10/d28/d4f/d6b/d8f/f8d d0/d10/d28/d4f/d6b/d8f/d56/df7/f165 0 2024-02-14T13:10:46.293 INFO:tasks.workunit.client.0.smithi012.stdout:4/973: write d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/f91 [1974370,110566] 0 2024-02-14T13:10:46.293 INFO:tasks.workunit.client.0.smithi012.stdout:7/881: dread df/d2d/d5d/d72/d8a/dcd/fce [0,4194304] 0 2024-02-14T13:10:46.295 INFO:tasks.workunit.client.0.smithi012.stdout:7/882: mkdir df/d27/d4b/d8d/d11d/d12a 0 2024-02-14T13:10:46.295 INFO:tasks.workunit.client.0.smithi012.stdout:7/883: fsync df/d27/f28 0 2024-02-14T13:10:46.296 INFO:tasks.workunit.client.0.smithi012.stdout:4/974: mknod d0/d10/d28/d4f/d6b/d8f/d56/d8c/c166 0 2024-02-14T13:10:46.311 INFO:tasks.workunit.client.0.smithi012.stdout:4/975: dread d0/d10/d28/d4f/d6b/d83/d17/f72 [4194304,4194304] 0 2024-02-14T13:10:46.312 INFO:tasks.workunit.client.0.smithi012.stdout:4/976: truncate d0/f95 7865968 0 2024-02-14T13:10:46.315 INFO:tasks.workunit.client.0.smithi012.stdout:4/977: rename d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/lc4 to d0/d10/d28/d4f/d6b/d8f/d56/d98/d110/l167 0 2024-02-14T13:10:46.318 INFO:tasks.workunit.client.0.smithi012.stdout:7/884: dwrite df/d27/d4b/f6c [0,4194304] 0 2024-02-14T13:10:46.331 INFO:tasks.workunit.client.0.smithi012.stdout:7/885: write df/d2d/d82/d88/fb7 [1505373,129594] 0 2024-02-14T13:10:46.337 INFO:tasks.workunit.client.0.smithi012.stdout:4/978: dwrite d0/d10/d28/d4f/d6b/d8f/d56/fad [0,4194304] 0 2024-02-14T13:10:46.344 INFO:tasks.workunit.client.0.smithi012.stdout:4/979: dread d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d89/faa [0,4194304] 0 2024-02-14T13:10:46.345 INFO:tasks.workunit.client.0.smithi012.stdout:4/980: getdents d0/de1 0 2024-02-14T13:10:46.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/886: dwrite df/d2d/d5d/f114 [0,4194304] 0 2024-02-14T13:10:46.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/887: chown df/db1 446 1 2024-02-14T13:10:46.347 INFO:tasks.workunit.client.0.smithi012.stdout:7/888: write df/d36/f39 [1839390,42825] 0 2024-02-14T13:10:46.349 INFO:tasks.workunit.client.0.smithi012.stdout:7/889: mknod df/d27/d4b/c12b 0 2024-02-14T13:10:46.350 INFO:tasks.workunit.client.0.smithi012.stdout:7/890: rename df/d2d/d82/lc1 to df/d27/d4b/d6b/d6d/d85/l12c 0 2024-02-14T13:10:46.350 INFO:tasks.workunit.client.0.smithi012.stdout:7/891: chown df/c5b 31 1 2024-02-14T13:10:46.351 INFO:tasks.workunit.client.0.smithi012.stdout:7/892: creat df/d2d/f12d x:0 0 0 2024-02-14T13:10:46.352 INFO:tasks.workunit.client.0.smithi012.stdout:7/893: creat df/d27/d100/d10b/f12e x:0 0 0 2024-02-14T13:10:46.352 INFO:tasks.workunit.client.0.smithi012.stdout:7/894: chown df/d2d/d5d/d72/ff7 23271329 1 2024-02-14T13:10:46.357 INFO:tasks.workunit.client.0.smithi012.stdout:7/895: dread df/d27/f2b [0,4194304] 0 2024-02-14T13:10:46.357 INFO:tasks.workunit.client.0.smithi012.stdout:7/896: stat df/d36 0 2024-02-14T13:10:46.358 INFO:tasks.workunit.client.0.smithi012.stdout:7/897: mkdir df/d2d/d82/d88/d12f 0 2024-02-14T13:10:46.358 INFO:tasks.workunit.client.0.smithi012.stdout:7/898: truncate df/d2d/d5d/d72/ff7 915452 0 2024-02-14T13:10:46.359 INFO:tasks.workunit.client.0.smithi012.stdout:4/981: dwrite d0/d10/d28/d4f/d6b/d8f/f103 [0,4194304] 0 2024-02-14T13:10:46.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/899: dwrite df/d27/d4b/d6b/d6d/f81 [0,4194304] 0 2024-02-14T13:10:46.374 INFO:tasks.workunit.client.0.smithi012.stdout:7/900: write df/d2d/f96 [4509812,115202] 0 2024-02-14T13:10:46.376 INFO:tasks.workunit.client.0.smithi012.stdout:7/901: mknod df/d36/d67/d11a/c130 0 2024-02-14T13:10:46.377 INFO:tasks.workunit.client.0.smithi012.stdout:7/902: rename df/d2d/d5d/d72/de8/f123 to df/d27/d4b/d8d/f131 0 2024-02-14T13:10:46.378 INFO:tasks.workunit.client.0.smithi012.stdout:7/903: mkdir df/d2d/d82/d88/d12f/d132 0 2024-02-14T13:10:46.378 INFO:tasks.workunit.client.0.smithi012.stdout:7/904: chown df/d2d/d82/d11f 390 1 2024-02-14T13:10:46.379 INFO:tasks.workunit.client.0.smithi012.stdout:7/905: unlink df/d27/d4b/d5a/f9d 0 2024-02-14T13:10:46.380 INFO:tasks.workunit.client.0.smithi012.stdout:7/906: unlink df/d2d/d82/d88/db2/lb3 0 2024-02-14T13:10:46.381 INFO:tasks.workunit.client.0.smithi012.stdout:4/982: dwrite d0/d10/d28/d4f/d6b/d83/d17/d5f/fdf [0,4194304] 0 2024-02-14T13:10:46.381 INFO:tasks.workunit.client.0.smithi012.stdout:7/907: mkdir df/d2d/d82/d88/d133 0 2024-02-14T13:10:46.386 INFO:tasks.workunit.client.0.smithi012.stdout:4/983: mknod d0/d10/d28/d4f/d6b/d83/d17/d5f/d82/d159/c168 0 2024-02-14T13:10:46.388 INFO:tasks.workunit.client.0.smithi012.stdout:4/984: truncate d0/d10/d28/d4f/d6b/d8f/d56/d163/f2f 463670 0 2024-02-14T13:10:46.388 INFO:tasks.workunit.client.0.smithi012.stdout:4/985: write d0/d10/d28/d4f/d6b/d8f/f76 [1020379,118044] 0 2024-02-14T13:10:46.390 INFO:tasks.workunit.client.0.smithi012.stdout:4/986: creat d0/d10/f169 x:0 0 0 2024-02-14T13:10:46.392 INFO:tasks.workunit.client.0.smithi012.stdout:4/987: unlink d0/d10/d28/d4f/d6b/d8f/d56/d163/c25 0 2024-02-14T13:10:46.398 INFO:tasks.workunit.client.0.smithi012.stdout:6/970: sync 2024-02-14T13:10:46.398 INFO:tasks.workunit.client.0.smithi012.stdout:6/971: chown d1/df/d24/d3f/d56/d93/d95/dc7 31 1 2024-02-14T13:10:46.399 INFO:tasks.workunit.client.0.smithi012.stdout:6/972: chown d1/df/d24/f40 6 1 2024-02-14T13:10:46.399 INFO:tasks.workunit.client.0.smithi012.stdout:7/908: dwrite df/d27/d4b/d6b/d6d/d85/db8/fef [0,4194304] 0 2024-02-14T13:10:46.400 INFO:tasks.workunit.client.0.smithi012.stdout:6/973: mkdir d1/df/d16/d7c/d112/d13a 0 2024-02-14T13:10:46.400 INFO:tasks.workunit.client.0.smithi012.stdout:6/974: readlink d1/l6c 0 2024-02-14T13:10:46.400 INFO:tasks.workunit.client.0.smithi012.stdout:6/975: chown d1/df/d16/d7c/d97/lc5 3017866 1 2024-02-14T13:10:46.401 INFO:tasks.workunit.client.0.smithi012.stdout:6/976: stat d1/df/f11d 0 2024-02-14T13:10:46.401 INFO:tasks.workunit.client.0.smithi012.stdout:6/977: dread - d1/d1e/dc/d43/dd4/ff7 zero size 2024-02-14T13:10:46.403 INFO:tasks.workunit.client.0.smithi012.stdout:7/909: creat df/d27/d4b/d8d/dd4/f134 x:0 0 0 2024-02-14T13:10:46.403 INFO:tasks.workunit.client.0.smithi012.stdout:4/988: dread d0/d10/d28/d4f/d6b/d8f/d56/d163/fb7 [0,4194304] 0 2024-02-14T13:10:46.403 INFO:tasks.workunit.client.0.smithi012.stdout:4/989: read - d0/d10/d28/d4f/d6b/d83/d99/f121 zero size 2024-02-14T13:10:46.403 INFO:tasks.workunit.client.0.smithi012.stdout:4/990: write d0/d10/d28/da9/d86/db5/ff9 [796750,80849] 0 2024-02-14T13:10:46.404 INFO:tasks.workunit.client.0.smithi012.stdout:6/978: mknod d1/df/d50/db4/c13b 0 2024-02-14T13:10:46.404 INFO:tasks.workunit.client.0.smithi012.stdout:6/979: fsync d1/d1e/dc/d43/f89 0 2024-02-14T13:10:46.408 INFO:tasks.workunit.client.0.smithi012.stdout:4/991: rmdir d0/d10/d28/d4f/d6b/d8f 39 2024-02-14T13:10:46.413 INFO:tasks.workunit.client.0.smithi012.stdout:7/910: write df/d27/d4b/d10d/d116/f120 [3104447,114753] 0 2024-02-14T13:10:46.414 INFO:tasks.workunit.client.0.smithi012.stdout:7/911: dread df/d27/d4b/d6b/fc2 [0,4194304] 0 2024-02-14T13:10:46.415 INFO:tasks.workunit.client.0.smithi012.stdout:7/912: symlink df/d27/d4b/d8d/l135 0 2024-02-14T13:10:46.417 INFO:tasks.workunit.client.0.smithi012.stdout:7/913: mknod df/d27/d4b/d10d/c136 0 2024-02-14T13:10:46.417 INFO:tasks.workunit.client.0.smithi012.stdout:7/914: chown df/f23 118 1 2024-02-14T13:10:46.417 INFO:tasks.workunit.client.0.smithi012.stdout:7/915: write df/d2d/f3f [258898,78766] 0 2024-02-14T13:10:46.417 INFO:tasks.workunit.client.0.smithi012.stdout:7/916: chown df/d2d/d5d/d72/de8 962 1 2024-02-14T13:10:46.418 INFO:tasks.workunit.client.0.smithi012.stdout:7/917: creat df/d2d/d5d/d72/d8a/dcd/f137 x:0 0 0 2024-02-14T13:10:46.425 INFO:tasks.workunit.client.0.smithi012.stdout:4/992: dwrite d0/d10/f79 [0,4194304] 0 2024-02-14T13:10:46.427 INFO:tasks.workunit.client.0.smithi012.stdout:4/993: dread d0/d10/d28/d4f/d6b/d8f/d56/d163/fa7 [0,4194304] 0 2024-02-14T13:10:46.429 INFO:tasks.workunit.client.0.smithi012.stdout:4/994: write d0/d10/d28/d4f/d6b/d8f/d56/f7f [962584,64142] 0 2024-02-14T13:10:46.431 INFO:tasks.workunit.client.0.smithi012.stdout:4/995: creat d0/d10/d28/d4f/dc7/dfb/f16a x:0 0 0 2024-02-14T13:10:46.442 INFO:tasks.workunit.client.0.smithi012.stdout:7/918: dwrite df/d27/d4b/d5a/ffa [0,4194304] 0 2024-02-14T13:10:46.444 INFO:tasks.workunit.client.0.smithi012.stdout:7/919: creat df/d27/d4b/d8d/d11d/d12a/f138 x:0 0 0 2024-02-14T13:10:46.444 INFO:tasks.workunit.client.0.smithi012.stdout:7/920: fdatasync df/d27/d4b/d5a/ffa 0 2024-02-14T13:10:46.445 INFO:tasks.workunit.client.0.smithi012.stdout:7/921: creat df/d2d/d82/d88/d12f/d132/f139 x:0 0 0 2024-02-14T13:10:46.446 INFO:tasks.workunit.client.0.smithi012.stdout:7/922: dread df/d27/d100/d10b/fe7 [0,4194304] 0 2024-02-14T13:10:46.463 INFO:tasks.workunit.client.0.smithi012.stdout:7/923: dwrite df/d2d/f83 [0,4194304] 0 2024-02-14T13:10:46.464 INFO:tasks.workunit.client.0.smithi012.stdout:7/924: rmdir df/db1 39 2024-02-14T13:10:46.467 INFO:tasks.workunit.client.0.smithi012.stdout:7/925: getdents df/d27 0 2024-02-14T13:10:46.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:46 smithi012 ceph-mon[32370]: pgmap v409: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 209 MiB/s rd, 260 MiB/s wr, 1.41k op/s 2024-02-14T13:10:46.475 INFO:tasks.workunit.client.0.smithi012.stdout:7/926: dread df/fb0 [0,4194304] 0 2024-02-14T13:10:46.475 INFO:tasks.workunit.client.0.smithi012.stdout:7/927: dread - df/d2d/d5d/d72/de8/f10f zero size 2024-02-14T13:10:46.476 INFO:tasks.workunit.client.0.smithi012.stdout:7/928: mkdir df/d2d/d82/d88/d90/d13a 0 2024-02-14T13:10:46.476 INFO:tasks.workunit.client.0.smithi012.stdout:7/929: chown df/d27/f4c 307699715 1 2024-02-14T13:10:46.476 INFO:tasks.workunit.client.0.smithi012.stdout:7/930: symlink df/d27/d4b/d8d/dd4/l13b 0 2024-02-14T13:10:46.478 INFO:tasks.workunit.client.0.smithi012.stdout:7/931: link df/d36/d67/l9b df/l13c 0 2024-02-14T13:10:46.479 INFO:tasks.workunit.client.0.smithi012.stdout:7/932: link df/d2d/ff2 df/d2d/f13d 0 2024-02-14T13:10:46.480 INFO:tasks.workunit.client.0.smithi012.stdout:7/933: symlink df/d27/d4b/l13e 0 2024-02-14T13:10:46.480 INFO:tasks.workunit.client.0.smithi012.stdout:7/934: readlink df/l9c 0 2024-02-14T13:10:46.480 INFO:tasks.workunit.client.0.smithi012.stdout:7/935: chown df/d27/d4b/d8d/dd4/f134 1492250 1 2024-02-14T13:10:46.480 INFO:tasks.workunit.client.0.smithi012.stdout:7/936: creat df/d36/d67/d11a/f13f x:0 0 0 2024-02-14T13:10:46.481 INFO:tasks.workunit.client.0.smithi012.stdout:7/937: mknod df/d2d/d5d/c140 0 2024-02-14T13:10:46.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:46 smithi103 ceph-mon[36921]: pgmap v409: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 209 MiB/s rd, 260 MiB/s wr, 1.41k op/s 2024-02-14T13:10:46.501 INFO:tasks.workunit.client.0.smithi012.stdout:7/938: dwrite df/d36/d67/fff [0,4194304] 0 2024-02-14T13:10:46.510 INFO:tasks.workunit.client.0.smithi012.stdout:7/939: read df/d27/d4b/d8d/fa0 [4112695,49595] 0 2024-02-14T13:10:46.511 INFO:tasks.workunit.client.0.smithi012.stdout:7/940: creat df/d27/d4b/d6b/f141 x:0 0 0 2024-02-14T13:10:46.511 INFO:tasks.workunit.client.0.smithi012.stdout:7/941: fdatasync df/d27/d4b/d6b/d6d/d85/fdd 0 2024-02-14T13:10:46.529 INFO:tasks.workunit.client.0.smithi012.stdout:7/942: dwrite df/f1f [0,4194304] 0 2024-02-14T13:10:46.531 INFO:tasks.workunit.client.0.smithi012.stdout:7/943: creat df/d27/d4b/d8d/d11d/f142 x:0 0 0 2024-02-14T13:10:46.532 INFO:tasks.workunit.client.0.smithi012.stdout:7/944: rename df/d2d/d82/ca9 to df/d2d/d82/d88/d12f/d132/c143 0 2024-02-14T13:10:46.533 INFO:tasks.workunit.client.0.smithi012.stdout:7/945: mknod df/d2d/d5d/c144 0 2024-02-14T13:10:46.533 INFO:tasks.workunit.client.0.smithi012.stdout:7/946: fdatasync df/f30 0 2024-02-14T13:10:46.534 INFO:tasks.workunit.client.0.smithi012.stdout:6/980: sync 2024-02-14T13:10:46.535 INFO:tasks.workunit.client.0.smithi012.stdout:7/947: link df/d27/d4b/d6b/d6d/l10e df/d27/d4b/d5a/l145 0 2024-02-14T13:10:46.535 INFO:tasks.workunit.client.0.smithi012.stdout:7/948: symlink df/l146 0 2024-02-14T13:10:46.536 INFO:tasks.workunit.client.0.smithi012.stdout:7/949: dread df/d24/f70 [0,4194304] 0 2024-02-14T13:10:46.537 INFO:tasks.workunit.client.0.smithi012.stdout:7/950: stat df/d2d/d5d/d72/d8a/l91 0 2024-02-14T13:10:46.537 INFO:tasks.workunit.client.0.smithi012.stdout:7/951: dread - df/d27/d4b/d6b/d6d/d85/db8/f128 zero size 2024-02-14T13:10:46.538 INFO:tasks.workunit.client.0.smithi012.stdout:7/952: rmdir df/d24/d56 39 2024-02-14T13:10:46.539 INFO:tasks.workunit.client.0.smithi012.stdout:7/953: mkdir df/d27/d4b/d8d/d11d/d147 0 2024-02-14T13:10:46.539 INFO:tasks.workunit.client.0.smithi012.stdout:7/954: readlink df/lbc 0 2024-02-14T13:10:46.539 INFO:tasks.workunit.client.0.smithi012.stdout:7/955: readlink df/lc7 0 2024-02-14T13:10:46.540 INFO:tasks.workunit.client.0.smithi012.stdout:7/956: truncate df/d36/d67/fa7 3190442 0 2024-02-14T13:10:46.542 INFO:tasks.workunit.client.0.smithi012.stdout:7/957: mknod df/d27/c148 0 2024-02-14T13:10:46.542 INFO:tasks.workunit.client.0.smithi012.stdout:6/981: dread d1/df/d50/db4/fdb [0,4194304] 0 2024-02-14T13:10:46.542 INFO:tasks.workunit.client.0.smithi012.stdout:7/958: creat df/d27/d4b/d8d/d11d/f149 x:0 0 0 2024-02-14T13:10:46.543 INFO:tasks.workunit.client.0.smithi012.stdout:7/959: chown df/l13c 0 1 2024-02-14T13:10:46.544 INFO:tasks.workunit.client.0.smithi012.stdout:6/982: mknod d1/df/d16/c13c 0 2024-02-14T13:10:46.545 INFO:tasks.workunit.client.0.smithi012.stdout:7/960: mknod df/d27/d100/d10b/c14a 0 2024-02-14T13:10:46.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/983: rename d1/d1e/d1b/db8/fff to d1/df/d24/d3f/f13d 0 2024-02-14T13:10:46.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/984: readlink d1/df/d16/d7c/dfe/d104/l118 0 2024-02-14T13:10:46.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/985: chown d1/d1e/d1b/d6d/ff9 3 1 2024-02-14T13:10:46.547 INFO:tasks.workunit.client.0.smithi012.stdout:6/986: truncate d1/d1e/d1b/d21/d69/de9/f131 326333 0 2024-02-14T13:10:46.548 INFO:tasks.workunit.client.0.smithi012.stdout:7/961: symlink df/d27/d4b/d6b/l14b 0 2024-02-14T13:10:46.548 INFO:tasks.workunit.client.0.smithi012.stdout:7/962: dread - df/d27/d4b/d8d/dd4/f134 zero size 2024-02-14T13:10:46.548 INFO:tasks.workunit.client.0.smithi012.stdout:7/963: write df/d2d/d5d/d72/f77 [5121536,46095] 0 2024-02-14T13:10:46.549 INFO:tasks.workunit.client.0.smithi012.stdout:6/987: mkdir d1/d1e/d1b/d13e 0 2024-02-14T13:10:46.549 INFO:tasks.workunit.client.0.smithi012.stdout:6/988: fsync d1/d1e/dc/d43/d75/fe3 0 2024-02-14T13:10:46.549 INFO:tasks.workunit.client.0.smithi012.stdout:6/989: write d1/d1e/d1b/f87 [1777428,24235] 0 2024-02-14T13:10:46.551 INFO:tasks.workunit.client.0.smithi012.stdout:7/964: symlink df/d2d/d5d/d72/d8a/dcd/l14c 0 2024-02-14T13:10:46.553 INFO:tasks.workunit.client.0.smithi012.stdout:4/996: sync 2024-02-14T13:10:46.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:46 smithi055 ceph-mon[36853]: pgmap v409: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 209 MiB/s rd, 260 MiB/s wr, 1.41k op/s 2024-02-14T13:10:46.569 INFO:tasks.workunit.client.0.smithi012.stdout:6/990: dwrite d1/df/f121 [4194304,4194304] 0 2024-02-14T13:10:46.570 INFO:tasks.workunit.client.0.smithi012.stdout:7/965: dwrite df/d27/fa2 [0,4194304] 0 2024-02-14T13:10:46.570 INFO:tasks.workunit.client.0.smithi012.stdout:7/966: truncate df/d24/d9e/fcc 206884 0 2024-02-14T13:10:46.571 INFO:tasks.workunit.client.0.smithi012.stdout:6/991: creat d1/df/d24/d5f/d11e/da5/dc9/f13f x:0 0 0 2024-02-14T13:10:46.572 INFO:tasks.workunit.client.0.smithi012.stdout:7/967: symlink df/d27/d4b/d6b/d6d/d85/db8/l14d 0 2024-02-14T13:10:46.573 INFO:tasks.workunit.client.0.smithi012.stdout:6/992: unlink d1/df/d16/l12e 0 2024-02-14T13:10:46.573 INFO:tasks.workunit.client.0.smithi012.stdout:6/993: truncate d1/df/d24/d5f/da0/f12d 1028416 0 2024-02-14T13:10:46.574 INFO:tasks.workunit.client.0.smithi012.stdout:7/968: symlink df/d27/d4b/d8d/d11d/l14e 0 2024-02-14T13:10:46.574 INFO:tasks.workunit.client.0.smithi012.stdout:7/969: chown df/d36/f3a 28317 1 2024-02-14T13:10:46.575 INFO:tasks.workunit.client.0.smithi012.stdout:7/970: mknod df/d27/d4b/c14f 0 2024-02-14T13:10:46.575 INFO:tasks.workunit.client.0.smithi012.stdout:7/971: fdatasync df/d27/d4b/d6b/d6d/d85/fad 0 2024-02-14T13:10:46.575 INFO:tasks.workunit.client.0.smithi012.stdout:7/972: read - df/d36/d67/d11a/f13f zero size 2024-02-14T13:10:46.575 INFO:tasks.workunit.client.0.smithi012.stdout:7/973: fdatasync df/d27/d4b/d6b/d6d/d85/db8/fd7 0 2024-02-14T13:10:46.576 INFO:tasks.workunit.client.0.smithi012.stdout:7/974: truncate df/d27/d4b/d8d/dd4/f106 1718585 0 2024-02-14T13:10:46.581 INFO:tasks.workunit.client.0.smithi012.stdout:7/975: dread df/d27/d4b/d6b/d6d/d85/db8/fe4 [0,4194304] 0 2024-02-14T13:10:46.581 INFO:tasks.workunit.client.0.smithi012.stdout:6/994: dread d1/d1e/dc/f10f [0,4194304] 0 2024-02-14T13:10:46.582 INFO:tasks.workunit.client.0.smithi012.stdout:7/976: creat df/d27/d4b/d8d/d11d/d12a/f150 x:0 0 0 2024-02-14T13:10:46.582 INFO:tasks.workunit.client.0.smithi012.stdout:6/995: mknod d1/d1e/d1b/db8/c140 0 2024-02-14T13:10:46.585 INFO:tasks.workunit.client.0.smithi012.stdout:7/977: getdents df 0 2024-02-14T13:10:46.586 INFO:tasks.workunit.client.0.smithi012.stdout:7/978: unlink df/f26 0 2024-02-14T13:10:46.587 INFO:tasks.workunit.client.0.smithi012.stdout:7/979: mknod df/d27/d4b/d10d/d116/c151 0 2024-02-14T13:10:46.587 INFO:tasks.workunit.client.0.smithi012.stdout:7/980: fdatasync df/d27/d4b/d8d/f131 0 2024-02-14T13:10:46.588 INFO:tasks.workunit.client.0.smithi012.stdout:7/981: creat df/d24/d56/f152 x:0 0 0 2024-02-14T13:10:46.596 INFO:tasks.workunit.client.0.smithi012.stdout:7/982: dread df/d36/d67/fff [0,4194304] 0 2024-02-14T13:10:46.597 INFO:tasks.workunit.client.0.smithi012.stdout:7/983: mkdir df/d27/d4b/d5a/d153 0 2024-02-14T13:10:46.597 INFO:tasks.workunit.client.0.smithi012.stdout:7/984: readlink df/l146 0 2024-02-14T13:10:46.598 INFO:tasks.workunit.client.0.smithi012.stdout:6/996: dwrite d1/df/d16/d7c/d127/f138 [8388608,4194304] 0 2024-02-14T13:10:46.600 INFO:tasks.workunit.client.0.smithi012.stdout:6/997: creat d1/df/d16/d7c/d112/d13a/f141 x:0 0 0 2024-02-14T13:10:46.601 INFO:tasks.workunit.client.0.smithi012.stdout:6/998: mknod d1/df/d16/c142 0 2024-02-14T13:10:46.601 INFO:tasks.workunit.client.0.smithi012.stdout:6/999: truncate d1/df/d24/f36 4443900 0 2024-02-14T13:10:46.612 INFO:tasks.workunit.client.0.smithi012.stdout:7/985: dwrite df/d2d/f83 [0,4194304] 0 2024-02-14T13:10:46.612 INFO:tasks.workunit.client.0.smithi012.stdout:7/986: write df/f1f [4502750,95956] 0 2024-02-14T13:10:46.627 INFO:tasks.workunit.client.0.smithi012.stdout:7/987: dwrite df/d27/d4b/d6b/d6d/d85/ff3 [0,4194304] 0 2024-02-14T13:10:46.627 INFO:tasks.workunit.client.0.smithi012.stdout:7/988: fsync df/d27/d4b/f8e 0 2024-02-14T13:10:46.629 INFO:tasks.workunit.client.0.smithi012.stdout:7/989: mkdir df/d36/d67/d11a/d154 0 2024-02-14T13:10:46.652 INFO:tasks.workunit.client.0.smithi012.stdout:7/990: dwrite df/d27/d4b/ff1 [0,4194304] 0 2024-02-14T13:10:46.660 INFO:tasks.workunit.client.0.smithi012.stdout:4/997: sync 2024-02-14T13:10:46.661 INFO:tasks.workunit.client.0.smithi012.stdout:4/998: creat d0/d10/d28/d4f/f16b x:0 0 0 2024-02-14T13:10:46.661 INFO:tasks.workunit.client.0.smithi012.stdout:4/999: stat d0/f5c 0 2024-02-14T13:10:46.674 INFO:tasks.workunit.client.0.smithi012.stdout:7/991: dwrite df/f124 [0,4194304] 0 2024-02-14T13:10:46.675 INFO:tasks.workunit.client.0.smithi012.stdout:7/992: chown df/d27/d4b/d6b/d6d/d85/fdd 302649327 1 2024-02-14T13:10:46.681 INFO:tasks.workunit.client.0.smithi012.stdout:7/993: dread df/d2d/d82/d88/f11c [0,4194304] 0 2024-02-14T13:10:46.681 INFO:tasks.workunit.client.0.smithi012.stdout:7/994: chown df/db1 572022 1 2024-02-14T13:10:46.682 INFO:tasks.workunit.client.0.smithi012.stdout:7/995: symlink df/d27/d4b/d8d/l155 0 2024-02-14T13:10:46.683 INFO:tasks.workunit.client.0.smithi012.stdout:7/996: unlink df/d27/d4b/d6b/d6d/d85/db8/l14d 0 2024-02-14T13:10:46.683 INFO:tasks.workunit.client.0.smithi012.stdout:7/997: truncate df/d27/fdc 1302463 0 2024-02-14T13:10:46.684 INFO:tasks.workunit.client.0.smithi012.stdout:7/998: stat df/lbc 0 2024-02-14T13:10:46.684 INFO:tasks.workunit.client.0.smithi012.stdout:7/999: creat df/d27/d4b/d8d/d11d/f156 x:0 0 0 2024-02-14T13:10:46.686 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf -- ./tmp.ipl1MsaA6v 2024-02-14T13:10:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 -- 172.21.15.12:0/3259746611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34100980 msgr2=0x7f6e34102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/3259746611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34100980 0x7f6e34102d70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009860 tx=0x7f6e2402bb70 comp rx=0 tx=0).stop 2024-02-14T13:10:48.162 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 -- 172.21.15.12:0/3259746611 shutdown_connections 2024-02-14T13:10:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/3259746611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e34105de0 0x7f6e341082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/3259746611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34103340 0x7f6e34105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/3259746611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34100980 0x7f6e34102d70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 -- 172.21.15.12:0/3259746611 >> 172.21.15.12:0/3259746611 conn(0x7f6e340faa10 msgr2=0x7f6e340fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.160+0000 7f6e38c9d640 1 -- 172.21.15.12:0/3259746611 shutdown_connections 2024-02-14T13:10:48.163 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.161+0000 7f6e38c9d640 1 -- 172.21.15.12:0/3259746611 wait complete. 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 Processor -- start 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 -- start start 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 0x7f6e341992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34103340 0x7f6e341997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e34105de0 0x7f6e341a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341a0da0 con 0x7f6e34105de0 2024-02-14T13:10:48.164 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 0x7f6e341992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 0x7f6e341992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:53476/0 (socket says 172.21.15.12:53476) 2024-02-14T13:10:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e3259c640 1 -- 172.21.15.12:0/2028819747 learned_addr learned my addr 172.21.15.12:0/2028819747 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e34105de0 0x7f6e341a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341a0f10 con 0x7f6e34103340 2024-02-14T13:10:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.162+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341a10d0 con 0x7f6e34100980 2024-02-14T13:10:48.165 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.163+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34103340 0x7f6e341997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e3259c640 1 -- 172.21.15.12:0/2028819747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34103340 msgr2=0x7f6e341997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34103340 0x7f6e341997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e3259c640 1 -- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e34105de0 msgr2=0x7f6e341a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e34105de0 0x7f6e341a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e3259c640 1 -- 172.21.15.12:0/2028819747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c009900 con 0x7f6e34100980 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34103340 0x7f6e341997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:10:48.166 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 0x7f6e341992b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e2402c180 tx=0x7f6e24034a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e237fe640 1 -- 172.21.15.12:0/2028819747 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24032400 con 0x7f6e34100980 2024-02-14T13:10:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.164+0000 7f6e237fe640 1 -- 172.21.15.12:0/2028819747 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6e24005440 con 0x7f6e34100980 2024-02-14T13:10:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.165+0000 7f6e237fe640 1 -- 172.21.15.12:0/2028819747 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24004d30 con 0x7f6e34100980 2024-02-14T13:10:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.165+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24009490 con 0x7f6e34100980 2024-02-14T13:10:48.168 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.165+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34192730 con 0x7f6e34100980 2024-02-14T13:10:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.168+0000 7f6e237fe640 1 -- 172.21.15.12:0/2028819747 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f6e2403b040 con 0x7f6e34100980 2024-02-14T13:10:48.170 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.168+0000 7f6e3b873740 1 Processor -- start 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 -- start start 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bd8bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bd90c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bd93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bcfa9e0 con 0x55b55bd8c130 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bcf7f10 con 0x55b55bd912a0 2024-02-14T13:10:48.171 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3b873740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bcf36f0 con 0x55b55bd8b740 2024-02-14T13:10:48.172 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bd90c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bd90c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41014/0 (socket says 172.21.15.12:41014) 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e3259c640 1 -- 172.21.15.12:0/2610651401 learned_addr learned my addr 172.21.15.12:0/2610651401 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bd8bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.169+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bd93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e237fe640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e1c0a2160 0x7f6e1c0a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e3259c640 1 -- 172.21.15.12:0/2610651401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 msgr2=0x55b55bd8bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bd8bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e3259c640 1 -- 172.21.15.12:0/2610651401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 msgr2=0x55b55bd93730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bd93730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e3259c640 1 -- 172.21.15.12:0/2610651401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b55ba04920 con 0x55b55bd8c130 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bd8bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bd93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e1c0a2160 0x7f6e1c0a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.173 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bd90c30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e240cb360 tx=0x7f6e240b8930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f488fa30c7a3f72 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.170+0000 7f6e237fe640 1 -- 172.21.15.12:0/2028819747 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f6e240efef0 con 0x7f6e34100980 2024-02-14T13:10:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.171+0000 7f6e20ff9640 1 -- 172.21.15.12:0/2610651401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240bc9b0 con 0x55b55bd8c130 2024-02-14T13:10:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.171+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e1c0a2160 0x7f6e1c0a4620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55b55bd8c990 tx=0x7f6e2c004a40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.171+0000 7f6e20ff9640 1 -- 172.21.15.12:0/2610651401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6e240bc720 con 0x55b55bd8c130 2024-02-14T13:10:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.171+0000 7f6e20ff9640 1 -- 172.21.15.12:0/2610651401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240bce40 con 0x55b55bd8c130 2024-02-14T13:10:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 -- 172.21.15.12:0/2610651401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 msgr2=0x55b55bd90c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bd90c30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6e240cb360 tx=0x7f6e240b8930 comp rx=0 tx=0).stop 2024-02-14T13:10:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 -- 172.21.15.12:0/2610651401 shutdown_connections 2024-02-14T13:10:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bd93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bd90c30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2610651401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bd8bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 -- 172.21.15.12:0/2610651401 >> 172.21.15.12:0/2610651401 conn(0x55b55bd86cb0 msgr2=0x55b55bd870b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 -- 172.21.15.12:0/2610651401 shutdown_connections 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 -- 172.21.15.12:0/2610651401 wait complete. 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 -- start start 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.172+0000 7f6e3b873740 1 Processor -- start 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bc8ffa0 con 0x55b55bd8c130 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55b9c7250 con 0x55b55bd912a0 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bc79200 con 0x55b55bd8b740 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.176 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:53502/0 (socket says 172.21.15.12:53502) 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41030/0 (socket says 172.21.15.12:41030) 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3259c640 1 -- 172.21.15.12:0/1508140479 learned_addr learned my addr 172.21.15.12:0/1508140479 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e3b873740 10 client.0 _ll_register_callbacks cb 0x55b55bce8b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 -- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 msgr2=0x55b55bda6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 -- 172.21.15.12:0/1508140479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 msgr2=0x55b55bdad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.173+0000 7f6e31d9b640 1 -- 172.21.15.12:0/1508140479 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34192730 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.174+0000 7f6e19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.174+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005fd0 tx=0x7f6e28011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2888e61ac552c009 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.174+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1508140479 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28012860 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.174+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1508140479 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f6e280129c0 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.174+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b55b9f3600 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1508140479 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e28012860 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 10 client.15342 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55b55bcf1d70 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1508140479 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x55b55b9f3600 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1508140479 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e28021020 con 0x55b55bd8c130 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 10 client.15342 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 20 client.15342 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55bdb21c0 0x55b55bdb45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 4 client.15342 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:10:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.175+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b55ba441b0 con 0x55b55bdb21c0 2024-02-14T13:10:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.176+0000 7f6e3259c640 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55bdb21c0 0x55b55bdb45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.177+0000 7f6e19ffb640 10 client.15342 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.177+0000 7f6e3259c640 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55bdb21c0 0x55b55bdb45e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2f23aa18e25877 server_cookie=4ce6d8e75bba7ee6 in_seq=0 out_seq=0 2024-02-14T13:10:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.178+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1508140479 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b55ba441b0 con 0x55b55bdb21c0 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.178+0000 7f6e19ffb640 10 client.15342 handle_command_reply: tid=0 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.178+0000 7f6e3b873740 1 client.15342 shutdown 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 msgr2=0x55b55bda6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005fd0 tx=0x7f6e28011870 comp rx=0 tx=0).stop 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 shutdown_connections 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55bdb21c0 0x55b55bdb45e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1508140479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e19ffb640 0 client.15342 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.179+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 >> 172.21.15.12:0/1508140479 conn(0x55b55bd86cb0 msgr2=0x55b55bd85ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.180+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 shutdown_connections 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.180+0000 7f6e3b873740 1 -- 172.21.15.12:0/1508140479 wait complete. 2024-02-14T13:10:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.180+0000 7f6e3b873740 20 client.15342 trim_cache size 0 max 16384 2024-02-14T13:10:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 Processor -- start 2024-02-14T13:10:48.206 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 -- start start 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd912a0 0x55b55bdad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55b9f3600 con 0x55b55bd8b740 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bd8c9c0 con 0x55b55bd8c130 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.204+0000 7f6e3b873740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bd93bf0 con 0x55b55bd912a0 2024-02-14T13:10:48.207 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e3259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41032/0 (socket says 172.21.15.12:41032) 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.12:58548/0 (socket says 172.21.15.12:58548) 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e3259c640 1 -- 172.21.15.12:0/2182991894 learned_addr learned my addr 172.21.15.12:0/2182991894 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd912a0 0x55b55bdad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 -- 172.21.15.12:0/2182991894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd912a0 msgr2=0x55b55bdad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd912a0 0x55b55bdad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 -- 172.21.15.12:0/2182991894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 msgr2=0x55b55bda6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 -- 172.21.15.12:0/2182991894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b55bc8e820 con 0x55b55bd8c130 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e3259c640 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:10:48.208 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.205+0000 7f6e31d9b640 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e28004b90 tx=0x7f6e28011e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae6c4e7fd77cf11b server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.206+0000 7f6e1bfff640 1 -- 172.21.15.12:0/2182991894 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28009b20 con 0x55b55bd8c130 2024-02-14T13:10:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.206+0000 7f6e1bfff640 1 -- 172.21.15.12:0/2182991894 <== mon.2 v2:172.21.15.55:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6e28012d40 con 0x55b55bd8c130 2024-02-14T13:10:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.206+0000 7f6e1bfff640 1 -- 172.21.15.12:0/2182991894 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28005320 con 0x55b55bd8c130 2024-02-14T13:10:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 -- 172.21.15.12:0/2182991894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 msgr2=0x55b55bda6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e28004b90 tx=0x7f6e28011e70 comp rx=0 tx=0).stop 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 -- 172.21.15.12:0/2182991894 shutdown_connections 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd912a0 0x55b55bdad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd8c130 0x55b55bda6780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 --2- 172.21.15.12:0/2182991894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8b740 0x55b55bda6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 -- 172.21.15.12:0/2182991894 >> 172.21.15.12:0/2182991894 conn(0x55b55bd86cb0 msgr2=0x55b55bdb8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 -- 172.21.15.12:0/2182991894 shutdown_connections 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 -- 172.21.15.12:0/2182991894 wait complete. 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 -- start start 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.207+0000 7f6e3b873740 1 Processor -- start 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bdab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bdabc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdacc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bdad150 con 0x55b55bd8c130 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bdad2c0 con 0x55b55bd912a0 2024-02-14T13:10:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55bdad480 con 0x55b55bd8b740 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3b873740 10 client.0 _ll_register_callbacks cb 0x7f6e240f3860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e31d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bdabc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e31d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bdabc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41048/0 (socket says 172.21.15.12:41048) 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e31d9b640 1 -- 172.21.15.12:0/1796458796 learned_addr learned my addr 172.21.15.12:0/1796458796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e3259c640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bdab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.208+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdacc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e32d9d640 1 -- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 msgr2=0x55b55bdab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bdab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e32d9d640 1 -- 172.21.15.12:0/1796458796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 msgr2=0x55b55bdabc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bdabc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e32d9d640 1 -- 172.21.15.12:0/1796458796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e240ede70 con 0x55b55bd912a0 2024-02-14T13:10:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e32d9d640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdacc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00e780 tx=0x7f6e2c010040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=369951cd3d2e8935 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:10:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-02-14T13:10:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.209+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1796458796 <== mon.2 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c013030 con 0x55b55bd912a0 2024-02-14T13:10:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.210+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1796458796 <== mon.2 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f6e2c01f040 con 0x55b55bd912a0 2024-02-14T13:10:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.210+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e240bc720 con 0x55b55bd912a0 2024-02-14T13:10:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1796458796 <== mon.2 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2c035020 con 0x55b55bd912a0 2024-02-14T13:10:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 10 client.24935 fetch_fsmap learned FSMap version 18 2024-02-14T13:10:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55b55bcf1d70 con 0x55b55bd912a0 2024-02-14T13:10:48.221 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1796458796 <== mon.2 v2:172.21.15.55:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6e240bc720 con 0x55b55bd912a0 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1796458796 <== mon.2 v2:172.21.15.55:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e2c030840 con 0x55b55bd912a0 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 10 client.24935 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 10 client.24935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 20 client.24935 populate_metadata read hostname 'smithi012' 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55be09900 0x55b55be0bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.219+0000 7f6e3b873740 4 client.24935 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.220+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b55ba30550 con 0x55b55be09900 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.220+0000 7f6e3259c640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55be09900 0x55b55be0bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.220+0000 7f6e3259c640 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55be09900 0x55b55be0bd20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76e38e20cfb7462 server_cookie=e270bc78a50bdebd in_seq=0 out_seq=0 2024-02-14T13:10:48.222 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.220+0000 7f6e19ffb640 10 client.24935 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:48.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:48 smithi012 ceph-mon[32370]: pgmap v410: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 233 MiB/s rd, 290 MiB/s wr, 1.39k op/s 2024-02-14T13:10:48.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:48 smithi103 ceph-mon[36921]: pgmap v410: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 233 MiB/s rd, 290 MiB/s wr, 1.39k op/s 2024-02-14T13:10:48.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:48 smithi055 ceph-mon[36853]: pgmap v410: 97 pgs: 97 active+clean; 2.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 233 MiB/s rd, 290 MiB/s wr, 1.39k op/s 2024-02-14T13:10:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.813+0000 7f6e19ffb640 1 -- 172.21.15.12:0/1796458796 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b55ba30550 con 0x55b55be09900 2024-02-14T13:10:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.813+0000 7f6e19ffb640 10 client.24935 handle_command_reply: tid=0 2024-02-14T13:10:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.813+0000 7f6e3b873740 1 client.24935 shutdown 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 msgr2=0x55b55bdacc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdacc10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00e780 tx=0x7f6e2c010040 comp rx=0 tx=0).stop 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 shutdown_connections 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55b55be09900 0x55b55be0bd20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b55bd912a0 0x55b55bdacc10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e19ffb640 0 client.24935 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b55bd8c130 0x55b55bdabc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 --2- 172.21.15.12:0/1796458796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b55bd8b740 0x55b55bdab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 >> 172.21.15.12:0/1796458796 conn(0x55b55bd86cb0 msgr2=0x55b55bd8a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 shutdown_connections 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 1 -- 172.21.15.12:0/1796458796 wait complete. 2024-02-14T13:10:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.814+0000 7f6e3b873740 20 client.24935 trim_cache size 0 max 16384 2024-02-14T13:10:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:10:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:10:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:10:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:10:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e1c0a2160 msgr2=0x7f6e1c0a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e1c0a2160 0x7f6e1c0a4620 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55b55bd8c990 tx=0x7f6e2c004a40 comp rx=0 tx=0).stop 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 msgr2=0x7f6e341992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 0x7f6e341992b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e2402c180 tx=0x7f6e24034a60 comp rx=0 tx=0).stop 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 shutdown_connections 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e1c0a2160 0x7f6e1c0a4620 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e34105de0 0x7f6e341a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34103340 0x7f6e341997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 --2- 172.21.15.12:0/2028819747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e34100980 0x7f6e341992b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 >> 172.21.15.12:0/2028819747 conn(0x7f6e340faa10 msgr2=0x7f6e34108fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 shutdown_connections 2024-02-14T13:10:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:10:48.815+0000 7f6e38c9d640 1 -- 172.21.15.12:0/2028819747 wait complete. 2024-02-14T13:10:50.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:50 smithi012 ceph-mon[32370]: pgmap v411: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 MiB/s rd, 245 MiB/s wr, 661 op/s 2024-02-14T13:10:50.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:50 smithi103 ceph-mon[36921]: pgmap v411: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 MiB/s rd, 245 MiB/s wr, 661 op/s 2024-02-14T13:10:50.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:50 smithi055 ceph-mon[36853]: pgmap v411: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 MiB/s rd, 245 MiB/s wr, 661 op/s 2024-02-14T13:10:52.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:52 smithi103 ceph-mon[36921]: pgmap v412: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 190 MiB/s rd, 241 MiB/s wr, 912 op/s 2024-02-14T13:10:52.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:52 smithi055 ceph-mon[36853]: pgmap v412: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 190 MiB/s rd, 241 MiB/s wr, 912 op/s 2024-02-14T13:10:52.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:52 smithi012 ceph-mon[32370]: pgmap v412: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 190 MiB/s rd, 241 MiB/s wr, 912 op/s 2024-02-14T13:10:54.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:54 smithi103 ceph-mon[36921]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s rd, 171 MiB/s wr, 761 op/s 2024-02-14T13:10:54.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:54 smithi055 ceph-mon[36853]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s rd, 171 MiB/s wr, 761 op/s 2024-02-14T13:10:54.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:54 smithi012 ceph-mon[32370]: pgmap v413: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 141 MiB/s rd, 171 MiB/s wr, 761 op/s 2024-02-14T13:10:55.529 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-14T13:10:55.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-14T13:10:56.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:56 smithi103 ceph-mon[36921]: pgmap v414: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 98 MiB/s wr, 728 op/s 2024-02-14T13:10:56.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:56 smithi055 ceph-mon[36853]: pgmap v414: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 98 MiB/s wr, 728 op/s 2024-02-14T13:10:56.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:56 smithi012 ceph-mon[32370]: pgmap v414: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 98 MiB/s wr, 728 op/s 2024-02-14T13:10:58.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:10:58 smithi103 ceph-mon[36921]: pgmap v415: 97 pgs: 97 active+clean; 441 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 69 MiB/s wr, 768 op/s 2024-02-14T13:10:58.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:10:58 smithi055 ceph-mon[36853]: pgmap v415: 97 pgs: 97 active+clean; 441 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 69 MiB/s wr, 768 op/s 2024-02-14T13:10:58.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:10:58 smithi012 ceph-mon[32370]: pgmap v415: 97 pgs: 97 active+clean; 441 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 69 MiB/s wr, 768 op/s 2024-02-14T13:11:00.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:00 smithi103 ceph-mon[36921]: pgmap v416: 97 pgs: 97 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 15 MiB/s wr, 696 op/s 2024-02-14T13:11:00.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:00 smithi055 ceph-mon[36853]: pgmap v416: 97 pgs: 97 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 15 MiB/s wr, 696 op/s 2024-02-14T13:11:00.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:00 smithi012 ceph-mon[32370]: pgmap v416: 97 pgs: 97 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 15 MiB/s wr, 696 op/s 2024-02-14T13:11:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 -- 172.21.15.12:0/4188329793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 msgr2=0x7f8aa4100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/4188329793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa4100ac0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009900 tx=0x7f8a9402bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 -- 172.21.15.12:0/4188329793 shutdown_connections 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/4188329793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa4101d70 0x7f8aa4108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/4188329793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 0x7f8aa4101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/4188329793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa4100ac0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 -- 172.21.15.12:0/4188329793 >> 172.21.15.12:0/4188329793 conn(0x7f8aa40fae50 msgr2=0x7f8aa40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 -- 172.21.15.12:0/4188329793 shutdown_connections 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.904+0000 7f8aa8de9640 1 -- 172.21.15.12:0/4188329793 wait complete. 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 Processor -- start 2024-02-14T13:11:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 -- start start 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa40ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 0x7f8aa419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa4101d70 0x7f8aa419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa419ede0 con 0x7f8aa41006a0 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa419ef50 con 0x7f8aa41013b0 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa8de9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa419f110 con 0x7f8aa4101d70 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa40ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa40ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55680/0 (socket says 172.21.15.12:55680) 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 -- 172.21.15.12:0/927725525 learned_addr learned my addr 172.21.15.12:0/927725525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa4101d70 0x7f8aa419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 0x7f8aa419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 -- 172.21.15.12:0/927725525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa4101d70 msgr2=0x7f8aa419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa4101d70 0x7f8aa419e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 -- 172.21.15.12:0/927725525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 msgr2=0x7f8aa419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 0x7f8aa419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 -- 172.21.15.12:0/927725525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94009560 con 0x7f8aa41006a0 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 0x7f8aa419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.905+0000 7f8aa259c640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa40ffd60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8a94036040 tx=0x7f8a94004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.906+0000 7f8a937fe640 1 -- 172.21.15.12:0/927725525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94004440 con 0x7f8aa41006a0 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.906+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa419f330 con 0x7f8aa41006a0 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.906+0000 7f8a937fe640 1 -- 172.21.15.12:0/927725525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f8a940052d0 con 0x7f8aa41006a0 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.906+0000 7f8a937fe640 1 -- 172.21.15.12:0/927725525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a94003d80 con 0x7f8aa41006a0 2024-02-14T13:11:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.906+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa419f890 con 0x7f8aa41006a0 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.908+0000 7f8a937fe640 1 -- 172.21.15.12:0/927725525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f8a94005440 con 0x7f8aa41006a0 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 Processor -- start 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 -- start start 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd6ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd6fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd72730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ccd99e0 con 0x55ad7cd6b130 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ccd6f10 con 0x55ad7cd702a0 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7ccd26f0 con 0x55ad7cd6a740 2024-02-14T13:11:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd6fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd6fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55684/0 (socket says 172.21.15.12:55684) 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd6ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa259c640 1 -- 172.21.15.12:0/3231103953 learned_addr learned my addr 172.21.15.12:0/3231103953 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8a937fe640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8a8c0a2160 0x7f8a8c0a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd72730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8a8c0a2160 0x7f8a8c0a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8a937fe640 1 -- 172.21.15.12:0/927725525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f8a940eff00 con 0x7f8aa41006a0 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.909+0000 7f8aa259c640 1 -- 172.21.15.12:0/3231103953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 msgr2=0x55ad7cd6ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa259c640 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd6ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa259c640 1 -- 172.21.15.12:0/3231103953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 msgr2=0x55ad7cd72730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa259c640 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd72730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa259c640 1 -- 172.21.15.12:0/3231103953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad7c9e3920 con 0x55ad7cd6b130 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd6ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa259c640 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd6fc30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8a940ed900 tx=0x7f8a9402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6113529c72dd60e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8a8c0a2160 0x7f8a8c0a4620 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55ad7cd6b990 tx=0x7f8a9c004ab0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8a90ff9640 1 -- 172.21.15.12:0/3231103953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940bc730 con 0x55ad7cd6b130 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8a90ff9640 1 -- 172.21.15.12:0/3231103953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f8a940bc550 con 0x55ad7cd6b130 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.910+0000 7f8a90ff9640 1 -- 172.21.15.12:0/3231103953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940035f0 con 0x55ad7cd6b130 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3231103953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 msgr2=0x55ad7cd6fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd6fc30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8a940ed900 tx=0x7f8a9402bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3231103953 shutdown_connections 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd72730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd6fc30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3231103953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd6ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3231103953 >> 172.21.15.12:0/3231103953 conn(0x55ad7cd65cb0 msgr2=0x55ad7cd660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3231103953 shutdown_connections 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3231103953 wait complete. 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- start start 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 Processor -- start 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 0x55ad7cd743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6b130 0x55ad7cd74920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cc6efa0 con 0x55ad7cd6a740 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7c9a6250 con 0x55ad7cd702a0 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.911+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cc58200 con 0x55ad7cd6b130 2024-02-14T13:11:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aab9bf740 10 client.0 _ll_register_callbacks cb 0x55ad7ccc7b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 0x55ad7cd743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 0x55ad7cd743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55696/0 (socket says 172.21.15.12:55696) 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 -- 172.21.15.12:0/1876333754 learned_addr learned my addr 172.21.15.12:0/1876333754 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6b130 0x55ad7cd74920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 -- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6b130 msgr2=0x55ad7cd74920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6b130 0x55ad7cd74920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 -- 172.21.15.12:0/1876333754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 msgr2=0x55ad7cd7b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 -- 172.21.15.12:0/1876333754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa419f890 con 0x55ad7cd6a740 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aa259c640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 0x55ad7cd743e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8a940eda10 tx=0x7f8a940058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e0ae7c0c3eab98 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8a89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:11:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8a89ffb640 1 -- 172.21.15.12:0/1876333754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940b8e90 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8a89ffb640 1 -- 172.21.15.12:0/1876333754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f8a940bcbf0 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad7c9d2600 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8a89ffb640 1 -- 172.21.15.12:0/1876333754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a940bd2f0 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aab9bf740 10 client.15360 fetch_fsmap learned FSMap version 18 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55ad7ccd0d70 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.912+0000 7f8a89ffb640 1 -- 172.21.15.12:0/1876333754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x55ad7c9d2600 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8a89ffb640 1 -- 172.21.15.12:0/1876333754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a9403c070 con 0x55ad7cd6a740 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aab9bf740 10 client.15360 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aab9bf740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aab9bf740 20 client.15360 populate_metadata read hostname 'smithi012' 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cd7fea0 0x55ad7cd82290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aab9bf740 4 client.15360 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:11:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad7ca231b0 con 0x55ad7cd7fea0 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cd7fea0 0x55ad7cd82290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8a89ffb640 10 client.15360 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.913+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cd7fea0 0x55ad7cd82290 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b233f44c1b96a8 server_cookie=195feb21eb0cb982 in_seq=0 out_seq=0 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8a89ffb640 1 -- 172.21.15.12:0/1876333754 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ad7ca231b0 con 0x55ad7cd7fea0 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8a89ffb640 10 client.15360 handle_command_reply: tid=0 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 client.15360 shutdown 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 msgr2=0x55ad7cd743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 0x55ad7cd743e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8a940eda10 tx=0x7f8a940058b0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 shutdown_connections 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cd7fea0 0x55ad7cd82290 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8a89ffb640 0 client.15360 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6b130 0x55ad7cd74920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/1876333754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6a740 0x55ad7cd743e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 >> 172.21.15.12:0/1876333754 conn(0x55ad7cd65cb0 msgr2=0x55ad7cd64ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 shutdown_connections 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 1 -- 172.21.15.12:0/1876333754 wait complete. 2024-02-14T13:11:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.915+0000 7f8aab9bf740 20 client.15360 trim_cache size 0 max 16384 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 Processor -- start 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 -- start start 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd86bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd7b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd6b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cd615a0 con 0x55ad7cd6b130 2024-02-14T13:11:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cd65b20 con 0x55ad7cd702a0 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cd66a20 con 0x55ad7cd6a740 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd7b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd7b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55706/0 (socket says 172.21.15.12:55706) 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/3929305054 learned_addr learned my addr 172.21.15.12:0/3929305054 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa259c640 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd86bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd6b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/3929305054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 msgr2=0x55ad7cd86bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd86bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/3929305054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 msgr2=0x55ad7cd6b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd6b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/3929305054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad7cc6d820 con 0x55ad7cd6b130 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.929+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd6b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd7b8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8a98004700 tx=0x7f8a98011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75996f2b827790a server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8a8bfff640 1 -- 172.21.15.12:0/3929305054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98020070 con 0x55ad7cd6b130 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8a8bfff640 1 -- 172.21.15.12:0/3929305054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f8a9801b900 con 0x55ad7cd6b130 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8a8bfff640 1 -- 172.21.15.12:0/3929305054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98016040 con 0x55ad7cd6b130 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3929305054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 msgr2=0x55ad7cd7b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd7b8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8a98004700 tx=0x7f8a98011810 comp rx=0 tx=0).stop 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3929305054 shutdown_connections 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd6b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd7b8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/3929305054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd86bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3929305054 >> 172.21.15.12:0/3929305054 conn(0x55ad7cd65cb0 msgr2=0x55ad7cd6f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3929305054 shutdown_connections 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.930+0000 7f8aab9bf740 1 -- 172.21.15.12:0/3929305054 wait complete. 2024-02-14T13:11:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 -- start start 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 Processor -- start 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd797a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd79ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cd7b230 con 0x55ad7cd6b130 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cd7b3a0 con 0x55ad7cd702a0 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad7cd7b560 con 0x55ad7cd6a740 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aab9bf740 10 client.0 _ll_register_callbacks cb 0x7f8a940b8cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd79ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd79ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55722/0 (socket says 172.21.15.12:55722) 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd797a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/2139242908 learned_addr learned my addr 172.21.15.12:0/2139242908 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 msgr2=0x55ad7cd797a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd797a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/2139242908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 msgr2=0x55ad7cd7acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa1d9b640 1 -- 172.21.15.12:0/2139242908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9800bdd0 con 0x55ad7cd6b130 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.931+0000 7f8aa2d9d640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aa1d9b640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd79ce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800bcc0 tx=0x7f8a98011340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25051e66d209e666 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8a89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8a89ffb640 1 -- 172.21.15.12:0/2139242908 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98020040 con 0x55ad7cd6b130 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8a89ffb640 1 -- 172.21.15.12:0/2139242908 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f8a98004930 con 0x55ad7cd6b130 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a940bc550 con 0x55ad7cd6b130 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8a89ffb640 1 -- 172.21.15.12:0/2139242908 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a98016040 con 0x55ad7cd6b130 2024-02-14T13:11:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 10 client.15366 fetch_fsmap learned FSMap version 18 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55ad7cc93720 con 0x55ad7cd6b130 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8a89ffb640 1 -- 172.21.15.12:0/2139242908 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f8a940bc550 con 0x55ad7cd6b130 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8a89ffb640 1 -- 172.21.15.12:0/2139242908 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a98025d00 con 0x55ad7cd6b130 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 10 client.15366 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 10 client.15366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 20 client.15366 populate_metadata read hostname 'smithi012' 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cdd7540 0x55ad7cdd9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 4 client.15366 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ad7ca0f550 con 0x55ad7cdd7540 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.932+0000 7f8aa259c640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cdd7540 0x55ad7cdd9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.933+0000 7f8a89ffb640 10 client.15366 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:01.933+0000 7f8aa259c640 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cdd7540 0x55ad7cdd9960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e3ac6a730e27b8 server_cookie=4d1f57fbd516b88d in_seq=0 out_seq=0 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8a89ffb640 1 -- 172.21.15.12:0/2139242908 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ad7ca0f550 con 0x55ad7cdd7540 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8a89ffb640 10 client.15366 handle_command_reply: tid=0 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 client.15366 shutdown 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 msgr2=0x55ad7cd79ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd79ce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800bcc0 tx=0x7f8a98011340 comp rx=0 tx=0).stop 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 shutdown_connections 2024-02-14T13:11:02.029 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55ad7cdd7540 0x55ad7cdd9960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ad7cd702a0 0x55ad7cd7acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad7cd6b130 0x55ad7cd79ce0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8a89ffb640 0 client.15366 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 --2- 172.21.15.12:0/2139242908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ad7cd6a740 0x55ad7cd797a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 >> 172.21.15.12:0/2139242908 conn(0x55ad7cd65cb0 msgr2=0x55ad7cd86bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 shutdown_connections 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 1 -- 172.21.15.12:0/2139242908 wait complete. 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.027+0000 7f8aab9bf740 20 client.15366 trim_cache size 0 max 16384 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:11:02.030 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:11:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:11:02.031 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8a8c0a2160 msgr2=0x7f8a8c0a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8a8c0a2160 0x7f8a8c0a4620 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55ad7cd6b990 tx=0x7f8a9c004ab0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 msgr2=0x7f8aa40ffd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa40ffd60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8a94036040 tx=0x7f8a94004040 comp rx=0 tx=0).stop 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 shutdown_connections 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f8a8c0a2160 0x7f8a8c0a4620 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8aa4101d70 0x7f8aa419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa41013b0 0x7f8aa419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 --2- 172.21.15.12:0/927725525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8aa41006a0 0x7f8aa40ffd60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 >> 172.21.15.12:0/927725525 conn(0x7f8aa40fae50 msgr2=0x7f8aa4104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 shutdown_connections 2024-02-14T13:11:02.032 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:02.028+0000 7f8aa8de9640 1 -- 172.21.15.12:0/927725525 wait complete. 2024-02-14T13:11:02.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:02 smithi103 ceph-mon[36921]: pgmap v417: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 7.5 MiB/s wr, 803 op/s 2024-02-14T13:11:02.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:02 smithi055 ceph-mon[36853]: pgmap v417: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 7.5 MiB/s wr, 803 op/s 2024-02-14T13:11:02.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:02 smithi012 ceph-mon[32370]: pgmap v417: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 7.5 MiB/s wr, 803 op/s 2024-02-14T13:11:04.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:04 smithi103 ceph-mon[36921]: pgmap v418: 97 pgs: 97 active+clean; 75 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.9 MiB/s wr, 523 op/s 2024-02-14T13:11:04.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:04 smithi055 ceph-mon[36853]: pgmap v418: 97 pgs: 97 active+clean; 75 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.9 MiB/s wr, 523 op/s 2024-02-14T13:11:04.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:04 smithi012 ceph-mon[32370]: pgmap v418: 97 pgs: 97 active+clean; 75 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.9 MiB/s wr, 523 op/s 2024-02-14T13:11:06.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:06 smithi055 ceph-mon[36853]: pgmap v419: 97 pgs: 97 active+clean; 65 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 405 op/s 2024-02-14T13:11:06.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:06 smithi012 ceph-mon[32370]: pgmap v419: 97 pgs: 97 active+clean; 65 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 405 op/s 2024-02-14T13:11:06.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:06 smithi103 ceph-mon[36921]: pgmap v419: 97 pgs: 97 active+clean; 65 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 405 op/s 2024-02-14T13:11:08.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:08 smithi055 ceph-mon[36853]: pgmap v420: 97 pgs: 97 active+clean; 63 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 489 op/s 2024-02-14T13:11:08.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:08 smithi012 ceph-mon[32370]: pgmap v420: 97 pgs: 97 active+clean; 63 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 489 op/s 2024-02-14T13:11:08.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:08 smithi103 ceph-mon[36921]: pgmap v420: 97 pgs: 97 active+clean; 63 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 489 op/s 2024-02-14T13:11:10.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:10 smithi055 ceph-mon[36853]: pgmap v421: 97 pgs: 97 active+clean; 63 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 409 op/s 2024-02-14T13:11:10.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:10 smithi012 ceph-mon[32370]: pgmap v421: 97 pgs: 97 active+clean; 63 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 409 op/s 2024-02-14T13:11:10.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:10 smithi103 ceph-mon[36921]: pgmap v421: 97 pgs: 97 active+clean; 63 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 409 op/s 2024-02-14T13:11:12.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:12 smithi055 ceph-mon[36853]: pgmap v422: 97 pgs: 97 active+clean; 62 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 509 op/s 2024-02-14T13:11:12.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:12 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:11:12.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:12 smithi012 ceph-mon[32370]: pgmap v422: 97 pgs: 97 active+clean; 62 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 509 op/s 2024-02-14T13:11:12.717 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:12 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:11:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:12 smithi103 ceph-mon[36921]: pgmap v422: 97 pgs: 97 active+clean; 62 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 509 op/s 2024-02-14T13:11:12.741 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:12 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-14T13:11:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: pgmap v423: 97 pgs: 97 active+clean; 59 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 453 op/s 2024-02-14T13:11:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:11:13.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:11:13.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:13 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: pgmap v423: 97 pgs: 97 active+clean; 59 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 453 op/s 2024-02-14T13:11:13.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:13.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:11:13.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:11:13.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:13 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: pgmap v423: 97 pgs: 97 active+clean; 59 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 453 op/s 2024-02-14T13:11:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:14.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:14.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-14T13:11:14.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-14T13:11:14.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:13 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' 2024-02-14T13:11:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 -- 172.21.15.12:0/631420339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098101cd0 msgr2=0x7fc0981040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 --2- 172.21.15.12:0/631420339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098101cd0 0x7fc0981040c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc090009900 tx=0x7fc09002bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 -- 172.21.15.12:0/631420339 shutdown_connections 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 --2- 172.21.15.12:0/631420339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 0x7fc098109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 --2- 172.21.15.12:0/631420339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc098104600 0x7fc0981069f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 --2- 172.21.15.12:0/631420339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098101cd0 0x7fc0981040c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.117+0000 7fc0a078a640 1 -- 172.21.15.12:0/631420339 >> 172.21.15.12:0/631420339 conn(0x7fc0980fb6c0 msgr2=0x7fc0980fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 -- 172.21.15.12:0/631420339 shutdown_connections 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 -- 172.21.15.12:0/631420339 wait complete. 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 Processor -- start 2024-02-14T13:11:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 -- start start 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc098101cd0 0x7fc098197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 0x7fc0981977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 0x7fc09819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09819ed60 con 0x7fc098104600 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09819eed0 con 0x7fc098106f30 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc0a078a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09819f090 con 0x7fc098101cd0 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc09dd25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 0x7fc0981977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc09dd25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 0x7fc0981977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45952/0 (socket says 172.21.15.12:45952) 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc09dd25640 1 -- 172.21.15.12:0/2388254348 learned_addr learned my addr 172.21.15.12:0/2388254348 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.118+0000 7fc09e526640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc098101cd0 0x7fc098197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09ed27640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 0x7fc09819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09dd25640 1 -- 172.21.15.12:0/2388254348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc098101cd0 msgr2=0x7fc098197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09dd25640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc098101cd0 0x7fc098197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09dd25640 1 -- 172.21.15.12:0/2388254348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 msgr2=0x7fc09819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09dd25640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 0x7fc09819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09dd25640 1 -- 172.21.15.12:0/2388254348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc090009560 con 0x7fc098104600 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09ed27640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 0x7fc09819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc09dd25640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 0x7fc0981977b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00e9f0 tx=0x7fc08c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc0977fe640 1 -- 172.21.15.12:0/2388254348 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0096c0 con 0x7fc098104600 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc0977fe640 1 -- 172.21.15.12:0/2388254348 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc08c005500 con 0x7fc098104600 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09819f370 con 0x7fc098104600 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc0977fe640 1 -- 172.21.15.12:0/2388254348 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c010430 con 0x7fc098104600 2024-02-14T13:11:15.125 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.119+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09819f880 con 0x7fc098104600 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.121+0000 7fc0977fe640 1 -- 172.21.15.12:0/2388254348 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fc08c005020 con 0x7fc098104600 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.121+0000 7fc0a3431740 1 Processor -- start 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 -- start start 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0977fe640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc0800a21e0 0x7fc0800a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b35771f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35777040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35779b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.133 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b356dc9e0 con 0x557b357776b0 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b356d9f10 con 0x557b35772540 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0a3431740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b356d56f0 con 0x557b35771b50 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc0977fe640 1 -- 172.21.15.12:0/2388254348 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fc08c014070 con 0x7fc098104600 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09ed27640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc0800a21e0 0x7fc0800a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b35771f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09ed27640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35779b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b35771f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:34176/0 (socket says 172.21.15.12:34176) 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 -- 172.21.15.12:0/2746004654 learned_addr learned my addr 172.21.15.12:0/2746004654 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09dd25640 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35777040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 -- 172.21.15.12:0/2746004654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 msgr2=0x557b35777040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35777040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 -- 172.21.15.12:0/2746004654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 msgr2=0x557b35779b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.134 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35779b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09e526640 1 -- 172.21.15.12:0/2746004654 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b353e6920 con 0x557b35771b50 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.122+0000 7fc09ed27640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc0800a21e0 0x7fc0800a46a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc088009fd0 tx=0x7fc088009d60 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.123+0000 7fc09e526640 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b35771f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc090009900 tx=0x7fc090005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f77d179690f9a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.123+0000 7fc094ff9640 1 -- 172.21.15.12:0/2746004654 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09002c9a0 con 0x557b35771b50 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.123+0000 7fc094ff9640 1 -- 172.21.15.12:0/2746004654 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc09002cb00 con 0x557b35771b50 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.123+0000 7fc094ff9640 1 -- 172.21.15.12:0/2746004654 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090005120 con 0x557b35771b50 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.123+0000 7fc0a3431740 1 -- 172.21.15.12:0/2746004654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 msgr2=0x557b35771f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.123+0000 7fc0a3431740 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b35771f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc090009900 tx=0x7fc090005e00 comp rx=0 tx=0).stop 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- 172.21.15.12:0/2746004654 shutdown_connections 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35779b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35777040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 --2- 172.21.15.12:0/2746004654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b35771f70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.135 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- 172.21.15.12:0/2746004654 >> 172.21.15.12:0/2746004654 conn(0x557b35768cb0 msgr2=0x557b357690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- 172.21.15.12:0/2746004654 shutdown_connections 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- 172.21.15.12:0/2746004654 wait complete. 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- start start 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 Processor -- start 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 0x557b3577b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b3577bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b357776b0 0x557b35782f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b35671fa0 con 0x557b35771b50 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b353a9250 con 0x557b357776b0 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b3565b200 con 0x557b35772540 2024-02-14T13:11:15.136 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc0a3431740 10 client.0 _ll_register_callbacks cb 0x557b356cab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc09e526640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 0x557b3577b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc09e526640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 0x557b3577b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45976/0 (socket says 172.21.15.12:45976) 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc09e526640 1 -- 172.21.15.12:0/622530097 learned_addr learned my addr 172.21.15.12:0/622530097 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc09dd25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b3577bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.124+0000 7fc09ed27640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b357776b0 0x557b35782f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09e526640 1 -- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 msgr2=0x557b3577bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09e526640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b3577bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09e526640 1 -- 172.21.15.12:0/622530097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b357776b0 msgr2=0x557b35782f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09e526640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b357776b0 0x557b35782f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09e526640 1 -- 172.21.15.12:0/622530097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc098109f60 con 0x557b35771b50 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09dd25640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b3577bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:11:15.137 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc09e526640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 0x557b3577b9a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc09002c170 tx=0x7fc090005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98d892d501f5f4c server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc07dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc07dffb640 1 -- 172.21.15.12:0/622530097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09002c9a0 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc07dffb640 1 -- 172.21.15.12:0/622530097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fc090005490 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b353d5600 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc07dffb640 1 -- 172.21.15.12:0/622530097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc090005650 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc0a3431740 10 client.15378 fetch_fsmap learned FSMap version 18 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x557b356d3d70 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc07dffb640 1 -- 172.21.15.12:0/622530097 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x557b353d5600 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc07dffb640 1 -- 172.21.15.12:0/622530097 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc09003c050 con 0x557b35771b50 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc0a3431740 10 client.15378 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.125+0000 7fc0a3431740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:11:15.138 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc0a3431740 20 client.15378 populate_metadata read hostname 'smithi012' 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc0a3431740 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357874b0 0x557b357898a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc0a3431740 4 client.15378 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b354261b0 con 0x557b357874b0 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc09dd25640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357874b0 0x557b357898a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc09dd25640 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357874b0 0x557b357898a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a09700fb31296b78 server_cookie=cf886b3acc51956c in_seq=0 out_seq=0 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.126+0000 7fc07dffb640 10 client.15378 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.128+0000 7fc07dffb640 1 -- 172.21.15.12:0/622530097 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557b354261b0 con 0x557b357874b0 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.128+0000 7fc07dffb640 10 client.15378 handle_command_reply: tid=0 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.128+0000 7fc0a3431740 1 client.15378 shutdown 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.128+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 msgr2=0x557b3577b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.128+0000 7fc0a3431740 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 0x557b3577b9a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc09002c170 tx=0x7fc090005090 comp rx=0 tx=0).stop 2024-02-14T13:11:15.139 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 shutdown_connections 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357874b0 0x557b357898a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b357776b0 0x557b35782f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b3577bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc07dffb640 0 client.15378 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 --2- 172.21.15.12:0/622530097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b35771b50 0x557b3577b9a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 >> 172.21.15.12:0/622530097 conn(0x557b35768cb0 msgr2=0x557b35767ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 shutdown_connections 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 1 -- 172.21.15.12:0/622530097 wait complete. 2024-02-14T13:11:15.140 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.129+0000 7fc0a3431740 20 client.15378 trim_cache size 0 max 16384 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 Processor -- start 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 -- start start 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35771b50 0x557b35772d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b35782ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35773290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b35769a20 con 0x557b357776b0 2024-02-14T13:11:15.150 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b357872b0 con 0x557b35771b50 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc0a3431740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b35764080 con 0x557b35772540 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35773290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35773290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45992/0 (socket says 172.21.15.12:45992) 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 -- 172.21.15.12:0/4168943901 learned_addr learned my addr 172.21.15.12:0/4168943901 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09dd25640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b35782ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09e526640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35771b50 0x557b35772d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 -- 172.21.15.12:0/4168943901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 msgr2=0x557b35782ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b35782ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 -- 172.21.15.12:0/4168943901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35771b50 msgr2=0x557b35772d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35771b50 0x557b35772d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09ed27640 1 -- 172.21.15.12:0/4168943901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b35670820 con 0x557b357776b0 2024-02-14T13:11:15.151 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09dd25640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b35782ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.143+0000 7fc09e526640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35771b50 0x557b35772d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc09ed27640 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35773290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc088014120 tx=0x7fc08801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b432d9581c07465 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc07ffff640 1 -- 172.21.15.12:0/4168943901 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088023040 con 0x557b357776b0 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc07ffff640 1 -- 172.21.15.12:0/4168943901 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc088014150 con 0x557b357776b0 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc07ffff640 1 -- 172.21.15.12:0/4168943901 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088019070 con 0x557b357776b0 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 -- 172.21.15.12:0/4168943901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 msgr2=0x557b35773290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35773290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc088014120 tx=0x7fc08801c000 comp rx=0 tx=0).stop 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 -- 172.21.15.12:0/4168943901 shutdown_connections 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35773290 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35772540 0x557b35782ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 --2- 172.21.15.12:0/4168943901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35771b50 0x557b35772d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.152 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 -- 172.21.15.12:0/4168943901 >> 172.21.15.12:0/4168943901 conn(0x557b35768cb0 msgr2=0x557b35767ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 -- 172.21.15.12:0/4168943901 shutdown_connections 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.144+0000 7fc0a3431740 1 -- 172.21.15.12:0/4168943901 wait complete. 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 -- start start 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 Processor -- start 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b357827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35782d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35780dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b357813e0 con 0x557b357776b0 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b35781550 con 0x557b35772540 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b35781710 con 0x557b35771b50 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 10 client.0 _ll_register_callbacks cb 0x7fc090009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:11:15.153 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35780dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35780dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46000/0 (socket says 172.21.15.12:46000) 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 -- 172.21.15.12:0/3089023277 learned_addr learned my addr 172.21.15.12:0/3089023277 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09e526640 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b357827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 -- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 msgr2=0x557b357827c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b357827c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 -- 172.21.15.12:0/3089023277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 msgr2=0x557b35782d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35782d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 -- 172.21.15.12:0/3089023277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b35696720 con 0x557b357776b0 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc09ed27640 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35780dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc088009270 tx=0x7fc088014400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30817d51488fa31d server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc07dffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc07dffb640 1 -- 172.21.15.12:0/3089023277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088019040 con 0x557b357776b0 2024-02-14T13:11:15.154 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc07dffb640 1 -- 172.21.15.12:0/3089023277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fc088029640 con 0x557b357776b0 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.145+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc09002cb00 con 0x557b357776b0 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc07dffb640 1 -- 172.21.15.12:0/3089023277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc088029800 con 0x557b357776b0 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 10 client.15384 fetch_fsmap learned FSMap version 18 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x557b3567cef0 con 0x557b357776b0 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc07dffb640 1 -- 172.21.15.12:0/3089023277 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc09002cb00 con 0x557b357776b0 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc07dffb640 1 -- 172.21.15.12:0/3089023277 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc088033a70 con 0x557b357776b0 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 10 client.15384 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 10 client.15384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 20 client.15384 populate_metadata read hostname 'smithi012' 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357dee00 0x557b357e1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 4 client.15384 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:11:15.155 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557b35412550 con 0x557b357dee00 2024-02-14T13:11:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc09e526640 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357dee00 0x557b357e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc07dffb640 10 client.15384 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:15.156 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.146+0000 7fc09e526640 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357dee00 0x557b357e1220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a39ccf1c89580eb server_cookie=1a4206f8e0a7cb90 in_seq=0 out_seq=0 2024-02-14T13:11:15.348 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.345+0000 7fc07dffb640 1 -- 172.21.15.12:0/3089023277 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557b35412550 con 0x557b357dee00 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc07dffb640 10 client.15384 handle_command_reply: tid=0 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 client.15384 shutdown 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 msgr2=0x557b35780dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35780dd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc088009270 tx=0x7fc088014400 comp rx=0 tx=0).stop 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 shutdown_connections 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x557b357dee00 0x557b357e1220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557b357776b0 0x557b35780dd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc07dffb640 0 client.15384 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557b35772540 0x557b35782d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 --2- 172.21.15.12:0/3089023277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b35771b50 0x557b357827c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.349 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 >> 172.21.15.12:0/3089023277 conn(0x557b35768cb0 msgr2=0x557b3576bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 shutdown_connections 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 1 -- 172.21.15.12:0/3089023277 wait complete. 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.346+0000 7fc0a3431740 20 client.15384 trim_cache size 0 max 16384 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:11:15.350 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:11:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc0800a21e0 msgr2=0x7fc0800a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc0800a21e0 0x7fc0800a46a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc088009fd0 tx=0x7fc088009d60 comp rx=0 tx=0).stop 2024-02-14T13:11:15.351 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 msgr2=0x7fc0981977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 0x7fc0981977b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00e9f0 tx=0x7fc08c00eeb0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 shutdown_connections 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc0800a21e0 0x7fc0800a46a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc098106f30 0x7fc09819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc098104600 0x7fc0981977b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 --2- 172.21.15.12:0/2388254348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc098101cd0 0x7fc098197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 >> 172.21.15.12:0/2388254348 conn(0x7fc0980fb6c0 msgr2=0x7fc0981026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 shutdown_connections 2024-02-14T13:11:15.352 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:15.347+0000 7fc0a078a640 1 -- 172.21.15.12:0/2388254348 wait complete. 2024-02-14T13:11:15.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:15 smithi012 ceph-mon[32370]: pgmap v424: 97 pgs: 97 active+clean; 61 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 463 op/s 2024-02-14T13:11:15.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:15 smithi103 ceph-mon[36921]: pgmap v424: 97 pgs: 97 active+clean; 61 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 463 op/s 2024-02-14T13:11:16.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:15 smithi055 ceph-mon[36853]: pgmap v424: 97 pgs: 97 active+clean; 61 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 463 op/s 2024-02-14T13:11:17.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:17 smithi012 ceph-mon[32370]: pgmap v425: 97 pgs: 97 active+clean; 40 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 523 op/s 2024-02-14T13:11:17.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:17 smithi103 ceph-mon[36921]: pgmap v425: 97 pgs: 97 active+clean; 40 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 523 op/s 2024-02-14T13:11:18.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:17 smithi055 ceph-mon[36853]: pgmap v425: 97 pgs: 97 active+clean; 40 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 523 op/s 2024-02-14T13:11:19.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:19 smithi012 ceph-mon[32370]: pgmap v426: 97 pgs: 97 active+clean; 40 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2024-02-14T13:11:19.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:19 smithi103 ceph-mon[36921]: pgmap v426: 97 pgs: 97 active+clean; 40 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2024-02-14T13:11:20.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:19 smithi055 ceph-mon[36853]: pgmap v426: 97 pgs: 97 active+clean; 40 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2024-02-14T13:11:21.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:21 smithi012 ceph-mon[32370]: pgmap v427: 97 pgs: 97 active+clean; 30 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 535 op/s 2024-02-14T13:11:21.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:21 smithi103 ceph-mon[36921]: pgmap v427: 97 pgs: 97 active+clean; 30 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 535 op/s 2024-02-14T13:11:22.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:21 smithi055 ceph-mon[36853]: pgmap v427: 97 pgs: 97 active+clean; 30 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 535 op/s 2024-02-14T13:11:23.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:23 smithi012 ceph-mon[32370]: pgmap v428: 97 pgs: 97 active+clean; 32 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 506 op/s 2024-02-14T13:11:23.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:23 smithi103 ceph-mon[36921]: pgmap v428: 97 pgs: 97 active+clean; 32 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 506 op/s 2024-02-14T13:11:24.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:23 smithi055 ceph-mon[36853]: pgmap v428: 97 pgs: 97 active+clean; 32 MiB data, 788 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 506 op/s 2024-02-14T13:11:25.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:25 smithi012 ceph-mon[32370]: pgmap v429: 97 pgs: 97 active+clean; 31 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 501 op/s 2024-02-14T13:11:25.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:25 smithi103 ceph-mon[36921]: pgmap v429: 97 pgs: 97 active+clean; 31 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 501 op/s 2024-02-14T13:11:26.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:25 smithi055 ceph-mon[36853]: pgmap v429: 97 pgs: 97 active+clean; 31 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 501 op/s 2024-02-14T13:11:27.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:27 smithi012 ceph-mon[32370]: pgmap v430: 97 pgs: 97 active+clean; 30 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 543 op/s 2024-02-14T13:11:27.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:27 smithi103 ceph-mon[36921]: pgmap v430: 97 pgs: 97 active+clean; 30 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 543 op/s 2024-02-14T13:11:28.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:27 smithi055 ceph-mon[36853]: pgmap v430: 97 pgs: 97 active+clean; 30 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 543 op/s 2024-02-14T13:11:28.442 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.438+0000 7f4e0442e640 1 -- 172.21.15.12:0/4174296255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc101340 msgr2=0x7f4dfc1017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.438+0000 7f4e0442e640 1 --2- 172.21.15.12:0/4174296255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc101340 0x7f4dfc1017c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009900 tx=0x7f4df002bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- 172.21.15.12:0/4174296255 shutdown_connections 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 --2- 172.21.15.12:0/4174296255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dfc101d00 0x7f4dfc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 --2- 172.21.15.12:0/4174296255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc101340 0x7f4dfc1017c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 --2- 172.21.15.12:0/4174296255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dfc100150 0x7f4dfc100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- 172.21.15.12:0/4174296255 >> 172.21.15.12:0/4174296255 conn(0x7f4dfc0fb6c0 msgr2=0x7f4dfc0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- 172.21.15.12:0/4174296255 shutdown_connections 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- 172.21.15.12:0/4174296255 wait complete. 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 Processor -- start 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- start start 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 0x7f4dfc197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dfc101340 0x7f4dfc197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dfc101d00 0x7f4dfc19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc19ed20 con 0x7f4dfc100150 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc19ee90 con 0x7f4dfc101d00 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.439+0000 7f4e0442e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc19f050 con 0x7f4dfc101340 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 0x7f4dfc197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 0x7f4dfc197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42530/0 (socket says 172.21.15.12:42530) 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 -- 172.21.15.12:0/875224847 learned_addr learned my addr 172.21.15.12:0/875224847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e019c9640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dfc101340 0x7f4dfc197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e029cb640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dfc101d00 0x7f4dfc19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 -- 172.21.15.12:0/875224847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dfc101340 msgr2=0x7f4dfc197770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dfc101340 0x7f4dfc197770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 -- 172.21.15.12:0/875224847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dfc101d00 msgr2=0x7f4dfc19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dfc101d00 0x7f4dfc19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 -- 172.21.15.12:0/875224847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec009840 con 0x7f4dfc100150 2024-02-14T13:11:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e021ca640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 0x7f4dfc197230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4df400d950 tx=0x7f4df400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4dfb7fe640 1 -- 172.21.15.12:0/875224847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4009c30 con 0x7f4dfc100150 2024-02-14T13:11:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0009560 con 0x7f4dfc100150 2024-02-14T13:11:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4dfb7fe640 1 -- 172.21.15.12:0/875224847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4df4009d90 con 0x7f4dfc100150 2024-02-14T13:11:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4dfb7fe640 1 -- 172.21.15.12:0/875224847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400f850 con 0x7f4dfc100150 2024-02-14T13:11:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.440+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc19f6d0 con 0x7f4dfc100150 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.442+0000 7f4dfb7fe640 1 -- 172.21.15.12:0/875224847 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f4df400f9b0 con 0x7f4dfc100150 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 Processor -- start 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 -- start start 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a09db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a00c9e0 con 0x55999a09d740 2024-02-14T13:11:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a009f10 con 0x55999a0a32a0 2024-02-14T13:11:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.443+0000 7f4e07003740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a0056f0 con 0x55999a09e130 2024-02-14T13:11:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4dfb7fe640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4de40a2160 0x7f4de40a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e029cb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a09db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0a2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.12:32812/0 (socket says 172.21.15.12:32812) 2024-02-14T13:11:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 -- 172.21.15.12:0/3271563825 learned_addr learned my addr 172.21.15.12:0/3271563825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e019c9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e029cb640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4de40a2160 0x7f4de40a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4dfb7fe640 1 -- 172.21.15.12:0/875224847 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f4df40cd990 con 0x7f4dfc100150 2024-02-14T13:11:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 -- 172.21.15.12:0/3271563825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 msgr2=0x55999a0a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 -- 172.21.15.12:0/3271563825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 msgr2=0x55999a09db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a09db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 -- 172.21.15.12:0/3271563825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559999d16920 con 0x55999a09e130 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e029cb640 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a09db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e029cb640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4de40a2160 0x7f4de40a4620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55999a09e990 tx=0x7f4dec009500 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4e021ca640 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0a2c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4df4096ae0 tx=0x7f4df406d740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=733803d6f82d351 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.444+0000 7f4df8bfe640 1 -- 172.21.15.12:0/3271563825 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df409ad80 con 0x55999a09e130 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4df8bfe640 1 -- 172.21.15.12:0/3271563825 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4df409a680 con 0x55999a09e130 2024-02-14T13:11:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4df8bfe640 1 -- 172.21.15.12:0/3271563825 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4010b60 con 0x55999a09e130 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 -- 172.21.15.12:0/3271563825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 msgr2=0x55999a0a2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0a2c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4df4096ae0 tx=0x7f4df406d740 comp rx=0 tx=0).stop 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 -- 172.21.15.12:0/3271563825 shutdown_connections 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0a2c30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 --2- 172.21.15.12:0/3271563825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a09db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 -- 172.21.15.12:0/3271563825 >> 172.21.15.12:0/3271563825 conn(0x55999a098cb0 msgr2=0x55999a0990b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 -- 172.21.15.12:0/3271563825 shutdown_connections 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.445+0000 7f4e07003740 1 -- 172.21.15.12:0/3271563825 wait complete. 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 -- start start 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 Processor -- start 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0a7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a09e130 0x55999a0a7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a0a32a0 0x55999a0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.456 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x559999fa1fa0 con 0x55999a09d740 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559999cd9250 con 0x55999a09e130 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x559999f8b200 con 0x55999a0a32a0 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e07003740 10 client.0 _ll_register_callbacks cb 0x559999ffab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0a7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42554/0 (socket says 172.21.15.12:42554) 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 -- 172.21.15.12:0/1630115665 learned_addr learned my addr 172.21.15.12:0/1630115665 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e029cb640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a0a32a0 0x55999a0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e019c9640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a09e130 0x55999a0a7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 -- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a0a32a0 msgr2=0x55999a0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a0a32a0 0x55999a0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 -- 172.21.15.12:0/1630115665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a09e130 msgr2=0x55999a0a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a09e130 0x55999a0a7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e021ca640 1 -- 172.21.15.12:0/1630115665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc19f6d0 con 0x55999a09d740 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.446+0000 7f4e019c9640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a09e130 0x55999a0a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e021ca640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0a7630 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000c00 tx=0x7f4df40950a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678a3361a6417e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4de1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4de1ffb640 1 -- 172.21.15.12:0/1630115665 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df409e7d0 con 0x55999a09d740 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4de1ffb640 1 -- 172.21.15.12:0/1630115665 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f4df409ad80 con 0x55999a09d740 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559999d05600 con 0x55999a09d740 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4de1ffb640 1 -- 172.21.15.12:0/1630115665 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df4096cf0 con 0x55999a09d740 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 10 client.15396 fetch_fsmap learned FSMap version 18 2024-02-14T13:11:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x55999a003d70 con 0x55999a09d740 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4de1ffb640 1 -- 172.21.15.12:0/1630115665 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x559999d05600 con 0x55999a09d740 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4de1ffb640 1 -- 172.21.15.12:0/1630115665 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4df40a2ab0 con 0x55999a09d740 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 10 client.15396 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 20 client.15396 populate_metadata read hostname 'smithi012' 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a0b30f0 0x55999a0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 4 client.15396 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.447+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559999d561b0 con 0x55999a0b30f0 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.448+0000 7f4e019c9640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a0b30f0 0x55999a0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.448+0000 7f4e019c9640 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a0b30f0 0x55999a0b5500 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ccb6c9f6b646a63 server_cookie=bed93e8e55d1d1a5 in_seq=0 out_seq=0 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.448+0000 7f4de1ffb640 10 client.15396 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4de1ffb640 1 -- 172.21.15.12:0/1630115665 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559999d561b0 con 0x55999a0b30f0 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4de1ffb640 10 client.15396 handle_command_reply: tid=0 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 client.15396 shutdown 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 msgr2=0x55999a0a7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0a7630 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000c00 tx=0x7f4df40950a0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 shutdown_connections 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a0b30f0 0x55999a0b5500 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a0a32a0 0x55999a0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4de1ffb640 0 client.15396 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a09e130 0x55999a0a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 --2- 172.21.15.12:0/1630115665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0a7630 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 >> 172.21.15.12:0/1630115665 conn(0x55999a098cb0 msgr2=0x55999a097ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 shutdown_connections 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 1 -- 172.21.15.12:0/1630115665 wait complete. 2024-02-14T13:11:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.449+0000 7f4e07003740 20 client.15396 trim_cache size 0 max 16384 2024-02-14T13:11:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.462+0000 7f4e07003740 1 Processor -- start 2024-02-14T13:11:28.465 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 -- start start 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a0940f0 con 0x55999a09d740 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a0b2f40 con 0x55999a0a32a0 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e07003740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x559999d561b0 con 0x55999a09e130 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42560/0 (socket says 172.21.15.12:42560) 2024-02-14T13:11:28.466 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 -- 172.21.15.12:0/3723444421 learned_addr learned my addr 172.21.15.12:0/3723444421 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e019c9640 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e029cb640 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 -- 172.21.15.12:0/3723444421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 msgr2=0x55999a0aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 -- 172.21.15.12:0/3723444421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 msgr2=0x55999a0a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 -- 172.21.15.12:0/3723444421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559999fa0820 con 0x55999a09d740 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e029cb640 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4e021ca640 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0b9ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4df409a330 tx=0x7f4df4010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13eda7fe5faa2129 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4de3fff640 1 -- 172.21.15.12:0/3723444421 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40a2e20 con 0x55999a09d740 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4de3fff640 1 -- 172.21.15.12:0/3723444421 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4df40850d0 con 0x55999a09d740 2024-02-14T13:11:28.467 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.463+0000 7f4de3fff640 1 -- 172.21.15.12:0/3723444421 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40ba0b0 con 0x55999a09d740 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 -- 172.21.15.12:0/3723444421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 msgr2=0x55999a0b9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0b9ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4df409a330 tx=0x7f4df4010f30 comp rx=0 tx=0).stop 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 -- 172.21.15.12:0/3723444421 shutdown_connections 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 --2- 172.21.15.12:0/3723444421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0b9ea0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 -- 172.21.15.12:0/3723444421 >> 172.21.15.12:0/3723444421 conn(0x55999a098cb0 msgr2=0x55999a0a2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 -- 172.21.15.12:0/3723444421 shutdown_connections 2024-02-14T13:11:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 -- 172.21.15.12:0/3723444421 wait complete. 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 -- start start 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.464+0000 7f4e07003740 1 Processor -- start 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a0ad210 con 0x55999a09d740 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a0ad380 con 0x55999a0a32a0 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x55999a0ad540 con 0x55999a09e130 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 10 client.0 _ll_register_callbacks cb 0x7f4df4096260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42574/0 (socket says 172.21.15.12:42574) 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 -- 172.21.15.12:0/2824625604 learned_addr learned my addr 172.21.15.12:0/2824625604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e019c9640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e029cb640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 -- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 msgr2=0x55999a0aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 -- 172.21.15.12:0/2824625604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 msgr2=0x55999a0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 -- 172.21.15.12:0/2824625604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55999a003d70 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e021ca640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0ae520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4df4098930 tx=0x7f4df4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3017ff0bae735074 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4de1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4de1ffb640 1 -- 172.21.15.12:0/2824625604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4099de0 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4de1ffb640 1 -- 172.21.15.12:0/2824625604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f4df409ad80 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4df409a680 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.465+0000 7f4de1ffb640 1 -- 172.21.15.12:0/2824625604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df40a2e20 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 10 client.15402 fetch_fsmap learned FSMap version 18 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=4+}) v3 -- 0x559999fc6720 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4de1ffb640 1 -- 172.21.15.12:0/2824625604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f4df409a680 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4de1ffb640 1 -- 172.21.15.12:0/2824625604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4df4099640 con 0x55999a09d740 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 10 client.15402 fetch_fsmap finished waiting for FSMap version 18 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-02-14T13:11:28.473 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 20 client.15402 populate_metadata read hostname 'smithi012' 2024-02-14T13:11:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a10a520 0x55999a10c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 4 client.15402 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-14T13:11:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 --> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559999d42550 con 0x55999a10a520 2024-02-14T13:11:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e019c9640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a10a520 0x55999a10c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4e019c9640 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a10a520 0x55999a10c910 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf848e2f311639df server_cookie=f71ec364ace4f9d1 in_seq=0 out_seq=0 2024-02-14T13:11:28.474 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.466+0000 7f4de1ffb640 10 client.15402 ms_handle_connect on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.723+0000 7f4de1ffb640 1 -- 172.21.15.12:0/2824625604 <== mds.0 v2:172.21.15.103:6838/2266124957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559999d42550 con 0x55999a10a520 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.723+0000 7f4de1ffb640 10 client.15402 handle_command_reply: tid=0 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.723+0000 7f4e07003740 1 client.15402 shutdown 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.723+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 msgr2=0x55999a0ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.723+0000 7f4e07003740 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0ae520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4df4098930 tx=0x7f4df4010d50 comp rx=0 tx=0).stop 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 shutdown_connections 2024-02-14T13:11:28.726 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:6838/2266124957,v1:172.21.15.103:6839/2266124957] conn(0x55999a10a520 0x55999a10c910 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4de1ffb640 0 client.15402 ms_handle_reset on v2:172.21.15.103:6838/2266124957 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55999a0a32a0 0x55999a0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55999a09e130 0x55999a0aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 --2- 172.21.15.12:0/2824625604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55999a09d740 0x55999a0ae520 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 >> 172.21.15.12:0/2824625604 conn(0x55999a098cb0 msgr2=0x55999a0a2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 shutdown_connections 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 1 -- 172.21.15.12:0/2824625604 wait complete. 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.724+0000 7f4e07003740 20 client.15402 trim_cache size 0 max 16384 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:{ 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "message": "", 2024-02-14T13:11:28.727 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout: "return_code": 0 2024-02-14T13:11:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stdout:} 2024-02-14T13:11:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4de40a2160 msgr2=0x7f4de40a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4de40a2160 0x7f4de40a4620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55999a09e990 tx=0x7f4dec009500 comp rx=0 tx=0).stop 2024-02-14T13:11:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 msgr2=0x7f4dfc197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:28.728 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 0x7f4dfc197230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4df400d950 tx=0x7f4df400de10 comp rx=0 tx=0).stop 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 shutdown_connections 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f4de40a2160 0x7f4de40a4620 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dfc101d00 0x7f4dfc19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dfc101340 0x7f4dfc197770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 --2- 172.21.15.12:0/875224847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc100150 0x7f4dfc197230 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 >> 172.21.15.12:0/875224847 conn(0x7f4dfc0fb6c0 msgr2=0x7f4dfc1046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 shutdown_connections 2024-02-14T13:11:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi012.front.sepia.ceph.com.smithi012.stderr:2024-02-14T13:11:28.725+0000 7f4e0442e640 1 -- 172.21.15.12:0/875224847 wait complete. 2024-02-14T13:11:29.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:29 smithi012 ceph-mon[32370]: pgmap v431: 97 pgs: 97 active+clean; 27 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 424 op/s 2024-02-14T13:11:29.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:29 smithi103 ceph-mon[36921]: pgmap v431: 97 pgs: 97 active+clean; 27 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 424 op/s 2024-02-14T13:11:30.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:29 smithi055 ceph-mon[36853]: pgmap v431: 97 pgs: 97 active+clean; 27 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 424 op/s 2024-02-14T13:11:31.399 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-14T13:11:31.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-14T13:11:31.752 DEBUG:teuthology.parallel:result is None 2024-02-14T13:11:31.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-14T13:11:31.787 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-14T13:11:31.787 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-02-14T13:11:31.803 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T13:11:31.835 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-02-14T13:11:31.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:11:31.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:31 smithi012 ceph-mon[32370]: pgmap v432: 97 pgs: 97 active+clean; 20 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 564 op/s 2024-02-14T13:11:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- 172.21.15.12:0/479236623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 msgr2=0x7f31941096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- 172.21.15.12:0/479236623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f31941096c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f318c009ca0 tx=0x7f318c02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:11:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- 172.21.15.12:0/479236623 shutdown_connections 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- 172.21.15.12:0/479236623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f31941096c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- 172.21.15.12:0/479236623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3194102470 0x7f31941028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- 172.21.15.12:0/479236623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3194101280 0x7f31941016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- 172.21.15.12:0/479236623 >> 172.21.15.12:0/479236623 conn(0x7f31940fc7d0 msgr2=0x7f31940fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- 172.21.15.12:0/479236623 shutdown_connections 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- 172.21.15.12:0/479236623 wait complete. 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 Processor -- start 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- start start 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3194101280 0x7f31941972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3194102470 0x7f31941977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f319419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319419ed90 con 0x7f3194102e30 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319419ef00 con 0x7f3194102470 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.977+0000 7f319c1c7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319419f0c0 con 0x7f3194101280 2024-02-14T13:11:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f319419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f319419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42584/0 (socket says 172.21.15.12:42584) 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 -- 172.21.15.12:0/229148293 learned_addr learned my addr 172.21.15.12:0/229148293 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f3199f63640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3194101280 0x7f31941972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f3199762640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3194102470 0x7f31941977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 -- 172.21.15.12:0/229148293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3194101280 msgr2=0x7f31941972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3194101280 0x7f31941972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 -- 172.21.15.12:0/229148293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3194102470 msgr2=0x7f31941977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3194102470 0x7f31941977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 -- 172.21.15.12:0/229148293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c009900 con 0x7f3194102e30 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319a764640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f319419e850 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f318c037040 tx=0x7f318c034a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0329b0 con 0x7f3194102e30 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f318c003e50 con 0x7f3194102e30 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319419f340 con 0x7f3194102e30 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c040450 con 0x7f3194102e30 2024-02-14T13:11:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.978+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319419f7f0 con 0x7f3194102e30 2024-02-14T13:11:31.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.979+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31941084d0 con 0x7f3194102e30 2024-02-14T13:11:31.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.980+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f318c00a040 con 0x7f3194102e30 2024-02-14T13:11:31.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.981+0000 7f318affd640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f31800a20c0 0x7f31800a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:31.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.981+0000 7f3199f63640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f31800a20c0 0x7f31800a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:31.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.981+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f318c0f0f30 con 0x7f3194102e30 2024-02-14T13:11:31.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.981+0000 7f3199f63640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f31800a20c0 0x7f31800a4580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f31941022d0 tx=0x7f3190005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:31.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:31.984+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f318c0b9f80 con 0x7f3194102e30 2024-02-14T13:11:31.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:31 smithi103 ceph-mon[36921]: pgmap v432: 97 pgs: 97 active+clean; 20 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 564 op/s 2024-02-14T13:11:32.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:31 smithi055 ceph-mon[36853]: pgmap v432: 97 pgs: 97 active+clean; 20 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 564 op/s 2024-02-14T13:11:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.167+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f319402ce50 con 0x7f3194102e30 2024-02-14T13:11:32.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.168+0000 7f318affd640 1 -- 172.21.15.12:0/229148293 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22684 (secure 0 0 0) 0x7f318c044090 con 0x7f3194102e30 2024-02-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:11:32.171 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:08:50.631073+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f31800a20c0 msgr2=0x7f31800a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f31800a20c0 0x7f31800a4580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f31941022d0 tx=0x7f3190005f90 comp rx=0 tx=0).stop 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 msgr2=0x7f319419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f319419e850 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f318c037040 tx=0x7f318c034a90 comp rx=0 tx=0).stop 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 shutdown_connections 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f31800a20c0 0x7f31800a4580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3194102e30 0x7f319419e850 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3194102470 0x7f31941977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 --2- 172.21.15.12:0/229148293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3194101280 0x7f31941972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.170+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 >> 172.21.15.12:0/229148293 conn(0x7f31940fc7d0 msgr2=0x7f31941056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.171+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 shutdown_connections 2024-02-14T13:11:32.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.171+0000 7f319c1c7640 1 -- 172.21.15.12:0/229148293 wait complete. 2024-02-14T13:11:32.184 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-14T13:06:47.668699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-14T13:06:48.352208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:11:32.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 -- 172.21.15.12:0/2718638453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 msgr2=0x7ff27c1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 --2- 172.21.15.12:0/2718638453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c1017b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff270009900 tx=0x7ff27002bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 -- 172.21.15.12:0/2718638453 shutdown_connections 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 --2- 172.21.15.12:0/2718638453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c101cf0 0x7ff27c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 --2- 172.21.15.12:0/2718638453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c1017b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 --2- 172.21.15.12:0/2718638453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27c100140 0x7ff27c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 -- 172.21.15.12:0/2718638453 >> 172.21.15.12:0/2718638453 conn(0x7ff27c0fb6d0 msgr2=0x7ff27c0fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 -- 172.21.15.12:0/2718638453 shutdown_connections 2024-02-14T13:11:32.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.288+0000 7ff282250640 1 -- 172.21.15.12:0/2718638453 wait complete. 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 Processor -- start 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 -- start start 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c100140 0x7ff27c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27c101cf0 0x7ff27c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c19ee00 con 0x7ff27c101330 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c19ef70 con 0x7ff27c100140 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff282250640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c19f130 con 0x7ff27c101cf0 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c197850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42612/0 (socket says 172.21.15.12:42612) 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 -- 172.21.15.12:0/4078529200 learned_addr learned my addr 172.21.15.12:0/4078529200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27bfff640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27c101cf0 0x7ff27c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27b7fe640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c100140 0x7ff27c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 -- 172.21.15.12:0/4078529200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27c101cf0 msgr2=0x7ff27c19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27c101cf0 0x7ff27c19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 -- 172.21.15.12:0/4078529200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c100140 msgr2=0x7ff27c197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c100140 0x7ff27c197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 -- 172.21.15.12:0/4078529200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009560 con 0x7ff27c101330 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.289+0000 7ff27affd640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c197850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff270006010 tx=0x7ff2700040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.290+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700044c0 con 0x7ff27c101330 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.290+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff2700052d0 con 0x7ff27c101330 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.290+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270003e10 con 0x7ff27c101330 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.290+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c19f3b0 con 0x7ff27c101330 2024-02-14T13:11:32.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.290+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c19f910 con 0x7ff27c101330 2024-02-14T13:11:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.291+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c107580 con 0x7ff27c101330 2024-02-14T13:11:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.292+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff270005440 con 0x7ff27c101330 2024-02-14T13:11:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.292+0000 7ff278ff9640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff2640a2140 0x7ff2640a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.292+0000 7ff27b7fe640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff2640a2140 0x7ff2640a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.292+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7ff2700f0010 con 0x7ff27c101330 2024-02-14T13:11:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.293+0000 7ff27b7fe640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff2640a2140 0x7ff2640a4600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff27c101190 tx=0x7ff26c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:32.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.297+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff2700b9040 con 0x7ff27c101330 2024-02-14T13:11:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.479+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff27c10ceb0 con 0x7ff27c101330 2024-02-14T13:11:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.479+0000 7ff278ff9640 1 -- 172.21.15.12:0/4078529200 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2700bc700 con 0x7ff27c101330 2024-02-14T13:11:32.481 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:11:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff2640a2140 msgr2=0x7ff2640a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff2640a2140 0x7ff2640a4600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff27c101190 tx=0x7ff26c005f90 comp rx=0 tx=0).stop 2024-02-14T13:11:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 msgr2=0x7ff27c197850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c197850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff270006010 tx=0x7ff2700040c0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 shutdown_connections 2024-02-14T13:11:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff2640a2140 0x7ff2640a4600 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff27c101cf0 0x7ff27c19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff27c101330 0x7ff27c197850 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 --2- 172.21.15.12:0/4078529200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff27c100140 0x7ff27c197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 >> 172.21.15.12:0/4078529200 conn(0x7ff27c0fb6d0 msgr2=0x7ff27c104750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 shutdown_connections 2024-02-14T13:11:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.482+0000 7ff282250640 1 -- 172.21.15.12:0/4078529200 wait complete. 2024-02-14T13:11:32.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-14T13:11:32.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 -- 172.21.15.12:0/3556117675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e8101cc0 msgr2=0x7fe1e81040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 --2- 172.21.15.12:0/3556117675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e8101cc0 0x7fe1e81040b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009900 tx=0x7fe1e402bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:32.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 -- 172.21.15.12:0/3556117675 shutdown_connections 2024-02-14T13:11:32.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 --2- 172.21.15.12:0/3556117675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e8106f20 0x7fe1e8109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 --2- 172.21.15.12:0/3556117675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e81045f0 0x7fe1e81069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 --2- 172.21.15.12:0/3556117675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e8101cc0 0x7fe1e81040b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 -- 172.21.15.12:0/3556117675 >> 172.21.15.12:0/3556117675 conn(0x7fe1e80fb6d0 msgr2=0x7fe1e80fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 -- 172.21.15.12:0/3556117675 shutdown_connections 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.598+0000 7fe1f015c640 1 -- 172.21.15.12:0/3556117675 wait complete. 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 Processor -- start 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 -- start start 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e8101cc0 0x7fe1e8197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 0x7fe1e81978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e8106f20 0x7fe1e819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819ee50 con 0x7fe1e81045f0 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819efc0 con 0x7fe1e8106f20 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1f015c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819f180 con 0x7fe1e8101cc0 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 0x7fe1e81978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 0x7fe1e81978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42634/0 (socket says 172.21.15.12:42634) 2024-02-14T13:11:32.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 -- 172.21.15.12:0/2299132098 learned_addr learned my addr 172.21.15.12:0/2299132098 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1edef8640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e8101cc0 0x7fe1e8197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ee6f9640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e8106f20 0x7fe1e819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 -- 172.21.15.12:0/2299132098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e8101cc0 msgr2=0x7fe1e8197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e8101cc0 0x7fe1e8197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 -- 172.21.15.12:0/2299132098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e8106f20 msgr2=0x7fe1e819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e8106f20 0x7fe1e819e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.599+0000 7fe1ed6f7640 1 -- 172.21.15.12:0/2299132098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4009560 con 0x7fe1e81045f0 2024-02-14T13:11:32.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.600+0000 7fe1ed6f7640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 0x7fe1e81978a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d770 tx=0x7fe1d800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.600+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8009c30 con 0x7fe1e81045f0 2024-02-14T13:11:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.600+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fe1d800de80 con 0x7fe1e81045f0 2024-02-14T13:11:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.600+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e819f460 con 0x7fe1e81045f0 2024-02-14T13:11:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.600+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800f6b0 con 0x7fe1e81045f0 2024-02-14T13:11:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.600+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e819f9f0 con 0x7fe1e81045f0 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.601+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e80fd1c0 con 0x7fe1e81045f0 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.602+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fe1d8005030 con 0x7fe1e81045f0 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.603+0000 7fe1deffd640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe1d40a20c0 0x7fe1d40a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.603+0000 7fe1edef8640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe1d40a20c0 0x7fe1d40a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.603+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fe1d80cda40 con 0x7fe1e81045f0 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.603+0000 7fe1edef8640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe1d40a20c0 0x7fe1d40a4580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009230 tx=0x7fe1e4005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.606+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe1d80969d0 con 0x7fe1e81045f0 2024-02-14T13:11:32.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.788+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1e810ce40 con 0x7fe1e81045f0 2024-02-14T13:11:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.789+0000 7fe1deffd640 1 -- 172.21.15.12:0/2299132098 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1d8021020 con 0x7fe1e81045f0 2024-02-14T13:11:32.791 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe1d40a20c0 msgr2=0x7fe1d40a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe1d40a20c0 0x7fe1d40a4580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009230 tx=0x7fe1e4005fd0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 msgr2=0x7fe1e81978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 0x7fe1e81978a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d770 tx=0x7fe1d800dc30 comp rx=0 tx=0).stop 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 shutdown_connections 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fe1d40a20c0 0x7fe1d40a4580 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1e8106f20 0x7fe1e819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1e81045f0 0x7fe1e81978a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 --2- 172.21.15.12:0/2299132098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e8101cc0 0x7fe1e8197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 >> 172.21.15.12:0/2299132098 conn(0x7fe1e80fb6d0 msgr2=0x7fe1e8102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 shutdown_connections 2024-02-14T13:11:32.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.791+0000 7fe1f015c640 1 -- 172.21.15.12:0/2299132098 wait complete. 2024-02-14T13:11:32.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:32 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/229148293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:32.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:32 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/4078529200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:11:32.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 -- 172.21.15.12:0/3811289476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38101d10 msgr2=0x7fdf38104100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3811289476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38101d10 0x7fdf38104100 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009900 tx=0x7fdf2c02bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 -- 172.21.15.12:0/3811289476 shutdown_connections 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3811289476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf38106f70 0x7fdf38109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3811289476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38104640 0x7fdf38106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3811289476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38101d10 0x7fdf38104100 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 -- 172.21.15.12:0/3811289476 >> 172.21.15.12:0/3811289476 conn(0x7fdf380fb6c0 msgr2=0x7fdf380fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 -- 172.21.15.12:0/3811289476 shutdown_connections 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.907+0000 7fdf3f008640 1 -- 172.21.15.12:0/3811289476 wait complete. 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 Processor -- start 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 -- start start 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38101d10 0x7fdf38199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 0x7fdf38199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf38106f70 0x7fdf381a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381a1000 con 0x7fdf38104640 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381a1170 con 0x7fdf38101d10 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381a1330 con 0x7fdf38106f70 2024-02-14T13:11:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 0x7fdf38199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 0x7fdf38199a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42644/0 (socket says 172.21.15.12:42644) 2024-02-14T13:11:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 -- 172.21.15.12:0/3154864090 learned_addr learned my addr 172.21.15.12:0/3154864090 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3cda4640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38101d10 0x7fdf38199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3d5a5640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf38106f70 0x7fdf381a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 -- 172.21.15.12:0/3154864090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf38106f70 msgr2=0x7fdf381a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf38106f70 0x7fdf381a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 -- 172.21.15.12:0/3154864090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38101d10 msgr2=0x7fdf38199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38101d10 0x7fdf38199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 -- 172.21.15.12:0/3154864090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c009560 con 0x7fdf38104640 2024-02-14T13:11:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3cda4640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38101d10 0x7fdf38199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf37fff640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 0x7fdf38199a50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24009c30 con 0x7fdf38104640 2024-02-14T13:11:32.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fdf24009d90 con 0x7fdf38104640 2024-02-14T13:11:32.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.908+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf381a1610 con 0x7fdf38104640 2024-02-14T13:11:32.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.909+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24010460 con 0x7fdf38104640 2024-02-14T13:11:32.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.909+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf381a1b70 con 0x7fdf38104640 2024-02-14T13:11:32.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.910+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf38108a60 con 0x7fdf38104640 2024-02-14T13:11:32.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.911+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fdf24003f20 con 0x7fdf38104640 2024-02-14T13:11:32.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.911+0000 7fdf35ffb640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdf280a2140 0x7fdf280a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:32.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.911+0000 7fdf3cda4640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdf280a2140 0x7fdf280a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:32.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.911+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fdf240cd9d0 con 0x7fdf38104640 2024-02-14T13:11:32.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.912+0000 7fdf3cda4640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdf280a2140 0x7fdf280a4600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c000c00 tx=0x7fdf2c005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:32.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:32.915+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdf24096960 con 0x7fdf38104640 2024-02-14T13:11:32.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:32 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/229148293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:32.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:32 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/4078529200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:11:33.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:32 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/229148293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:33.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:32 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/4078529200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:11:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.095+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf3802ce50 con 0x7fdf38104640 2024-02-14T13:11:33.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.095+0000 7fdf35ffb640 1 -- 172.21.15.12:0/3154864090 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf2409a020 con 0x7fdf38104640 2024-02-14T13:11:33.097 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdf280a2140 msgr2=0x7fdf280a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdf280a2140 0x7fdf280a4600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c000c00 tx=0x7fdf2c005be0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 msgr2=0x7fdf38199a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 0x7fdf38199a50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf2400dde0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 shutdown_connections 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fdf280a2140 0x7fdf280a4600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf38106f70 0x7fdf381a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf38104640 0x7fdf38199a50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 --2- 172.21.15.12:0/3154864090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf38101d10 0x7fdf38199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 >> 172.21.15.12:0/3154864090 conn(0x7fdf380fb6c0 msgr2=0x7fdf38101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 shutdown_connections 2024-02-14T13:11:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.097+0000 7fdf3f008640 1 -- 172.21.15.12:0/3154864090 wait complete. 2024-02-14T13:11:33.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 -- 172.21.15.12:0/506961818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 msgr2=0x7ffaf81017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 --2- 172.21.15.12:0/506961818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf81017e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009900 tx=0x7ffae402bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 -- 172.21.15.12:0/506961818 shutdown_connections 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 --2- 172.21.15.12:0/506961818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8101d20 0x7ffaf81085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 --2- 172.21.15.12:0/506961818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf81017e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 --2- 172.21.15.12:0/506961818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8100170 0x7ffaf8100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 -- 172.21.15.12:0/506961818 >> 172.21.15.12:0/506961818 conn(0x7ffaf80fb6e0 msgr2=0x7ffaf80fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 -- 172.21.15.12:0/506961818 shutdown_connections 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.211+0000 7ffafeea4640 1 -- 172.21.15.12:0/506961818 wait complete. 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 Processor -- start 2024-02-14T13:11:33.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 -- start start 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8100170 0x7ffaf806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf819c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8101d20 0x7ffaf819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf819eed0 con 0x7ffaf8101360 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf819f040 con 0x7ffaf8101d20 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafeea4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf819f200 con 0x7ffaf8100170 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf819c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf819c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42658/0 (socket says 172.21.15.12:42658) 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 -- 172.21.15.12:0/16322193 learned_addr learned my addr 172.21.15.12:0/16322193 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafcc40640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8100170 0x7ffaf806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 -- 172.21.15.12:0/16322193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8100170 msgr2=0x7ffaf806a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafd441640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8101d20 0x7ffaf819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8100170 0x7ffaf806a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 -- 172.21.15.12:0/16322193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8101d20 msgr2=0x7ffaf819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8101d20 0x7ffaf819e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 -- 172.21.15.12:0/16322193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009560 con 0x7ffaf8101360 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafcc40640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8100170 0x7ffaf806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffafd441640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8101d20 0x7ffaf819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf7fff640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf819c0d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.212+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae40044e0 con 0x7ffaf8101360 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.213+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ffae40054e0 con 0x7ffaf8101360 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.213+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf819f420 con 0x7ffaf8101360 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.213+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae403e450 con 0x7ffaf8101360 2024-02-14T13:11:33.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.213+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf819fa00 con 0x7ffaf8101360 2024-02-14T13:11:33.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.214+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf8107490 con 0x7ffaf8101360 2024-02-14T13:11:33.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.215+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ffae40035f0 con 0x7ffaf8101360 2024-02-14T13:11:33.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.215+0000 7ffaf5ffb640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ffae80a2140 0x7ffae80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:33.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.215+0000 7ffafcc40640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ffae80a2140 0x7ffae80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:33.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.216+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7ffae40f06b0 con 0x7ffaf8101360 2024-02-14T13:11:33.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.216+0000 7ffafcc40640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ffae80a2140 0x7ffae80a4600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006fd0 tx=0x7ffaec008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:33.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.219+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffae40b9640 con 0x7ffaf8101360 2024-02-14T13:11:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.455+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7ffaf810be30 con 0x7ffaf8101360 2024-02-14T13:11:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.463+0000 7ffaf5ffb640 1 -- 172.21.15.12:0/16322193 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+736411 (secure 0 0 0) 0x7ffae40bcd00 con 0x7ffaf8101360 2024-02-14T13:11:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:11:33.474 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-02-14T13:11:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 18, 2024-02-14T13:11:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "active_gid": 14148, 2024-02-14T13:11:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "active_name": "x", 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addrs": { 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1684027624 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1684027624 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addr": "172.21.15.12:6801/1684027624", 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "active_change": "2024-02-14T12:59:48.272238+0000", 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "active_mgr_features": 4540701272860131327, 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "available": true, 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "standbys": [ 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 24109, 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "z", 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701272860131327, 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.478 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.480 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.481 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.492 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-02-14T13:11:33.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-14T13:11:33.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.500 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-14T13:11:33.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.502 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.502 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-02-14T13:11:33.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-02-14T13:11:33.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-02-14T13:11:33.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-02-14T13:11:33.504 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-02-14T13:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.505 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-02-14T13:11:33.506 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-02-14T13:11:33.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.506 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.506 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.508 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:33.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:33.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.510 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.510 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-02-14T13:11:33.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-02-14T13:11:33.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.511 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:33.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:33.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-14T13:11:33.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-14T13:11:33.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.512 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-02-14T13:11:33.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-14T13:11:33.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.514 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.515 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-02-14T13:11:33.516 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-02-14T13:11:33.516 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.516 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.516 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-02-14T13:11:33.516 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-02-14T13:11:33.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-14T13:11:33.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-02-14T13:11:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-02-14T13:11:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-02-14T13:11:33.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-02-14T13:11:33.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-02-14T13:11:33.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-14T13:11:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-02-14T13:11:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-14T13:11:33.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-02-14T13:11:33.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.547 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.551 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-14T13:11:33.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-02-14T13:11:33.561 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-14T13:11:33.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.564 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-02-14T13:11:33.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-02-14T13:11:33.568 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.572 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-02-14T13:11:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-02-14T13:11:33.574 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.575 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.578 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-02-14T13:11:33.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.581 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-14T13:11:33.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-14T13:11:33.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-14T13:11:33.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.589 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-14T13:11:33.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-02-14T13:11:33.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.601 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.602 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-14T13:11:33.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.609 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-14T13:11:33.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.614 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.616 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.621 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.622 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.625 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.626 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-02-14T13:11:33.628 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.629 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.633 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.634 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.635 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.636 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.637 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.640 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.641 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-14T13:11:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.645 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-14T13:11:33.646 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-02-14T13:11:33.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.650 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.653 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-02-14T13:11:33.654 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-02-14T13:11:33.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-02-14T13:11:33.657 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-02-14T13:11:33.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.661 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.662 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.664 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-02-14T13:11:33.665 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-02-14T13:11:33.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-02-14T13:11:33.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.669 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.671 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.672 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.675 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.676 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.679 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.685 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.686 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.687 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-02-14T13:11:33.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.691 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-02-14T13:11:33.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-02-14T13:11:33.697 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-14T13:11:33.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.699 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.700 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.704 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.705 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.706 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.708 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.709 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.710 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.712 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-14T13:11:33.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.715 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.716 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.720 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.721 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.722 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.724 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-02-14T13:11:33.725 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.726 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.727 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.728 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.729 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.730 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.731 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.732 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.733 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.734 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-02-14T13:11:33.736 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-02-14T13:11:33.737 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.738 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.740 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.741 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.742 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.744 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.745 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.746 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-14T13:11:33.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.748 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.749 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.750 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.751 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.752 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.753 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.753 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.753 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.753 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.754 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.754 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.754 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.754 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.754 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-02-14T13:11:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-02-14T13:11:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.756 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.756 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.756 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.756 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.756 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.756 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.757 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.757 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-14T13:11:33.757 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-14T13:11:33.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.758 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.758 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-02-14T13:11:33.758 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.758 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.758 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.758 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-02-14T13:11:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.760 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.760 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.760 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-02-14T13:11:33.760 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.760 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.761 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:33.762 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:33.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.762 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.762 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-02-14T13:11:33.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.764 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:33.764 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:33.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.764 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-02-14T13:11:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-14T13:11:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.767 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-02-14T13:11:33.767 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.767 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.767 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.767 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.767 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.768 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-02-14T13:11:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.769 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-02-14T13:11:33.770 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-02-14T13:11:33.770 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.770 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.770 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.770 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.771 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-02-14T13:11:33.771 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-02-14T13:11:33.771 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.771 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.771 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.772 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-02-14T13:11:33.772 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-02-14T13:11:33.772 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-02-14T13:11:33.772 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.772 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.772 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.773 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-02-14T13:11:33.774 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.774 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.774 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.774 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.775 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.775 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.775 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.775 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.775 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.775 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.776 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.776 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.776 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.776 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.776 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.776 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.777 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.777 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.777 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.777 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.777 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.778 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.778 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.778 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.778 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.778 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.779 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.780 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.780 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.781 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.782 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.782 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.782 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.782 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.782 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.782 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.783 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.783 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.783 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.783 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.783 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.784 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.784 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.784 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.784 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.785 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.786 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-02-14T13:11:33.786 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-02-14T13:11:33.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.786 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.786 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.787 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.788 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-02-14T13:11:33.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.791 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-02-14T13:11:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.793 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.794 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.796 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.798 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.800 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.801 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.804 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "drive_group_interval": { 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "drive_group_interval", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300.0", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.805 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.806 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.807 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.808 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.809 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.811 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.812 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.813 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.814 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.816 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.817 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-02-14T13:11:33.819 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-02-14T13:11:33.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.822 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-02-14T13:11:33.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.824 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.825 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.829 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.830 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.832 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.833 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.834 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.835 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.836 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.837 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.838 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.839 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.840 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.841 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.842 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.843 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.844 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:33.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.846 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.847 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.848 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.849 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.850 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.852 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-02-14T13:11:33.853 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.854 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.856 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.860 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-02-14T13:11:33.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.862 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.864 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.865 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.866 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-02-14T13:11:33.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-02-14T13:11:33.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.871 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.873 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.876 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.879 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.881 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.883 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.886 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-02-14T13:11:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-02-14T13:11:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-02-14T13:11:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-02-14T13:11:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-02-14T13:11:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.898 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.898 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-02-14T13:11:33.898 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-02-14T13:11:33.898 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.898 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.898 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-14T13:11:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 24110, 2024-02-14T13:11:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "y", 2024-02-14T13:11:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701272860131327, 2024-02-14T13:11:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-02-14T13:11:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-02-14T13:11:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-02-14T13:11:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.915 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-02-14T13:11:33.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.920 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-02-14T13:11:33.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-02-14T13:11:33.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-14T13:11:33.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.928 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.929 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.929 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.929 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.929 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.929 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.931 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-14T13:11:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-02-14T13:11:33.935 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:33.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-02-14T13:11:33.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-02-14T13:11:33.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-02-14T13:11:33.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.950 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.951 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.952 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-02-14T13:11:33.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-02-14T13:11:33.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.957 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-14T13:11:33.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-14T13:11:33.960 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-14T13:11:33.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-02-14T13:11:33.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-02-14T13:11:33.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-02-14T13:11:33.968 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:33.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-14T13:11:33.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.974 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:33.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-02-14T13:11:33.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-14T13:11:33.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-02-14T13:11:33.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-02-14T13:11:33.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-02-14T13:11:33.997 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:33.998 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:33.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.000 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-14T13:11:34.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.008 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.009 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-14T13:11:34.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-14T13:11:34.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-14T13:11:34.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.031 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.032 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-14T13:11:34.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.042 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.043 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.044 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-02-14T13:11:34.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.049 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.052 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-02-14T13:11:34.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-02-14T13:11:34.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-02-14T13:11:34.062 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.064 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.067 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-02-14T13:11:34.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.072 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-02-14T13:11:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-02-14T13:11:34.074 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.075 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.076 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.076 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.076 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.076 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.076 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.077 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.077 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.077 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.079 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.079 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.079 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.081 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.081 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.081 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.081 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.081 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-02-14T13:11:34.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-02-14T13:11:34.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-02-14T13:11:34.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.092 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.094 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-14T13:11:34.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.102 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.104 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.106 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.107 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.108 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.110 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-02-14T13:11:34.118 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.120 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-02-14T13:11:34.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.125 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.128 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.132 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.134 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.135 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.140 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-14T13:11:34.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.146 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-02-14T13:11:34.151 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.155 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.160 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.161 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.162 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.163 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-02-14T13:11:34.169 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.172 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.173 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.174 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.176 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-02-14T13:11:34.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.187 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:34.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.191 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-02-14T13:11:34.192 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.193 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.196 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.196 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.196 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.196 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.196 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.196 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.197 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.197 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.197 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.198 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.198 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.198 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.200 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-02-14T13:11:34.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-02-14T13:11:34.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.203 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-02-14T13:11:34.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-02-14T13:11:34.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.204 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.205 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.205 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.205 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-02-14T13:11:34.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-02-14T13:11:34.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.207 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.207 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-02-14T13:11:34.208 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.208 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.208 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.211 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-02-14T13:11:34.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-02-14T13:11:34.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.212 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.213 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.214 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.215 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.215 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.215 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.215 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.215 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.216 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.216 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.224 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.226 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.227 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.228 INFO:teuthology.orchestra.run.smithi012.stdout: "drive_group_interval": { 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "drive_group_interval", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300.0", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.233 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.235 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.237 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.238 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-02-14T13:11:34.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-02-14T13:11:34.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.243 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.245 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.247 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.248 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-02-14T13:11:34.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-02-14T13:11:34.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.253 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.254 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.259 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.260 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.261 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.263 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.265 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.267 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.270 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.271 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-02-14T13:11:34.274 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.275 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-02-14T13:11:34.276 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.280 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.284 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.292 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.298 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.299 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.300 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-02-14T13:11:34.303 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-02-14T13:11:34.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.306 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.308 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.310 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.311 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.313 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-02-14T13:11:34.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.316 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "modules": [ 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "iostat", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "nfs", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "restful" 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.319 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.320 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.321 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.322 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.323 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-02-14T13:11:34.325 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-02-14T13:11:34.331 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:34.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-02-14T13:11:34.335 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-14T13:11:34.336 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-14T13:11:34.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.338 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.339 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.340 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.343 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.344 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.345 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-14T13:11:34.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-14T13:11:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.348 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.349 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.350 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.352 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.354 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-02-14T13:11:34.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-02-14T13:11:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-14T13:11:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-02-14T13:11:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-02-14T13:11:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-14T13:11:34.369 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.371 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.372 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-14T13:11:34.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.375 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-02-14T13:11:34.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.380 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.382 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.383 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.384 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.384 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.384 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.384 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.384 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.384 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.385 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.385 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.385 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-02-14T13:11:34.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.388 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.389 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-14T13:11:34.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-02-14T13:11:34.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.395 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-02-14T13:11:34.395 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.395 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-02-14T13:11:34.395 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.396 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.399 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-02-14T13:11:34.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.402 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-02-14T13:11:34.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.411 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.413 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.421 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.422 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.427 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.428 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.429 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-14T13:11:34.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-02-14T13:11:34.431 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.432 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-14T13:11:34.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.435 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.436 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.439 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.440 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.445 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-14T13:11:34.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-14T13:11:34.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-14T13:11:34.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.456 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.458 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.459 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.460 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.462 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.464 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.468 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-02-14T13:11:34.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-02-14T13:11:34.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.478 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.480 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-02-14T13:11:34.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.489 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-02-14T13:11:34.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-02-14T13:11:34.493 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-02-14T13:11:34.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-02-14T13:11:34.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-02-14T13:11:34.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-14T13:11:34.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.497 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.499 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.499 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.500 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.500 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.500 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.500 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.500 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.500 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.501 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.501 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.504 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.504 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.505 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.507 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.508 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.508 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.509 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.510 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-02-14T13:11:34.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.512 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-02-14T13:11:34.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-02-14T13:11:34.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.513 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.513 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-02-14T13:11:34.513 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.513 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-02-14T13:11:34.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.514 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-02-14T13:11:34.514 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-02-14T13:11:34.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-02-14T13:11:34.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.515 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.516 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.516 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-14T13:11:34.516 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.516 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-02-14T13:11:34.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.520 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.522 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.527 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-02-14T13:11:34.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.532 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.537 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.543 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.549 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.551 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.552 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.554 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.555 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.557 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.559 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.561 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.564 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.566 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-02-14T13:11:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.568 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.571 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.573 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.575 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.576 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.577 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.578 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.579 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.580 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.582 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-02-14T13:11:34.584 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-02-14T13:11:34.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.589 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.593 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.595 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.596 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.597 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-02-14T13:11:34.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.601 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-14T13:11:34.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.603 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.606 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.607 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.610 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-02-14T13:11:34.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-02-14T13:11:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.618 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.619 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.620 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.627 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.628 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.629 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "drive_group_interval": { 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "drive_group_interval", 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.631 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300.0", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.634 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.636 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.638 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.641 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.645 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.646 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-02-14T13:11:34.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.648 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-02-14T13:11:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-02-14T13:11:34.650 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-02-14T13:11:34.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-02-14T13:11:34.652 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-02-14T13:11:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-02-14T13:11:34.654 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.656 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.659 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.660 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.662 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.666 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.668 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-02-14T13:11:34.670 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.673 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.675 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.676 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.677 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-02-14T13:11:34.678 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-02-14T13:11:34.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-02-14T13:11:34.680 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.683 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.685 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.686 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.688 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.690 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.691 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.692 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.696 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.699 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.700 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.701 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.702 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-02-14T13:11:34.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-02-14T13:11:34.709 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.713 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-02-14T13:11:34.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.716 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-02-14T13:11:34.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-02-14T13:11:34.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "services": { 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard": "https://172.21.15.12:8443/" 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "always_on_modules": { 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "octopus": [ 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-02-14T13:11:34.719 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "pacific": [ 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-02-14T13:11:34.720 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "quincy": [ 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "reef": [ 2024-02-14T13:11:34.721 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "squid": [ 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-02-14T13:11:34.722 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "last_failure_osd_epoch": 3, 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "active_clients": [ 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3292141252 2024-02-14T13:11:34.723 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "libcephsqlite", 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 718192834 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 527314931 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3929135111 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-02-14T13:11:34.725 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:33 smithi055 ceph-mon[36853]: pgmap v433: 97 pgs: 97 active+clean; 9.3 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 458 op/s 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:33 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2299132098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:33 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3154864090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:33 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/16322193' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:33 smithi103 ceph-mon[36921]: pgmap v433: 97 pgs: 97 active+clean; 9.3 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 458 op/s 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:33 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2299132098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:33 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3154864090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:11:34.727 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:33 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/16322193' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ffae80a2140 msgr2=0x7ffae80a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ffae80a2140 0x7ffae80a4600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffaec006fd0 tx=0x7ffaec008040 comp rx=0 tx=0).stop 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 msgr2=0x7ffaf819c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf819c0d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae40042f0 comp rx=0 tx=0).stop 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 shutdown_connections 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ffae80a2140 0x7ffae80a4600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf8101d20 0x7ffaf819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaf8101360 0x7ffaf819c0d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 --2- 172.21.15.12:0/16322193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaf8100170 0x7ffaf806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 >> 172.21.15.12:0/16322193 conn(0x7ffaf80fb6e0 msgr2=0x7ffaf8104660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 shutdown_connections 2024-02-14T13:11:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:33.468+0000 7ffafeea4640 1 -- 172.21.15.12:0/16322193 wait complete. 2024-02-14T13:11:34.767 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-14T13:11:34.777 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-14T13:11:34.777 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:11:34.777 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-14T13:11:34.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:33 smithi012 ceph-mon[32370]: pgmap v433: 97 pgs: 97 active+clean; 9.3 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 458 op/s 2024-02-14T13:11:34.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:33 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2299132098' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:11:34.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:33 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3154864090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:11:34.778 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:33 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/16322193' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-02-14T13:11:34.797 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-02-14T13:11:34.797 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-14T13:11:34.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:11:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- 172.21.15.12:0/1392285497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4101340 msgr2=0x7f3be41017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- 172.21.15.12:0/1392285497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4101340 0x7f3be41017c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009900 tx=0x7f3bd402bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- 172.21.15.12:0/1392285497 shutdown_connections 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- 172.21.15.12:0/1392285497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101d00 0x7f3be4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- 172.21.15.12:0/1392285497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4101340 0x7f3be41017c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- 172.21.15.12:0/1392285497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be4100150 0x7f3be4100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- 172.21.15.12:0/1392285497 >> 172.21.15.12:0/1392285497 conn(0x7f3be40fb6c0 msgr2=0x7f3be40fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- 172.21.15.12:0/1392285497 shutdown_connections 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- 172.21.15.12:0/1392285497 wait complete. 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 Processor -- start 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- start start 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 0x7f3be410aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101340 0x7f3be4109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be4101d00 0x7f3be4109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4109cf0 con 0x7f3be4100150 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4109e60 con 0x7f3be4101d00 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.007+0000 7f3bec365640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be41a12b0 con 0x7f3be4101340 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 0x7f3be410aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 0x7f3be410aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33686/0 (socket says 172.21.15.12:33686) 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 -- 172.21.15.12:0/507876511 learned_addr learned my addr 172.21.15.12:0/507876511 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3be9900640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101340 0x7f3be4109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 -- 172.21.15.12:0/507876511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101340 msgr2=0x7f3be4109050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea902640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be4101d00 0x7f3be4109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101340 0x7f3be4109050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 -- 172.21.15.12:0/507876511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be4101d00 msgr2=0x7f3be4109590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be4101d00 0x7f3be4109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 -- 172.21.15.12:0/507876511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4009560 con 0x7f3be4100150 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3be9900640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101340 0x7f3be4109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bea101640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 0x7f3be410aa10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c9a0 tx=0x7f3be000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0007c10 con 0x7f3be4100150 2024-02-14T13:11:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f3be0007d70 con 0x7f3be4100150 2024-02-14T13:11:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000f910 con 0x7f3be4100150 2024-02-14T13:11:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be41a1560 con 0x7f3be4100150 2024-02-14T13:11:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.008+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be41a1a70 con 0x7f3be4100150 2024-02-14T13:11:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.009+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be4107410 con 0x7f3be4100150 2024-02-14T13:11:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.011+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f3be000fa70 con 0x7f3be4100150 2024-02-14T13:11:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.011+0000 7f3bdb7fe640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3bd00a20c0 0x7f3bd00a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.011+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f3be0013070 con 0x7f3be4100150 2024-02-14T13:11:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.011+0000 7f3be9900640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3bd00a20c0 0x7f3bd00a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.012+0000 7f3be9900640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3bd00a20c0 0x7f3bd00a4580 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3be410a780 tx=0x7f3bd4005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.015+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3be0097480 con 0x7f3be4100150 2024-02-14T13:11:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.201+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3be410cc60 con 0x7f3be4100150 2024-02-14T13:11:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.202+0000 7f3bdb7fe640 1 -- 172.21.15.12:0/507876511 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22684 (secure 0 0 0) 0x7f3be009ab40 con 0x7f3be4100150 2024-02-14T13:11:35.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:11:35.204 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:08:50.631073+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:11:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3bd00a20c0 msgr2=0x7f3bd00a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3bd00a20c0 0x7f3bd00a4580 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3be410a780 tx=0x7f3bd4005be0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 msgr2=0x7f3be410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 0x7f3be410aa10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c9a0 tx=0x7f3be000ce60 comp rx=0 tx=0).stop 2024-02-14T13:11:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 shutdown_connections 2024-02-14T13:11:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f3bd00a20c0 0x7f3bd00a4580 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3be4101d00 0x7f3be4109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3be4101340 0x7f3be4109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 --2- 172.21.15.12:0/507876511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be4100150 0x7f3be410aa10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 >> 172.21.15.12:0/507876511 conn(0x7f3be40fb6c0 msgr2=0x7f3be41045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 shutdown_connections 2024-02-14T13:11:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.204+0000 7f3bec365640 1 -- 172.21.15.12:0/507876511 wait complete. 2024-02-14T13:11:35.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-14T13:02:16.635319+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-14T13:06:47.668699+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-14T13:06:48.352208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-14T13:11:35.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-14T13:11:35.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 -- 172.21.15.12:0/578144934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 msgr2=0x7f6c94109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/578144934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94109680 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009ca0 tx=0x7f6c8c02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 -- 172.21.15.12:0/578144934 shutdown_connections 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/578144934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94109680 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/578144934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 0x7f6c941028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/578144934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 0x7f6c94101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 -- 172.21.15.12:0/578144934 >> 172.21.15.12:0/578144934 conn(0x7f6c940fc7d0 msgr2=0x7f6c940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 -- 172.21.15.12:0/578144934 shutdown_connections 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 -- 172.21.15.12:0/578144934 wait complete. 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.321+0000 7f6c99e5c640 1 Processor -- start 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 -- start start 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 0x7f6c94074fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 0x7f6c94073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c940742c0 con 0x7f6c94102df0 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94074430 con 0x7f6c94101240 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c99e5c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c941a12f0 con 0x7f6c94102430 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33694/0 (socket says 172.21.15.12:33694) 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 -- 172.21.15.12:0/708773377 learned_addr learned my addr 172.21.15.12:0/708773377 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c937fe640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 0x7f6c94074fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c92ffd640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 0x7f6c94073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 -- 172.21.15.12:0/708773377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 msgr2=0x7f6c94073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 0x7f6c94073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 -- 172.21.15.12:0/708773377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 msgr2=0x7f6c94074fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 0x7f6c94074fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 -- 172.21.15.12:0/708773377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009900 con 0x7f6c94102df0 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c92ffd640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 0x7f6c94073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c937fe640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 0x7f6c94074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.322+0000 7f6c93fff640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94073b60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c034d20 tx=0x7f6c8c034d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.323+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c003970 con 0x7f6c94102df0 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.323+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6c8c004040 con 0x7f6c94102df0 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.323+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0406b0 con 0x7f6c94102df0 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.323+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c941a1540 con 0x7f6c94102df0 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.323+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c941a1a40 con 0x7f6c94102df0 2024-02-14T13:11:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.324+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c941085e0 con 0x7f6c94102df0 2024-02-14T13:11:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.325+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f6c8c00a040 con 0x7f6c94102df0 2024-02-14T13:11:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.325+0000 7f6c90ff9640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c7c0a2140 0x7f6c7c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.325+0000 7f6c937fe640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c7c0a2140 0x7f6c7c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.325+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f6c8c0f0f60 con 0x7f6c94102df0 2024-02-14T13:11:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.326+0000 7f6c937fe640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c7c0a2140 0x7f6c7c0a4600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c94102290 tx=0x7f6c8400a560 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.330+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6c8c0b9f80 con 0x7f6c94102df0 2024-02-14T13:11:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.510+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c9402ce50 con 0x7f6c94102df0 2024-02-14T13:11:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.510+0000 7f6c90ff9640 1 -- 172.21.15.12:0/708773377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c8c008220 con 0x7f6c94102df0 2024-02-14T13:11:35.512 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-02-14T13:11:35.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c7c0a2140 msgr2=0x7f6c7c0a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c7c0a2140 0x7f6c7c0a4600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c94102290 tx=0x7f6c8400a560 comp rx=0 tx=0).stop 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 msgr2=0x7f6c94073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94073b60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c034d20 tx=0x7f6c8c034d50 comp rx=0 tx=0).stop 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 shutdown_connections 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6c7c0a2140 0x7f6c7c0a4600 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c94102df0 0x7f6c94073b60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c94102430 0x7f6c94073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 --2- 172.21.15.12:0/708773377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c94101240 0x7f6c94074fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.512+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 >> 172.21.15.12:0/708773377 conn(0x7f6c940fc7d0 msgr2=0x7f6c941057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.513+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 shutdown_connections 2024-02-14T13:11:35.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.513+0000 7f6c99e5c640 1 -- 172.21.15.12:0/708773377 wait complete. 2024-02-14T13:11:35.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.629+0000 7f6160439640 1 -- 172.21.15.12:0/1488423710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 msgr2=0x7f6158109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.629+0000 7f6160439640 1 --2- 172.21.15.12:0/1488423710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f6158109360 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6148009ca0 tx=0x7f614802c0f0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- 172.21.15.12:0/1488423710 shutdown_connections 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 --2- 172.21.15.12:0/1488423710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f6158109360 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 --2- 172.21.15.12:0/1488423710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61581045e0 0x7f61581069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 --2- 172.21.15.12:0/1488423710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6158101cb0 0x7f61581040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- 172.21.15.12:0/1488423710 >> 172.21.15.12:0/1488423710 conn(0x7f61580fb6c0 msgr2=0x7f61580fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- 172.21.15.12:0/1488423710 shutdown_connections 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- 172.21.15.12:0/1488423710 wait complete. 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 Processor -- start 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- start start 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158101cb0 0x7f61581972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61581045e0 0x7f6158197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f615819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615819edb0 con 0x7f6158106f10 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615819ef20 con 0x7f6158101cb0 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f6160439640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615819f0e0 con 0x7f61581045e0 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f615e9d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f615819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f615e9d6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f615819e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33716/0 (socket says 172.21.15.12:33716) 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.630+0000 7f615e9d6640 1 -- 172.21.15.12:0/2960955157 learned_addr learned my addr 172.21.15.12:0/2960955157 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615d9d4640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61581045e0 0x7f6158197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e1d5640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158101cb0 0x7f61581972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e9d6640 1 -- 172.21.15.12:0/2960955157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61581045e0 msgr2=0x7f6158197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e9d6640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61581045e0 0x7f6158197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e9d6640 1 -- 172.21.15.12:0/2960955157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158101cb0 msgr2=0x7f61581972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e9d6640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158101cb0 0x7f61581972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e9d6640 1 -- 172.21.15.12:0/2960955157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148009900 con 0x7f6158106f10 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e1d5640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158101cb0 0x7f61581972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f615e9d6640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f615819e870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6148037040 tx=0x7f6148034d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148032eb0 con 0x7f6158106f10 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6148003e50 con 0x7f6158106f10 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615819f360 con 0x7f6158106f10 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148040450 con 0x7f6158106f10 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.631+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615819f860 con 0x7f6158106f10 2024-02-14T13:11:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.632+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61580fd1b0 con 0x7f6158106f10 2024-02-14T13:11:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.634+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f614800a040 con 0x7f6158106f10 2024-02-14T13:11:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.634+0000 7f61577fe640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61400a2140 0x7f61400a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.634+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f61480f1100 con 0x7f6158106f10 2024-02-14T13:11:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.634+0000 7f615e1d5640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61400a2140 0x7f61400a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.635+0000 7f615e1d5640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61400a2140 0x7f61400a4600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150005ea0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.638+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f61480ba110 con 0x7f6158106f10 2024-02-14T13:11:35.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.819+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f615810cc40 con 0x7f6158106f10 2024-02-14T13:11:35.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.819+0000 7f61577fe640 1 -- 172.21.15.12:0/2960955157 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6148039020 con 0x7f6158106f10 2024-02-14T13:11:35.821 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-02-14T13:11:35.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61400a2140 msgr2=0x7f61400a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61400a2140 0x7f61400a4600 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6150005fd0 tx=0x7f6150005ea0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 msgr2=0x7f615819e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f615819e870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6148037040 tx=0x7f6148034d40 comp rx=0 tx=0).stop 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 shutdown_connections 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f61400a2140 0x7f61400a4600 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6158106f10 0x7f615819e870 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61581045e0 0x7f6158197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 --2- 172.21.15.12:0/2960955157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6158101cb0 0x7f61581972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 >> 172.21.15.12:0/2960955157 conn(0x7f61580fb6c0 msgr2=0x7f6158102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 shutdown_connections 2024-02-14T13:11:35.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.821+0000 7f6160439640 1 -- 172.21.15.12:0/2960955157 wait complete. 2024-02-14T13:11:35.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:35 smithi012 ceph-mon[32370]: pgmap v434: 97 pgs: 97 active+clean; 8.4 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 414 op/s 2024-02-14T13:11:35.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:35 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/507876511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:35.833 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:35 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/708773377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:11:35.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-14T13:11:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 -- 172.21.15.12:0/585843620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04101025b0 msgr2=0x7f0410102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 --2- 172.21.15.12:0/585843620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04101025b0 0x7f0410102a30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0400009900 tx=0x7f040002bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 -- 172.21.15.12:0/585843620 shutdown_connections 2024-02-14T13:11:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 --2- 172.21.15.12:0/585843620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0410102f70 0x7f0410109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 --2- 172.21.15.12:0/585843620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04101025b0 0x7f0410102a30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 --2- 172.21.15.12:0/585843620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04100ff540 0x7f04100ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 -- 172.21.15.12:0/585843620 >> 172.21.15.12:0/585843620 conn(0x7f04100fae30 msgr2=0x7f04100fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 -- 172.21.15.12:0/585843620 shutdown_connections 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.938+0000 7f0417d8e640 1 -- 172.21.15.12:0/585843620 wait complete. 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 Processor -- start 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 -- start start 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 0x7f0410197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04101025b0 0x7f0410197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0410102f70 0x7f041019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041019ee10 con 0x7f04100ff540 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041019ef80 con 0x7f0410102f70 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0417d8e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041019f140 con 0x7f04101025b0 2024-02-14T13:11:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 0x7f0410197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 0x7f0410197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33730/0 (socket says 172.21.15.12:33730) 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 -- 172.21.15.12:0/3677292328 learned_addr learned my addr 172.21.15.12:0/3677292328 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415329640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04101025b0 0x7f0410197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 -- 172.21.15.12:0/3677292328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04101025b0 msgr2=0x7f0410197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f041632b640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0410102f70 0x7f041019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04101025b0 0x7f0410197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 -- 172.21.15.12:0/3677292328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0410102f70 msgr2=0x7f041019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0410102f70 0x7f041019e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 -- 172.21.15.12:0/3677292328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400009560 con 0x7f04100ff540 2024-02-14T13:11:35.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.939+0000 7f0415b2a640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 0x7f0410197320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f040800e9c0 tx=0x7f040800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.940+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080096e0 con 0x7f04100ff540 2024-02-14T13:11:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.940+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f040800cd80 con 0x7f04100ff540 2024-02-14T13:11:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.940+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041019f420 con 0x7f04100ff540 2024-02-14T13:11:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.940+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408010430 con 0x7f04100ff540 2024-02-14T13:11:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.940+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041019f8e0 con 0x7f04100ff540 2024-02-14T13:11:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.941+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04101086e0 con 0x7f04100ff540 2024-02-14T13:11:35.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.942+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f0408003680 con 0x7f04100ff540 2024-02-14T13:11:35.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.942+0000 7f0406ffd640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f03fc0a20c0 0x7f03fc0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:35.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.942+0000 7f0415329640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f03fc0a20c0 0x7f03fc0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:35.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.943+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f0408014070 con 0x7f04100ff540 2024-02-14T13:11:35.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.943+0000 7f0415329640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f03fc0a20c0 0x7f03fc0a4580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0400005c40 tx=0x7f0400005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:35.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:35.947+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0408097140 con 0x7f04100ff540 2024-02-14T13:11:35.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:35 smithi103 ceph-mon[36921]: pgmap v434: 97 pgs: 97 active+clean; 8.4 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 414 op/s 2024-02-14T13:11:35.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:35 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/507876511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:35.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:35 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/708773377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:11:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:35 smithi055 ceph-mon[36853]: pgmap v434: 97 pgs: 97 active+clean; 8.4 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 414 op/s 2024-02-14T13:11:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:35 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/507876511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:36.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:35 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/708773377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-14T13:11:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.131+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f041010ccd0 con 0x7f04100ff540 2024-02-14T13:11:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.132+0000 7f0406ffd640 1 -- 172.21.15.12:0/3677292328 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f040809a800 con 0x7f04100ff540 2024-02-14T13:11:36.134 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f03fc0a20c0 msgr2=0x7f03fc0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f03fc0a20c0 0x7f03fc0a4580 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0400005c40 tx=0x7f0400005fd0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 msgr2=0x7f0410197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 0x7f0410197320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f040800e9c0 tx=0x7f040800ee80 comp rx=0 tx=0).stop 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 shutdown_connections 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f03fc0a20c0 0x7f03fc0a4580 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0410102f70 0x7f041019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04101025b0 0x7f0410197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 --2- 172.21.15.12:0/3677292328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04100ff540 0x7f0410197320 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 >> 172.21.15.12:0/3677292328 conn(0x7f04100fae30 msgr2=0x7f04101058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 shutdown_connections 2024-02-14T13:11:36.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.134+0000 7f0417d8e640 1 -- 172.21.15.12:0/3677292328 wait complete. 2024-02-14T13:11:36.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-14T13:11:36.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 -- 172.21.15.12:0/1322202988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 msgr2=0x7fa1941017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 --2- 172.21.15.12:0/1322202988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941017a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa188009900 tx=0x7fa18802bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 -- 172.21.15.12:0/1322202988 shutdown_connections 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 --2- 172.21.15.12:0/1322202988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa194101ce0 0x7fa194108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 --2- 172.21.15.12:0/1322202988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941017a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 --2- 172.21.15.12:0/1322202988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa194100130 0x7fa194100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 -- 172.21.15.12:0/1322202988 >> 172.21.15.12:0/1322202988 conn(0x7fa1940fb6c0 msgr2=0x7fa1940fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 -- 172.21.15.12:0/1322202988 shutdown_connections 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.248+0000 7fa19a284640 1 -- 172.21.15.12:0/1322202988 wait complete. 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 Processor -- start 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 -- start start 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa194100130 0x7fa1941972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa194101ce0 0x7fa19419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419eda0 con 0x7fa194101320 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419ef10 con 0x7fa194100130 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa19a284640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419f0d0 con 0x7fa194101ce0 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa1937fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa1937fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33750/0 (socket says 172.21.15.12:33750) 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.249+0000 7fa1937fe640 1 -- 172.21.15.12:0/2670965022 learned_addr learned my addr 172.21.15.12:0/2670965022 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa198821640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa194101ce0 0x7fa19419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa193fff640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa194100130 0x7fa1941972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1937fe640 1 -- 172.21.15.12:0/2670965022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa194101ce0 msgr2=0x7fa19419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1937fe640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa194101ce0 0x7fa19419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1937fe640 1 -- 172.21.15.12:0/2670965022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa194100130 msgr2=0x7fa1941972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1937fe640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa194100130 0x7fa1941972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1937fe640 1 -- 172.21.15.12:0/2670965022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009560 con 0x7fa194101320 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1937fe640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941977f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa188006010 tx=0x7fa1880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880044e0 con 0x7fa194101320 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fa1880054e0 con 0x7fa194101320 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19419f350 con 0x7fa194101320 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18803e450 con 0x7fa194101320 2024-02-14T13:11:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.250+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19419f8b0 con 0x7fa194101320 2024-02-14T13:11:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.251+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19410bb40 con 0x7fa194101320 2024-02-14T13:11:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.252+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fa1880035f0 con 0x7fa194101320 2024-02-14T13:11:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.253+0000 7fa1917fa640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a2140 0x7fa17c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.253+0000 7fa193fff640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a2140 0x7fa17c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.253+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fa1880f0000 con 0x7fa194101320 2024-02-14T13:11:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.253+0000 7fa193fff640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a2140 0x7fa17c0a4600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa184005fd0 tx=0x7fa184005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:36.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.257+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa1880b9030 con 0x7fa194101320 2024-02-14T13:11:36.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.454+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa19410bcd0 con 0x7fa194101320 2024-02-14T13:11:36.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.454+0000 7fa1917fa640 1 -- 172.21.15.12:0/2670965022 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) v1 ==== 81+0+589 (secure 0 0 0) 0x7fa1880bc6f0 con 0x7fa194101320 2024-02-14T13:11:36.456 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3839639122 2024-02-15T12:59:48.272127+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/305486509 2024-02-15T12:59:48.272127+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2684526403 2024-02-15T12:59:48.272127+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/955464513 2024-02-15T12:59:48.272127+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2867303975 2024-02-15T12:59:21.651055+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/1478984094 2024-02-15T12:59:21.651055+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3222670253 2024-02-15T12:59:21.651055+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1960111540 2024-02-15T12:59:21.651055+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/1478984094 2024-02-15T12:59:21.651055+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/955464513 2024-02-15T12:59:48.272127+0000 2024-02-14T13:11:36.457 INFO:teuthology.orchestra.run.smithi012.stderr:listed 10 entries 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.456+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a2140 msgr2=0x7fa17c0a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.456+0000 7fa19a284640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a2140 0x7fa17c0a4600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa184005fd0 tx=0x7fa184005850 comp rx=0 tx=0).stop 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.456+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 msgr2=0x7fa1941977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.456+0000 7fa19a284640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941977f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa188006010 tx=0x7fa1880042f0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 shutdown_connections 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fa17c0a2140 0x7fa17c0a4600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa194101ce0 0x7fa19419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa194101320 0x7fa1941977f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 --2- 172.21.15.12:0/2670965022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa194100130 0x7fa1941972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 >> 172.21.15.12:0/2670965022 conn(0x7fa1940fb6c0 msgr2=0x7fa1940fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 shutdown_connections 2024-02-14T13:11:36.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.457+0000 7fa19a284640 1 -- 172.21.15.12:0/2670965022 wait complete. 2024-02-14T13:11:36.470 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-14T13:11:36.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:11:36.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-14T13:11:36.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T13:11:36.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:11:36.518 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-14T13:11:36.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:11:36.558 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-02-14T13:11:36.613 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-14T13:11:36.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:11:36.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-14T13:11:36.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-14T13:11:36.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-02-14T13:11:36.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:36 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2960955157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:11:36.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:36 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3677292328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:11:36.745 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:36 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2670965022' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-14T13:11:36.785 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-14T13:11:36.795 INFO:tasks.cephadm:Teardown begin 2024-02-14T13:11:36.796 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-14T13:11:36.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:11:36.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 -- 172.21.15.12:0/1111867986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102e00 msgr2=0x7f3854109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1111867986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102e00 0x7f3854109690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f384c009ca0 tx=0x7f384c02c0f0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 -- 172.21.15.12:0/1111867986 shutdown_connections 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1111867986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102e00 0x7f3854109690 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1111867986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854102440 0x7f38541028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1111867986 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3854101250 0x7f3854101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 -- 172.21.15.12:0/1111867986 >> 172.21.15.12:0/1111867986 conn(0x7f38540fc7e0 msgr2=0x7f38540fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 -- 172.21.15.12:0/1111867986 shutdown_connections 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 -- 172.21.15.12:0/1111867986 wait complete. 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 Processor -- start 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.929+0000 7f3859fc7640 1 -- start start 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101250 0x7f3854197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 0x7f3854197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3854102e00 0x7f385419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385419ed30 con 0x7f3854102440 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385419eea0 con 0x7f3854102e00 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385419f060 con 0x7f3854101250 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 0x7f3854197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 0x7f3854197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33772/0 (socket says 172.21.15.12:33772) 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 -- 172.21.15.12:0/1364723753 learned_addr learned my addr 172.21.15.12:0/1364723753 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f38537fe640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101250 0x7f3854197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 -- 172.21.15.12:0/1364723753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101250 msgr2=0x7f3854197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101250 0x7f3854197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 -- 172.21.15.12:0/1364723753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3854102e00 msgr2=0x7f385419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3854102e00 0x7f385419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 -- 172.21.15.12:0/1364723753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009900 con 0x7f3854102440 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f38537fe640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101250 0x7f3854197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3852ffd640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 0x7f3854197780 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9f0 tx=0x7f384800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848009700 con 0x7f3854102440 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385419f340 con 0x7f3854102440 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f384800cd80 con 0x7f3854102440 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848018920 con 0x7f3854102440 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.930+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385419f850 con 0x7f3854102440 2024-02-14T13:11:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.932+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854108590 con 0x7f3854102440 2024-02-14T13:11:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.932+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f3848018a80 con 0x7f3854102440 2024-02-14T13:11:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.933+0000 7f3850ff9640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f383c0a20c0 0x7f383c0a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.933+0000 7f38537fe640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f383c0a20c0 0x7f383c0a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.933+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f3848014070 con 0x7f3854102440 2024-02-14T13:11:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.933+0000 7f38537fe640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f383c0a20c0 0x7f383c0a4580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38541022a0 tx=0x7f3844005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:36.937+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3848052d20 con 0x7f3854102440 2024-02-14T13:11:36.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:36 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2960955157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:11:36.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:36 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3677292328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:11:36.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:36 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2670965022' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-14T13:11:37.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:36 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2960955157' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-02-14T13:11:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:36 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3677292328' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-02-14T13:11:37.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:36 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2670965022' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-14T13:11:37.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.157+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f385402ceb0 con 0x7f3854102440 2024-02-14T13:11:37.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.158+0000 7f3850ff9640 1 -- 172.21.15.12:0/1364723753 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7f3848097120 con 0x7f3854102440 2024-02-14T13:11:37.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:11:37.160 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:11:37.161 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:11:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f383c0a20c0 msgr2=0x7f383c0a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f383c0a20c0 0x7f383c0a4580 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f38541022a0 tx=0x7f3844005f90 comp rx=0 tx=0).stop 2024-02-14T13:11:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 msgr2=0x7f3854197780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 0x7f3854197780 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f384800e9f0 tx=0x7f384800eeb0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 shutdown_connections 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f383c0a20c0 0x7f383c0a4580 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3854102e00 0x7f385419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3854102440 0x7f3854197780 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 --2- 172.21.15.12:0/1364723753 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3854101250 0x7f3854197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 >> 172.21.15.12:0/1364723753 conn(0x7f38540fc7e0 msgr2=0x7f3854105760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 shutdown_connections 2024-02-14T13:11:37.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.160+0000 7f3859fc7640 1 -- 172.21.15.12:0/1364723753 wait complete. 2024-02-14T13:11:37.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-14T13:11:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 -- 172.21.15.12:0/3771080829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 msgr2=0x7fc430101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 --2- 172.21.15.12:0/3771080829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc430101240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc420009ca0 tx=0x7fc42002c0f0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 -- 172.21.15.12:0/3771080829 shutdown_connections 2024-02-14T13:11:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 --2- 172.21.15.12:0/3771080829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc430101240 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 --2- 172.21.15.12:0/3771080829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 0x7fc430100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 --2- 172.21.15.12:0/3771080829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4300ffac0 0x7fc4300ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 -- 172.21.15.12:0/3771080829 >> 172.21.15.12:0/3771080829 conn(0x7fc4300fb6c0 msgr2=0x7fc4300fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 -- 172.21.15.12:0/3771080829 shutdown_connections 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.274+0000 7fc4352ae640 1 -- 172.21.15.12:0/3771080829 wait complete. 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 Processor -- start 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 -- start start 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4300ffac0 0x7fc430199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 0x7fc4301999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc4301a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301a0f60 con 0x7fc430100dc0 2024-02-14T13:11:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301a10d0 con 0x7fc4300ffac0 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc4352ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301a1290 con 0x7fc430100420 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc4301a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc4301a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33796/0 (socket says 172.21.15.12:33796) 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc42f7fe640 1 -- 172.21.15.12:0/2714429609 learned_addr learned my addr 172.21.15.12:0/2714429609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.275+0000 7fc42effd640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4300ffac0 0x7fc430199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42e7fc640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 0x7fc4301999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42f7fe640 1 -- 172.21.15.12:0/2714429609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 msgr2=0x7fc4301999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42f7fe640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 0x7fc4301999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42f7fe640 1 -- 172.21.15.12:0/2714429609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4300ffac0 msgr2=0x7fc430199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42f7fe640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4300ffac0 0x7fc430199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42f7fe640 1 -- 172.21.15.12:0/2714429609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420009900 con 0x7fc430100dc0 2024-02-14T13:11:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42e7fc640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 0x7fc4301999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc42f7fe640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc4301a0a20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc420037040 tx=0x7fc420009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200329b0 con 0x7fc430100dc0 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7fc420003e50 con 0x7fc430100dc0 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200048a0 con 0x7fc430100dc0 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4301a1510 con 0x7fc430100dc0 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.276+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4301a19c0 con 0x7fc430100dc0 2024-02-14T13:11:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.277+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43010a970 con 0x7fc430100dc0 2024-02-14T13:11:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.278+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7fc42000a040 con 0x7fc430100dc0 2024-02-14T13:11:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.278+0000 7fc417fff640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4180a20c0 0x7fc4180a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.279+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7fc4200f0b20 con 0x7fc430100dc0 2024-02-14T13:11:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.279+0000 7fc42effd640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4180a20c0 0x7fc4180a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.279+0000 7fc42effd640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4180a20c0 0x7fc4180a4580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc428009bd0 tx=0x7fc428005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.283+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc4200b9b40 con 0x7fc430100dc0 2024-02-14T13:11:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.505+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc43002cdb0 con 0x7fc430100dc0 2024-02-14T13:11:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.506+0000 7fc417fff640 1 -- 172.21.15.12:0/2714429609 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11281 (secure 0 0 0) 0x7fc420034e60 con 0x7fc430100dc0 2024-02-14T13:11:37.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:11:37.509 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4009779912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4009779912},{"type":"v1","addr":"172.21.15.12:6835","nonce":4009779912}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/186215076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":186215076},{"type":"v1","addr":"172.21.15.12:6837","nonce":186215076}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/1039817926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":1039817926},{"type":"v1","addr":"172.21.15.12:6839","nonce":1039817926}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/2782336879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":2782336879},{"type":"v1","addr":"172.21.15.12:6841","nonce":2782336879}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24410,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3784712131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3784712131},{"type":"v1","addr":"172.21.15.55:6833","nonce":3784712131}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/11363714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":11363714},{"type":"v1","addr":"172.21.15.103:6833","nonce":11363714}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/403501220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":403501220},{"type":"v1","addr":"172.21.15.55:6835","nonce":403501220}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3553342942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6836","nonce":3553342942},{"type":"v1","addr":"172.21.15.55:6837","nonce":3553342942}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/3937333390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3937333390},{"type":"v1","addr":"172.21.15.103:6835","nonce":3937333390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24493,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2795037448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2795037448},{"type":"v1","addr":"172.21.15.103:6837","nonce":2795037448}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-14T13:06:49.142270+0000","modified":"2024-02-14T13:06:52.178143+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.55:6839/3549809563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6838","nonce":3549809563},{"type":"v1","addr":"172.21.15.55:6839","nonce":3549809563}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24505":{"gid":24505,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.103:6839/2266124957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":2266124957},{"type":"v1","addr":"172.21.15.103:6839","nonce":2266124957}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-14T13:11:37.509 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2024-02-14T13:11:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.508+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4180a20c0 msgr2=0x7fc4180a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.508+0000 7fc4352ae640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4180a20c0 0x7fc4180a4580 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc428009bd0 tx=0x7fc428005f90 comp rx=0 tx=0).stop 2024-02-14T13:11:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.508+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 msgr2=0x7fc4301a0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.508+0000 7fc4352ae640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc4301a0a20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc420037040 tx=0x7fc420009360 comp rx=0 tx=0).stop 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 shutdown_connections 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7fc4180a20c0 0x7fc4180a4580 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc430100dc0 0x7fc4301a0a20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430100420 0x7fc4301999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 --2- 172.21.15.12:0/2714429609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4300ffac0 0x7fc430199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 >> 172.21.15.12:0/2714429609 conn(0x7fc4300fb6c0 msgr2=0x7fc4300fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 shutdown_connections 2024-02-14T13:11:37.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.509+0000 7fc4352ae640 1 -- 172.21.15.12:0/2714429609 wait complete. 2024-02-14T13:11:37.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.623+0000 7feeeafc7640 1 -- 172.21.15.12:0/2423981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4100150 msgr2=0x7feee4100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.623+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2423981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4100150 0x7feee4100570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7feedc009900 tx=0x7feedc02bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- 172.21.15.12:0/2423981939 shutdown_connections 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2423981939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101d00 0x7feee4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2423981939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4101340 0x7feee41017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2423981939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4100150 0x7feee4100570 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- 172.21.15.12:0/2423981939 >> 172.21.15.12:0/2423981939 conn(0x7feee40fb6c0 msgr2=0x7feee40fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- 172.21.15.12:0/2423981939 shutdown_connections 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- 172.21.15.12:0/2423981939 wait complete. 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 Processor -- start 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- start start 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4100150 0x7feee4196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 0x7feee4196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101d00 0x7feee419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee419dd30 con 0x7feee4101340 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee419dea0 con 0x7feee4100150 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feeeafc7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee419e060 con 0x7feee4101d00 2024-02-14T13:11:37.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feee3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 0x7feee4196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feee3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 0x7feee4196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33822/0 (socket says 172.21.15.12:33822) 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.624+0000 7feee3fff640 1 -- 172.21.15.12:0/2107583118 learned_addr learned my addr 172.21.15.12:0/2107583118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee8d63640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4100150 0x7feee4196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee9564640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101d00 0x7feee419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee3fff640 1 -- 172.21.15.12:0/2107583118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101d00 msgr2=0x7feee419d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee3fff640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101d00 0x7feee419d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee3fff640 1 -- 172.21.15.12:0/2107583118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4100150 msgr2=0x7feee4196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee3fff640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4100150 0x7feee4196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee3fff640 1 -- 172.21.15.12:0/2107583118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc009560 con 0x7feee4101340 2024-02-14T13:11:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee8d63640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4100150 0x7feee4196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee3fff640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 0x7feee4196780 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7feed400eb30 tx=0x7feed400c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed400ce50 con 0x7feee4101340 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7feed4011a50 con 0x7feee4101340 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40683f0 con 0x7feee4101340 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4019c90 con 0x7feee4101340 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.625+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee4068980 con 0x7feee4101340 2024-02-14T13:11:37.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.626+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee4068020 con 0x7feee4101340 2024-02-14T13:11:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.627+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7feed4011bc0 con 0x7feee4101340 2024-02-14T13:11:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.628+0000 7feee1ffb640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7feed00a20c0 0x7feed00a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.628+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7feed40cfe50 con 0x7feee4101340 2024-02-14T13:11:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.628+0000 7feee8d63640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7feed00a20c0 0x7feed00a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.628+0000 7feee8d63640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7feed00a20c0 0x7feed00a4580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feedc006010 tx=0x7feedc005be0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:37.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.632+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feed4098de0 con 0x7feee4101340 2024-02-14T13:11:37.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.814+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feee41070e0 con 0x7feee4101340 2024-02-14T13:11:37.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.816+0000 7feee1ffb640 1 -- 172.21.15.12:0/2107583118 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+22684 (secure 0 0 0) 0x7feed409c4a0 con 0x7feee4101340 2024-02-14T13:11:37.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-02-14T13:11:37.819 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"fsid":"ab42aa14-cb38-11ee-95b9-87774f69a715","created":"2024-02-14T12:58:53.704063+0000","modified":"2024-02-14T13:08:50.631073+0000","last_up_change":"2024-02-14T13:06:00.434729+0000","last_in_change":"2024-02-14T13:05:39.849248+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-14T13:02:16.635319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-14T13:06:47.668699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-14T13:06:48.352208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"baab6740-5c44-4b37-a37b-47e3bc605f46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6803","nonce":389227292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6805","nonce":389227292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6809","nonce":389227292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":389227292},{"type":"v1","addr":"172.21.15.12:6807","nonce":389227292}]},"public_addr":"172.21.15.12:6803/389227292","cluster_addr":"172.21.15.12:6805/389227292","heartbeat_back_addr":"172.21.15.12:6809/389227292","heartbeat_front_addr":"172.21.15.12:6807/389227292","state":["exists","up"]},{"osd":1,"uuid":"578b4ffb-958f-47ee-b59c-174e3c36865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6801","nonce":2858711523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6803","nonce":2858711523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6807","nonce":2858711523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":2858711523},{"type":"v1","addr":"172.21.15.55:6805","nonce":2858711523}]},"public_addr":"172.21.15.55:6801/2858711523","cluster_addr":"172.21.15.55:6803/2858711523","heartbeat_back_addr":"172.21.15.55:6807/2858711523","heartbeat_front_addr":"172.21.15.55:6805/2858711523","state":["exists","up"]},{"osd":2,"uuid":"fa0a5301-f06a-43e3-9451-a8991fda5a4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6801","nonce":3794024283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6803","nonce":3794024283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6807","nonce":3794024283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3794024283},{"type":"v1","addr":"172.21.15.103:6805","nonce":3794024283}]},"public_addr":"172.21.15.103:6801/3794024283","cluster_addr":"172.21.15.103:6803/3794024283","heartbeat_back_addr":"172.21.15.103:6807/3794024283","heartbeat_front_addr":"172.21.15.103:6805/3794024283","state":["exists","up"]},{"osd":3,"uuid":"abc4dcbd-0a9a-4d10-b401-14e11ca7fdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6811","nonce":95002866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6813","nonce":95002866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6817","nonce":95002866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":95002866},{"type":"v1","addr":"172.21.15.12:6815","nonce":95002866}]},"public_addr":"172.21.15.12:6811/95002866","cluster_addr":"172.21.15.12:6813/95002866","heartbeat_back_addr":"172.21.15.12:6817/95002866","heartbeat_front_addr":"172.21.15.12:6815/95002866","state":["exists","up"]},{"osd":4,"uuid":"aab18809-48a8-4c56-b06a-fc56396a0246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6809","nonce":59815868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6811","nonce":59815868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6815","nonce":59815868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":59815868},{"type":"v1","addr":"172.21.15.55:6813","nonce":59815868}]},"public_addr":"172.21.15.55:6809/59815868","cluster_addr":"172.21.15.55:6811/59815868","heartbeat_back_addr":"172.21.15.55:6815/59815868","heartbeat_front_addr":"172.21.15.55:6813/59815868","state":["exists","up"]},{"osd":5,"uuid":"04b0e92e-887f-4551-a3b8-a0df3d9de9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6809","nonce":67358017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6811","nonce":67358017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6815","nonce":67358017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":67358017},{"type":"v1","addr":"172.21.15.103:6813","nonce":67358017}]},"public_addr":"172.21.15.103:6809/67358017","cluster_addr":"172.21.15.103:6811/67358017","heartbeat_back_addr":"172.21.15.103:6815/67358017","heartbeat_front_addr":"172.21.15.103:6813/67358017","state":["exists","up"]},{"osd":6,"uuid":"6290f434-6daf-4e1f-b599-8478726c0696","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6819","nonce":677900962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6821","nonce":677900962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6825","nonce":677900962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":677900962},{"type":"v1","addr":"172.21.15.12:6823","nonce":677900962}]},"public_addr":"172.21.15.12:6819/677900962","cluster_addr":"172.21.15.12:6821/677900962","heartbeat_back_addr":"172.21.15.12:6825/677900962","heartbeat_front_addr":"172.21.15.12:6823/677900962","state":["exists","up"]},{"osd":7,"uuid":"60c4850a-411e-4fbf-944d-9c9530ae5dcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6817","nonce":4145865981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6819","nonce":4145865981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6823","nonce":4145865981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":4145865981},{"type":"v1","addr":"172.21.15.55:6821","nonce":4145865981}]},"public_addr":"172.21.15.55:6817/4145865981","cluster_addr":"172.21.15.55:6819/4145865981","heartbeat_back_addr":"172.21.15.55:6823/4145865981","heartbeat_front_addr":"172.21.15.55:6821/4145865981","state":["exists","up"]},{"osd":8,"uuid":"c3da844e-9ab0-422d-89da-3d369ed494a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6817","nonce":1363317081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6819","nonce":1363317081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6823","nonce":1363317081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1363317081},{"type":"v1","addr":"172.21.15.103:6821","nonce":1363317081}]},"public_addr":"172.21.15.103:6817/1363317081","cluster_addr":"172.21.15.103:6819/1363317081","heartbeat_back_addr":"172.21.15.103:6823/1363317081","heartbeat_front_addr":"172.21.15.103:6821/1363317081","state":["exists","up"]},{"osd":9,"uuid":"220ec4cc-7468-4e46-aada-4e4edeb7bcb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6827","nonce":4020892296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6829","nonce":4020892296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6833","nonce":4020892296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":4020892296},{"type":"v1","addr":"172.21.15.12:6831","nonce":4020892296}]},"public_addr":"172.21.15.12:6827/4020892296","cluster_addr":"172.21.15.12:6829/4020892296","heartbeat_back_addr":"172.21.15.12:6833/4020892296","heartbeat_front_addr":"172.21.15.12:6831/4020892296","state":["exists","up"]},{"osd":10,"uuid":"7c9ebf61-379a-4730-a7da-9f031671d4af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6825","nonce":3825680100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6827","nonce":3825680100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6831","nonce":3825680100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":3825680100},{"type":"v1","addr":"172.21.15.55:6829","nonce":3825680100}]},"public_addr":"172.21.15.55:6825/3825680100","cluster_addr":"172.21.15.55:6827/3825680100","heartbeat_back_addr":"172.21.15.55:6831/3825680100","heartbeat_front_addr":"172.21.15.55:6829/3825680100","state":["exists","up"]},{"osd":11,"uuid":"5bc702e3-9dd4-469c-8d35-1addfce5dbf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":82,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6825","nonce":4052235474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6827","nonce":4052235474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6831","nonce":4052235474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":4052235474},{"type":"v1","addr":"172.21.15.103:6829","nonce":4052235474}]},"public_addr":"172.21.15.103:6825/4052235474","cluster_addr":"172.21.15.103:6827/4052235474","heartbeat_back_addr":"172.21.15.103:6831/4052235474","heartbeat_front_addr":"172.21.15.103:6829/4052235474","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:23.532986+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:01:48.778804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:12.465936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:02:37.442308+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:02.542843+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:26.804948+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:03:51.476818+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:17.461426+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:04:41.859003+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:07.302435+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:33.177016+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-14T13:05:57.664592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3839639122":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/305486509":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2684526403":"2024-02-15T12:59:48.272127+0000","172.21.15.12:6801/955464513":"2024-02-15T12:59:48.272127+0000","172.21.15.12:0/2867303975":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6801/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/3222670253":"2024-02-15T12:59:21.651055+0000","172.21.15.12:0/1960111540":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/1478984094":"2024-02-15T12:59:21.651055+0000","172.21.15.12:6800/955464513":"2024-02-15T12:59:48.272127+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7feed00a20c0 msgr2=0x7feed00a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7feed00a20c0 0x7feed00a4580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feedc006010 tx=0x7feedc005be0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 msgr2=0x7feee4196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 0x7feee4196780 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7feed400eb30 tx=0x7feed400c270 comp rx=0 tx=0).stop 2024-02-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 shutdown_connections 2024-02-14T13:11:37.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7feed00a20c0 0x7feed00a4580 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feee4101d00 0x7feee419d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4101340 0x7feee4196780 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 --2- 172.21.15.12:0/2107583118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee4100150 0x7feee4196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 >> 172.21.15.12:0/2107583118 conn(0x7feee40fb6c0 msgr2=0x7feee41046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 shutdown_connections 2024-02-14T13:11:37.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.819+0000 7feeeafc7640 1 -- 172.21.15.12:0/2107583118 wait complete. 2024-02-14T13:11:37.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:37 smithi012 ceph-mon[32370]: pgmap v435: 97 pgs: 97 active+clean; 8.6 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 400 op/s 2024-02-14T13:11:37.831 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:37 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/1364723753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:11:37.832 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:37 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2714429609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:11:37.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 -- 172.21.15.12:0/989923665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 msgr2=0x7f571c101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- 172.21.15.12:0/989923665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c101660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5714009ca0 tx=0x7f571402c0f0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 -- 172.21.15.12:0/989923665 shutdown_connections 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- 172.21.15.12:0/989923665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c102df0 0x7f571c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- 172.21.15.12:0/989923665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102430 0x7f571c1028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- 172.21.15.12:0/989923665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c101660 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 -- 172.21.15.12:0/989923665 >> 172.21.15.12:0/989923665 conn(0x7f571c0fc7d0 msgr2=0x7f571c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:37.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 -- 172.21.15.12:0/989923665 shutdown_connections 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 -- 172.21.15.12:0/989923665 wait complete. 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 Processor -- start 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 -- start start 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c102430 0x7f571c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.935+0000 7f572455c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102df0 0x7f571c19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f572455c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c19ef10 con 0x7f571c101240 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f572455c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c19f080 con 0x7f571c102df0 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f572455c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c19f240 con 0x7f571c102430 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33840/0 (socket says 172.21.15.12:33840) 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 -- 172.21.15.12:0/3380133191 learned_addr learned my addr 172.21.15.12:0/3380133191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:37.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f5721af7640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c102430 0x7f571c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f5722af9640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102df0 0x7f571c19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 -- 172.21.15.12:0/3380133191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c102430 msgr2=0x7f571c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c102430 0x7f571c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 -- 172.21.15.12:0/3380133191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102df0 msgr2=0x7f571c19e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102df0 0x7f571c19e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 -- 172.21.15.12:0/3380133191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009900 con 0x7f571c101240 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f5722af9640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102df0 0x7f571c19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f57222f8640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c197420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5714037040 tx=0x7f5714034d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714003970 con 0x7f571c101240 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c19f4c0 con 0x7f571c101240 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f5714004040 con 0x7f571c101240 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140406b0 con 0x7f571c101240 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.936+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c19f9f0 con 0x7f571c101240 2024-02-14T13:11:37.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.937+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c1085e0 con 0x7f571c101240 2024-02-14T13:11:37.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.938+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f571400a040 con 0x7f571c101240 2024-02-14T13:11:37.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.939+0000 7f571b7fe640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f57040a20c0 0x7f57040a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:37.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.939+0000 7f5721af7640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f57040a20c0 0x7f57040a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:37.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.939+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8298+0+0 (secure 0 0 0) 0x7f57140f1350 con 0x7f571c101240 2024-02-14T13:11:37.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.939+0000 7f5721af7640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f57040a20c0 0x7f57040a4580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f571c198930 tx=0x7f5710008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:37.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:37.943+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f57140ba3a0 con 0x7f571c101240 2024-02-14T13:11:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:37 smithi103 ceph-mon[36921]: pgmap v435: 97 pgs: 97 active+clean; 8.6 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 400 op/s 2024-02-14T13:11:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:37 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/1364723753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:11:37.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:37 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2714429609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:11:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:37 smithi055 ceph-mon[36853]: pgmap v435: 97 pgs: 97 active+clean; 8.6 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 400 op/s 2024-02-14T13:11:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:37 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/1364723753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:11:38.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:37 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2714429609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-14T13:11:38.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.160+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f571c02cde0 con 0x7f571c101240 2024-02-14T13:11:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.163+0000 7f571b7fe640 1 -- 172.21.15.12:0/3380133191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5714044090 con 0x7f571c101240 2024-02-14T13:11:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.165+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f57040a20c0 msgr2=0x7f57040a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.165+0000 7f572455c640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f57040a20c0 0x7f57040a4580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f571c198930 tx=0x7f5710008040 comp rx=0 tx=0).stop 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.165+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 msgr2=0x7f571c197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.165+0000 7f572455c640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c197420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5714037040 tx=0x7f5714034d20 comp rx=0 tx=0).stop 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 shutdown_connections 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f57040a20c0 0x7f57040a4580 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f571c102df0 0x7f571c19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f571c102430 0x7f571c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 --2- 172.21.15.12:0/3380133191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f571c101240 0x7f571c197420 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 >> 172.21.15.12:0/3380133191 conn(0x7f571c0fc7d0 msgr2=0x7f571c1057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 shutdown_connections 2024-02-14T13:11:38.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.166+0000 7f572455c640 1 -- 172.21.15.12:0/3380133191 wait complete. 2024-02-14T13:11:38.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 -- 172.21.15.12:0/268813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664101320 msgr2=0x7f26641017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 --2- 172.21.15.12:0/268813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664101320 0x7f26641017a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2654009900 tx=0x7f265402bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 -- 172.21.15.12:0/268813357 shutdown_connections 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 --2- 172.21.15.12:0/268813357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664101ce0 0x7f2664108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 --2- 172.21.15.12:0/268813357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664101320 0x7f26641017a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 --2- 172.21.15.12:0/268813357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2664100130 0x7f2664100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 -- 172.21.15.12:0/268813357 >> 172.21.15.12:0/268813357 conn(0x7f26640fb6c0 msgr2=0x7f26640fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 -- 172.21.15.12:0/268813357 shutdown_connections 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 -- 172.21.15.12:0/268813357 wait complete. 2024-02-14T13:11:38.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 Processor -- start 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.283+0000 7f266b78a640 1 -- start start 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 0x7f2664068f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664101320 0x7f266419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2664101ce0 0x7f266419e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266419ede0 con 0x7f2664100130 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266419ef50 con 0x7f2664101320 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266419f110 con 0x7f2664101ce0 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 0x7f2664068f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 0x7f2664068f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33852/0 (socket says 172.21.15.12:33852) 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 -- 172.21.15.12:0/3158321752 learned_addr learned my addr 172.21.15.12:0/3158321752 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669d27640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2664101ce0 0x7f266419e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2668d25640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664101320 0x7f266419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:38.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 -- 172.21.15.12:0/3158321752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2664101ce0 msgr2=0x7f266419e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2664101ce0 0x7f266419e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 -- 172.21.15.12:0/3158321752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664101320 msgr2=0x7f266419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664101320 0x7f266419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 -- 172.21.15.12:0/3158321752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2654009560 con 0x7f2664100130 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f2669526640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 0x7f2664068f00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f266000d770 tx=0x7f266000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660009c30 con 0x7f2664100130 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266419f390 con 0x7f2664100130 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f266000de80 con 0x7f2664100130 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660010460 con 0x7f2664100130 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.284+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266419f8c0 con 0x7f2664100130 2024-02-14T13:11:38.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.285+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2664107470 con 0x7f2664100130 2024-02-14T13:11:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.286+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f2660003f60 con 0x7f2664100130 2024-02-14T13:11:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.287+0000 7f265a7fc640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f26500a20c0 0x7f26500a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.287+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8384+0+0 (secure 0 0 0) 0x7f26600cd9f0 con 0x7f2664100130 2024-02-14T13:11:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.287+0000 7f2668d25640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f26500a20c0 0x7f26500a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:38.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.287+0000 7f2668d25640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f26500a20c0 0x7f26500a4580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2654009230 tx=0x7f2654005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:38.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.291+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f26600969a0 con 0x7f2664100130 2024-02-14T13:11:38.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a[32366]: 2024-02-14T13:11:38.161+0000 7fe893d92700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-14T13:11:38.492 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: ignoring --setuser ceph since I am not root 2024-02-14T13:11:38.492 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: ignoring --setgroup ceph since I am not root 2024-02-14T13:11:38.492 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mds[67715]: -- 172.21.15.103:0/1454670377 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56074e233520 con 0x56074e209000 2024-02-14T13:11:38.492 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: starting mds.i at 2024-02-14T13:11:38.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:38.511+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f266410bb40 con 0x7f2664100130 2024-02-14T13:11:38.561 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b[67967]: ignoring --setuser ceph since I am not root 2024-02-14T13:11:38.561 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b[67967]: ignoring --setgroup ceph since I am not root 2024-02-14T13:11:38.561 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mds[67971]: -- 172.21.15.55:0/252047465 <== mon.2 v2:172.21.15.55:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556b84021520 con 0x556b83ff7000 2024-02-14T13:11:38.561 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b[67967]: starting mds.b at 2024-02-14T13:11:38.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2107583118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:38.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3380133191' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-14T13:11:38.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-14T13:11:38.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-14T13:11:38.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3380133191' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-14T13:11:38.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: osdmap e92: 12 total, 12 up, 12 in 2024-02-14T13:11:38.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-02-14T13:11:38.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:38 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3158321752' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2107583118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3380133191' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3380133191' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: osdmap e92: 12 total, 12 up, 12 in 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-02-14T13:11:38.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:38 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3158321752' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:11:39.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2107583118' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3380133191' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3380133191' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: osdmap e92: 12 total, 12 up, 12 in 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-02-14T13:11:39.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:38 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3158321752' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-02-14T13:11:39.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.170+0000 7f265a7fc640 1 -- 172.21.15.12:0/3158321752 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f266009a060 con 0x7f2664100130 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f26500a20c0 msgr2=0x7f26500a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f26500a20c0 0x7f26500a4580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2654009230 tx=0x7f2654005fd0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 msgr2=0x7f2664068f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 0x7f2664068f00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f266000d770 tx=0x7f266000dc30 comp rx=0 tx=0).stop 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 shutdown_connections 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f26500a20c0 0x7f26500a4580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2664101ce0 0x7f266419e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2664101320 0x7f266419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 --2- 172.21.15.12:0/3158321752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2664100130 0x7f2664068f00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 >> 172.21.15.12:0/3158321752 conn(0x7f26640fb6c0 msgr2=0x7f2664104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:39.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.173+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 shutdown_connections 2024-02-14T13:11:39.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.174+0000 7f266b78a640 1 -- 172.21.15.12:0/3158321752 wait complete. 2024-02-14T13:11:39.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-14T13:11:39.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 -- 172.21.15.12:0/3442784423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 msgr2=0x7f6e28100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 --2- 172.21.15.12:0/3442784423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e28100560 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009900 tx=0x7f6e2002bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 -- 172.21.15.12:0/3442784423 shutdown_connections 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 --2- 172.21.15.12:0/3442784423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 0x7f6e28108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 --2- 172.21.15.12:0/3442784423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 0x7f6e281017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 --2- 172.21.15.12:0/3442784423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e28100560 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 -- 172.21.15.12:0/3442784423 >> 172.21.15.12:0/3442784423 conn(0x7f6e280fb6d0 msgr2=0x7f6e280fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 -- 172.21.15.12:0/3442784423 shutdown_connections 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.302+0000 7f6e30623640 1 -- 172.21.15.12:0/3442784423 wait complete. 2024-02-14T13:11:39.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 Processor -- start 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 -- start start 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e2806a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 0x7f6e2819c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 0x7f6e2819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2819edf0 con 0x7f6e28100140 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2819ef60 con 0x7f6e28101cf0 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e30623640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2819f120 con 0x7f6e28101330 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e2806a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e2806a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33862/0 (socket says 172.21.15.12:33862) 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 -- 172.21.15.12:0/3111826894 learned_addr learned my addr 172.21.15.12:0/3111826894 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 -- 172.21.15.12:0/3111826894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 msgr2=0x7f6e2819c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2ebc0640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 0x7f6e2819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2dbbe640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 0x7f6e2819c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 0x7f6e2819c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 -- 172.21.15.12:0/3111826894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 msgr2=0x7f6e2819e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 0x7f6e2819e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 -- 172.21.15.12:0/3111826894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009560 con 0x7f6e28100140 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2ebc0640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 0x7f6e2819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2dbbe640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 0x7f6e2819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.303+0000 7f6e2e3bf640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e2806a3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000c00 tx=0x7f6e20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.304+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20004df0 con 0x7f6e28100140 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.304+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2819f3a0 con 0x7f6e28100140 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.304+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7f6e20005430 con 0x7f6e28100140 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.304+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2003e450 con 0x7f6e28100140 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.304+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2819f900 con 0x7f6e28100140 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.304+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28107530 con 0x7f6e28100140 2024-02-14T13:11:39.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.306+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7f6e20005160 con 0x7f6e28100140 2024-02-14T13:11:39.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.306+0000 7f6e277fe640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e100a20c0 0x7f6e100a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:39.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.306+0000 7f6e2dbbe640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e100a20c0 0x7f6e100a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:39.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.306+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8384+0+0 (secure 0 0 0) 0x7f6e200f0930 con 0x7f6e28100140 2024-02-14T13:11:39.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.307+0000 7f6e2dbbe640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e100a20c0 0x7f6e100a4580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c005d00 tx=0x7f6e1c005ed0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:39.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.310+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e200b9870 con 0x7f6e28100140 2024-02-14T13:11:39.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:39.491+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e2810bb10 con 0x7f6e28100140 2024-02-14T13:11:39.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: pgmap v437: 97 pgs: 97 active+clean; 8.6 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 344 op/s 2024-02-14T13:11:39.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: Cluster is now healthy 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3158321752' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.55:6838/3067008209,v1:172.21.15.55:6839/3067008209] up:boot 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: mds.? [v2:172.21.15.103:6838/311492792,v1:172.21.15.103:6839/311492792] up:boot 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: fsmap 12 up:standby 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-02-14T13:11:39.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-02-14T13:11:39.969 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:39 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3111826894' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-14T13:11:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: pgmap v437: 97 pgs: 97 active+clean; 8.6 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 344 op/s 2024-02-14T13:11:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-14T13:11:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-14T13:11:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: Cluster is now healthy 2024-02-14T13:11:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3158321752' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-02-14T13:11:39.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.55:6838/3067008209,v1:172.21.15.55:6839/3067008209] up:boot 2024-02-14T13:11:39.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: mds.? [v2:172.21.15.103:6838/311492792,v1:172.21.15.103:6839/311492792] up:boot 2024-02-14T13:11:39.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: fsmap 12 up:standby 2024-02-14T13:11:39.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-02-14T13:11:39.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-02-14T13:11:39.993 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:39 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3111826894' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-14T13:11:40.060 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: pgmap v437: 97 pgs: 97 active+clean; 8.6 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 344 op/s 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: Cluster is now healthy 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3158321752' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.55:6838/3067008209,v1:172.21.15.55:6839/3067008209] up:boot 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: mds.? [v2:172.21.15.103:6838/311492792,v1:172.21.15.103:6839/311492792] up:boot 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: fsmap 12 up:standby 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: from='mgr.14148 172.21.15.12:0/3044730930' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-02-14T13:11:40.061 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:39 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3111826894' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-14T13:11:40.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.172+0000 7f6e277fe640 1 -- 172.21.15.12:0/3111826894 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6e200bcf30 con 0x7f6e28100140 2024-02-14T13:11:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.176+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e100a20c0 msgr2=0x7f6e100a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.176+0000 7f6e30623640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e100a20c0 0x7f6e100a4580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c005d00 tx=0x7f6e1c005ed0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.176+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 msgr2=0x7f6e2806a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.176+0000 7f6e30623640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e2806a3b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000c00 tx=0x7f6e20004270 comp rx=0 tx=0).stop 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.176+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 shutdown_connections 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7f6e100a20c0 0x7f6e100a4580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e28101cf0 0x7f6e2819e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e28101330 0x7f6e2819c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 --2- 172.21.15.12:0/3111826894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e28100140 0x7f6e2806a3b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 >> 172.21.15.12:0/3111826894 conn(0x7f6e280fb6d0 msgr2=0x7f6e28104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 shutdown_connections 2024-02-14T13:11:40.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.177+0000 7f6e30623640 1 -- 172.21.15.12:0/3111826894 wait complete. 2024-02-14T13:11:40.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-14T13:11:40.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.310+0000 7ff906c39640 1 -- 172.21.15.12:0/4063412402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 msgr2=0x7ff9001069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:40.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.310+0000 7ff906c39640 1 --2- 172.21.15.12:0/4063412402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff9001069d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009900 tx=0x7ff8f002bc30 comp rx=0 tx=0).stop 2024-02-14T13:11:40.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- 172.21.15.12:0/4063412402 shutdown_connections 2024-02-14T13:11:40.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 --2- 172.21.15.12:0/4063412402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900106f10 0x7ff900109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 --2- 172.21.15.12:0/4063412402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff9001069d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 --2- 172.21.15.12:0/4063412402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff900101cb0 0x7ff9001040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- 172.21.15.12:0/4063412402 >> 172.21.15.12:0/4063412402 conn(0x7ff9000fb6a0 msgr2=0x7ff9000fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- 172.21.15.12:0/4063412402 shutdown_connections 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- 172.21.15.12:0/4063412402 wait complete. 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 Processor -- start 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- start start 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900101cb0 0x7ff9001972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:40.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff900197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff900106f10 0x7ff90019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90019ede0 con 0x7ff9001045e0 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90019ef50 con 0x7ff900106f10 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff906c39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90019f110 con 0x7ff900101cb0 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff8f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff900197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff8f7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff900197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33866/0 (socket says 172.21.15.12:33866) 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.311+0000 7ff8f7fff640 1 -- 172.21.15.12:0/2437004653 learned_addr learned my addr 172.21.15.12:0/2437004653 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff9049d5640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900101cb0 0x7ff9001972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff9051d6640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff900106f10 0x7ff90019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f7fff640 1 -- 172.21.15.12:0/2437004653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900101cb0 msgr2=0x7ff9001972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900101cb0 0x7ff9001972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f7fff640 1 -- 172.21.15.12:0/2437004653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff900106f10 msgr2=0x7ff90019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff900106f10 0x7ff90019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f7fff640 1 -- 172.21.15.12:0/2437004653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0009560 con 0x7ff9001045e0 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f7fff640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff900197830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0000c00 tx=0x7ff8f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0004df0 con 0x7ff9001045e0 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90019f390 con 0x7ff9001045e0 2024-02-14T13:11:40.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) v1 ==== 1140+0+0 (secure 0 0 0) 0x7ff8f0005430 con 0x7ff9001045e0 2024-02-14T13:11:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f003e450 con 0x7ff9001045e0 2024-02-14T13:11:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.312+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90019f8f0 con 0x7ff9001045e0 2024-02-14T13:11:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.313+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9000fd190 con 0x7ff9001045e0 2024-02-14T13:11:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.314+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 136768+0+0 (secure 0 0 0) 0x7ff8f00055a0 con 0x7ff9001045e0 2024-02-14T13:11:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.315+0000 7ff8f5ffb640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff8e80a2140 0x7ff8e80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-14T13:11:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.315+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 7801+0+0 (secure 0 0 0) 0x7ff8f00f0660 con 0x7ff9001045e0 2024-02-14T13:11:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.315+0000 7ff9049d5640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff8e80a2140 0x7ff8e80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-14T13:11:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.316+0000 7ff9049d5640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff8e80a2140 0x7ff8e80a4600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00bbe0 tx=0x7ff8fc00b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-14T13:11:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.319+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff8f00b9790 con 0x7ff9001045e0 2024-02-14T13:11:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:40.502+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff90010cc10 con 0x7ff9001045e0 2024-02-14T13:11:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.180+0000 7ff8f5ffb640 1 -- 172.21.15.12:0/2437004653 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff8f00bce50 con 0x7ff9001045e0 2024-02-14T13:11:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-02-14T13:11:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff8e80a2140 msgr2=0x7ff8e80a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff8e80a2140 0x7ff8e80a4600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00bbe0 tx=0x7ff8fc00b390 comp rx=0 tx=0).stop 2024-02-14T13:11:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 msgr2=0x7ff900197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-14T13:11:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff900197830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0000c00 tx=0x7ff8f0004270 comp rx=0 tx=0).stop 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 shutdown_connections 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:6800/1684027624,v1:172.21.15.12:6801/1684027624] conn(0x7ff8e80a2140 0x7ff8e80a4600 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff900106f10 0x7ff90019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9001045e0 0x7ff900197830 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 --2- 172.21.15.12:0/2437004653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff900101cb0 0x7ff9001972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 >> 172.21.15.12:0/2437004653 conn(0x7ff9000fb6a0 msgr2=0x7ff900102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 shutdown_connections 2024-02-14T13:11:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-02-14T13:11:41.183+0000 7ff906c39640 1 -- 172.21.15.12:0/2437004653 wait complete. 2024-02-14T13:11:41.205 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-14T13:11:41.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-14T13:11:41.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-14T13:11:41.315 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-14T13:11:41.316 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-14T13:11:41.331 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-14T13:11:41.348 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-14T13:11:41.371 INFO:tasks.cephadm:Stopping all daemons... 2024-02-14T13:11:41.371 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-14T13:11:41.371 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a 2024-02-14T13:11:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/3111826894' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-02-14T13:11:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 ceph-mon[32370]: osdmap e93: 12 total, 12 up, 12 in 2024-02-14T13:11:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 ceph-mon[32370]: from='client.? 172.21.15.12:0/2437004653' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-14T13:11:41.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 systemd[1]: Stopping Ceph mon.a for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:41.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:41 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/3111826894' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-02-14T13:11:41.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:41 smithi103 ceph-mon[36921]: osdmap e93: 12 total, 12 up, 12 in 2024-02-14T13:11:41.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:41 smithi103 ceph-mon[36921]: from='client.? 172.21.15.12:0/2437004653' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-14T13:11:41.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/3111826894' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-02-14T13:11:41.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:41 smithi055 ceph-mon[36853]: osdmap e93: 12 total, 12 up, 12 in 2024-02-14T13:11:41.560 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:41 smithi055 ceph-mon[36853]: from='client.? 172.21.15.12:0/2437004653' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-14T13:11:41.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a[32366]: 2024-02-14T13:11:41.652+0000 7fe89959d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:11:41.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a[32366]: 2024-02-14T13:11:41.652+0000 7fe89959d700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-14T13:11:41.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:41 smithi012 podman[86913]: 2024-02-14 13:11:41.674739466 +0000 UTC m=+0.116480647 container died 3413393e387400fe5a3cd7fd6a1791b6f862ddc74d3f6f31b2b501a80c33ed8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True) 2024-02-14T13:11:42.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:42 smithi012 podman[86913]: 2024-02-14 13:11:42.261546738 +0000 UTC m=+0.703287917 container cleanup 3413393e387400fe5a3cd7fd6a1791b6f862ddc74d3f6f31b2b501a80c33ed8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:11:42.467 INFO:journalctl@ceph.mon.a.smithi012.stdout:Feb 14 13:11:42 smithi012 bash[86913]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-a 2024-02-14T13:11:42.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.a.service' 2024-02-14T13:11:42.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:11:42.687 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-14T13:11:42.687 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-02-14T13:11:42.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.b 2024-02-14T13:11:43.005 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:42 smithi055 systemd[1]: Stopping Ceph mon.b for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-b[36849]: 2024-02-14T13:11:43.002+0000 7f0599958700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:11:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-b[36849]: 2024-02-14T13:11:43.002+0000 7f0599958700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-02-14T13:11:43.310 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:43 smithi055 podman[70291]: 2024-02-14 13:11:43.074750927 +0000 UTC m=+0.187562431 container died 820f66574326e078d9616f5e992a6b38c5fb360c2119f929300d6710cf9cca22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-b, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-14T13:11:43.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:43 smithi055 podman[70291]: 2024-02-14 13:11:43.644205009 +0000 UTC m=+0.757016515 container cleanup 820f66574326e078d9616f5e992a6b38c5fb360c2119f929300d6710cf9cca22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, ceph=True, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:11:43.811 INFO:journalctl@ceph.mon.b.smithi055.stdout:Feb 14 13:11:43 smithi055 bash[70291]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-b 2024-02-14T13:11:44.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.b.service' 2024-02-14T13:11:44.147 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:11:44.147 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-02-14T13:11:44.147 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-02-14T13:11:44.147 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.c 2024-02-14T13:11:44.491 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:44 smithi103 systemd[1]: Stopping Ceph mon.c for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:45.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c[36916]: 2024-02-14T13:11:45.401+0000 7fc5abef5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:11:45.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c[36916]: 2024-02-14T13:11:45.401+0000 7fc5abef5700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-02-14T13:11:45.742 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:45 smithi103 podman[69930]: 2024-02-14 13:11:45.422299155 +0000 UTC m=+1.072486573 container died 0dc130bedecee20beddbe7bf585996adf708b8d7f761594a46d2bdf0207d7ead (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, GIT_BRANCH=HEAD) 2024-02-14T13:11:49.764 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:49 smithi103 podman[69930]: 2024-02-14 13:11:49.511652497 +0000 UTC m=+5.161839889 container cleanup 0dc130bedecee20beddbe7bf585996adf708b8d7f761594a46d2bdf0207d7ead (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-14T13:11:49.765 INFO:journalctl@ceph.mon.c.smithi103.stdout:Feb 14 13:11:49 smithi103 bash[69930]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mon-c 2024-02-14T13:11:49.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mon.c.service' 2024-02-14T13:11:49.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:11:49.940 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-02-14T13:11:49.940 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-14T13:11:49.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x 2024-02-14T13:11:50.249 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:11:49 smithi012 systemd[1]: Stopping Ceph mgr.x for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:50.529 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:11:50 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:11:50.247+0000 7fc9854d3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:11:50.530 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:11:50 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x[32605]: 2024-02-14T13:11:50.247+0000 7fc9854d3700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-14T13:11:50.530 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:11:50 smithi012 podman[87037]: 2024-02-14 13:11:50.279230164 +0000 UTC m=+0.142040222 container died 454a9a83b62c1a49cddb2153e4807261190e35064efe338745c267d9d7aac997 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:11:50.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:11:50 smithi012 podman[87037]: 2024-02-14 13:11:50.765260438 +0000 UTC m=+0.628070495 container cleanup 454a9a83b62c1a49cddb2153e4807261190e35064efe338745c267d9d7aac997 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6fe3fa3adb3a69ed9af8a494c4670cfd0d57fe0, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131) 2024-02-14T13:11:50.968 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Feb 14 13:11:50 smithi012 bash[87037]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-x 2024-02-14T13:11:51.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.x.service' 2024-02-14T13:11:51.186 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:11:51.186 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-14T13:11:51.187 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-14T13:11:51.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.y 2024-02-14T13:11:51.560 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:11:51 smithi055 systemd[1]: Stopping Ceph mgr.y for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:51.926 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:11:51 smithi055 podman[70415]: 2024-02-14 13:11:51.620595114 +0000 UTC m=+0.236092088 container died dea078cbb750ae25efd2a3675662516de6fca8bdaa9bba1dc7d45e4def6b4e63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-14T13:11:52.251 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:11:51 smithi055 podman[70415]: 2024-02-14 13:11:51.99072486 +0000 UTC m=+0.606221836 container cleanup dea078cbb750ae25efd2a3675662516de6fca8bdaa9bba1dc7d45e4def6b4e63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux ) 2024-02-14T13:11:52.251 INFO:journalctl@ceph.mgr.y.smithi055.stdout:Feb 14 13:11:51 smithi055 bash[70415]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-y 2024-02-14T13:11:52.423 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.y.service' 2024-02-14T13:11:52.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:11:52.464 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-14T13:11:52.464 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-02-14T13:11:52.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.z 2024-02-14T13:11:52.797 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:52 smithi103 systemd[1]: Stopping Ceph mgr.z for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:53.060 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:52 smithi103 podman[70056]: 2024-02-14 13:11:52.796310578 +0000 UTC m=+0.140727461 container died 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-14T13:11:53.361 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 podman[70056]: 2024-02-14 13:11:53.133445883 +0000 UTC m=+0.477862753 container cleanup 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:11:53.361 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 bash[70056]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z 2024-02-14T13:11:53.604 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.z.service' 2024-02-14T13:11:53.627 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 podman[70069]: 2024-02-14 13:11:53.360022431 +0000 UTC m=+0.561881209 container remove 4f809dedbe9a24c3bcc5dce6e549d4eb7260cbea2d9f9e2e196f87532fe67ed4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mgr-z, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-14T13:11:53.628 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-02-14T13:11:53.628 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.z.service: Failed with result 'exit-code'. 2024-02-14T13:11:53.628 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 systemd[1]: Stopped Ceph mgr.z for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:11:53.628 INFO:journalctl@ceph.mgr.z.smithi103.stdout:Feb 14 13:11:53 smithi103 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mgr.z.service: Consumed 10.738s CPU time. 2024-02-14T13:11:53.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:11:53.640 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-02-14T13:11:53.640 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-14T13:11:53.640 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.0 2024-02-14T13:11:53.954 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:53 smithi012 systemd[1]: Stopping Ceph osd.0 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:11:54.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0[47095]: 2024-02-14T13:11:53.952+0000 7f3d529dd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:11:54.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0[47095]: 2024-02-14T13:11:53.952+0000 7f3d529dd700 -1 osd.0 94 *** Got signal Terminated *** 2024-02-14T13:11:54.217 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:53 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0[47095]: 2024-02-14T13:11:53.952+0000 7f3d529dd700 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:11:59.771 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:59 smithi012 podman[87169]: 2024-02-14 13:11:59.496367338 +0000 UTC m=+5.661670259 container died e9d1c5c971c778aa67d6768174145e0751747e6913287d6d3c5dc82004143444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-02-14T13:12:00.096 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:59 smithi012 podman[87169]: 2024-02-14 13:11:59.827243982 +0000 UTC m=+5.992546903 container cleanup e9d1c5c971c778aa67d6768174145e0751747e6913287d6d3c5dc82004143444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-14T13:12:00.096 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:11:59 smithi012 bash[87169]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0 2024-02-14T13:12:00.467 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:00 smithi012 podman[87188]: 2024-02-14 13:12:00.094985214 +0000 UTC m=+0.588864089 container remove e9d1c5c971c778aa67d6768174145e0751747e6913287d6d3c5dc82004143444 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0) 2024-02-14T13:12:00.724 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:00 smithi012 podman[87281]: 2024-02-14 13:12:00.400081568 +0000 UTC m=+0.017697667 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:00.724 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:00 smithi012 podman[87281]: 2024-02-14 13:12:00.52109309 +0000 UTC m=+0.138709184 container create dc79894639a54b5f51bf76e43c450fed1b83f4e74c29a826f9d7838e483e3247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0-deactivate, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-02-14T13:12:00.982 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:00 smithi012 podman[87281]: 2024-02-14 13:12:00.72363128 +0000 UTC m=+0.341247377 container init dc79894639a54b5f51bf76e43c450fed1b83f4e74c29a826f9d7838e483e3247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-02-14T13:12:00.982 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:00 smithi012 podman[87281]: 2024-02-14 13:12:00.726906793 +0000 UTC m=+0.344522888 container start dc79894639a54b5f51bf76e43c450fed1b83f4e74c29a826f9d7838e483e3247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.2) 2024-02-14T13:12:00.982 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:00 smithi012 podman[87281]: 2024-02-14 13:12:00.798416609 +0000 UTC m=+0.416032704 container attach dc79894639a54b5f51bf76e43c450fed1b83f4e74c29a826f9d7838e483e3247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0-deactivate, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:01.261 INFO:journalctl@ceph.osd.0.smithi012.stdout:Feb 14 13:12:01 smithi012 podman[87281]: 2024-02-14 13:12:01.029303931 +0000 UTC m=+0.646920026 container died dc79894639a54b5f51bf76e43c450fed1b83f4e74c29a826f9d7838e483e3247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-0-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, GIT_CLEAN=True) 2024-02-14T13:12:01.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.0.service' 2024-02-14T13:12:01.641 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:01.641 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-14T13:12:01.641 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-14T13:12:01.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.1 2024-02-14T13:12:02.005 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:01 smithi055 systemd[1]: Stopping Ceph osd.1 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:02.310 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1[41491]: 2024-02-14T13:12:02.002+0000 7fb150af8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:02.310 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1[41491]: 2024-02-14T13:12:02.002+0000 7fb150af8700 -1 osd.1 94 *** Got signal Terminated *** 2024-02-14T13:12:02.311 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1[41491]: 2024-02-14T13:12:02.002+0000 7fb150af8700 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:07.811 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:07 smithi055 podman[70540]: 2024-02-14 13:12:07.445311408 +0000 UTC m=+5.574022897 container died 85c01ef01cdb85be273d2eaafa9f96d433118f12d42b1870be5552a8c8e509db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux ) 2024-02-14T13:12:08.205 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:07 smithi055 podman[70540]: 2024-02-14 13:12:07.936226561 +0000 UTC m=+6.064938022 container cleanup 85c01ef01cdb85be273d2eaafa9f96d433118f12d42b1870be5552a8c8e509db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:12:08.205 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:07 smithi055 bash[70540]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1 2024-02-14T13:12:08.560 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:08 smithi055 podman[70568]: 2024-02-14 13:12:08.204264203 +0000 UTC m=+0.759152339 container remove 85c01ef01cdb85be273d2eaafa9f96d433118f12d42b1870be5552a8c8e509db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131) 2024-02-14T13:12:08.901 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:08 smithi055 podman[70660]: 2024-02-14 13:12:08.470358605 +0000 UTC m=+0.018184401 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:08.901 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:08 smithi055 podman[70660]: 2024-02-14 13:12:08.596967843 +0000 UTC m=+0.144793617 container create 3552c4dae55bf384a7a4baf724f7ce57846e595e03c2c7bc7e6a3583f2013f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2) 2024-02-14T13:12:08.901 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:08 smithi055 podman[70660]: 2024-02-14 13:12:08.807990324 +0000 UTC m=+0.355816101 container init 3552c4dae55bf384a7a4baf724f7ce57846e595e03c2c7bc7e6a3583f2013f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:12:08.901 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:08 smithi055 podman[70660]: 2024-02-14 13:12:08.811531466 +0000 UTC m=+0.359357246 container start 3552c4dae55bf384a7a4baf724f7ce57846e595e03c2c7bc7e6a3583f2013f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-02-14T13:12:08.901 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:08 smithi055 podman[70660]: 2024-02-14 13:12:08.899247076 +0000 UTC m=+0.447072858 container attach 3552c4dae55bf384a7a4baf724f7ce57846e595e03c2c7bc7e6a3583f2013f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1-deactivate, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:12:09.152 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:09 smithi055 podman[70660]: 2024-02-14 13:12:09.120539232 +0000 UTC m=+0.668365028 container died 3552c4dae55bf384a7a4baf724f7ce57846e595e03c2c7bc7e6a3583f2013f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-14T13:12:09.668 INFO:journalctl@ceph.osd.1.smithi055.stdout:Feb 14 13:12:09 smithi055 podman[70686]: 2024-02-14 13:12:09.653279684 +0000 UTC m=+0.527440360 container remove 3552c4dae55bf384a7a4baf724f7ce57846e595e03c2c7bc7e6a3583f2013f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-1-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-14T13:12:09.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.1.service' 2024-02-14T13:12:09.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:09.721 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-14T13:12:09.721 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-14T13:12:09.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.2 2024-02-14T13:12:10.003 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:09 smithi103 systemd[1]: Stopping Ceph osd.2 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:10.003 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2[42102]: 2024-02-14T13:12:09.995+0000 7fc90a15c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:10.003 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2[42102]: 2024-02-14T13:12:09.995+0000 7fc90a15c700 -1 osd.2 94 *** Got signal Terminated *** 2024-02-14T13:12:10.003 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2[42102]: 2024-02-14T13:12:09.995+0000 7fc90a15c700 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:15.657 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:15 smithi103 podman[70182]: 2024-02-14 13:12:15.369896894 +0000 UTC m=+5.461198347 container died a36c3e35e2266d4b7ff5f3a5f532db78ff311869f33045faf65cc0da34a9c95b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS) 2024-02-14T13:12:15.991 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:15 smithi103 podman[70182]: 2024-02-14 13:12:15.738351603 +0000 UTC m=+5.829653032 container cleanup a36c3e35e2266d4b7ff5f3a5f532db78ff311869f33045faf65cc0da34a9c95b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0) 2024-02-14T13:12:15.991 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:15 smithi103 bash[70182]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2 2024-02-14T13:12:16.355 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:15 smithi103 podman[70214]: 2024-02-14 13:12:15.999369753 +0000 UTC m=+0.619967697 container remove a36c3e35e2266d4b7ff5f3a5f532db78ff311869f33045faf65cc0da34a9c95b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-14T13:12:16.654 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:16 smithi103 podman[70303]: 2024-02-14 13:12:16.257050588 +0000 UTC m=+0.018392172 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:16.654 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:16 smithi103 podman[70303]: 2024-02-14 13:12:16.367147991 +0000 UTC m=+0.128489566 container create 9cca824cefceaeea155840e0a698f057709892a4d61b72920b107a09c0d7bd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD) 2024-02-14T13:12:16.654 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:16 smithi103 podman[70303]: 2024-02-14 13:12:16.594395812 +0000 UTC m=+0.355737396 container init 9cca824cefceaeea155840e0a698f057709892a4d61b72920b107a09c0d7bd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2-deactivate, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:16.654 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:16 smithi103 podman[70303]: 2024-02-14 13:12:16.597488422 +0000 UTC m=+0.358830006 container start 9cca824cefceaeea155840e0a698f057709892a4d61b72920b107a09c0d7bd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:12:16.992 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:16 smithi103 podman[70303]: 2024-02-14 13:12:16.652665821 +0000 UTC m=+0.414007421 container attach 9cca824cefceaeea155840e0a698f057709892a4d61b72920b107a09c0d7bd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131) 2024-02-14T13:12:16.992 INFO:journalctl@ceph.osd.2.smithi103.stdout:Feb 14 13:12:16 smithi103 podman[70303]: 2024-02-14 13:12:16.891600595 +0000 UTC m=+0.652942196 container died 9cca824cefceaeea155840e0a698f057709892a4d61b72920b107a09c0d7bd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_CLEAN=True, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-14T13:12:17.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.2.service' 2024-02-14T13:12:17.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:17.543 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-14T13:12:17.543 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-14T13:12:17.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.3 2024-02-14T13:12:17.838 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:17 smithi012 systemd[1]: Stopping Ceph osd.3 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:18.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:17 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:17.835+0000 7fb7a3ec3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:18.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:17 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:17.835+0000 7fb7a3ec3700 -1 osd.3 94 *** Got signal Terminated *** 2024-02-14T13:12:18.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:17 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:17.835+0000 7fb7a3ec3700 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:20.020 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:19 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:19.747+0000 7fb79ccb7700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.749501+0000 front 2024-02-14T13:11:56.749418+0000 (oldest deadline 2024-02-14T13:12:19.649625+0000) 2024-02-14T13:12:20.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:20 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:20.227+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:20.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:20.568+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:21.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:20 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:20.781+0000 7fb79ccb7700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.749501+0000 front 2024-02-14T13:11:56.749418+0000 (oldest deadline 2024-02-14T13:12:19.649625+0000) 2024-02-14T13:12:21.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:21 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:21.009+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:21.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:21 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:21.238+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:21.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:21.528+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:21.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:21.582+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:22.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:21 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:21.790+0000 7fb79ccb7700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.749501+0000 front 2024-02-14T13:11:56.749418+0000 (oldest deadline 2024-02-14T13:12:19.649625+0000) 2024-02-14T13:12:22.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:22 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:22.021+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:22.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:22 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:22.283+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:22.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:22.541+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:22.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:22.510+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:23.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:22 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3[53757]: 2024-02-14T13:12:22.796+0000 7fb79ccb7700 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.749501+0000 front 2024-02-14T13:11:56.749418+0000 (oldest deadline 2024-02-14T13:12:19.649625+0000) 2024-02-14T13:12:23.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:22 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:22.996+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:23.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:22 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:22.835+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:23.471 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:23 smithi012 podman[87390]: 2024-02-14 13:12:23.218961287 +0000 UTC m=+5.484896479 container died 73735b70d229fa373fff912a80ff6d2c23064f9df677bf0cdbc24a4a1bd8c8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:23.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:23 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:23.280+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:23.821 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:23 smithi012 podman[87390]: 2024-02-14 13:12:23.635705989 +0000 UTC m=+5.901641188 container cleanup 73735b70d229fa373fff912a80ff6d2c23064f9df677bf0cdbc24a4a1bd8c8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131) 2024-02-14T13:12:23.821 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:23 smithi012 bash[87390]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3 2024-02-14T13:12:23.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:23.576+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:23.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:23.512+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:24.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:23 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:23.820+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:24.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:23 smithi012 podman[87419]: 2024-02-14 13:12:23.820441153 +0000 UTC m=+0.596691740 container remove 73735b70d229fa373fff912a80ff6d2c23064f9df677bf0cdbc24a4a1bd8c8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, org.label-schema.build-date=20240131) 2024-02-14T13:12:24.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:23 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:23.954+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:24.533 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:24 smithi012 podman[87511]: 2024-02-14 13:12:24.166080702 +0000 UTC m=+0.017534679 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:24.533 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:24 smithi012 podman[87511]: 2024-02-14 13:12:24.271485535 +0000 UTC m=+0.122939496 container create 1b828f7b72fe02f8f28817f0cb308faf24cb0cbb5ede3f27b5d3d0141235a981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:12:24.810 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:24 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:24.322+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:24.833 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:24 smithi012 podman[87511]: 2024-02-14 13:12:24.532193551 +0000 UTC m=+0.383647517 container init 1b828f7b72fe02f8f28817f0cb308faf24cb0cbb5ede3f27b5d3d0141235a981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2) 2024-02-14T13:12:24.833 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:24 smithi012 podman[87511]: 2024-02-14 13:12:24.536270301 +0000 UTC m=+0.387724263 container start 1b828f7b72fe02f8f28817f0cb308faf24cb0cbb5ede3f27b5d3d0141235a981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:12:24.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:24.625+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:24.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:24.509+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:25.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:24 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:24.906+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:25.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:24 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:24.835+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:25.217 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:24 smithi012 podman[87511]: 2024-02-14 13:12:24.928079482 +0000 UTC m=+0.779533461 container attach 1b828f7b72fe02f8f28817f0cb308faf24cb0cbb5ede3f27b5d3d0141235a981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-02-14T13:12:25.218 INFO:journalctl@ceph.osd.3.smithi012.stdout:Feb 14 13:12:24 smithi012 podman[87511]: 2024-02-14 13:12:24.92830121 +0000 UTC m=+0.779755174 container died 1b828f7b72fe02f8f28817f0cb308faf24cb0cbb5ede3f27b5d3d0141235a981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-14T13:12:25.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:25 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:25.290+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:25.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.3.service' 2024-02-14T13:12:25.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:25.672 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-14T13:12:25.672 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-14T13:12:25.672 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.4 2024-02-14T13:12:25.990 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:25 smithi055 systemd[1]: Stopping Ceph osd.4 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:25.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:25.658+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:25.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:25.544+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:26.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:25 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:25.928+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:26.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:25 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:25.879+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:26.310 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:25 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:12:25.988+0000 7f3e77e67700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:26.310 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:25 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:12:25.988+0000 7f3e77e67700 -1 osd.4 94 *** Got signal Terminated *** 2024-02-14T13:12:26.310 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:25 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:12:25.988+0000 7f3e77e67700 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:26.810 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:26 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:26.314+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:26.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:26 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:26.702+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:26.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:26 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:26.562+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:27.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:26.881+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:27.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:26 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:26.875+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:27.810 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:27 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:27.320+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:27.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:27 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:27.724+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:27.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:27 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:27.576+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:28.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:27 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:27.876+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:28.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:27 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:27.913+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:28.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:28 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:28.272+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:28.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:28 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:28.593+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:28.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:28 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:28.681+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:28.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:28 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:28.681+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:29.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:28 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:28.828+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:29.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:28 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:28.828+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:29.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:28 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:28.864+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:29.245 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:28 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:12:28.938+0000 7f3e74c63700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:02.900766+0000 front 2024-02-14T13:12:02.900741+0000 (oldest deadline 2024-02-14T13:12:28.201005+0000) 2024-02-14T13:12:29.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:29 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:29.102+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:29.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:29 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:29.244+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:29.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:29 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:29.573+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:29.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:29 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:29.661+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:29.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:29 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:29.661+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:30.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:29 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:29.785+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:30.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:29 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:29.785+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:30.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:29 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:29.868+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:30.266 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:29 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4[48499]: 2024-02-14T13:12:29.961+0000 7f3e74c63700 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:02.900766+0000 front 2024-02-14T13:12:02.900741+0000 (oldest deadline 2024-02-14T13:12:28.201005+0000) 2024-02-14T13:12:30.266 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:30 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:30.118+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:30.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:30 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:30.150+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:30.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:30 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:30.264+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:30.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:30 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:30.555+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:30.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:30 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:30.621+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:30.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:30 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:30.621+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:31.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:30 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:30.805+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:31.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:30 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:30.805+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:31.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:30 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:30.876+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:31.368 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:31 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:31.221+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:31.369 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:31 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:31.083+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:31.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:31 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:31.108+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:31.649 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:31 smithi055 podman[70765]: 2024-02-14 13:12:31.367426698 +0000 UTC m=+5.481446670 container died 0ff73ce9dcd9fa22cc016a8f58cc3918ef45f24b4969d786c292160d0c59203c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:12:31.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:31 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:31.610+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:31.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:31 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:31.610+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:31.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:31 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:31.544+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:31.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:31 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:31.544+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:31.999 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:31 smithi055 podman[70765]: 2024-02-14 13:12:31.763725682 +0000 UTC m=+5.877745643 container cleanup 0ff73ce9dcd9fa22cc016a8f58cc3918ef45f24b4969d786c292160d0c59203c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2) 2024-02-14T13:12:31.999 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:31 smithi055 bash[70765]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4 2024-02-14T13:12:32.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:31 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:31.873+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:32.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:31 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:31.802+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:32.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:31 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:31.802+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:32.310 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:32 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:32.091+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:32.310 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:31 smithi055 podman[70782]: 2024-02-14 13:12:31.998158997 +0000 UTC m=+0.628974080 container remove 0ff73ce9dcd9fa22cc016a8f58cc3918ef45f24b4969d786c292160d0c59203c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.license=GPLv2) 2024-02-14T13:12:32.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:32 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:32.241+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:32.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:32 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:32.241+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:32.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:32 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:32.116+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:32.602 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:32 smithi055 podman[70882]: 2024-02-14 13:12:32.23836307 +0000 UTC m=+0.018544422 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:32.602 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:32 smithi055 podman[70882]: 2024-02-14 13:12:32.349243621 +0000 UTC m=+0.129424952 container create ec42ecebb67ef798aa837a694d356c82ee185ff8d6dcaa9c3d9cafa28a1bd409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:32.904 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:32 smithi055 podman[70882]: 2024-02-14 13:12:32.601488923 +0000 UTC m=+0.381670271 container init ec42ecebb67ef798aa837a694d356c82ee185ff8d6dcaa9c3d9cafa28a1bd409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_CLEAN=True) 2024-02-14T13:12:32.904 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:32 smithi055 podman[70882]: 2024-02-14 13:12:32.604772174 +0000 UTC m=+0.384953514 container start ec42ecebb67ef798aa837a694d356c82ee185ff8d6dcaa9c3d9cafa28a1bd409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131) 2024-02-14T13:12:32.904 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:32 smithi055 podman[70882]: 2024-02-14 13:12:32.68493506 +0000 UTC m=+0.465116420 container attach ec42ecebb67ef798aa837a694d356c82ee185ff8d6dcaa9c3d9cafa28a1bd409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS) 2024-02-14T13:12:32.904 INFO:journalctl@ceph.osd.4.smithi055.stdout:Feb 14 13:12:32 smithi055 podman[70882]: 2024-02-14 13:12:32.902960212 +0000 UTC m=+0.683141551 container died ec42ecebb67ef798aa837a694d356c82ee185ff8d6dcaa9c3d9cafa28a1bd409 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131) 2024-02-14T13:12:32.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:32 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:32.567+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:32.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:32 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:32.567+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:32.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:32 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:32.542+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:32.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:32 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:32.542+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:33.197 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:33 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:33.087+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:33.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:32 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:32.885+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:33.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:32 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:32.813+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:33.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:32 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:32.813+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:33.472 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:33 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:33.216+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:33.472 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:33 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:33.216+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:33.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:33.069+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:33.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.4.service' 2024-02-14T13:12:33.544 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:33.544 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-14T13:12:33.544 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-14T13:12:33.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.5 2024-02-14T13:12:33.844 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:33.510+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:33.844 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:33.510+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:33.844 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:33.569+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:33.844 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:33.569+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:33.844 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:33 smithi103 systemd[1]: Stopping Ceph osd.5 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:33.845 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:33.842+0000 7f62930b0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:33.845 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:33.842+0000 7f62930b0700 -1 osd.5 94 *** Got signal Terminated *** 2024-02-14T13:12:33.845 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:33 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:33.842+0000 7f62930b0700 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:34.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:33 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:33.783+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:34.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:33 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:33.783+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:34.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:33 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:33.887+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:34.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:33 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:33.887+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:34.241 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:34 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:34.020+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:34.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:34 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:34.130+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:34.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:34 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:34.257+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:34.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:34 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:34.257+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:34.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:34 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:34.598+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:34.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:34 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:34.598+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:34.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:34 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:34.557+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:34.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:34 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:34.557+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:35.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:34 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:34.827+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:35.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:34 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:34.827+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:35.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:34 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:34.868+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:35.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:34 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:34.868+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:35.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:35 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:35.057+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:35.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:35 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:35.283+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:35.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:35 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:35.283+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:35.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:35 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:35.119+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:35.967 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:35 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:35.785+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:35.967 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:35 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:35.785+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:35.967 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:35 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:35.915+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:35.967 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:35 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:35.915+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:35.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:35 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:35.641+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:35.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:35 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:35.641+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:35.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:35 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:35.560+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:35.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:35 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:35.560+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:36.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:36.082+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:36.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:36.082+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:36.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:36 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:36.109+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:36.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:36 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:36.290+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:36.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:36 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:36.290+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:36.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:36 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:36.290+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:36.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:36.609+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:36.991 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:36.609+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:36.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:36.594+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:36.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:36 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:36.594+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:37.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:36 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:36.782+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:37.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:36 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:36.782+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:37.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:36 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:36.894+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:37.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:36 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:36.894+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:37.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:37.044+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:37.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:37.044+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:37.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:37 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:37.107+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:37.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:37 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:37.317+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:37.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:37 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:37.317+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:37.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:37 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:37.317+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:37.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:37.577+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:37.993 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:37.577+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:37.993 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:37.593+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:37.993 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:37.593+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:37.993 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:37 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:37.593+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:38.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:37 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:37.798+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:38.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:37 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:37.798+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:38.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:37 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:37.899+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:38.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:37 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:37.899+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:38.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:38.014+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:38.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:38.014+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:38.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:38.146+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:38.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:38.146+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:38.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:38.284+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:38.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:38.284+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:38.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:38 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:38.284+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:38.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:38.541+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:55.583229+0000 front 2024-02-14T13:11:55.583400+0000 (oldest deadline 2024-02-14T13:12:21.483198+0000) 2024-02-14T13:12:38.992 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5[48657]: 2024-02-14T13:12:38.541+0000 7f628bea4700 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.483857+0000 front 2024-02-14T13:12:01.483891+0000 (oldest deadline 2024-02-14T13:12:27.884665+0000) 2024-02-14T13:12:38.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:38.559+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:38.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:38.559+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:38.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:38 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:38.559+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:39.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:38.842+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:39.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:38.842+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:39.218 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:38.842+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:39.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:38.909+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:39.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:38.909+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:39.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:38 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:38.909+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:39.296 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:39 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:39.026+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:39.296 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:39 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:39.026+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:39.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:39 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:39.143+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:39.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:39 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:39.143+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:39.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:39 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:39.270+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:39.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:39 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:39.270+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:39.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:39 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:39.270+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:39.565 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:39 smithi103 podman[70412]: 2024-02-14 13:12:39.295516534 +0000 UTC m=+5.558580907 container died e2cc7d9ea2253fa9a9ca724dc2583423cb5b22e6973590a38493b4aa71c92ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS) 2024-02-14T13:12:39.819 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:39 smithi103 podman[70412]: 2024-02-14 13:12:39.566736194 +0000 UTC m=+5.829800564 container cleanup e2cc7d9ea2253fa9a9ca724dc2583423cb5b22e6973590a38493b4aa71c92ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:39.819 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:39 smithi103 bash[70412]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5 2024-02-14T13:12:39.819 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:39 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:39.563+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:39.819 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:39 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:39.563+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:39.819 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:39 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:39.563+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:40.116 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:39 smithi103 podman[70428]: 2024-02-14 13:12:39.8182236 +0000 UTC m=+0.523612849 container remove e2cc7d9ea2253fa9a9ca724dc2583423cb5b22e6973590a38493b4aa71c92ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:40.116 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:40 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:40.048+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:40.116 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:40 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:40.048+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:40.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:39.880+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:40.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:39.880+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:40.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:39.880+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:40.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:39.908+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:40.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:39.908+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:40.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:39 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:39.908+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:40.389 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:40 smithi103 podman[70521]: 2024-02-14 13:12:40.018026728 +0000 UTC m=+0.017613288 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:40.390 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:40 smithi103 podman[70521]: 2024-02-14 13:12:40.144158788 +0000 UTC m=+0.143745330 container create 81b7fea1729a6f47b05e6a3f80e75e1875b89f0c74e54c56a41acd051ea9a944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5-deactivate, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-14T13:12:40.390 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:40 smithi103 podman[70521]: 2024-02-14 13:12:40.388616708 +0000 UTC m=+0.388203257 container init 81b7fea1729a6f47b05e6a3f80e75e1875b89f0c74e54c56a41acd051ea9a944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2) 2024-02-14T13:12:40.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:40 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:40.191+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:40.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:40 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:40.191+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:40.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:40 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:40.231+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:40.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:40 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:40.231+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:40.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:40 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:40.231+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:40.681 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:40 smithi103 podman[70521]: 2024-02-14 13:12:40.392623336 +0000 UTC m=+0.392209874 container start 81b7fea1729a6f47b05e6a3f80e75e1875b89f0c74e54c56a41acd051ea9a944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2) 2024-02-14T13:12:40.681 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:40 smithi103 podman[70521]: 2024-02-14 13:12:40.454834947 +0000 UTC m=+0.454421502 container attach 81b7fea1729a6f47b05e6a3f80e75e1875b89f0c74e54c56a41acd051ea9a944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:12:40.681 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:40 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:40.524+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:40.681 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:40 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:40.524+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:40.681 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:40 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:40.524+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:40.967 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:40 smithi103 podman[70521]: 2024-02-14 13:12:40.67946796 +0000 UTC m=+0.679054504 container died 81b7fea1729a6f47b05e6a3f80e75e1875b89f0c74e54c56a41acd051ea9a944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, io.buildah.version=1.33.2) 2024-02-14T13:12:41.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.5.service' 2024-02-14T13:12:41.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:40.907+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:41.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:40.907+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:41.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:40.908+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:41.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:40.868+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:41.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:40.868+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:41.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:40.868+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:41.229 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:41 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:41.077+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:41.230 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:41 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:41.077+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:41.230 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:41 smithi103 podman[70547]: 2024-02-14 13:12:41.183299861 +0000 UTC m=+0.494122805 container remove 81b7fea1729a6f47b05e6a3f80e75e1875b89f0c74e54c56a41acd051ea9a944 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:12:41.230 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:41 smithi103 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-14T13:12:41.230 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:41 smithi103 systemd[1]: Stopped Ceph osd.5 for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:12:41.230 INFO:journalctl@ceph.osd.5.smithi103.stdout:Feb 14 13:12:41 smithi103 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.5.service: Consumed 25.158s CPU time. 2024-02-14T13:12:41.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:41.244 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-14T13:12:41.244 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-14T13:12:41.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.6 2024-02-14T13:12:41.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:41 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:41.165+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:41.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:41 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:41.165+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:41.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:41 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:41.196+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:41.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:41 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:41.196+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:41.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:41 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:41.196+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:41.571 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 systemd[1]: Stopping Ceph osd.6 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:41.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:41.569+0000 7fd11d638700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:41.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:41.569+0000 7fd11d638700 -1 osd.6 94 *** Got signal Terminated *** 2024-02-14T13:12:41.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:41.569+0000 7fd11d638700 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:41.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:41.839+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:41.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:41.839+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:41.841 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:41.839+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:41.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:41 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:41.537+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:41.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:41 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:41.537+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:41.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:41 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:41.537+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:42.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:41.875+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:42.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:41.875+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:42.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:41 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:41.875+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:42.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:42.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:42.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:42.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:42.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:42 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:42.165+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:42.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:42 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:42.165+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:42.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:42 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:42.165+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:42.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:42 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:42.167+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:42.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:42 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:42.167+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:42.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:42.553+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:42.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:42.553+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:42.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:42 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:42.553+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:43.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:42.803+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:43.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:42.803+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:43.218 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:42.803+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:43.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:42.908+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:43.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:42.909+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:43.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:42 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:42.909+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:43.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:43 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:43.089+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:43.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:43 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:43.089+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:43.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:43.142+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:43.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:43.142+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:43.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:43.120+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:43.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:43.120+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:43.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:43 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:43.120+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:43.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:43 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:43.583+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:43.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:43 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:43.583+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:43.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:43 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:43.583+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:44.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:43.842+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:44.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:43.842+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:44.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:43.842+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:44.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:43.929+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:44.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:43.929+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:44.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:43.929+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:44.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:43 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:43.929+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:44.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:44 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:44.104+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:44.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:44 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:44.104+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:44.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:44.178+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:44.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:44.178+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:44.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:44.147+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:44.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:44.147+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:44.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:44.147+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:44.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:44.147+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:44.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:44 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:44.562+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:44.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:44 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:44.562+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:44.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:44 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:44.562+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:45.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:44.847+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:45.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:44.847+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:45.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:44.847+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:45.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:44.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:45.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:44.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:45.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:44.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:45.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:44 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:44.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:45.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:45.144+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:45.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:45.144+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:45.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:45.144+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:45.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:45 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:45.219+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:45.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:45 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:45.219+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:45.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:45 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:45.134+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:45.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:45 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:45.134+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:45.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:45 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:45.134+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:45.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:45 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:45.134+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:45.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:45.604+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:45.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:45.604+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:45.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:45 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:45.604+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:46.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:45.885+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:57.723083+0000 front 2024-02-14T13:11:57.723132+0000 (oldest deadline 2024-02-14T13:12:20.023313+0000) 2024-02-14T13:12:46.217 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:45.885+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:03.524519+0000 front 2024-02-14T13:12:03.524558+0000 (oldest deadline 2024-02-14T13:12:28.824521+0000) 2024-02-14T13:12:46.218 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:45.885+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.525948+0000 front 2024-02-14T13:12:13.526079+0000 (oldest deadline 2024-02-14T13:12:38.825971+0000) 2024-02-14T13:12:46.218 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6[60635]: 2024-02-14T13:12:45.885+0000 7fd11642c700 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:22.827639+0000 front 2024-02-14T13:12:22.827606+0000 (oldest deadline 2024-02-14T13:12:45.127722+0000) 2024-02-14T13:12:46.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:45.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:46.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:45.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:46.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:45.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:46.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:45 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:45.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:46.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:46 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:46.109+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:46.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:46 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:46.109+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:46.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:46 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:46.109+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:46.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:46.154+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:46.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:46.154+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:46.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:46.154+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:46.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:46.154+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:46.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:46.267+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:46.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:46.267+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:46.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:46 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:46.267+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:46.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:46 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:46.605+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:46.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:46 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:46.605+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:46.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:46 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:46.605+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:47.305 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:47 smithi012 podman[87616]: 2024-02-14 13:12:47.022782783 +0000 UTC m=+5.576017599 container died 30d444498c9667a98bea1d42be6084c9e269a25f902cfef0adb15aabca0e65fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-14T13:12:47.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:46.983+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:47.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:46.983+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:47.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:46.983+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:47.306 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:46 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:46.983+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:47.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:47 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:47.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:47.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:47 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:47.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:47.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:47 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:47.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:47.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:47.140+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:47.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:47.140+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:47.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:47.140+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:47.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:47.140+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:47.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:47.315+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:47.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:47.315+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:47.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:47.315+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:47.717 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:47 smithi012 podman[87616]: 2024-02-14 13:12:47.47013636 +0000 UTC m=+6.023371175 container cleanup 30d444498c9667a98bea1d42be6084c9e269a25f902cfef0adb15aabca0e65fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:12:47.717 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:47 smithi012 bash[87616]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6 2024-02-14T13:12:47.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:47 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:47.589+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:47.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:47 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:47.589+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:47.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:47 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:47.589+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:48.032 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:47 smithi012 podman[87633]: 2024-02-14 13:12:47.746571854 +0000 UTC m=+0.721986471 container remove 30d444498c9667a98bea1d42be6084c9e269a25f902cfef0adb15aabca0e65fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.license=GPLv2) 2024-02-14T13:12:48.334 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:48 smithi012 podman[87726]: 2024-02-14 13:12:48.088982702 +0000 UTC m=+0.111979879 container create dba1d7c4971abd0619ae45e615f0382a540ffc5c73b2f844b65279c83fd5652d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-14T13:12:48.334 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:48 smithi012 podman[87726]: 2024-02-14 13:12:47.994644781 +0000 UTC m=+0.017641956 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:48.334 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:48.030+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:48.334 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:48.030+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:48.334 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:48.030+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:48.334 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:48 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:48.030+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:48.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:48 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:48.135+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:48.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:48 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:48.135+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:48.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:48 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:48.135+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:48.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:48.304+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:48.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:48.304+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:48.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:48.304+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:48.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:48.131+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:48.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:48.131+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:48.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:48.131+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:48.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:48 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:48.131+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:48.639 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:48 smithi012 podman[87726]: 2024-02-14 13:12:48.332961269 +0000 UTC m=+0.355958444 container init dba1d7c4971abd0619ae45e615f0382a540ffc5c73b2f844b65279c83fd5652d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-14T13:12:48.639 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:48 smithi012 podman[87726]: 2024-02-14 13:12:48.336299841 +0000 UTC m=+0.359297023 container start dba1d7c4971abd0619ae45e615f0382a540ffc5c73b2f844b65279c83fd5652d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-14T13:12:48.639 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:48 smithi012 podman[87726]: 2024-02-14 13:12:48.416292066 +0000 UTC m=+0.439289253 container attach dba1d7c4971abd0619ae45e615f0382a540ffc5c73b2f844b65279c83fd5652d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:12:48.928 INFO:journalctl@ceph.osd.6.smithi012.stdout:Feb 14 13:12:48 smithi012 podman[87726]: 2024-02-14 13:12:48.638278362 +0000 UTC m=+0.661275546 container died dba1d7c4971abd0619ae45e615f0382a540ffc5c73b2f844b65279c83fd5652d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-6-deactivate, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS) 2024-02-14T13:12:48.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:48 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:48.613+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:48.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:48 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:48.613+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:48.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:48 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:48.613+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:49.181 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:49 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:49.044+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:49.181 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:49 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:49.045+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:49.182 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:49 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:49.045+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:49.182 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:49 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:49.045+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:49.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.6.service' 2024-02-14T13:12:49.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:49.244 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-14T13:12:49.244 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-14T13:12:49.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.7 2024-02-14T13:12:49.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:49 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:49.147+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:49.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:49 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:49.147+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:49.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:49 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:49.147+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:49.550 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:49.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:49.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:49.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:49.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:49.269+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:49.269+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:49.269+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 systemd[1]: Stopping Ceph osd.7 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:49.548+0000 7f001bed3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:49.548+0000 7f001bed3700 -1 osd.7 94 *** Got signal Terminated *** 2024-02-14T13:12:49.551 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:49 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:49.548+0000 7f001bed3700 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:49.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:49 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:49.631+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:49.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:49 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:49.631+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:49.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:49 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:49.631+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:50.369 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:50 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:50.019+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:50.369 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:50 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:50.019+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:50.369 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:50 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:50.019+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:50.369 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:50 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:50.019+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:50.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:50 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:50.188+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:50.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:50 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:50.188+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:50.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:50 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:50.188+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:50.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:50.282+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:50.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:50.282+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:50.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:50.282+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:50.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:50.101+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:50.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:50.101+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:50.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:50.101+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:50.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:50.101+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:50.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:50 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:50.586+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:50.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:50 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:50.586+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:50.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:50 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:50.586+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:51.385 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:51 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:51.010+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:51.385 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:51 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:51.010+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:51.385 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:51 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:51.010+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:51.385 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:51 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:51.010+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:51.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:51.196+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:51.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:51.196+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:51.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:51.196+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:51.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:51.285+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:51.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:51.285+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:51.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:51.285+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:51.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:51.082+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:51.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:51.082+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:51.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:51.082+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:51.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:51 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:51.082+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:51.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:51.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:51.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:51.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:51.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:51 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:51.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:52.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:52.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:52.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:52.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:52.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:52 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:52.166+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:52.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:52 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:52.166+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:52.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:52 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:52.166+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:52.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:52.281+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:52.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:52.281+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:52.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:52.281+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:52.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:52.092+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:52.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:52.092+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:52.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:52.092+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:52.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:52 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:52.092+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:52.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:52 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:52.571+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:52.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:52 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:52.571+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:52.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:52 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:52.571+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:53.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.992+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:53.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.992+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:53.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.992+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:53.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.992+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:53.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:52 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:52.992+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:53.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:53.138+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:53.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:53.138+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:53.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:53.138+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:53.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:53.138+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:53.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:53.234+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:53.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:53.234+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:53.234+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:53.234+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:26.675628+0000 front 2024-02-14T13:12:26.675660+0000 (oldest deadline 2024-02-14T13:12:52.575745+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:53.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:53.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:53.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:53.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:53.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:53 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:53.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:53.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:53.551+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:53.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:53.551+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:53.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:53.551+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:53.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:53 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:53.551+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:12:54.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.012+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:54.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.012+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:54.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.012+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:54.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.012+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:54.468 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.012+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:54.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:54.167+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:54.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:54.167+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:54.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:54.167+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:54.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:54.167+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:54.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:54.189+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.071857+0000 front 2024-02-14T13:12:05.071820+0000 (oldest deadline 2024-02-14T13:12:29.172036+0000) 2024-02-14T13:12:54.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:54.189+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.873430+0000 front 2024-02-14T13:12:13.873352+0000 (oldest deadline 2024-02-14T13:12:37.373370+0000) 2024-02-14T13:12:54.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:54.189+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:20.874662+0000 front 2024-02-14T13:12:20.874706+0000 (oldest deadline 2024-02-14T13:12:45.574803+0000) 2024-02-14T13:12:54.560 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7[55137]: 2024-02-14T13:12:54.189+0000 7f0018ccf700 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:26.675628+0000 front 2024-02-14T13:12:26.675660+0000 (oldest deadline 2024-02-14T13:12:52.575745+0000) 2024-02-14T13:12:54.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:54.115+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:54.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:54.115+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:54.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:54.115+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:54.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:54.115+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:54.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:54.115+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:54.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:54.517+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:54.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:54.517+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:54.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:54.517+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:54.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:54 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:54.517+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:12:55.209 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:54 smithi055 podman[70990]: 2024-02-14 13:12:54.920244581 +0000 UTC m=+5.474768362 container died 074dfb9787720c26336b9fbd3ad6cfd52aa7a676c0ae0ea07664c29c10643c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131) 2024-02-14T13:12:55.210 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:55 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:55.152+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:55.210 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:55 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:55.152+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:55.210 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:55 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:55.152+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:55.210 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:55 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:55.152+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:55.210 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:55 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:55.152+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:55.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:55.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:55.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:55.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:55.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:54 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:54.972+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:55.481 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:55.134+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:55.481 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:55.134+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:55.481 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:55.134+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:55.481 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:55.134+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:55.535 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:55 smithi055 podman[70990]: 2024-02-14 13:12:55.299465373 +0000 UTC m=+5.853989145 container cleanup 074dfb9787720c26336b9fbd3ad6cfd52aa7a676c0ae0ea07664c29c10643c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240131) 2024-02-14T13:12:55.535 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:55 smithi055 bash[70990]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7 2024-02-14T13:12:55.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:55.479+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:55.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:55.479+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:55.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:55.479+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:55.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:55 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:55.479+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:12:55.810 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:55 smithi055 podman[71008]: 2024-02-14 13:12:55.533838193 +0000 UTC m=+0.609305784 container remove 074dfb9787720c26336b9fbd3ad6cfd52aa7a676c0ae0ea07664c29c10643c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2) 2024-02-14T13:12:56.129 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:55 smithi055 podman[71098]: 2024-02-14 13:12:55.7644982 +0000 UTC m=+0.018312423 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:12:56.129 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:55 smithi055 podman[71098]: 2024-02-14 13:12:55.901335465 +0000 UTC m=+0.155149678 container create b22af291c60d70f7b9b187a632ba3e297892146b8400c8b42973f3d56d0cdfaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7-deactivate, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:12:56.129 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:56 smithi055 podman[71098]: 2024-02-14 13:12:56.12861892 +0000 UTC m=+0.382433131 container init b22af291c60d70f7b9b187a632ba3e297892146b8400c8b42973f3d56d0cdfaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:56 smithi055 podman[71098]: 2024-02-14 13:12:56.132360011 +0000 UTC m=+0.386174223 container start b22af291c60d70f7b9b187a632ba3e297892146b8400c8b42973f3d56d0cdfaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:56 smithi055 podman[71098]: 2024-02-14 13:12:56.203424561 +0000 UTC m=+0.457238780 container attach b22af291c60d70f7b9b187a632ba3e297892146b8400c8b42973f3d56d0cdfaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:56 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:56.128+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:56 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:56.128+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:56 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:56.128+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:56 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:56.128+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:56.445 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:56 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:56.128+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:56.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:55 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:55.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:56.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:55 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:55.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:56.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:55 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:55.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:56.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:55 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:55.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:56.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:55 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:55.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:56.475 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:56.117+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:56.475 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:56.117+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:56.475 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:56.117+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:56.475 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:56.117+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:56.732 INFO:journalctl@ceph.osd.7.smithi055.stdout:Feb 14 13:12:56 smithi055 podman[71098]: 2024-02-14 13:12:56.443927516 +0000 UTC m=+0.697741737 container died b22af291c60d70f7b9b187a632ba3e297892146b8400c8b42973f3d56d0cdfaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-14T13:12:56.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:56.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:56.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:56.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:56.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:56.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:56.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:56 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:56.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:12:57.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.7.service' 2024-02-14T13:12:57.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:12:57.067 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-14T13:12:57.067 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-02-14T13:12:57.067 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.8 2024-02-14T13:12:57.288 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:57 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:57.096+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:57.288 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:57 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:57.096+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:57.288 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:57 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:57.096+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:57.288 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:57 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:57.096+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:57.288 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:57 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:57.096+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:57.362 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 systemd[1]: Stopping Ceph osd.8 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:12:57.362 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.145+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:57.362 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.145+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:57.362 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.145+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:57.363 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.145+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:57.363 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.360+0000 7fab28a9c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:12:57.363 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.360+0000 7fab28a9c700 -1 osd.8 94 *** Got signal Terminated *** 2024-02-14T13:12:57.363 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:57.360+0000 7fab28a9c700 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:12:57.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:57.038+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:57.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:57.038+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:57.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:57.038+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:57.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:57.038+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:57.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:57 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:57.038+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:57.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:57.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:57.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:57.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:57.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:57.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:57.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:57 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:57.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:12:58.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:58 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:58.035+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:58.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:58 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:58.035+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:58.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:58 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:58.035+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:58.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:58 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:58.035+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:58.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:58 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:58.035+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:58.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:58.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:58.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:58.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:58.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:58.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:58.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:58.096+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:58.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:58 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:58.059+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:58.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:58 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:58.059+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:58.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:58 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:58.059+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:58.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:58 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:58.059+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:58.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:58 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:58.059+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:58.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:58.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:58.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:58.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:58.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:58.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:58.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:58.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:12:59.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:12:59.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:12:59.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:12:59.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:12:59.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.034+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:12:59.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:59.099+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:12:59.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:59.099+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:12:59.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:59.099+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:12:59.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:12:59.099+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:12:59.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:59 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:59.074+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:12:59.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:59 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:59.074+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:12:59.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:59 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:59.074+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:12:59.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:59 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:59.074+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:12:59.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:12:59 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:12:59.074+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:12:59.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:59.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:12:59.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:59.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:12:59.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:59.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:12:59.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:12:59 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:12:59.554+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:00.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:00.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:00.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:00.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:00.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:12:59 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:12:59.988+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:00.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:00.053+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:13:00.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:00.053+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:13:00.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:00.053+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:13:00.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:00.053+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:13:00.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:00 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:00.079+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:00.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:00 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:00.079+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:00.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:00 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:00.079+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:00.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:00 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:00.079+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:00.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:00 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:00.079+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:00.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:00 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:00.079+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:00.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:00.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:00.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:00.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:00.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:00.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:00.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:00 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:00.531+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:01.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:00 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:00.946+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:01.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:00 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:00.946+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:01.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:00 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:00.946+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:01.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:00 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:00.946+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:01.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:00 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:00.946+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:01.462 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:01.068+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:01.462 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:01.068+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:01.462 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:01.068+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:01.462 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:01.068+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:01.462 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:01.068+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:01.462 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:01 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:01.068+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:01.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:01.038+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:13:01.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:01.038+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:13:01.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:01.038+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:13:01.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:01.038+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:13:01.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:01.527+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:01.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:01.527+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:01.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:01.527+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:01.992 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:01 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:01.527+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:02.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:02.032+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:02.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:02.032+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:02.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:02.032+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:02.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:02.032+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:02.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:02.032+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:02.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:02 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:02.032+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:02.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:01 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:01.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:02.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:01 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:01.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:02.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:01 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:01.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:02.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:01 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:01.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:02.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:01 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:01.990+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:02.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:02.062+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:04.841979+0000 front 2024-02-14T13:12:04.841952+0000 (oldest deadline 2024-02-14T13:12:28.341883+0000) 2024-02-14T13:13:02.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:02.062+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:13.444445+0000 front 2024-02-14T13:12:13.444479+0000 (oldest deadline 2024-02-14T13:12:35.744693+0000) 2024-02-14T13:13:02.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:02.062+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:19.146408+0000 front 2024-02-14T13:12:19.146453+0000 (oldest deadline 2024-02-14T13:12:44.446563+0000) 2024-02-14T13:13:02.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:02.062+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.947839+0000 front 2024-02-14T13:12:27.947741+0000 (oldest deadline 2024-02-14T13:12:52.647667+0000) 2024-02-14T13:13:02.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8[55715]: 2024-02-14T13:13:02.062+0000 7fab25898700 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.548643+0000 front 2024-02-14T13:12:38.548622+0000 (oldest deadline 2024-02-14T13:13:02.048777+0000) 2024-02-14T13:13:02.884 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:02.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:02.884 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:02.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:02.884 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:02.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:02.884 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:02 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:02.501+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:03.146 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:02 smithi103 podman[70625]: 2024-02-14 13:13:02.882948546 +0000 UTC m=+5.623948284 container died 62b348cb3bf48a425d5e97926d548fe5c71e8013d1c23baf96e98436969b9b29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-14T13:13:03.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:02.959+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:03.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:02.959+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:03.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:02.959+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:03.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:02.959+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:03.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:02 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:02.959+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:03.491 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:03 smithi103 podman[70625]: 2024-02-14 13:13:03.243890297 +0000 UTC m=+5.984890024 container cleanup 62b348cb3bf48a425d5e97926d548fe5c71e8013d1c23baf96e98436969b9b29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, ceph=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-14T13:13:03.492 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:03 smithi103 bash[70625]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8 2024-02-14T13:13:03.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:03.065+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:03.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:03.065+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:03.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:03.065+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:03.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:03.065+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:03.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:03.065+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:03.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:03 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:03.065+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:03.858 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:03 smithi103 podman[70643]: 2024-02-14 13:13:03.51353379 +0000 UTC m=+0.626445906 container remove 62b348cb3bf48a425d5e97926d548fe5c71e8013d1c23baf96e98436969b9b29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0) 2024-02-14T13:13:03.858 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:03.507+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:03.858 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:03.507+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:03.859 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:03.507+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:03.859 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:03.507+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:04.157 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:03 smithi103 podman[70733]: 2024-02-14 13:13:03.760287449 +0000 UTC m=+0.017655242 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:13:04.157 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:03 smithi103 podman[70733]: 2024-02-14 13:13:03.870869571 +0000 UTC m=+0.128237382 container create 1a98112819d348e8aedbc69a88f8e463c061f84c40d05cabc0ef7908d3124848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8-deactivate, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.build-date=20240131) 2024-02-14T13:13:04.157 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:04 smithi103 podman[70733]: 2024-02-14 13:13:04.073229399 +0000 UTC m=+0.330597201 container init 1a98112819d348e8aedbc69a88f8e463c061f84c40d05cabc0ef7908d3124848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240131) 2024-02-14T13:13:04.157 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:04 smithi103 podman[70733]: 2024-02-14 13:13:04.07643088 +0000 UTC m=+0.333798664 container start 1a98112819d348e8aedbc69a88f8e463c061f84c40d05cabc0ef7908d3124848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:13:04.157 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:04 smithi103 podman[70733]: 2024-02-14 13:13:04.156339038 +0000 UTC m=+0.413706841 container attach 1a98112819d348e8aedbc69a88f8e463c061f84c40d05cabc0ef7908d3124848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:13:04.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:03.922+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:04.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:03.922+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:04.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:03.922+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:04.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:03.922+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:04.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:03.922+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:04.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:03 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:03.922+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:04.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:04.042+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:04.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:04.042+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:04.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:04.042+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:04.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:04.042+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:04.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:04.042+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:04.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:04 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:04.042+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:04.470 INFO:journalctl@ceph.osd.8.smithi103.stdout:Feb 14 13:13:04 smithi103 podman[70733]: 2024-02-14 13:13:04.365527945 +0000 UTC m=+0.622895745 container died 1a98112819d348e8aedbc69a88f8e463c061f84c40d05cabc0ef7908d3124848 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-14T13:13:04.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:04.468+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:04.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:04.468+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:04.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:04.468+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:04.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:04 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:04.468+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:05.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.8.service' 2024-02-14T13:13:05.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:05.045 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-02-14T13:13:05.045 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-02-14T13:13:05.046 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.9 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:04.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:04.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:04.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:04.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:04.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:04 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:04.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:05.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 systemd[1]: Stopping Ceph osd.9 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:05.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:05.048+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:05.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:05.048+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:05.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:05.048+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:05.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:05.048+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:05.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:05.048+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:05.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:05 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:05.048+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:05.717 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.345+0000 7f3325f17700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:05.717 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.345+0000 7f3325f17700 -1 osd.9 94 *** Got signal Terminated *** 2024-02-14T13:13:05.717 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.345+0000 7f3325f17700 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:13:05.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:05 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:05.494+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:05.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:05 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:05.494+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:05.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:05 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:05.494+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:05.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:05 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:05.494+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:05.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:05 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:05.494+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:06.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:06.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:06.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:06.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:06.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:06.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:05 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:05.881+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:06.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:06.073+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:06.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:06.073+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:06.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:06.073+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:06.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:06.073+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:06.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:06.073+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:06.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:06 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:06.073+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:06.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:06 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:06.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:06.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:06 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:06.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:06.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:06 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:06.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:06.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:06 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:06.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:06.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:06 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:06.473+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:07.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:06.855+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:07.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:06.855+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:07.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:06.855+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:07.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:06.855+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:07.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:06.855+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:07.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:06 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:06.855+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:07.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:07.034+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:07.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:07.034+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:07.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:07.034+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:07.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:07.034+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:07.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:07.034+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:07.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:07 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:07.034+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:07.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:07 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:07.463+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:07.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:07 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:07.463+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:07.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:07 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:07.463+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:07.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:07 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:07.463+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:07.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:07 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:07.463+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:08.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:07.874+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:08.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:07.874+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:08.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:07.874+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:08.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:07.874+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:08.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:07.874+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:08.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:07 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:07.874+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:08.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.069+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:08.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.069+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:08.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.069+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:08.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.070+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:08.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.070+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:08.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.070+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:08.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:08 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:08.070+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:08.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:08.422+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:08.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:08.422+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:08.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:08.422+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:08.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:08.422+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:08.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:08.422+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:09.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:08.834+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:09.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:08.834+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:09.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:08.834+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:09.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:08.834+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:09.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:08.834+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:09.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:08 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:08.834+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:09.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:09.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:09.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:09.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:09.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:09.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:09.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:09 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:09.117+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:09.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:09.466+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:09.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:09.466+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:09.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:09.466+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:09.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:09.466+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:09.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:09.466+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:09.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:09 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:09.466+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:10.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:56.053999+0000 front 2024-02-14T13:11:56.053933+0000 (oldest deadline 2024-02-14T13:12:21.854666+0000) 2024-02-14T13:13:10.217 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:01.855100+0000 front 2024-02-14T13:12:01.855050+0000 (oldest deadline 2024-02-14T13:12:33.055641+0000) 2024-02-14T13:13:10.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.156985+0000 front 2024-02-14T13:12:14.157061+0000 (oldest deadline 2024-02-14T13:12:38.256974+0000) 2024-02-14T13:13:10.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.257341+0000 front 2024-02-14T13:12:18.257417+0000 (oldest deadline 2024-02-14T13:12:43.557514+0000) 2024-02-14T13:13:10.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:29.359249+0000 front 2024-02-14T13:12:29.359198+0000 (oldest deadline 2024-02-14T13:12:52.859174+0000) 2024-02-14T13:13:10.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:34.560405+0000 front 2024-02-14T13:12:34.560430+0000 (oldest deadline 2024-02-14T13:13:03.360747+0000) 2024-02-14T13:13:10.218 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:09 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9[67272]: 2024-02-14T13:13:09.850+0000 7f3322d13700 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.061742+0000 front 2024-02-14T13:12:45.061764+0000 (oldest deadline 2024-02-14T13:13:09.761811+0000) 2024-02-14T13:13:10.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:10.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:10.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:10.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:10.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:10.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:10.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:10 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:10.158+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:10.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:10 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:10.483+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:10.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:10 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:10.483+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:10.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:10 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:10.483+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:10.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:10 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:10.483+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:10.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:10 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:10.483+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:10.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:10 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:10.483+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:11.131 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:10 smithi012 podman[87844]: 2024-02-14 13:13:10.859271887 +0000 UTC m=+5.608120030 container died 9006916e4128e356f66f0f4e3f399f337b0e5ed28746973219df94dfc88b588b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-14T13:13:11.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:11 smithi012 podman[87844]: 2024-02-14 13:13:11.303704714 +0000 UTC m=+6.052552862 container cleanup 9006916e4128e356f66f0f4e3f399f337b0e5ed28746973219df94dfc88b588b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-14T13:13:11.467 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:11 smithi012 bash[87844]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9 2024-02-14T13:13:11.515 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:11.515 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:11.515 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:11.515 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:11.516 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:11.516 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:11.516 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:11 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:11.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:11.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:11.448+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:11.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:11.448+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:11.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:11.448+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:11.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:11.448+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:11.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:11.448+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:11.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:11.448+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:11.915 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:11 smithi012 podman[87861]: 2024-02-14 13:13:11.480036418 +0000 UTC m=+0.615985542 container remove 9006916e4128e356f66f0f4e3f399f337b0e5ed28746973219df94dfc88b588b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:13:12.209 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:11 smithi012 podman[87954]: 2024-02-14 13:13:11.914252483 +0000 UTC m=+0.114700025 container create cb8d609a5afc60bcd35987b36a7834bd33e1216be2bbd51d1349d90c8694b082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-14T13:13:12.209 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:11 smithi012 podman[87954]: 2024-02-14 13:13:11.818581663 +0000 UTC m=+0.019029220 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:13:12.209 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:12 smithi012 podman[87954]: 2024-02-14 13:13:12.133428338 +0000 UTC m=+0.333875893 container init cb8d609a5afc60bcd35987b36a7834bd33e1216be2bbd51d1349d90c8694b082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-14T13:13:12.209 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:12 smithi012 podman[87954]: 2024-02-14 13:13:12.136780497 +0000 UTC m=+0.337228040 container start cb8d609a5afc60bcd35987b36a7834bd33e1216be2bbd51d1349d90c8694b082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True) 2024-02-14T13:13:12.209 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:12 smithi012 podman[87954]: 2024-02-14 13:13:12.208284632 +0000 UTC m=+0.408732184 container attach cb8d609a5afc60bcd35987b36a7834bd33e1216be2bbd51d1349d90c8694b082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:13:12.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:12.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:12.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:12.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:12.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:12.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:12.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:12 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:12.113+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:12.717 INFO:journalctl@ceph.osd.9.smithi012.stdout:Feb 14 13:13:12 smithi012 podman[87980]: 2024-02-14 13:13:12.463369945 +0000 UTC m=+0.018283440 container died cb8d609a5afc60bcd35987b36a7834bd33e1216be2bbd51d1349d90c8694b082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2) 2024-02-14T13:13:12.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:12 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:12.433+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:12.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:12 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:12.433+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:12.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:12 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:12.433+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:12.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:12 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:12.433+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:12.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:12 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:12.433+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:12.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:12 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:12.433+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:12.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.9.service' 2024-02-14T13:13:13.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:13.010 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-02-14T13:13:13.010 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-02-14T13:13:13.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.10 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 systemd[1]: Stopping Ceph osd.10 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:13.311 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:13.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:13 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:13.450+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:13.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:13 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:13.450+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:13.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:13 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:13.450+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:13.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:13 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:13.450+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:13.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:13 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:13.450+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:13.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:13 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:13.450+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:13.811 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.334+0000 7f739fa1a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:13.811 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.334+0000 7f739fa1a700 -1 osd.10 94 *** Got signal Terminated *** 2024-02-14T13:13:13.811 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:13 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:13.334+0000 7f739fa1a700 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:13:14.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:14.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:14.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:14.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:14.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:14.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:14.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:14 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:14.132+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:14.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:14.439+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:14.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:14.439+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:14.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:14.439+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:14.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:14.439+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:14.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:14.439+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:14.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:14 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:14.439+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:15.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:15.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:15.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:15.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:15.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:15.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:15.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:15 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:15.127+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:15.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:15.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:15.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:15.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:15.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:15.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:15.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:15 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:15.402+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:16.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:16.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:16.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:16.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:16.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:16.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:16.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:16 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:16.100+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:16.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:16.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:16.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:16.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:16.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:16.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:16.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:16 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:16.415+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:17.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:17.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:17.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:17.560 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:17.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:17.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:17.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:17 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:17.093+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:17.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:17.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:17.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:17.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:17.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:17.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:17.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:17 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:17.369+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.495542+0000 front 2024-02-14T13:11:58.495727+0000 (oldest deadline 2024-02-14T13:12:19.595658+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.496841+0000 front 2024-02-14T13:12:05.496865+0000 (oldest deadline 2024-02-14T13:12:31.397059+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:11.397852+0000 front 2024-02-14T13:12:11.397756+0000 (oldest deadline 2024-02-14T13:12:36.097840+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-02-14T13:12:18.398750+0000 front 2024-02-14T13:12:18.398861+0000 (oldest deadline 2024-02-14T13:12:43.698740+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:30.600530+0000 front 2024-02-14T13:12:30.600592+0000 (oldest deadline 2024-02-14T13:12:52.900682+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.201789+0000 front 2024-02-14T13:12:38.201771+0000 (oldest deadline 2024-02-14T13:12:59.901629+0000) 2024-02-14T13:13:18.561 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10[62253]: 2024-02-14T13:13:18.099+0000 7f739c816700 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.003760+0000 front 2024-02-14T13:12:45.003883+0000 (oldest deadline 2024-02-14T13:13:07.204005+0000) 2024-02-14T13:13:18.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:18.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:18.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:18.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:18.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:18.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:18.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:18 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:18.322+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:18.987 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:18 smithi055 podman[71217]: 2024-02-14 13:13:18.702199001 +0000 UTC m=+5.481524489 container died e0650ae78cda60c00fd00483c6c2382f3f458d31d02b8b9a9b188e8102755904 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131) 2024-02-14T13:13:19.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71217]: 2024-02-14 13:13:19.084222474 +0000 UTC m=+5.863547940 container cleanup e0650ae78cda60c00fd00483c6c2382f3f458d31d02b8b9a9b188e8102755904 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2) 2024-02-14T13:13:19.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 bash[71217]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10 2024-02-14T13:13:19.645 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71236]: 2024-02-14 13:13:19.326696816 +0000 UTC m=+0.616689048 container remove e0650ae78cda60c00fd00483c6c2382f3f458d31d02b8b9a9b188e8102755904 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=) 2024-02-14T13:13:19.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:19.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:19.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:19.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:19.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:19.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:19.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:19 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:19.345+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:19.939 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71324]: 2024-02-14 13:13:19.644534365 +0000 UTC m=+0.106144210 container create af757619db906ed79e3370893a94c92d41070ce6214c737c5ff7363c86a81650 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-14T13:13:19.939 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71324]: 2024-02-14 13:13:19.5566973 +0000 UTC m=+0.018307108 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:13:19.939 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71324]: 2024-02-14 13:13:19.86336644 +0000 UTC m=+0.324976243 container init af757619db906ed79e3370893a94c92d41070ce6214c737c5ff7363c86a81650 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-14T13:13:19.939 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71324]: 2024-02-14 13:13:19.866601295 +0000 UTC m=+0.328211098 container start af757619db906ed79e3370893a94c92d41070ce6214c737c5ff7363c86a81650 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:13:19.939 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:19 smithi055 podman[71324]: 2024-02-14 13:13:19.938178219 +0000 UTC m=+0.399788037 container attach af757619db906ed79e3370893a94c92d41070ce6214c737c5ff7363c86a81650 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-02-14T13:13:20.310 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:20 smithi055 podman[71324]: 2024-02-14 13:13:20.169636778 +0000 UTC m=+0.631246581 container died af757619db906ed79e3370893a94c92d41070ce6214c737c5ff7363c86a81650 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-02-14T13:13:20.726 INFO:journalctl@ceph.osd.10.smithi055.stdout:Feb 14 13:13:20 smithi055 podman[71350]: 2024-02-14 13:13:20.707888193 +0000 UTC m=+0.533180357 container remove af757619db906ed79e3370893a94c92d41070ce6214c737c5ff7363c86a81650 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-10-deactivate, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True) 2024-02-14T13:13:20.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.10.service' 2024-02-14T13:13:20.741 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:20.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:20.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:20.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:20.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:20.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:20.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:20.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:20.779 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:20.779 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-02-14T13:13:20.779 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-02-14T13:13:20.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.11 2024-02-14T13:13:21.081 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:20 smithi103 systemd[1]: Stopping Ceph osd.11 for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:21.491 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.079+0000 7f1c83c63700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.079+0000 7f1c83c63700 -1 osd.11 94 *** Got signal Terminated *** 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.079+0000 7f1c83c63700 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:21.492 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:21 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:21.327+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:22.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:22 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:22.360+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:23.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:23 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:23.337+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:24.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:24 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:24.338+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-02-14T13:11:58.556263+0000 front 2024-02-14T13:11:58.556389+0000 (oldest deadline 2024-02-14T13:12:19.656263+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6804 osd.1 since back 2024-02-14T13:12:05.358712+0000 front 2024-02-14T13:12:05.358777+0000 (oldest deadline 2024-02-14T13:12:30.658646+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6804 osd.2 since back 2024-02-14T13:12:14.759541+0000 front 2024-02-14T13:12:14.759579+0000 (oldest deadline 2024-02-14T13:12:37.059739+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6812 osd.4 since back 2024-02-14T13:12:27.561686+0000 front 2024-02-14T13:12:27.561891+0000 (oldest deadline 2024-02-14T13:12:53.461698+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.103:6812 osd.5 since back 2024-02-14T13:12:38.762585+0000 front 2024-02-14T13:12:38.762604+0000 (oldest deadline 2024-02-14T13:13:04.662649+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-02-14T13:12:45.163549+0000 front 2024-02-14T13:12:45.163522+0000 (oldest deadline 2024-02-14T13:13:08.663428+0000) 2024-02-14T13:13:25.742 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:25 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11[62367]: 2024-02-14T13:13:25.311+0000 7f1c7ca57700 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.55:6820 osd.7 since back 2024-02-14T13:12:52.665015+0000 front 2024-02-14T13:12:52.664989+0000 (oldest deadline 2024-02-14T13:13:14.964869+0000) 2024-02-14T13:13:26.846 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:26 smithi103 podman[70850]: 2024-02-14 13:13:26.577517964 +0000 UTC m=+5.607374975 container died 7631a49f8f22eea1a1d31fc4a21d02d57052be55cc7e68c36b468f4bf659dd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-14T13:13:26.846 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:26 smithi103 podman[70850]: 2024-02-14 13:13:26.845331153 +0000 UTC m=+5.875188134 container cleanup 7631a49f8f22eea1a1d31fc4a21d02d57052be55cc7e68c36b468f4bf659dd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-14T13:13:27.241 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:26 smithi103 bash[70850]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11 2024-02-14T13:13:27.241 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70867]: 2024-02-14 13:13:27.046617391 +0000 UTC m=+0.459036341 container remove 7631a49f8f22eea1a1d31fc4a21d02d57052be55cc7e68c36b468f4bf659dd7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-14T13:13:27.667 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70955]: 2024-02-14 13:13:27.26158446 +0000 UTC m=+0.017729778 image pull 87bb2d90c3bfdbfc7753e96fe432d72f52eead7ee57204154cc1e27e7313fa90 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836 2024-02-14T13:13:27.668 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70955]: 2024-02-14 13:13:27.37247995 +0000 UTC m=+0.128625274 container create fecbfb097005e15faf8e93585109be03579bd3c00b806e4e926eb0d02cb6be90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-14T13:13:27.668 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70955]: 2024-02-14 13:13:27.591372091 +0000 UTC m=+0.347517401 container init fecbfb097005e15faf8e93585109be03579bd3c00b806e4e926eb0d02cb6be90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11-deactivate, org.label-schema.build-date=20240131, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-14T13:13:27.668 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70955]: 2024-02-14 13:13:27.594606743 +0000 UTC m=+0.350752050 container start fecbfb097005e15faf8e93585109be03579bd3c00b806e4e926eb0d02cb6be90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11-deactivate, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, ceph=True, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:13:27.668 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70955]: 2024-02-14 13:13:27.6661545 +0000 UTC m=+0.422299830 container attach fecbfb097005e15faf8e93585109be03579bd3c00b806e4e926eb0d02cb6be90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11-deactivate, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-14T13:13:27.991 INFO:journalctl@ceph.osd.11.smithi103.stdout:Feb 14 13:13:27 smithi103 podman[70955]: 2024-02-14 13:13:27.884304507 +0000 UTC m=+0.640449813 container died fecbfb097005e15faf8e93585109be03579bd3c00b806e4e926eb0d02cb6be90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-osd-11-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=) 2024-02-14T13:13:28.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@osd.11.service' 2024-02-14T13:13:28.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:28.498 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-02-14T13:13:28.498 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-02-14T13:13:28.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.a 2024-02-14T13:13:28.797 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:13:28 smithi012 systemd[1]: Stopping Ceph mds.a for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:29.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:13:28 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a[74275]: 2024-02-14T13:13:28.795+0000 7f28c9ef1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:29.217 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:13:28 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a[74275]: 2024-02-14T13:13:28.795+0000 7f28c9ef1700 -1 mds.a *** got signal Terminated *** 2024-02-14T13:13:30.106 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:13:29 smithi012 podman[88076]: 2024-02-14 13:13:29.840951346 +0000 UTC m=+1.145063203 container died f898943ab558fd97ffa12258f031ccd84c4c35f1487adbfd8d5f246a6b4636fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-14T13:13:30.448 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:13:30 smithi012 podman[88076]: 2024-02-14 13:13:30.246088914 +0000 UTC m=+1.550200770 container cleanup f898943ab558fd97ffa12258f031ccd84c4c35f1487adbfd8d5f246a6b4636fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-14T13:13:30.449 INFO:journalctl@ceph.mds.a.smithi012.stdout:Feb 14 13:13:30 smithi012 bash[88076]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-a 2024-02-14T13:13:30.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.a.service' 2024-02-14T13:13:30.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:30.620 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-02-14T13:13:30.620 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-02-14T13:13:30.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.d 2024-02-14T13:13:30.959 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:30 smithi012 systemd[1]: Stopping Ceph mds.d for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:31.217 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:30 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d[73319]: 2024-02-14T13:13:30.957+0000 7fd99745e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:31.217 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:30 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d[73319]: 2024-02-14T13:13:30.957+0000 7fd99745e700 -1 mds.d *** got signal Terminated *** 2024-02-14T13:13:34.917 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:34 smithi012 podman[88198]: 2024-02-14 13:13:34.650145466 +0000 UTC m=+3.807883908 container died 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131) 2024-02-14T13:13:35.584 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:35 smithi012 podman[88198]: 2024-02-14 13:13:35.224434737 +0000 UTC m=+4.382173185 container cleanup 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:13:35.584 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:35 smithi012 bash[88198]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d 2024-02-14T13:13:35.584 INFO:journalctl@ceph.mds.d.smithi012.stdout:Feb 14 13:13:35 smithi012 podman[88212]: 2024-02-14 13:13:35.46791209 +0000 UTC m=+0.810619023 container remove 442697aca767a25194a26f059ca5c1422c5b10d3e2c066ea7ce9fd4788c5e0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-d, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:13:35.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.d.service' 2024-02-14T13:13:35.635 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:35.636 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-02-14T13:13:35.636 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-02-14T13:13:35.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.g 2024-02-14T13:13:35.947 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:13:35 smithi012 systemd[1]: Stopping Ceph mds.g for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:36.217 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:13:35 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g[73910]: 2024-02-14T13:13:35.945+0000 7fdfd9b2f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:36.217 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:13:35 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g[73910]: 2024-02-14T13:13:35.945+0000 7fdfd9b2f700 -1 mds.g *** got signal Terminated *** 2024-02-14T13:13:39.389 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:13:39 smithi012 podman[88318]: 2024-02-14 13:13:39.012438419 +0000 UTC m=+3.160542098 container died a8d6fda58bb7a39219c4e093419dfd1c71ebcafaa9e72119e7682a26f5043694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:13:39.714 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:13:39 smithi012 podman[88318]: 2024-02-14 13:13:39.545029696 +0000 UTC m=+3.693133386 container cleanup a8d6fda58bb7a39219c4e093419dfd1c71ebcafaa9e72119e7682a26f5043694 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g, GIT_CLEAN=True, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131) 2024-02-14T13:13:39.714 INFO:journalctl@ceph.mds.g.smithi012.stdout:Feb 14 13:13:39 smithi012 bash[88318]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-g 2024-02-14T13:13:39.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.g.service' 2024-02-14T13:13:39.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:39.956 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-02-14T13:13:39.957 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-02-14T13:13:39.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.j 2024-02-14T13:13:40.467 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:40 smithi012 systemd[1]: Stopping Ceph mds.j for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:40.467 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j[72928]: 2024-02-14T13:13:40.265+0000 7fb2474e3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:40.468 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:40 smithi012 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j[72928]: 2024-02-14T13:13:40.265+0000 7fb2474e3700 -1 mds.j *** got signal Terminated *** 2024-02-14T13:13:44.009 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:43 smithi012 podman[88440]: 2024-02-14 13:13:43.755531952 +0000 UTC m=+3.584114536 container died 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:13:44.384 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:44 smithi012 podman[88440]: 2024-02-14 13:13:44.19053805 +0000 UTC m=+4.019120625 container cleanup 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-14T13:13:44.384 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:44 smithi012 bash[88440]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j 2024-02-14T13:13:44.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.j.service' 2024-02-14T13:13:44.642 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:44 smithi012 podman[88454]: 2024-02-14 13:13:44.383341122 +0000 UTC m=+0.619309592 container remove 74ea97825c3ad22526e54b5e08670039b835b1ad5db5f57bd9f096dc00f20581 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-02-14T13:13:44.642 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:44 smithi012 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.j.service: Deactivated successfully. 2024-02-14T13:13:44.642 INFO:journalctl@ceph.mds.j.smithi012.stdout:Feb 14 13:13:44 smithi012 systemd[1]: Stopped Ceph mds.j for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:13:44.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:44.653 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-02-14T13:13:44.653 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-02-14T13:13:44.653 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.b 2024-02-14T13:13:44.943 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:44 smithi055 systemd[1]: Stopping Ceph mds.b for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:45.214 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b[67967]: 2024-02-14T13:13:44.941+0000 7f2ea4e17700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:45.214 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:44 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b[67967]: 2024-02-14T13:13:44.941+0000 7f2ea4e17700 -1 mds.b *** got signal Terminated *** 2024-02-14T13:13:46.486 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:46 smithi055 podman[71429]: 2024-02-14 13:13:46.232864611 +0000 UTC m=+1.383936596 container died 8fab6c33dbaadab5808a2ae0947967f755b2ec55ab91a85b5d878ea5ff32e92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-14T13:13:46.744 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:46 smithi055 podman[71429]: 2024-02-14 13:13:46.566973127 +0000 UTC m=+1.718045154 container cleanup 8fab6c33dbaadab5808a2ae0947967f755b2ec55ab91a85b5d878ea5ff32e92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa) 2024-02-14T13:13:46.744 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:46 smithi055 bash[71429]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b 2024-02-14T13:13:46.994 INFO:journalctl@ceph.mds.b.smithi055.stdout:Feb 14 13:13:46 smithi055 podman[71455]: 2024-02-14 13:13:46.742955506 +0000 UTC m=+0.511904981 container remove 8fab6c33dbaadab5808a2ae0947967f755b2ec55ab91a85b5d878ea5ff32e92f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-b, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240131) 2024-02-14T13:13:46.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.b.service' 2024-02-14T13:13:47.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:47.041 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-02-14T13:13:47.041 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-02-14T13:13:47.042 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.e 2024-02-14T13:13:47.310 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:13:47 smithi055 systemd[1]: Stopping Ceph mds.e for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:47.810 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:13:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e[67347]: 2024-02-14T13:13:47.403+0000 7fb000b33700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:47.810 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:13:47 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e[67347]: 2024-02-14T13:13:47.403+0000 7fb000b33700 -1 mds.e *** got signal Terminated *** 2024-02-14T13:13:49.723 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:13:49 smithi055 podman[71561]: 2024-02-14 13:13:49.45564153 +0000 UTC m=+2.182716793 container died ebb61be33b7c26c4636388bef8e42890f3a5137540424c3d937e660de5221678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD) 2024-02-14T13:13:50.061 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:13:49 smithi055 podman[71561]: 2024-02-14 13:13:49.804070301 +0000 UTC m=+2.531145550 container cleanup ebb61be33b7c26c4636388bef8e42890f3a5137540424c3d937e660de5221678 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.vendor=CentOS) 2024-02-14T13:13:50.061 INFO:journalctl@ceph.mds.e.smithi055.stdout:Feb 14 13:13:49 smithi055 bash[71561]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-e 2024-02-14T13:13:50.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.e.service' 2024-02-14T13:13:50.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:50.322 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-02-14T13:13:50.322 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-02-14T13:13:50.322 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.h 2024-02-14T13:13:50.650 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:50 smithi055 systemd[1]: Stopping Ceph mds.h for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:51.060 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h[67657]: 2024-02-14T13:13:50.648+0000 7f06e8267700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:51.061 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:50 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h[67657]: 2024-02-14T13:13:50.648+0000 7f06e8267700 -1 mds.h *** got signal Terminated *** 2024-02-14T13:13:53.834 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:53 smithi055 podman[71682]: 2024-02-14 13:13:53.57595377 +0000 UTC m=+3.029611741 container died 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-14T13:13:54.109 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:53 smithi055 podman[71682]: 2024-02-14 13:13:53.907609211 +0000 UTC m=+3.361267181 container cleanup 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-14T13:13:54.110 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:53 smithi055 bash[71682]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h 2024-02-14T13:13:54.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.h.service' 2024-02-14T13:13:54.375 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:54 smithi055 podman[71696]: 2024-02-14 13:13:54.108748902 +0000 UTC m=+0.525915685 container remove 9b98252fd188ed2869576f8a804e9ddab675f37e81791fc22080d0fc7421d458 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-h, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-14T13:13:54.376 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:54 smithi055 systemd[1]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.h.service: Deactivated successfully. 2024-02-14T13:13:54.376 INFO:journalctl@ceph.mds.h.smithi055.stdout:Feb 14 13:13:54 smithi055 systemd[1]: Stopped Ceph mds.h for ab42aa14-cb38-11ee-95b9-87774f69a715. 2024-02-14T13:13:54.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:54.388 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-02-14T13:13:54.388 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-02-14T13:13:54.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.k 2024-02-14T13:13:54.695 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:54 smithi055 systemd[1]: Stopping Ceph mds.k for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:55.060 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k[67027]: 2024-02-14T13:13:54.693+0000 7fed7b454700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:55.061 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:54 smithi055 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k[67027]: 2024-02-14T13:13:54.693+0000 7fed7b454700 -1 mds.k *** got signal Terminated *** 2024-02-14T13:13:57.310 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:57 smithi055 podman[71803]: 2024-02-14 13:13:57.01333088 +0000 UTC m=+2.406082695 container died 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131) 2024-02-14T13:13:57.692 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:57 smithi055 podman[71803]: 2024-02-14 13:13:57.328116718 +0000 UTC m=+2.720868525 container cleanup 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_CLEAN=True, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-14T13:13:57.692 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:57 smithi055 bash[71803]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k 2024-02-14T13:13:57.692 INFO:journalctl@ceph.mds.k.smithi055.stdout:Feb 14 13:13:57 smithi055 podman[71818]: 2024-02-14 13:13:57.470551636 +0000 UTC m=+0.447285033 container remove 12e32b172797fe9858545fe81fdae4a1490db87061bdd503f9ca6a113ef5a00f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-k, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-14T13:13:57.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.k.service' 2024-02-14T13:13:57.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:13:57.747 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-02-14T13:13:57.747 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-02-14T13:13:57.747 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.c 2024-02-14T13:13:58.055 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:13:57 smithi103 systemd[1]: Stopping Ceph mds.c for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:13:58.314 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:13:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c[67402]: 2024-02-14T13:13:58.053+0000 7f8fe3f02700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:13:58.314 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:13:58 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c[67402]: 2024-02-14T13:13:58.053+0000 7f8fe3f02700 -1 mds.c *** got signal Terminated *** 2024-02-14T13:14:02.363 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:14:02 smithi103 podman[71059]: 2024-02-14 13:14:02.060421666 +0000 UTC m=+4.115129461 container died 8b7df7fb93322138bdd5dcec5404ab9b5d88dbb24f98312c1e2801c0023cbe30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-14T13:14:02.741 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:14:02 smithi103 podman[71059]: 2024-02-14 13:14:02.527609335 +0000 UTC m=+4.582317123 container cleanup 8b7df7fb93322138bdd5dcec5404ab9b5d88dbb24f98312c1e2801c0023cbe30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, ceph=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-14T13:14:02.741 INFO:journalctl@ceph.mds.c.smithi103.stdout:Feb 14 13:14:02 smithi103 bash[71059]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-c 2024-02-14T13:14:02.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.c.service' 2024-02-14T13:14:02.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:14:02.987 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-02-14T13:14:02.987 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-02-14T13:14:02.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.f 2024-02-14T13:14:03.491 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:03 smithi103 systemd[1]: Stopping Ceph mds.f for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:14:03.492 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f[67092]: 2024-02-14T13:14:03.289+0000 7f84c9523700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:14:03.492 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:03 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f[67092]: 2024-02-14T13:14:03.289+0000 7f84c9523700 -1 mds.f *** got signal Terminated *** 2024-02-14T13:14:07.657 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:07 smithi103 podman[71191]: 2024-02-14 13:14:07.3002179 +0000 UTC m=+4.098149301 container died 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131) 2024-02-14T13:14:07.657 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:07 smithi103 podman[71191]: 2024-02-14 13:14:07.656230364 +0000 UTC m=+4.454161765 container cleanup 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux ) 2024-02-14T13:14:07.991 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:07 smithi103 bash[71191]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f 2024-02-14T13:14:07.992 INFO:journalctl@ceph.mds.f.smithi103.stdout:Feb 14 13:14:07 smithi103 podman[71205]: 2024-02-14 13:14:07.890522127 +0000 UTC m=+0.588279313 container remove 01ae42641540e6ff6f662e6e4a180ca6ddf143f7002dc43c55f5844e7f7efa67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131) 2024-02-14T13:14:08.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.f.service' 2024-02-14T13:14:08.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:14:08.062 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-02-14T13:14:08.062 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-02-14T13:14:08.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.i 2024-02-14T13:14:08.394 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:08 smithi103 systemd[1]: Stopping Ceph mds.i for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:14:08.737 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: 2024-02-14T13:14:08.392+0000 7f9dcc47e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:14:08.737 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:08 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i[67711]: 2024-02-14T13:14:08.392+0000 7f9dcc47e700 -1 mds.i *** got signal Terminated *** 2024-02-14T13:14:10.492 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:10 smithi103 podman[71312]: 2024-02-14 13:14:10.236092911 +0000 UTC m=+1.949023448 container died 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-14T13:14:10.971 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:10 smithi103 podman[71312]: 2024-02-14 13:14:10.568036653 +0000 UTC m=+2.280967182 container cleanup 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.build-date=20240131, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-14T13:14:10.971 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:10 smithi103 bash[71312]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i 2024-02-14T13:14:10.971 INFO:journalctl@ceph.mds.i.smithi103.stdout:Feb 14 13:14:10 smithi103 podman[71326]: 2024-02-14 13:14:10.744177313 +0000 UTC m=+0.509501193 container remove 95594a237f217a3747ef285fdd8bfb76397a8ebdbee94f92ca13cce40b6768e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-14T13:14:10.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.i.service' 2024-02-14T13:14:11.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:14:11.030 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-02-14T13:14:11.030 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-02-14T13:14:11.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.l 2024-02-14T13:14:11.348 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:14:11 smithi103 systemd[1]: Stopping Ceph mds.l for ab42aa14-cb38-11ee-95b9-87774f69a715... 2024-02-14T13:14:11.741 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:14:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l[66782]: 2024-02-14T13:14:11.346+0000 7f58d209b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-14T13:14:11.741 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:14:11 smithi103 ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l[66782]: 2024-02-14T13:14:11.346+0000 7f58d209b700 -1 mds.l *** got signal Terminated *** 2024-02-14T13:14:14.474 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:14:14 smithi103 podman[71434]: 2024-02-14 13:14:14.187065381 +0000 UTC m=+2.942408370 container died 3d198de0754567ae93ddc3f6b2effbe90e668ea4f9ca7aacdaf936beac0181af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2) 2024-02-14T13:14:14.742 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:14:14 smithi103 podman[71434]: 2024-02-14 13:14:14.555626524 +0000 UTC m=+3.310969479 container cleanup 3d198de0754567ae93ddc3f6b2effbe90e668ea4f9ca7aacdaf936beac0181af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:191d989ab4898b16a15a61605f682f0e88010be49063b30f29a026a527875836, name=ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240206.051942-a6fe3fa, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-14T13:14:14.742 INFO:journalctl@ceph.mds.l.smithi103.stdout:Feb 14 13:14:14 smithi103 bash[71434]: ceph-ab42aa14-cb38-11ee-95b9-87774f69a715-mds-l 2024-02-14T13:14:14.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ab42aa14-cb38-11ee-95b9-87774f69a715@mds.l.service' 2024-02-14T13:14:14.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-14T13:14:14.961 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-02-14T13:14:14.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-14T13:14:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:14:17.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-14T13:14:17.721 INFO:teuthology.orchestra.run.smithi055.stdout:Deleting cluster with fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:14:20.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-14T13:14:20.504 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:14:22.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-14T13:14:23.004 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-14T13:14:23.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-14T13:14:23.075 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-14T13:14:23.077 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi012/crash 2024-02-14T13:14:23.078 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash -- . 2024-02-14T13:14:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-14T13:14:23.108 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2024-02-14T13:14:23.110 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi055/crash 2024-02-14T13:14:23.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash -- . 2024-02-14T13:14:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:tar: /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-14T13:14:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:tar: Error is not recoverable: exiting now 2024-02-14T13:14:23.164 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi103/crash 2024-02-14T13:14:23.165 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash -- . 2024-02-14T13:14:23.201 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-14T13:14:23.201 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-02-14T13:14:23.202 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-14T13:14:23.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-14T13:14:23.236 INFO:teuthology.orchestra.run.smithi012.stdout:2024-02-14T13:00:46.775274+0000 mon.a (mon.0) 189 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-14T13:14:23.237 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-14T13:14:23.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[SEC\]' /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-14T13:14:23.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]' /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-14T13:14:23.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[WRN\]' /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-14T13:14:23.454 INFO:teuthology.orchestra.run.smithi012.stdout:2024-02-14T13:00:46.775274+0000 mon.a (mon.0) 189 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-14T13:14:23.454 INFO:tasks.cephadm:Compressing logs... 2024-02-14T13:14:23.455 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-14T13:14:23.497 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-14T13:14:23.499 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-14T13:14:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-14T13:14:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:: No such file or directory 2024-02-14T13:14:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.6.log 2024-02-14T13:14:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.a.log 2024-02-14T13:14:23.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-14T13:14:23.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.g.log 2024-02-14T13:14:23.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.j.log 2024-02-14T13:14:23.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.3.log 2024-02-14T13:14:23.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.x.log 2024-02-14T13:14:23.536 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.0.log 2024-02-14T13:14:23.536 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.x.log: 90.1% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-14T13:14:23.536 INFO:teuthology.orchestra.run.smithi012.stderr: 94.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.g.log.gz 2024-02-14T13:14:23.536 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-14T13:14:23.536 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log 2024-02-14T13:14:23.536 INFO:teuthology.orchestra.run.smithi012.stderr: 94.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.j.log.gz 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr: 82.6% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log.gz 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log: 85.9% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.9.log 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.d.log 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.a.log 2024-02-14T13:14:23.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.d.log.gz 2024-02-14T13:14:23.539 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.a.log: 94.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.a.log.gz 2024-02-14T13:14:23.540 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-14T13:14:23.540 INFO:teuthology.orchestra.run.smithi103.stderr:: No such file or directory 2024-02-14T13:14:23.540 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.l.log 2024-02-14T13:14:23.540 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.i.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.11.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.z.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.i.log: /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.8.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.5.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.f.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.f.log: 90.3% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:gzip 94.6% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.l.log.gz 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.2.log 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr: 82.4% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log.gz 2024-02-14T13:14:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.c.log 2024-02-14T13:14:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.2.log: 85.9% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-14T13:14:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-14T13:14:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.c.log: 92.2% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.z.log.gz 2024-02-14T13:14:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.c.log 2024-02-14T13:14:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log: 94.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.f.log.gz 2024-02-14T13:14:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.c.log: 94.8% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.c.log.gz 2024-02-14T13:14:23.545 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.10.log 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.b.log 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.4.log 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.b.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-14T13:14:23.547 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.1.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.k.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.4.log: /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.h.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.7.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.e.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.7.log: 90.2% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.y.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.e.log: 94.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.k.log.gz 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr: 94.6% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.h.log.gz 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log: 82.5% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.cephadm.log.gz 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr: 94.6%gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.e.log.gz 2024-02-14T13:14:23.548 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.b.log 2024-02-14T13:14:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log: 85.9% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-14T13:14:23.549 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.b.log: 92.0% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.y.log.gz 2024-02-14T13:14:23.549 INFO:teuthology.orchestra.run.smithi103.stderr: 90.9% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-14T13:14:23.555 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-14T13:14:23.715 INFO:teuthology.orchestra.run.smithi012.stderr: 89.6% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mgr.x.log.gz 2024-02-14T13:14:23.816 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.c.log.gz 2024-02-14T13:14:23.822 INFO:teuthology.orchestra.run.smithi055.stderr: 92.0% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.b.log.gz 2024-02-14T13:14:24.107 INFO:teuthology.orchestra.run.smithi012.stderr: 90.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mon.a.log.gz 2024-02-14T13:14:24.958 INFO:teuthology.orchestra.run.smithi055.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.4.log.gz 2024-02-14T13:14:25.068 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.9.log.gz 2024-02-14T13:14:25.334 INFO:teuthology.orchestra.run.smithi103.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.11.log.gz 2024-02-14T13:14:25.400 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.6.log.gz 2024-02-14T13:14:25.496 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.8.log.gz 2024-02-14T13:14:25.621 INFO:teuthology.orchestra.run.smithi012.stderr: 93.5% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.0.log.gz 2024-02-14T13:14:25.701 INFO:teuthology.orchestra.run.smithi055.stderr: 93.6% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.1.log.gz 2024-02-14T13:14:25.836 INFO:teuthology.orchestra.run.smithi055.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.10.log.gz 2024-02-14T13:14:25.849 INFO:teuthology.orchestra.run.smithi012.stderr: 93.5% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.3.log.gz 2024-02-14T13:14:25.851 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-02-14T13:14:25.851 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m2.342s 2024-02-14T13:14:25.851 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m8.376s 2024-02-14T13:14:25.851 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.293s 2024-02-14T13:14:26.018 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.2.log.gz 2024-02-14T13:14:26.253 INFO:teuthology.orchestra.run.smithi055.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.7.log.gz 2024-02-14T13:14:26.451 INFO:teuthology.orchestra.run.smithi103.stderr: 93.7% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-osd.5.log.gz 2024-02-14T13:14:27.643 INFO:teuthology.orchestra.run.smithi055.stderr: 95.2% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.b.log.gz 2024-02-14T13:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr: 2024-02-14T13:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:real 0m4.130s 2024-02-14T13:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:user 0m12.626s 2024-02-14T13:14:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m0.429s 2024-02-14T13:15:06.736 INFO:teuthology.orchestra.run.smithi103.stderr: 93.2% -- replaced with /var/log/ceph/ab42aa14-cb38-11ee-95b9-87774f69a715/ceph-mds.i.log.gz 2024-02-14T13:15:06.738 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-02-14T13:15:06.738 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m43.224s 2024-02-14T13:15:06.738 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m50.973s 2024-02-14T13:15:06.738 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.650s 2024-02-14T13:15:06.738 INFO:tasks.cephadm:Archiving logs... 2024-02-14T13:15:06.739 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi012/log 2024-02-14T13:15:06.740 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-14T13:15:07.923 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi055/log 2024-02-14T13:15:07.925 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-14T13:15:09.543 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi103/log 2024-02-14T13:15:09.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-14T13:15:17.081 INFO:tasks.cephadm:Removing cluster... 2024-02-14T13:15:17.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --force 2024-02-14T13:15:17.280 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:15:17.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --force 2024-02-14T13:15:17.746 INFO:teuthology.orchestra.run.smithi055.stdout:Deleting cluster with fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:15:18.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ab42aa14-cb38-11ee-95b9-87774f69a715 --force 2024-02-14T13:15:18.222 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: ab42aa14-cb38-11ee-95b9-87774f69a715 2024-02-14T13:15:18.532 INFO:tasks.cephadm:Removing cephadm ... 2024-02-14T13:15:18.532 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-14T13:15:18.551 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-14T13:15:18.567 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-14T13:15:18.583 INFO:tasks.cephadm:Teardown complete 2024-02-14T13:15:18.583 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-14T13:15:18.595 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-14T13:15:18.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-14T13:15:18.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-14T13:15:18.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-14T13:15:18.711 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-14T13:15:18.721 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-14T13:15:18.721 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-14T13:15:18.723 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-14T13:15:18.726 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-14T13:15:18.736 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-02-14T13:15:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: ntpq: command not found 2024-02-14T13:15:18.740 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-02-14T13:15:18.740 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-14T13:15:18.740 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-02-14T13:15:18.740 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1394us[+1401us] +/- 78ms 2024-02-14T13:15:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -286us[ -279us] +/- 55ms 2024-02-14T13:15:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -1098us[-1091us] +/- 93ms 2024-02-14T13:15:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T13:15:18.743 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-14T13:15:18.743 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2024-02-14T13:15:18.743 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +1421us[+1421us] +/- 78ms 2024-02-14T13:15:18.743 INFO:teuthology.orchestra.run.smithi055.stdout:^* hv02.front.sepia.ceph.com 3 6 377 49 -282us[ -278us] +/- 55ms 2024-02-14T13:15:18.743 INFO:teuthology.orchestra.run.smithi055.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -1085us[-1082us] +/- 93ms 2024-02-14T13:15:18.743 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T13:15:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-14T13:15:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-02-14T13:15:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1402us[+1407us] +/- 78ms 2024-02-14T13:15:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -293us[ -288us] +/- 55ms 2024-02-14T13:15:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -1099us[-1094us] +/- 93ms 2024-02-14T13:15:18.744 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-14T13:15:18.745 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-14T13:15:18.755 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-14T13:15:18.755 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-14T13:15:18.765 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-14T13:15:18.861 DEBUG:teuthology.orchestra.run.smithi055:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-14T13:15:18.946 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-14T13:15:19.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-14T13:15:19.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:15:19.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-14T13:15:19.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:15:19.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-14T13:15:19.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:15:19.111 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-14T13:15:19.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-14T13:15:19.169 INFO:teuthology.task.internal:Duration was 1436.320326 seconds 2024-02-14T13:15:19.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-14T13:15:19.180 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-14T13:15:19.180 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-14T13:15:19.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-14T13:15:19.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-14T13:15:19.223 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-14T13:15:19.228 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-14T13:15:19.236 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-14T13:15:19.591 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-14T13:15:19.591 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-02-14T13:15:19.592 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-14T13:15:19.611 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2024-02-14T13:15:19.611 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-14T13:15:19.639 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-02-14T13:15:19.639 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-14T13:15:19.661 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-14T13:15:19.661 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-14T13:15:19.663 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-14T13:15:19.682 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-14T13:15:19.733 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-14T13:15:19.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-14T13:15:19.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-14T13:15:19.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-14T13:15:20.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-14T13:15:20.122 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-14T13:15:20.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-14T13:15:20.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-14T13:15:20.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-14T13:15:20.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-14T13:15:20.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-14T13:15:20.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-14T13:15:20.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-14T13:15:20.244 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-02-14T13:15:20.250 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2024-02-14T13:15:20.274 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-02-14T13:15:20.304 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-14T13:15:20.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:15:20.318 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-14T13:15:20.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:15:20.332 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-14T13:15:20.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-14T13:15:20.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-14T13:15:20.369 INFO:teuthology.task.internal:Transferring archived files... 2024-02-14T13:15:20.370 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi012 2024-02-14T13:15:20.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-14T13:15:20.415 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi055 2024-02-14T13:15:20.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-14T13:15:20.457 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595/remote/smithi103 2024-02-14T13:15:20.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-14T13:15:20.495 INFO:teuthology.task.internal:Removing archive directory... 2024-02-14T13:15:20.495 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-14T13:15:20.497 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-14T13:15:20.500 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-14T13:15:20.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-14T13:15:20.556 INFO:teuthology.task.internal:Not uploading archives. 2024-02-14T13:15:20.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-14T13:15:20.567 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-14T13:15:20.568 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-14T13:15:20.570 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-14T13:15:20.573 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-14T13:15:20.582 INFO:teuthology.orchestra.run.smithi012.stdout: 265303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 14 13:15 /home/ubuntu/cephtest 2024-02-14T13:15:20.585 INFO:teuthology.orchestra.run.smithi055.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 14 13:15 /home/ubuntu/cephtest 2024-02-14T13:15:20.597 INFO:teuthology.orchestra.run.smithi103.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 14 13:15 /home/ubuntu/cephtest 2024-02-14T13:15:20.599 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-14T13:15:20.610 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-14T13:15:20.634 INFO:teuthology.nuke:Checking targets against current locks 2024-02-14T13:15:20.660 DEBUG:teuthology.nuke:shortname: smithi012 2024-02-14T13:15:20.660 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-14T13:15:20.689 DEBUG:teuthology.nuke:shortname: smithi055 2024-02-14T13:15:20.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-14T13:15:20.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-14 12:42:52.142736', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1OiEGnKLohZkUg9gPcrlx0X2idlZtkQ6t2atbDftVjZz2Xh3Fv2qi4gD0v3X1Sd2tD6J8Ht6dZCsmxSS1mNuY='} 2024-02-14T13:15:20.711 DEBUG:teuthology.nuke:shortname: smithi103 2024-02-14T13:15:20.711 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-14T13:15:20.717 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-14 12:42:52.143990', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIV/b+GCqPCSI/bvwUWvnbyHMeGEscQ9tEeRtn0JuUNHF72cho0WTr/yx3xmUJmgG3iLldTluHIDLj72+FZ6hvI='} 2024-02-14T13:15:20.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-14 12:42:52.141229', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8qlwUb18sMiRFQ0xcJYqMizXcmfZtGEgPg5j5hBW2eHLJFJFRhcsmrKUDkBbCK2RzIL58v5f23zDRiBTlPLB4='} 2024-02-14T13:15:20.748 INFO:teuthology.orchestra.console.smithi012:Power off 2024-02-14T13:15:20.748 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T13:15:20.772 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-02-14T13:15:20.773 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:20.791 INFO:teuthology.orchestra.console.smithi055:Power off 2024-02-14T13:15:20.792 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T13:15:20.803 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-02-14T13:15:20.815 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-02-14T13:15:20.815 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:20.832 INFO:teuthology.orchestra.console.smithi103:Power off 2024-02-14T13:15:20.832 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T13:15:20.842 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-02-14T13:15:20.854 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-02-14T13:15:20.854 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:20.875 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-14T13:15:24.805 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:24.843 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:24.876 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:24.915 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-02-14T13:15:24.953 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-02-14T13:15:24.985 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-14T13:15:28.918 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:28.954 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:28.985 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T13:15:29.027 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-02-14T13:15:29.063 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-02-14T13:15:29.093 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-14T13:15:29.128 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-02-14T13:15:29.164 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-02-14T13:15:29.194 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-02-14T13:15:29.299 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} duration: 1436.3203263282776 failure_reason: '"2024-02-14T13:00:46.775274+0000 mon.a (mon.0) 189 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2024-02-14T13:15:29.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T13:15:29.394 INFO:teuthology.run:FAIL